Oh well, sorry, it looks like this was because I was playing the game off a USB stick, and somehow some of the folders were set to read only. Now starting another game seems to work fine
Weird though how the save state function doesn't seem to work. Anyhow I'll keep my fingers crossed.
