In my game I could rename a province, which I did (Connacht became Mayo). Then, in a later game as von Habsburg, I was not able to rename anything anywhere, but County Mayo still existed.
So it appears to me that the game is taking a re-named item from one game into the next game, and in that next game you cannot access the renaming process.