Keep getting naturals in key signature

I keep getting automatically generated key signatures with 4 naturals. They are arranged identically to the four sharps that signify E Major. Not only are they automatically generated, but they override the ks I've selected. I can't cut them, and dragging a new ks over them doesn't do any good either. They just won't go away. I'm using version 0.9.6.1 for Mac OS X. Help!