sound issue

Whenever I leave a score on my desktop open, and come back to it later on, the sound doesn't work.
I have to go into Preferences/ audio & MIDI and change the audio device parameter to something different and then it works again.
I'm using a Mac mini M2. This is annoying...any ideas for a fix?
Smorg