Avoid another potential deadlock: if no file descriptors are registered, our non-blocking ALSA code cannot ever work.