AutoVoice AutoVoice always opens when pressing the home button for voice search

When I hold the home button to say a voice command, the AutoVoice user interface always opens up. How can I disable that?

For example, when I'm watching a video on YouTube and then hold the home button and say "Turn the lights on", it stops the video, opens the AutoVoice app interface and then my lights turn on. This is kind of annoying to be honest because every time I say a voice command that doesn't open another app, I have to manually switch back the the previous app afterwards. Ideally AutoVoice would just listen when I hold the button and not open the app interface at all.