That is not such an outrageous thought. Parliamentary governments have "no confidence" referendums in the middle of their prime minister terms and boot the bums out if they don't like them.
I can't be sure about all Parliamentary Democracies but that's not the case in the UK and, I assume most nations using the 'Westminster' system.
While calls for a 'vote of no confidence' either in a PM or other minister are
'relatively' common an
actual no confidence vote in a Government is unusual. For a Government to be ousted by one is practically unheard of - there have been only four British Prime Ministers forced to resign after losing such votes,
ever; the first (and the first ever such vote) being Lord North in 1782, the last being James Callaghan in 1979.
In the Westminster System if a vote of no confidence is tabled the Government may (and often do) respond with a vote of confidence, this will take precedence and negate any vote of no confidence.
There is also the recall election process, which unlike a no confidence motion does involve the electorate. I believe the procedure still exists in about 18 US states (North Dakata recalling Lynne Frazier in 1921 and Calfornina recalling Governor Gray Davis in 2003) as well as some Canadian provinces (since 1995) and in Venezuela - failure to recall Chavez in 2004.
Personally, I think we should re-introduce the ancient Athenian procedure of
Ostracism.