Julian Lewis makes his case:

Public votes as a show of loyalty with implicit menace have been the tool of insecure tyrants throughout history. Bercow if he had any honour would know that since he doesn’t command the respect of a substantial proportion of the House would go. He doesn’t. If as much as a quarter of the House has no confidence in the Speaker he should make way…