Mbete's order came when the MPs began shouting "pay back the money!" in reference to the upgrade of President Jacob Zuma's Nkandla homestead.
Mbete earlier ordered party leader Julius Malema and the other members all dressed in red overalls to leave and said she would get security to remove them.
Proceedings were suspended until they had been removed.
News24's Jerusha Sukhdeo-Raath was at Parliament. Watch a full summary of everything that happened here.
Riot police arrive at parliament. pic.twitter.com/lQLo3MUqwq
— Jerusha SukhdeoRaath (@JerushaRaath) August 21, 2014
EFF MPs leave parliament singing and chanting. pic.twitter.com/8SxvDK1Ve5
— Jerusha SukhdeoRaath (@JerushaRaath) August 21, 2014
EFF MPs get physical with police and they try push through a line of officers. pic.twitter.com/v2XRYzPfnH
— Jerusha SukhdeoRaath (@JerushaRaath) August 21, 2014