I'm not sure, as the speaker can't vote either, so in fact 323 is the magic number, I think.
Anyway, the Shinners can hardly break a century-long position and suddenly decide they do recognise the authority of the British Parliament after all, can they? The oath to the Queen would be tricky for a start.