I have met many Australians. Like Americans, South Africans or New Zealanders, they are utterly irrelevant as human beings, neither one thing nor another, and certainly not worthy of an Englishman's ire.
Now losing to a real enemy, I could understand being distressed by that. Germany, Ireland or Belgium, losing to those freaks would offend me.