I think you had it right the first time; Brexit wasn't about facts, it was more about feelings and grabbing a rare opportunity to express the feeling that we simply don't like Europeans very much.
Tolerate them, yes. Even enjoy them. But "like"? No. We're not really going to "Leave" though; that was never the intention. At least, of Brexit.