In a roundabout way, they were. Immigration has never been far away from any debate about the economy, employment, benefits etc. Of course in recent years the economy has been overshadowed by a crash that has nothing to do with the EU. That is also running out of shelf life so they will be looking for a new answer.
Looking forward to all those right wing euro sceptics converting to vehement supporters of public sector investment and championing the NHS.