Construction labour shortage ‘nothing to do with Brexit’