Council body fears cladding levy will lead to fewer affordable homes