I have ran into this problem a few times. A bunch of buildings with all the workers they need, all workers stay off duty all the time no matter what I do.