I know you can see how many of something by clicking on it, but first you have to find one. How about a count or highlighting or something to indicate at least what you haven't built yet? in the building sidebar or build menu?
I spent a day without starting olives, because I didn't realize I'd unlocked that slave. I'm currently trying to figure out what buildings of all the mostly red roofed buildings I haven't yet built.