I played as Babylon from the start to the end and find out, that the Astronomy House doesn't count as farmers nor science district for later game buildings.