Schools from the 1900s

How do I find out about schools that are no longer standing in the south otago area of New Zealand. I am assuming that their would of been records kept and they would have to be somewhere.
Any help would be great