Does any one know of database structure such as this http://www.maxmind.com/app/geolitecity that is optimized for super fast retrieval of long and lat based on either ZIP or (City, State, Country) parameters?
Maxmind’s database does not support any other retrieval than IP retrieval, at least not to mine knowledge. So if you know how to do it preferably in Java, I’m all ears.
This should not be SQL type database or CSV file or Google API solution. Thous are just to slow. Especially if you want to offer search results sorted by distance.
Paid solutions are also option. The data structure doesn’t have to be free.
I don’t believe there is such a thing as a “fast” way to do this. I’ve built a geocoding API for Canadian postal codes and the way we search is to have two indexes of postal codes – one sorted by lattitude and one sorted by longitude. You can do some spherical geometry and develop a bounding “box” that fits everything in a given radius but you still have to go back and do a point to point distance measurement using Vincenty or Haversine or your algorithm of choice for the distance between your origin and each postal code you find.
With a world-wide database, your math gets complicated by the fact that you can cross meridians and the equator.
You’ll want some kind of encoding scheme that lets you work in radians, since that is what most distance calculation hueristics require.