The libraries have many atlases; here are two standards. Remember that you can also find atlases focussing on specific regions or topics.
The following books provide, in varying degrees, overviews, vital facts, and statistics about the world's countries. Find contact information for important deparments and officials, country histories, and much, much more.