About Search Engine Robots and Other User Agents
Search Engine Robots and Other User Agents- John A. Fotheringham presents data in tabular form on the robots sent by search engines and other sites to read and index Web pages: their origins, names and IP addresses.