The idea of a search engine lies in its use of crawler bots. Engines such as Google possess a program that sees as many pages as possible to assemble information on that page, such as text, pictures, movies, and meta data. It has been the most preferred method of search indexing since the beginning of the world wide web.