Website indexing is one of the first steps (after crawling) in a process of how web pages are ranked and served as search engine results.

Crawlers are technical but understandable thanks to Microsoft's Senior Program Manager Frédéric Dubut's presentation at SMX East.