How most search engines work


  • search engines have 3 main components:

    • crawler: moves over the web like a mouse clicking user
      but fetches all webpages back to his home ...

    • ... where they are indexed and stored in a database (=indexer)

    • web interface: that's what you see of the search engine
      what allows you to query

  • so they just know whats in their database, not what is actually on the web

  • and they do not know the contents of other databases


start         (C) W.Sander-Beuermann,   Universit?t Hannover,   RRZN,   SuchmaschinenLabor,   SuMa-eV