Bot can also be called as spider, crawler. Bot is the software that visits the websites and stores the information related to the visited site. When a bot visits a site, technically it is referred as crawling. Based upon various factors described by the search engine, the bot assigns a specific value to each site. So when a user enters a keyword in the search box, based upon the information gathered by the bot or spider, the search engine puts various websites in front of the user.
Almost all the search engines rely on crawlers. It is not possible to visit various websites manually. It is even more difficult or rather impossible to store the data from various websites on the internet, retrieve it and show the relevant data to the user. Hence the major search engines rely on software called bot or crawler or spiders.
No comments:
Post a Comment