Monthly Archives: April 2014

How search engines find my site?

How search engines find my site? Crawler OR SPIDERS:  A Web crawler is a program that visits the site and read the ‘robots.txt’ to know which webpages are allowed for indexing . It is typically for the purpose of Web indexing. … Continue reading

Posted in Uncategorized | Tagged , , | Leave a comment