+63917 712 8496
In a series of tweets by Google Webmasters, they have announced their proposal of a draft stating that Robots.txt is well on its way from becoming a de facto standard to an official one.
Tag Archives: robots.txt
The Complete Guide to Robots.txt and Noindex Meta Tag
The Robots.txt file and Noindex meta tag are important for doing on-page SEO. This gives you the power to tell Google which pages they should crawl and which pages they should index – display in the search results.
How Faceted Navigation Affects SEO
Faceted navigation is problematic for almost all e-commerce websites. The number of pages that e-commerce websites have on different versions of a single product poses a threat to the crawler’s efficiency – which could negatively affect your SEO. But what does faceted navigation really mean?
How Robots.txt and Meta Tags Affect Search Engine Crawling
If you are concerned about the privacy of your website and you do not want the search engine crawlers or bots to crawl certain pages of your website, then “Robots.txt” is the one-stop solution that will keep the crawlers away from the ‘No Entry’ zone.