WEBii.net  |  888.932.9377 TOLL FREE | 512.241.1777 AUSTIN
The WEBii Blog

Website News
& Tips & Other
WWW Stuff

slider

Posts Tagged robots.txt

How To: Stop Search Engines From Indexing Certain Pages

Bobby Martinez Written by Bobby Martinez

Did you know that you can stop Google from indexing certain pages in your website? You can, with a certain tool called “robots.txt” Robots.txt , as you might have already guessed, is a text file that you can put on your website that will direct programs that crawl the web (web crawling bots) and give [...]

Read more