Effectively With META Robots Tags
Placed in Website Guide | January 12th, 2010
“Robots” meta-tag, if properly used, such as search engines, whether or not to index and follow a specific page. For purposes of this section, we will be with “()” symbols to represent “<>” in the HTML coding.
Some examples of robot use are:
(meta name = “robots” content = “index, follow”)
(meta name = “robots” content = “noindex, follow”)
(meta name = “robots” content = “index, nofollow”)
(meta name = “robots” content = “noindex, nofollow”)
Consider first what these terms mean before you declare the use for each individual:
“index” – This directive allows the robots to search engines (or spiders to index) that is OK on the page. In other words, you are so that the search engine on your site within their search index is included.
“noindex” – to this day you will be informed that the robots This page is not indexed. In other words, this page will not be displayed in its search directory.
“Forward” – When you use this tag, you tell search engines that you want their robots on the following links found on this page.
“nofollow” – in contrast to the above definition, this policy, the robot is, do not follow links on your page.
Putting It All Together:
With the tags said robot, we study the use of each.
1. (meta name = “robots” content = “index, follow”)
This tag is used if you want search engines to index the page and follow the links to other sites. Most search engines use this parameter as the “standard” setting. It is possible that you may not even need to use this tag if you want to follow the search and index page. However, an article on the world of search engines (searchengineworld.com / meta / robots.htm) indicates that Inktomi is not used by default. Instead, they use the index, nofollow “tag.
Better safe than sorry!
There has been much discussion of whether it is necessary to use that day. If there is even a remote possibility that some search engines do not use them as a preset, then it would make sense to belong to this day if you want your site in their research and follow your links. Do your research and decide for yourself.
2. (meta name = “robots” content = “noindex, follow”)
This tag can be used for search engines that you do not want to say that the page in their directory, but you want them to follow links to other sites. A good example of its use is your disclaimer or privacy policy pages. You may not these pages appear in search engines when they are only important for the visitor today. But if the links of these pages to other pages that you want to find search engines, then you would still want to follow the spiders “these links.
3. (meta name = “robots” content = “index, nofollow”)
This day will not be your site indexed in search engines, but all the links on this page will not be accepted.
4. (meta name = “robots” content = “noindex, nofollow”)
If this tag is that research is not the page in its directory and will not follow a link on the page either.
Where does the robot “is” one day?
“Robots” meta tag should be used as part of the head () and (per capita) of the tags on your page. These tags are at the top of the HTML coding. It will look something like this:
(Head)
(Title) Title of your page here (/ track)
(meta name = “keywords” content = “word1, word2, word3, word4)
(meta name = “description” content = “A brief description of the content of this page.)
(meta name = “robots” content = “index, follow”)
(part)
(Body)
Your site here.
(/ Body)
(/ HTML)
More Robot Tags
Google automatically archive page as it crawls. This is called a “cached” version of the page. Visitors can view the archived version of the page by clicking on the “cache” in the search results. If you do not want your content is archived, you can use the following tag:
(meta name = “robots” content = “noarchive)
* It will only prevent your website “cache”. If you do not want your page are not even indexed, you will still need to include the “noindex” tag.
Another alternative to the above day is the day that deals especially with Google. If you want other robots search engine to archive your site, but you do not want Google, you can use the following tag:
(meta name = “googlebot” content = “noarchive)
The abuse of robots tags
Something must plunge, is everywhere on the sites Google Indexing day. It is a little preposterous label that proves necessary. Some people think that this day will allow Google to Spider your site, but this is simply not true.
The day is as follows: (meta name = “googlebot” content = “index, follow”).
Googlebot Some believe that owners of websites with the words “that their site has the advantage of faster and spidered by Google is available. According to information Google Web crawler, using the noindex, nofollow tags noarchive or if you do not want the Google cache, index, or follow this page. Google is the default index and follow the links on the page so that these “so-called” googlebot “Index / day when some owners of the site a day is completely unnecessary.
Another day, some idiot — The “revisit-after” tag
(meta name = “revisit-after” content = “90 days”)
(meta name = “revisit-after” content = “15 days”)
Do not know where this myth started. Today, this day will be found through the Internet. Webmasters have even encouraged, and affirmed that it actually works. Are we naive enough to believe that search engines need to know when they come back? I’ve never used that day, and my side has no problem crawling on a regular basis. Even some (search engine optimization SEO) sites to maintain their value. This brings us to the importance of researching the subject thoroughly first. My research came from some interesting information on Webmaster World.
It is important that the correct use of “robots consider sleep on your website. Improper use of labels May cause spidering errors lead to the fact that robots completely ignore the page all together. If you’re interested in learning more about Web robots, this great little site that gives you the information you need to use it effectively: www.robotstxt.org / WC / robots.html.
All other brands, product names, company names, trademarks and marks are the properties of their respective owners.

