Your content may not appear in searches for several reasons
engine results, it is important to note that
the index may contain pages that it does not display in its
How to know if your content is actually indexed
In fact, it can be difficult to know if your content is indexed.
In some cases, documents may not appear to be indexed via one of the
these methods, but documents can be found in the index using other
methods. For example, the tools for webmasters may indicate that few documents
are indexed even when you can search their sentences and find the
documents on the search engine. In such a case, the documents are
How content becomes indexed
Before the search engines index the content, they must find it with the help of a
You should check the logs of your web server to see if
search engine crawlers (identified by their user agent – eg.
Bing / MSNbot)
visit your site.
Major search engines such as Google and Bing generally explore sites
frequently, but the robot may not be aware of the new site. You can
notify search engines to the existence of your site by
register as a webmaster (Google Webmaster
Tools, Webmaster Bing
Tools) or, if the search
engine does not provide this installation, submitting a link to its
Exploration robots (for example, Yahoo).
How long has your site / content been online?
Search engines can index the content very
quickly after finding it, however, these updates are sometimes delayed.
Smaller search engines can also be much less responsive and take weeks to index
If your content has only been online for several days and does not have
links from other sites (or its links come from sites that
crawlers do not visit often), it is probably not indexed.
If your site has not been online for more than a few months, the search engines
may not have enough confidence to index a lot of content yet.
Has the content been excluded by the webmaster?
This step is especially important if you take a site from
somebody else and there is a problem with a specific page or directory:
exclusions and delete them if you want the crawlers to index the content
Is there a technical problem preventing the indexing of your content?
If you have an established site but specific content is not
indexed (there are no web search results on URLs where the content
lies) the webmaster tools provided by Google and Bing can provide
useful diagnostic information.
The documentation provides detailed information on common web problems.
robots that prevent the indexing of content and, if you use
Google Webmaster Tools, you will receive an alert if any of these messages
problems are detected on your site.
Correct errors and configuration errors as quickly as possible to make sure
that all the content of your site is indexed.
Is the content of poor quality?
Search engines do not index most of the crawled pages. They only index content of the highest quality. Search engines will not index the content if:
- It's spam, gibberish or nonsense.
- We find it elsewhere. When search engines find duplicate content, they choose only one of the duplicates to index. This is usually the original that has more reputation and links.
- It's skinny It takes more than a few lines of original text. Preferably much more. Pages created automatically with little content, such as a page for each of your users, will probably not be indexed.
- It does not have enough reputation or links. A page can be buried too deep in your site to be classified. Any page with no external links and more than a few clicks from the home page is unlikely to be indexed.
Are some of your content indexed, but not all?
If your site contains hundreds of pages, Google will almost never choose to index each page. If your site has tens of thousands of pages, it is very common for Google to choose to index only a small portion of these pages.
Google chooses the number of pages to index on a site based on the general reputation of the site and the quality of the content. Google typically indexes a higher percentage of a site over time, as the reputation of the site grows.