I ’ll get right to it. If your website isn’t being indexed by Google or Bing, it will not be read by any of their bots or seen by any of their users. We’ll focus on Google since they have more active users. We are going to go over site indexing and what it can do for your SEO.
What in the Heck is Site Indexing?
Google explains it this way:
“The Google index is similar to an index in a library, which lists information about all the books the library has available. However, instead of books, the Google index lists all the web pages that Google knows about. When Google visits your site, it detects new and updated pages and updates the Google index.”
Want to see which of your pages Google is indexing? You can do a simple Google search to figure it out.
As an example of how to format it, this is what I type when I search for our website:
Note: Don’t use spaces or capital letters, and don’t forget the quotation marks.
Here’s a screenshot of what I see when I do that. Our homepage is at the top, followed by our Services Page, our blog (Insights), our Careers page, and our Contact info. These pages are being read by Google bots, so our services will be easier for business owners to find.
Indexing requests will affect both platforms, but it’s important to make sure your sites are listed in the “sites to search” section. [You can find that in the Basics tab of your Google CSE dashboard. [It may not take effect immediately, so keep an eye on things to make sure they get updated.]
Find Out if There Are Errors in Your Site Structure
Typically, it’s happening due to meta robots tags. While these tags are useful because you may not want every web page you own to be Google indexed.
But it’s a good idea to run some tests to ensure you only have those tags that are not essential viewing for your clients and prospects.
A window will pop up showing a list of sites that are disallowed from Google Bots’ reading and indexing.
Here’s a small portion of the list for Apple as an example.
When you do this, you’ll see any sites under your domain you’re telling Google Bots to ignore or disallow from their indexing.
You can test a given page on your list using the bar at the bottom of your Google Search Console.
Robots files are used for two primary purposes:
- Index follows. Google and other bots will follow/read your page.
- Noindex nofollow. Google and other bots will not follow/read your page. They will also not follow any links on those pages.
In short, you may not have to index every page on your website to have great SEO. But you want to make sure you’re not blocking any pages that should be indexed.
We have no doubt that once you use site indexing to test your site and make necessary changes through Google, you’ll be moving on up in no time.