Adam Gent’s Post

Just in case anyone needs to hear this...or read it. From Daily Stoic newsletter.

What do you think everyone? Useful? Scary? AI Overview seems to get triggered by "What is..." or question based queries. Interestingly if you just type [technical SEO] the AI Overview does not appear. At least it gives you sources for where it gets information.

Alpha testers asked for URL filter in the data table. So we added it. This means you can now: 📂 Segment the report using a web property, and then 🔗 Filter the data by index status and page URL. In the screenshot I am: 🕵♀️ Segmenting the data on the /p/ folder 🕷 Filtering on "Crawled - previously indexed" index status, and then 🔗 Filtering on URLs that do not contain "wisdom" (blog post style pages). Allowing me to analyse and narrow down on problem pages within seconds. All while the indexing data is updated on a daily basis using the URL Inspection API. #seo #technicalseo #googlesearchconsole

Capturing historic indexing data from the URL Inspection API. Ever wished when changes happened to a page in the URL Inspection tool? We've been thinking of ways to help SEO professionals capture changes to the different "states" in the crawling and indexing pipeline. Inspecting over time its important to help identify when there have been changes for a URL. And when they were made. Showing it for each page in a URL report alongside the current inspection data. Apart from Time to Index and traffic data, anything you'd like to see? #seo #technicalseo #googlesearchconsole

Pages get kicked out of Google's index all the time. When it happens you start to panic...why is going kicking these pages out? For example these pages were indexed but are now not indexed by G: /p/think-like-a-seo-pm-course-early-bird-discount /p/summer-update-2023 /p/product-management-books-seos But when you drill into the pages that were indexed and are moved into "Crawled - Currently Indexed" you quickly realise they should be kicked out. Almost zero: > Impressions > Clicks > External links > Internal links Basically, no love from you or users. It makes perfect sense that over time this "content and engagement" decay means that Google's system kicks the pages out of its index. Storing pages in their index is costing them money after all. It's only a matter of time before Google's index drops your pages. - p.s. The screenshot is from a tool I'm building. We actually transform the data so users can separate "Crawled - previously indexed" from "Crawled - currently not indexed". It makes it easier to quickly narrow down on the pages that were indexed but now have been kicked out by Google.

Gary Illyes and Daniel Waisberg I have a question about the URL Inspection tool and the indexing pipeline. I've noticed that Google can drop the canonical data (both user-selected and Google-selected) for pages that were indexed and moved to "crawled - currently not indexed". Is this a reporting error or does your index eventually just drop data points like the canonical metrics? It would make sense but it doesn't happen for all the pages. So, I just wanted to ask in case I assumed the wrong thing. p.s. The first screenshot is of a custom tool where we flag pages that were indexed and moved to crawled - currently not indexed (we mark these are crawled - previously indexed). I've left another screenshot of the URL inspection tool in the comments.

I've seen Google's worldwide market share take such a nose dive. I'm not sure I 100% trust the data. Doing a bit of research suggests this statcounter is inaccurate. Link to the data and articles in the comments.

Glenn Gabe has been writing about Google updates since I can remember (10+ years?!). So when he writes about updates I take notice. What I enjoy most about Glenn's writing is that it's based on his experience in the trenches and his insights from client work. Screenshot from his recent blog post on the Core update. I'll link to the post in the comments.

Update on the Google index monitoring tool. Added the ability to download ALL the pages from the table. Released to alpha testers. Tech co-founder added loading bar to help people understand the downloading progress. Do you want to know more about the tool and data? Check out the blog post in the link below.

Do you see sudden drops in pages indexed in Google Search Console? The reality is that these drops don't reflect when the pages were kicked out the index. In fact, tracking daily index status of pages shows the drop is gradual. Showing a clear trend in certain sections of the website being slowly kicked out of the index by Google. It doesn't happen in one big push, but gradually overtime. The issue with GSC reporting is that it is aggregated and updates 1-2 times per week. So although the reporting shows a sudden drop. Your pages are being kicked out the index a lot earlier (days before). If you want to learn more about the tool I'm building the I have left a link in the comments below.