Skip to main content

Technical SEO Q&A

Real problems and solutions related to Technical SEO.

All Topics

Technical SEO

Category: Technical SEO

Technical SEO Sep 22, 2026 | 3 min read

Why Are Pages Discovered but Not Indexed Despite a 100 PageSpeed Score?

Problem:

A friend has many pages on his site stuck in "Discovered, currently not indexed" in Google Search Console. His PageSpeed Insights performance score is 100, which suggests the site is …

Solution:

A PageSpeed score of 100 does not necessarily mean Googlebot is experiencing a fast server response. PageSpeed Insights reports Lighthouse lab results and, when available, real user CrUX data. Its …

Read Full Answer
Technical SEO Sep 12, 2026 | 3 min read

Technical SEO Audit: How to Verify Googlebot and Analyze Server Logs

Problem:

I am auditing a large publishing website. I want to see how Google actually crawls the site. So, I start checking the Server Access Logs from the origin server instead …

Solution:

A large website can receive millions of bot requests every day. The problem is that not every bot claiming to be Googlebot is actually Googlebot. Fake crawlers can copy Google's …

Read Full Answer
Technical SEO Sep 09, 2026 | 4 min read

Why Is a URL Indexed Despite Being Blocked by robots.txt?

Problem:

During a technical SEO audit, a URL was found to be indexed by Google even though the website's robots.txt file contained a directive intended to block the URL. The relevant …

Solution:

A Disallow rule in robots.txt does not remove a URL from Google's index. It controls crawling, not indexing. If a URL stays indexed even after you block it with robots.txt, …

Read Full Answer