This site is a controlled test environment for observing how web crawlers behave when pages provide HTTP freshness and revalidation information.
What is being measured here
Every page on this site returns an ETag and a Last-Modified header derived from real content and real modification times. When a client sends a conditional request using If-None-Match or If-Modified-Since, the server answers 304 Not Modified if nothing has changed.
The origin web server records every request, including which conditional headers the client sent and which validators the server returned. Those logs are parsed into a database and analysed.
What is not being claimed
HTTP caching headers are defined in RFC 9110 and RFC 9111 as caching and revalidation mechanisms. They are not documented by any search or AI operator as a ranking signal, and nothing on this site should be read as evidence that they are.
Sections
- About — what this experiment is and why it exists
- Services — the technical capabilities being demonstrated
- AI Analytics — how crawler activity is measured
- Blog — articles on HTTP caching and crawler behaviour
- Contact — how to get in touch