What response headers reveal
HTTP response headers tell you more about a site than its HTML: the web server and CDN (Server, CF-Ray, X-Powered-By), caching policy (Cache-Control, ETag), redirects (Location), issued cookies (Set-Cookie) and attack protection — Strict-Transport-Security, Content-Security-Policy, X-Frame-Options, X-Content-Type-Options, Referrer-Policy, Permissions-Policy.
Why scrapers care
Headers show whether a site sits behind Cloudflare, Akamai or DataDome, whether it sends Retry-After and X-RateLimit-*, and how it reacts to cookie-less requests. That tells you which proxy type you need: sites behind anti-bot protection almost always require residential or mobile proxies rather than datacenter ones.
FAQ
Is the request made from my IP? No, from our server — the site never sees your address.
Why do headers differ from my browser? Many sites vary the response by User-Agent, cookies and request country.
