Yesterday we were amused to see this post on Reddit’s sysadmin forum:
Our architecture lead Nick Craver looked into this and gave a great answer, including that about 29% of the previous day’s Stack Overflow traffic was to the home page.
From his perspective as a system administrator, that’s exactly the right analysis. Nick’s team has to ensure the site renders reliably and quickly, so counting the number of requests make sense. However, as a data scientist I’m more interested in how users view the site, and the vast majority of our traffic comes from automated traffic, including search engines and scrapers. …