83% of requests (globally) to our apex homepages (bbc.co.uk/ and bbc.com/) are from "Python Requests".
-
83% of requests (globally) to our apex homepages (bbc.co.uk/ and bbc.com/) are from "Python Requests".
That's 84 million requests per day.
In the words of Bricktop...
#BBC #WebStats #PythonRequests #BrickTop

-
83% of requests (globally) to our apex homepages (bbc.co.uk/ and bbc.com/) are from "Python Requests".
That's 84 million requests per day.
In the words of Bricktop...
#BBC #WebStats #PythonRequests #BrickTop

@tdp_org have you checked out the source ips to see if its just a bunch of cloud vms or something?
-
@tdp_org have you checked out the source ips to see if its just a bunch of cloud vms or something?
@Viss There's quarter of a million distinct IPs so no, I haven't done that but I have looked at the ASNs from which the requests come and they're mostly eyeball ISPs. I suspect there's some common router config or similar which uses it as "is the internet working" - the usual


-
@Viss There's quarter of a million distinct IPs so no, I haven't done that but I have looked at the ASNs from which the requests come and they're mostly eyeball ISPs. I suspect there's some common router config or similar which uses it as "is the internet working" - the usual


@tdp_org ah, could possibly be botnet type stuff with all the edge devices that have been popped recently and turned into proxies?
-
@tdp_org ah, could possibly be botnet type stuff with all the edge devices that have been popped recently and turned into proxies?
@Viss It's possible but it's so consistent that I doubt it.
One of the many "joys" of being a relatively well-known presence on the internet I spose
-
@Viss It's possible but it's so consistent that I doubt it.
One of the many "joys" of being a relatively well-known presence on the internet I spose
@tdp_org what are all those python clients actually requesting? is it just the same uri over and over again from 250k hosts?
-
@Viss It's possible but it's so consistent that I doubt it.
One of the many "joys" of being a relatively well-known presence on the internet I spose
-
83% of requests (globally) to our apex homepages (bbc.co.uk/ and bbc.com/) are from "Python Requests".
That's 84 million requests per day.
In the words of Bricktop...
#BBC #WebStats #PythonRequests #BrickTop

What will be the impact on critical infrastructure if you decide to drop or reject all the connectivity checks from one day to another?
Care to find out?
-
@Gaelan Yeah we're on plenty of those lists

I suppose it's a compliment of sorts -
83% of requests (globally) to our apex homepages (bbc.co.uk/ and bbc.com/) are from "Python Requests".
That's 84 million requests per day.
In the words of Bricktop...
#BBC #WebStats #PythonRequests #BrickTop

@tdp_org Default user agents are the bane of my life. I wish libraries would force users to set it correctly
-
@Viss It's possible but it's so consistent that I doubt it.
One of the many "joys" of being a relatively well-known presence on the internet I spose
-
R relay@relay.an.exchange shared this topic
