83% of requests (globally) to our apex homepages (bbc.co.uk/ and bbc.com/) are from "Python Requests".
-
83% of requests (globally) to our apex homepages (bbc.co.uk/ and bbc.com/) are from "Python Requests".
That's 84 million requests per day.
In the words of Bricktop...
-
83% of requests (globally) to our apex homepages (bbc.co.uk/ and bbc.com/) are from "Python Requests".
That's 84 million requests per day.
In the words of Bricktop...
@tdp_org have you checked out the source ips to see if its just a bunch of cloud vms or something?
-
@tdp_org have you checked out the source ips to see if its just a bunch of cloud vms or something?
@Viss There's quarter of a million distinct IPs so no, I haven't done that but I have looked at the ASNs from which the requests come and they're mostly eyeball ISPs. I suspect there's some common router config or similar which uses it as "is the internet working" - the usual


-
@Viss There's quarter of a million distinct IPs so no, I haven't done that but I have looked at the ASNs from which the requests come and they're mostly eyeball ISPs. I suspect there's some common router config or similar which uses it as "is the internet working" - the usual


@tdp_org ah, could possibly be botnet type stuff with all the edge devices that have been popped recently and turned into proxies?
-
@tdp_org ah, could possibly be botnet type stuff with all the edge devices that have been popped recently and turned into proxies?
@Viss It's possible but it's so consistent that I doubt it.
One of the many "joys" of being a relatively well-known presence on the internet I spose
-
@Viss It's possible but it's so consistent that I doubt it.
One of the many "joys" of being a relatively well-known presence on the internet I spose
@tdp_org what are all those python clients actually requesting? is it just the same uri over and over again from 250k hosts?
-
@Viss It's possible but it's so consistent that I doubt it.
One of the many "joys" of being a relatively well-known presence on the internet I spose
-
83% of requests (globally) to our apex homepages (bbc.co.uk/ and bbc.com/) are from "Python Requests".
That's 84 million requests per day.
In the words of Bricktop...
What will be the impact on critical infrastructure if you decide to drop or reject all the connectivity checks from one day to another?
Care to find out?
-
@Gaelan Yeah we're on plenty of those lists

I suppose it's a compliment of sorts -
83% of requests (globally) to our apex homepages (bbc.co.uk/ and bbc.com/) are from "Python Requests".
That's 84 million requests per day.
In the words of Bricktop...
@tdp_org Default user agents are the bane of my life. I wish libraries would force users to set it correctly
-
@Viss It's possible but it's so consistent that I doubt it.
One of the many "joys" of being a relatively well-known presence on the internet I spose
-
R relay@relay.an.exchange shared this topic
