Cloudflare will block AI bots from crawling websites by default for new customers, and broker pay-per-crawl deals between its customers and bot operators.
You must log in or register to comment.
A place to discuss privacy and freedom in the digital world.
Privacy has become a very important issue in modern society, with companies and governments constantly abusing their power, more and more people are waking up to the importance of digital privacy.
In this community everyone is welcome to post links and discuss topics related to privacy.
Some Rules
- Posting a link to a website containing tracking isn’t great, if contents of the website are behind a paywall maybe copy them into the post
- Don’t promote proprietary software
- Try to keep things on topic
- If you have a question, please try searching for previous discussions, maybe it has already been answered
- Reposts are fine, but should have at least a couple of weeks in between so that the post can reach a new audience
- Be nice :)
Related communities
much thanks to @gary_host_laptop for the logo design :)
- 0 users online
- 113 users / day
- 519 users / week
- 1.44K users / month
- 4.49K users / 6 months
- 1 subscriber
- 4.3K Posts
- 109K Comments
- Modlog
they can already block VPN traffic (unless you use their VPN)
their whole business model is based on them being a man in the middle that decrypts ssl and analyses the packets plainly
about a third of the worldwide websites are using cloudflare so they have a pretry good birds eye view on behaviour of any machine, datacenter or ip range that will be visiting a lot of websites, which in turn will trivially whether it is normal user behaviour or a crawler.
Not the first time that, with all my privacy measures on, instead of an page, I see the page from Cloudflare analyzing if I am a bot, before it let me access the page I wanted. Invisible in the web is only a bad joke. Anybody is visible in the moment he goes online, irrelevant if he use VPN, TOR or whatever, this times have passed. Believing it is as hilarious as in the Movie Independence day infecting with an Virus an Alien Mothership, using an crappy Laptop (I have laughed a lot with this scene).
deleted by creator
Yes, TOR never was secure against secret services and goverments, les nowadays with AI and massive server power from these. Don’t forget who developed the TOR network and from whom are the servers used. Drug Barons since time turned to use pen and paper for their orders and communication, because the web and even the Dark Web isn’t really private anymore (traffic analysis, exploiting software vulnerabilities, monitoring exit nodes, using Honeypot nodes…)
deleted by creator
Naturally the Darkweb has nothing to do with the TOR network, But even if you access it using the TOR network, they find you if they want, as you can see.
Yeah that’s how most VPNs work.
Okay? Analyze all you want. They can’t stop bots on any of the other sites they regulate either.
Great. Bots intentionally change up their behavior and identifying information as to be undetected.
Why not? They are doing edge caching, they can literally just block the connection from visiting the site just like they do with their DDoS mitigation.
block which connection? Again, these AI companies know people don’t want them crawling their sites and they do everything they can to be invisible. This has been an issue for years at this point.
blocking DDoS is trivial by comparison.
They can and do. What is blocked depends on what the website owner sets as settings in cloudflare.
If they have to crawl the web while behaving like a normal human, it will be magnitudes slower and more costly.
And how does the owner know which connections are bots?
They don’t care, they have trillions of dollars of VC money to power through.
The owner sets the level. If they set strict level, all bots are blocked.
They do care. VC funding happens because the result is profitable. If it is less profitable, there will be less funding because of higher investment risk.
I don’t know what you don’t understand. These bots are not labeling themselves as bots. They are camouflaging themselves to look like any other type of traffic.
No, VC funding happens because investors are duped into thinking the result is profitable.
You keep pulling bullshit statements out of your ass.
https://www.nber.org/digest/may01/how-high-are-vc-returns
VC funding IS profitable in general.
https://www.theaustralian.com.au/business/technology/titanium-ventures-builds-ai-tools-to-unearth-next-1bn-tech-unicorn/news-story/5e36720b2977704ce672ea4c3bfc1321
AI VC funding IS also profitable overall.
I’m not and your tone is completely unnecessary so maybe dial it back a bit.
Yes, VC funding can be profitable. It’s also often not. Like any other investment. Corporations will absolutely lie and blow smoke up their ass if they think it can get them more money.
rarely. Because the overall trends from the 2 links I shared show that it is more often profitable, resulting in a net return on investment.
My tone perfectly reflects my level of respect for you being ongoingly confidently wrong. Sorry if that hurt you. Cheers.