Ranter
Join devRant
Do all the things like
++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
Sign Up
Pipeless API

From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
Learn More
Comments
-
Nah, I downloaded whole devrant several times and devrant doesn't give an inch. Also, are you aware about the crawlers these days? Molodetz had a traffic over 400gb last few months. Hosting ain't for pussies these days.
Normally dfox hops by, clickclack and things run again. -
Nah, I downloaded whole devrant several times and devrant doesn't give an inch. Also, are you aware about the crawlers these days? Molodetz had a traffic over 400gb last few months. Hosting ain't for pussies these days.
Normally dfox hops by, clickclack and things run again. -
@D-4got10-01 yep, cloudflare is a good one, but If the person crawling really wants to crawl your data and has some expertise and patience, it's not so easy to avoid it
-
by this point I think it's mostly to keep cost down, probably it's running on a cluster of disposable vapes or something
-
@whimsical but it's not just me right? Performance is pretty terrible, considering how few users are actually on this site now.
-
@jonathands I only remember reading something about using some special mention or whatever on the site so that the crawlers go away.
Haven't bothered looking into that one, though. No need.
Related Rants
-
JMoodyFWD29Well that was a fun call I just had. Owner of the company I freelance for: Hey I forgot to tell you something...
-
Redp1ll12Interview HR: So .. tell us .. where do you see our AI acting in 5 years? ME: Doing your job minus the stupi...
-
kekayan7
When you wanted to know deep learning immediately
DevRant seems terrible slow. Wonder if someone is crawling/data mining it.
rant
meta
ai
mining
crawling