Ranter
Join devRant
Do all the things like
				++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
				Sign Up
			Pipeless API
 
				From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
				Learn More
			Comments
		- 
				
				whimsical125143dNah, I downloaded whole devrant several times and devrant doesn't give an inch. Also, are you aware about the crawlers these days? Molodetz had a traffic over 400gb last few months. Hosting ain't for pussies these days.
 
 Normally dfox hops by, clickclack and things run again.
- 
				
				whimsical125143dNah, I downloaded whole devrant several times and devrant doesn't give an inch. Also, are you aware about the crawlers these days? Molodetz had a traffic over 400gb last few months. Hosting ain't for pussies these days.
 
 Normally dfox hops by, clickclack and things run again.
- 
				
				 jonathands39943d@D-4got10-01 yep, cloudflare is a good one, but If the person crawling really wants to crawl your data and has some expertise and patience, it's not so easy to avoid it jonathands39943d@D-4got10-01 yep, cloudflare is a good one, but If the person crawling really wants to crawl your data and has some expertise and patience, it's not so easy to avoid it
- 
				
				 jonathands39943dby this point I think it's mostly to keep cost down, probably it's running on a cluster of disposable vapes or something jonathands39943dby this point I think it's mostly to keep cost down, probably it's running on a cluster of disposable vapes or something
- 
				
				 djsumdog678143d@whimsical but it's not just me right? Performance is pretty terrible, considering how few users are actually on this site now. djsumdog678143d@whimsical but it's not just me right? Performance is pretty terrible, considering how few users are actually on this site now.
- 
				
				 D-4got10-01248843d@jonathands I only remember reading something about using some special mention or whatever on the site so that the crawlers go away. D-4got10-01248843d@jonathands I only remember reading something about using some special mention or whatever on the site so that the crawlers go away.
 
 Haven't bothered looking into that one, though. No need.
- 
				
				 Wisecrack935325dIf it is on the internet, you can be sure some search engine or bot is indexing it. Wisecrack935325dIf it is on the internet, you can be sure some search engine or bot is indexing it.
Related Rants
- 
						
							 JMoodyFWD29Well that was a fun call I just had. Owner of the company I freelance for: Hey I forgot to tell you something... JMoodyFWD29Well that was a fun call I just had. Owner of the company I freelance for: Hey I forgot to tell you something...
- 
						
							Redp1ll12Interview HR: So .. tell us .. where do you see our AI acting in 5 years? ME: Doing your job minus the stupi...
- 
						
							kekayan7 When you wanted to know deep learning immediately When you wanted to know deep learning immediately


DevRant seems terrible slow. Wonder if someone is crawling/data mining it.
rant
meta
ai
mining
crawling