5
Awlex
6y

I spend fucking weeks planing how to crawl the reddit api as concurrent as possible, only to realiye that there is a ratelimit of 300 request per 600 seconds

FUCK, SHIT GODVERDOMME, VAFFANCULO, EAT SHIT, PENETRATE ME WITH A SWORDFISH, FMFL

Comments
  • 1
    Use more API clients?
  • 1
    @svgPhoenix I'm not gonna try on an supposingly IP based ratelimit.

    Edit: I bugged devrant
  • 1
    Guess you can't add images afterwards
  • 0
    Maybe a proxy list would work?

    Oh, what are you using all that data for?
  • 3
    Unless you want something real time there are reddit database dumps laying around internet.
  • 2
    Umm of course there is?

    Easy solution:
    Multiple proxied slaves. Yawn.
Add Comment