offline - I downloaded the entire stackoverflow DB for offline use. And it's almost 94GB - devRant

Ranter

Comments

43

grayfox

3620

6y

Filter all the "duplicate question" and the "Google that" comments and responses and it will go down to 15GB for sure
5

cleancoder

466

6y

@grayfox Yes that's true, a lot of it are actually duplicates. I download each records based on tags and each question has multiple tags. But anyway, I'm gonna improve my downloader later.
7

jonmi

59

6y

Would you mind sharing your downloader?
8

gitpush

32412

6y

How did you do that?
6

mangodb

3878

6y

Just leaving a tactical dot here .
Don't mind me.
4

pandasama

950

6y

🎲
4

Psychosadistic

634

6y

📌
3

rigobertomolina

926

6y

.
5

bjoer751

77

6y

Or you could just download the published DB dump https://archive.org/details/...

I know, not as fun as creating a spider, but you'll get more metadata than is visible.
1

HoloDreamer

6527

6y

📌
2

tacticalKimchi

856

6y

I never knew you could do this.
1

dufferz

676

6y

@pyaf do you really need vs do you really want though.. I'd love to have it too. Its a pretty invaluable resource if you are unexpectedly hit with no Internet or something.

(download All the things!)
3

cleancoder

466

6y

@irene intermittent internet
1

flocke

261

6y

@irene The documentation is way to polite, I need my daily abuse on SO or I can't work.

Related Rants

devRant © 2021 Hexical Labs LLC
Privacy Policy | Terms of Service