GOT AN A+ FOR MY LAST PROJECT OF HIGH SCHOOL!!! SO FUCKING HAPPY!!!

(by the way, we built a search engine for this project. A pretty big and fast one too)

How did it search or "crawl" pages? And which pages? Real internet pages or just a local test network

Congrats!
And here I am, half way through high school, explaining for loops to my classmates. 😭

@lucavinci Our first crawler crawled all sorts of different pages from different websites, but with only three developers and a shitload of incompatible data from different websites, we thought it would be best if we just crawled one website (Wikipedia) until we had enough pages (like 50 million).

Then we wrote a script that indexed most of those pages..

In the end we could search through 200.000 pages.. 200.000 pages seems like a small table, but we started indexing pages around 5 days before the deadline...

@Jappe sounds interessting and fun to be honest. And hard, too.

I wish the HS I attended had such high-level cs classes... The best we got was an introduction to DreamWeaver... The teacher didn't even understand half of what she was teaching...

I'm curious. Could you share the code? :)

@stefano I could and I'll probably will

@immadeofpixels if it makes you feel better, the best we got were TI Pro PC's. 8086 processor. Green screen. The typing class got IBM PS/2s with EGA (we didn't have VGA yet) displays.

@yamatoman We had ChromeBoxes that just did remote desktop into a server in the same room. It was noisy, hot, and laggy when we all tried to do even semi-demanding tasks at once.
And to add insult to injury, the next classroom over that was used only for teaching basic video editing had fancy new slim iMacs.

@franga2000 My situation right now....