19

So I just launched a website where you can create web-scrapers with just the click of a button:
http://scrape.host

Comments
  • 0
    That looks great !
  • 0
  • 0
  • 0
    Nicely done (y).
  • 1
    Unable to get it working in opera.
    Just sayin.
  • 0
    @Arpit05 Yeah it only supports modern and common browsers right now. Such as chrome, firefox and safari
  • 0
    @Mitch377 thank you for your input. I am aware that the terms of use is not very good. It actually stopped me from going live with it for months because I might not like the consicvenses, but this weekend I though "what the heck, lets put it live"
  • 1
    @Mitch377 it does read robots.txt though, and won't scrape disallowed urls.
  • 0
    @ianertson that's good that it follows robots.txt

    I still hate the concept of scraping, but I'm biased because I worked at a place got a while that ran a bunch of "news" WordPress sites that just posted scraped content nonstop.

    They had to call Google once a week to get sites back into search results.
  • 1
    @NathanDoesDev I did also work for a company before, all they did was creating scrapers. That's actually where I got the idea from.
  • 1
    @ianertson that's my point. It's a terrible practice which is unethical (mass-plagerism and providing no valuable content to your users) and not to mention it's really bad for your site's SEO.
  • 0
    @NathanDoesDev I don't see how it is unethical though. It's just gathering data that is accesible to anyone anyways.
  • 1
    @ianertson taking somebody's content and posting it on your own site derives the actual author of traffic that should be theirs. It didn't provide unique content to users. It's plagerism if you don't attribute the content to the author. And once again, search engines like Google will penalize you for stealing content, and if you do it a lot then they will ban your site from the search engine.

    Don't do it.
  • 0
    On the what is a scraper page it says Our scraper 'travles' :P
  • 0
    MADE IN SWEDEN? i liek.
  • 0
    Login page without SSL? You might want to take a look at letsencrypt.org
Add Comment