Subscribe
Sign in
Review Scraper API
p/review-scraper-apiReviews from 50+ sites in JSON
Start new thread
Philip Källberg

Web Scraper API - Scrape the web at scale without getting blocked

by•

This API enables you to scrape any data from any website, without worrying about proxies, CAPTCHAs, headless browsers and many other complexities involved in web scraping. We make sure you never get blocked again!

Add a comment

Replies

Best
Philip Källberg
Maker
Hi Hunters 👋 We launched the Review Scraper API here on PH [0] back in 2018, and subsequently added the Local NAP API, Review Index API among several other APIs. As our scale has grown, we started to outgrow the existing solutions that we were using, both in terms of quality and cost. In short, they just weren't working well for the price we were paying. We launched the Web Scraper API as a solution to this, and are now offering this technology to other companies who are scraping the web at volume. As part of this launch, we are offering: 🚀 For users new to web scraping: 30,000 free credits to get you started (just email us after your upvote) 🔥 For those who use our competitors: 50% off your invoice for the same package (limited time offer, just attach the invoice to our support) Feel free to sign up for an account and kick the tires - I'd love to hear what you think! [0]: https://www.producthunt.com/post...
Felix Melchner
Awesome! I was looking forward to this for months! Can't wait to test it out!
Philip Källberg
Maker
@felixmelchner thanks for your support!
Kamil
It looks amazing! It's really hard to scrape many different websites effectively because of the problems with picking right proxy vendors or scaling JS rendering solution... This product will definetely help with those issues, so excited to use this :)
Philip Källberg
Maker
@kamiltm1 we excited to see how you use it 🙌
Horatiu Mocian
When I was working on a blog and forum crawler a while back, I would have loved to have a web crawler available as an API to help get past some of the biggest hurdles - proxy servers, captchas and others. And all of these became ever more complex in the past years. So it's great to have the Web Scraper API available, so anybody looking to do crawling at large scale can get going in an instant.
Philip Källberg
Maker
@horatiumocian web scraping is a tricky topic, and getting more and more complex! our goal is to abstract that complexity away from our users, so they can deliver the value for their customers and not spend time debugging their scrapers :) excited to work on this with you!
Tamara Krestianková
This is incredibly helpful API! Everyone who ever tried to do scraping at large scale probably struggled with blocking (captchas, ip banning, js challenges and so on). Anti-scraping solutions are getting better and better these days and thanks to this API you do not have to worry about that anymore :)) So excited to use this product!
Philip Källberg
Maker
@tamara_krestiankova for sure, there's so many challenges in large volume web scraping! excited to see how people use this api :)
Adam Pritchard
This looks awesome! Quick question - could I use this to find emails in website privacy policies? Trying to collate a list of them for easy access for people
Philip Källberg
Maker
@adam_pritchard1 thanks for checking us out! this api returns the raw html to you and you'd have to extract the email on your end if that makes sense?
Benoit Chambon
🥷 technique haha, love it! Congrats on the launch😃
Philip Källberg
Maker
@benoit_chambon thanks for the support :)
Yehoshua Zlotogorski
Congrats on the launch - I can definitely see myself using this and love the offers to get us onboard 🤣
Philip Källberg
Maker
@yehoshua_zlotogorski hehe glad to hear it, we'd love to get you onboard ;)
Elie Steinbock
Just tried a url and was immediately blocked by Incapsula (Imperva)
Philip Källberg
Maker
@eliezer_steinbock1 thanks for checking us out and the heads up, we'll take a look! feel free to contact our support with the specific URL and we'll get back to you with a resolution.
D.M. Braun
Curious to see how this can make a difference in understanding our audience. More than ready to give it a shot.
Philip Källberg
Maker
@d_m_braun Awesome thanks for checking us out! Feel free to sign up :)
Eban Escott
This looks awesome. Keen on giving this a try!
Daryll Wong
Love the abstraction to just a simple API. Many other alternatives are to deal with servers, which isn't really pretty.
Sanket Makhija
Looks solid, it looks similar to Scraper API, Scraping Bee and etc. but will use it to verify the difference. Congratulations on an awesome launch.
Hasan Diwan
I'm wondering what this adds over what diffbot offers?
Jesús Barrio
It really works
Ben Kenney
Cool product! Is this usable for one without technical competency? I’m looking for a scraper to gather data which is expected to be scraped, and publicly specially formatted for that. Do you feel that someone without any technical experience could figure out how to use this?
David Iwanow
Your website is broken