Subscribe
Sign in
Web Scraper API — Scrape the web at scale without getting blocked
This API enables you to scrape any data from any website, without worrying about proxies, CAPTCHAs, headless browsers and many other complexities involved in web scraping. We make sure you never get blocked again!
26
Replies
Best
@yehoshua_zlotogorski hehe glad to hear it, we'd love to get you onboard ;)
Hi Hunters 👋
We launched the Review Scraper API here on PH [0] back in 2018, and subsequently added the Local NAP API, Review Index API among several other APIs. As our scale has grown, we started to outgrow the existing solutions that we were using, both in terms of quality and cost.
In short, they just weren't working well for the price we were paying. We launched the Web Scraper API as a solution to this, and are now offering this technology to other companies who are scraping the web at volume. As part of this launch, we are offering:
🚀 For users new to web scraping: 30,000 free credits to get you started (just email us after your upvote)
🔥 For those who use our competitors: 50% off your invoice for the same package (limited time offer, just attach the invoice to our support)
Feel free to sign up for an account and kick the tires - I'd love to hear what you think!
[0]: https://www.producthunt.com/post...
Love the abstraction to just a simple API. Many other alternatives are to deal with servers, which isn't really pretty.
Looks solid, it looks similar to Scraper API, Scraping Bee and etc. but will use it to verify the difference. Congratulations on an awesome launch.
When I was working on a blog and forum crawler a while back, I would have loved to have a web crawler available as an API to help get past some of the biggest hurdles - proxy servers, captchas and others. And all of these became ever more complex in the past years. So it's great to have the Web Scraper API available, so anybody looking to do crawling at large scale can get going in an instant.
@horatiumocian web scraping is a tricky topic, and getting more and more complex! our goal is to abstract that complexity away from our users, so they can deliver the value for their customers and not spend time debugging their scrapers :) excited to work on this with you!
This looks awesome! Quick question - could I use this to find emails in website privacy policies? Trying to collate a list of them for easy access for people
@adam_pritchard1 thanks for checking us out! this api returns the raw html to you and you'd have to extract the email on your end if that makes sense?
Cool product! Is this usable for one without technical competency? I’m looking for a scraper to gather data which is expected to be scraped, and publicly specially formatted for that. Do you feel that someone without any technical experience could figure out how to use this?
Curious to see how this can make a difference in understanding our audience. More than ready to give it a shot.
This is incredibly helpful API! Everyone who ever tried to do scraping at large scale probably struggled with blocking (captchas, ip banning, js challenges and so on). Anti-scraping solutions are getting better and better these days and thanks to this API you do not have to worry about that anymore :)) So excited to use this product!
@tamara_krestiankova for sure, there's so many challenges in large volume web scraping! excited to see how people use this api :)
@eliezer_steinbock1 thanks for checking us out and the heads up, we'll take a look! feel free to contact our support with the specific URL and we'll get back to you with a resolution.
Alpe Audio