Apify
p/apify
Build, deploy, and monitor web scraping and automation tools
Kat Manalac

Apify — Your one-stop shop for web scraping and web RPA solutions

Featured
56
Apify is an open web scraping and automation platform, where you can find dozens of ready-made data extraction and automation tools, build new tools using our popular open-source SDK, or order an affordable turn-key solution from certified developers.
Replies
Best
Jeroen Corthout ☕
Happy Apify user here! I'm using it to automate LinkedIn connection requests to people who sign up for @salesflare by searching their LinkedIn profile in Google through Apify. Works like a charm! ❤️
Jakub Balada
@jeroen_corthout It's great to see such a web automation flow on Apify. Btw, haven't you considered to publish your actor at Apify store?
Jeroen Corthout ☕
@jakubbalada I'm using the Google Search Results Scraper actor if I'm not mistaken. Super handy! Here it is: https://apify.com/apify/google-s...
Jan Čurn
Hey Product Hunt and thanks to @katmanalac for hunting us! Jan, Jakub and the Apify team here, it’s great to be back! We’ve come a long way since we first launched here as Apifier in 2015. We’ve grown from two guys in a small house in Mountain View into a company of 30 amazing people on a mission to make the web more programmable. And as our product has changed completely since the first launch, it’s about time we brought Apify to you again. Apify is a web scraping and robotic process automation (RPA) platform that lets you extract structured data from any website and automate any workflow on the web. Apify can help eliminate time-consuming and repetitive tasks that you or your employees perform manually in a web browser. Further, it can help you get the data you need to improve your products, marketing, sales, and business decisions. Here’s what you can do with Apify: 🔍 Browse ready-made web scraping and web RPA tools published by our community and use them in your projects in just a few clicks. ➡️ https://apify.com/store 🧑🏿‍💻 Haven’t found the right tool? If you’re a developer, you can build your own scrapers, crawlers, or robots using our popular open-source SDK and extensive documentation. ➡️ https://sdk.apify.com/ 🛒 Alternatively, you can order an affordable turn-key web scraping or RPA solution from certified external developers. Simply submit your project and wait for the offers to roll in. ➡️ https://apify.com/marketplace 🏢 You can also request a complete end-to-end solution for any scale from Apify experts and partners. ➡️ https://apify.com/enterprise We’d love to get your feedback and we’ll be around to answer any questions! As a thank you, we’ve prepared a special offer - a 20% discount for the first 6 months. To take advantage of this offer, enter the following promo code when subscribing: PRODUCT_HUNT_SPECIAL
Kim Døfler
@Apify has been on my radar for years. Haven't got around to actually set an actor yet. However, I have chatted with their support a number of times discussing various solutions and they are very accommodating, going that extra mile to help. Great experience. They are definitely top of mind for my scraping and automation projects. Kim Døfler https://triggergrowth.com
Michael Moore
@apify @doefler interesting to hear they've been on your radar for years yet you still haven't dipped your toe in the water. I'd be curious... what are you using instead? (if you don't mind me asking)
Idris Mokhtarzada
We've been using Apify for a while now and love it! The team has put together a really great platform and they back it with incredible support, which is especially important when doing things like scraping, because it's not always perfect. So having a great team to support you when things don't work out is fantastic. Can't wait to see the continued improvement from the Apify team!
Jakub Balada
@idris_mokhtarzada Thanks Idris for such great feedback. You guys are one of our most favorite users, we're talking about your use case quite often when demonstrating web automation powered by Apify.
Ben
I've been using the service for around 3 years. It is fantastic and my go-to for scraping anything. If you have any issues the team are on it and always happy to help. I can't recommend Apify enough!
Jan Čurn
@beesum ❤️
Alexandru Porcescu
Apify made NodeJS a web scraping first citizen. Before it's tools Python was the king. Now it is giving scrapy a run for its money. Good job guys!
Raffaele Asquer
I have been using the Instagram scraper actors for months. The Google SERP scraper is nice too, but I feel I've only scratched the surface of Apify, you can do so many more things!
Khalid B
I am a happy Apify customer (Not affiliated with Apify). Apify is a robust and easy to use platform for data scraping. We have migrated all of our scraping tasks from AWS Lambda to Apify. Apify is a time saver. Give it a try! Improvement: simplify the pricing model. The "Actor compute units" can be complicated to understand and to measure at first.
Jan Čurn
@therasmus79 Thank you for your kind words! We're working on a new billing system that should make the pricing much simpler. It will be ready soon.
Tuğkan Cengiz
As far as I see you can scrape almost everything with the support of the SDK and platform. Really liked the idea. Great job guys!
Jan Čurn
@tugkancengiz Thank you!
Kelly Belton
Quick question? Do you impose automated limits to make sure that we scrape reasonably or is it up to us to place such controls? What I usually struggle is to find the right balance for scraping a high volume of data in a reasonable amount of time.
Lukáš Křivka
@kellybelton Hi Kelly, this is a very important question. Most of our public scrapers in our Store (https://apify.com/store) have internal limits that depend on the capacity of the target website. If you build a new scraper, it is naturally slowed down by the available memory so you have time to evaluate the ideal speed/costs ratio. It is definitely a lot about common sense, if you scrape a website of Amazon's site, you can go faster, but with smaller sites, you want to go slower to not overload their servers. Our SDK allows you to limit the max concurrency and add more delays.
Owen Richards
Been using Apify to scrape lots of specific news sources and report back to a customer with new content for about 3 years and love it! The service and documentation is great and the platform as a whole really reliable. Good job guys! 🎉
Jakub Balada
@owenthetwit Great use case! We're glad to have you onboard for such a long time.
Ryo Chiba
Excited to see this on Product Hunt, congrats Apify team! Highly recommend this product to anyone looking for a powerful but easy to use RPA. You can read about our experience here: https://apify.com/success-storie...
Jakub Balada
@ryochiba Thanks a lot for sharing your use case how Topic is using Apify!
Laurence Frappier
Nice product, looks lile Phantombuster but with a different catalog of automation
Richard Nwankwo
Very useful scraping platform. Was up and running doing scraping tasks shortly after going through the tutorial (https://docs.apify.com/scraping/...) Great tool to have in your dev toolbox
Jan Čurn
@richnwan Thank you, Richard!
Viktor Salnichenko
Great product, but I tried your Instagram Profile Scrapper -> does not work or I am a fool, please fix it and I will continue being your customer!
Niels Ole Dam
Have been using Apify for production tasks for over a year – very pleased with their service. And they have a great customer support team, too. Can definitly recommend!
Lukáš Křivka
@niels_ole_dam Thanks a lot for a nice feedback!
Jakub Balada
@niels_ole_dam Thanks for your recommendation!
Niels Ole Dam
@lukas_krivka1 You're welcome. BTW we're also using your handy google-sheets Actor for simplifing fetching dynamic pre-run data into some of our Apify tasks – very nice with these kinds of prebuild addons to the platform. :-)
TheSax
Happy Apify customer for more than a year now. Absolutely love the product, and although you *can* use the sdk on, say an ec2 instance, I love that I dont have to think about proxys etc - it just works! The team delivers great support and I have noticed several great improvements over time.
Jan Čurn
@thesmons Thank you, we're glad to have you onboard!
Memories 2 Digital
Used Apify for a couple of years, their tools are great (even if you don't use their cloud services!)
Jan Čurn
@memories_2_digital Many thanks for your kind words!
Marcus Anzengruber
Have only been using it for a few hours, but incredibly impressed so far and plan to leverage it at scale to automate tasks at the company where I work. Well done!
abdelhalim laidi
I used Apify library as well as apify platform and it is really great for automation and scraping. I strongly recommend dealing with Apify, they have a great, helpful and patient team.
Jan Čurn
@abdelhalim_laidi Thank you so much for your kind words!