Subscribe
Sign in
General
p/generalShare and discuss tech, products, business, startups, or product recommendations
Start new thread
Fabian Maume

Are you using webscraping?

5
•
There are plenty of actionable data out there on the internet. You can access them by using webscraping. I build my own saas using webscraping QApop, and I'm currently hunting a library to help out with webscraping development: Crawlee

Add a comment

Replies
Best
Alex Robinson
We couldn't find a tool to help us scrape blog posts, we ended up having to create our own. We needed to be able to parse any blog and find the author, published date, and article text. We use it to automatically generate videos from blogs, you can checkout it out at vidon.ai.
Sebastian Potcher
I'm heavily using Phantombuster.
Jefry Pozo
I'm currently developing a mobile application for which I will need to scrape data from some sites to notify users about deals and price changes.
Fabian Maume
@jefrypozo1 Interesting. Are you running the scraping server side? Scraping from mobile phone would be expensive with data.
Jefry Pozo
@fabian_maume of course. The mobile app will connect to an API in a server which will do the scraping