MLScrape API
p/mlscrape-api
API to extract product data from any online shop
Buneme kyakilika
MLScrape API — API to extract product data from any online shop
1
•
MLScrape is an AI-based API that allows you to extract structured product data from any online shop. The final API is not ready yet but I've setup a prototype with a demo page in order to get some feedback. Try it out and let me know what you think!
Replies
Best
Buneme kyakilika
Hello, Over the past few months I've been working on a neural-network based web scraper for e-commerce websites. The aim is to be able to scrape product data from any product page (so far it extracts the name, price, main image URL and technical specification of the product). I've developed a working prototype of the API along with a demo page (with rate limits so please use it within reason! 🙂 ) in order to get some feedback before I carry on with the project. Because the API is only a prototype, there are some features which are currently missing but will be added later on - for example: • Only English sites that use GBP, EUR or USD are supported • I haven't finished integrating my computer vision algorithms, which means that in some specific situations, the API might not detect a strikethrough and will therefore mix-up the "current price" of the product with the "old price" • The service is running on a hobby heroku server so the API takes a few seconds longer than it otherwise would. I would appreciate any feedback on the API, in particular: • Is there any other product data that you would like to see (e.g product ID, delivery costs, etc)? • What sort of applications would you use this API for once it's fully developed? • Apart from e-commerce sites, what other types of websites would you like to see an API for (e.g news websites, real estate listings, etc)?