Subscribe
Sign in
Microlink 2.0 — Extract structured data from any website
Microlink turns any website into useful structured data.
Just enter an URL and you will get relevant information from any link and easily create beautiful previews.
The powerful API makes simple add it with any existing stack or cloud.
It offers a free plan based on daily quota. Just pay as you need.
23
Replies
Question is how much this product can scale to do bulk checks. Also performance on free version seemed lacking if you were going to check more than one url
I've been testing it to integrate it in a 6 years old product (we display social media content, and this would provide the preview for the links) and the experience so far has been great.
Pros:Easy to integrate on any platform
Cons:None so far
We released the new `screenshot` API Parameters for creating fancy screenshots
Microlink screenshot
👋 Hello, Product Hunters
microlink turns any website into well structured normalized metadata.
It can unify and detect data such as the title, author, date, description, language,...
Also, it detects media data like image, video or audio.
Complementary, the API provides capabilities to do extra things like:
- Take a screenshot of the website (partial or full page).
- Get a predominant color palette per each image detected.
- Make easy embed content directly in your HTML markup.
You can see more in the API documentation https://docs.microlink.io/api
Under the hood, microlink is built with top notch technologies of the industry, using headless browser technique when it is necessary.
We are proud that the major of our software is Open Source: https://github.com/microlinkhq.
We provide a cloud service oriented to quickly scale it based on your demand and aims for getting the best response time and availability.
Also, free plan is available 🙂
Been using Microlink for a while now and IMO it's the best scraping tool out there. It's super easy to extend with custom rules.
The devs are very active on their slack and responsive to new feature requests.
Highly recommend it
I've been using micro link for about 2 - 3 months now. I have few subscriptions for different needs. Really dig what you guys do. I reached out few times when I had a problem, and I had someone respond to me right away with few options. Keep on rocking. Upvote! Upvote!
@rdev nope, the information is extracted from meta tags under the target url, it's publicly exposed. Also we not rehosting assets like image or video 🙂
@kikobeats Niantic's game Ingress has a world-wide game view called Intel which operates in a browser, therefore publicly exposed. Yet if you'll be automatically pulling data from it, they will terminate your account.
Just because it's displayed in the browser doesn't mean it's allowed to be scrapped from it :)
@rdev meta tags such as open graph has been designed to be shareable, your example is not comparable
@rdev
Let's try and be constructive, so you think the tool can theoretically be used to break TOS.
What do you think the tool manufacturer should do about this?
Grass up users? Employ a lawyer to read every TOS of every website a user wishes to use this on? Automatically block the tool's use on websites when requested by the owner? Require users to state they aren't violating TOS?
Assumption of bad intent speaks volumes.
Looks like an awesome project Kiko! I can think of numerous use case for something like this, wishing you the best with it. :)
Whether it provides information within the dialogue
Pros:Easy to integrate
Cons:Any ways to get more data if the page provides
It's a very interesting and useful product that can be used with the library / framework of your choise.
Pros:Simple. Easy to use. Carefully designed. Awesome support. Nice documentation.
Cons:There's no audio preview yet, but it'll be available soon.
Hi @kikobeats I was curious to know what the difference is between the open source repos vs the free/paid version on your website?
How much code/functionality does someone get access to when using your open source repo?
@ratan_mehta
The major part our code is Open Source because the code is not the business.
Our pro plan offers the quality and scalability that you expected from an on a cloud solution.
URLs are unstable on the time. Our main effort is to make API response time fast under any situation, extracting as much data as possible.
For this, we provide a cache layer, auto prerendering detection, dynamic TTL per domain and more extra features behind the umbrella that for the user it's transparent.
So, basically, you are paying to have time and don't distract your dev team.
It's pretty similar to provision your own servers vs. uses a cloud solution like AWS.
I've been using Microlink for almost a year now, and after trying many other tools out there I'm pretty sure microlink provides the best in market.
Pros:Straightforward API, video extraction, awesome support
Cons:none so far