Langfuse
p/langfuse
Open Source LLM Engineering Platform
Clemens Rawert

Langfuse 2.0 — the open source LLM engineering platform

Featured
104
Langfuse is the open source LLM Engineering Platform. It provides observability, tracing, evaluations, prompt management, playground and metrics to debug and improve LLM apps. Langfuse is open. It works with any model, framework and you can export all data.
Replies
Best
Clemens Rawert
Hi Product Hunt 👋👋👋 I’m Clemens, co-founder of Langfuse (with @marc_klingen and @max_deichmann). We are so excited to be live on Product Hunt again today launching Langfuse 2.0! We originally launched Langfuse right here in late August 2023 and made it to #1 Product of the Day. Earlier this year we were lucky enough to be awarded a Golden Kitty in the AI Infra category for 2023! Product Hunt holds a special place in our heart and company history. Langfuse has come a long way. Last year, we set out to build open source observability and analytics for LLM apps. We saw a need and gap for a dev-focussed, open source and self-hostable product that allows for complex tracing and nesting of LLM and other workloads. We are excited to introduce Langfuse 2.0 today. We have moved from an observability tool to a platform for LLM engineering. The scope is now wider and the core product has matured so much since last year. A few things you should know about: 👣 Tracing: TS & Python (new: decorator) + OpenAI, Llama Index, Langchain, Litellm + more 🤨 Eval Service: Automatically run evals against all new incoming traces 💾 Datasets: Collect, test and run fine-tuning, testing, and golden datasets in Langfuse 💯 Metrics: Dashboards and analytics on cost, latency and quality 🤖 Prompt Management: Version and deploy prompts from within Langfuse 🕹️ LLM Playground: Engineer your prompts with context in Langfuse 🏎️ Export & Fine Tune: Open GET API and csv/JSON exports to build downstream use cases 🚄 Scale: We’ve invested significantly in scaling and resilience as we’ve scaled to thousands of users and handle millions of events a day 🧑‍🤝‍🧑 Community: Join our thousands of users on GitHub Discussions and Discord See for yourself: ⭐ GitHub: https://github.com/langfuse/lang... ⏯️ Demo (includes data, no credit card): https://langfuse.com/demo 📚 Docs: https://langfuse.com/docs We’re excited to launch the all-new Langfuse on Product Hunt today. We will be in the comments the whole day and can’t wait to hear your thoughts & feedback!
Clemens Rawert
@julietroseb thank you, Juliet :)
Sathish Nagarajan (SNR)
@marc_klingen @max_deichmann @clemo_sf opensourcing LLM engineering platform is great thing in the AI space. Keep up the good work. Congratulations
Oliver Montes
@marc_klingen @max_deichmann @clemo_sf Really amazing product, best in class, Congratulations langfuse team!
Sajida
Congrats on Langfuse 2.0! From observability to a full LLM engineering platform, impressive growth! The features are powerful, catering to user needs. Like snazzystep shoes, Langfuse empowers users to excel. Best wishes on your Product Hunt launch!https://snazzystep.com/wp-admin/
Marc Mengler
💎 Pixel perfection
We were notified automatically about the new launch. It triggered a Slack discussion of our AI infra experts: 'a very nice alternative to langsmith, and it's also cheaper since it isn't per user :+1: It's also open source, so if we don't want to pay for the service we can host it ourselves.' 'We want to remove langchain anyway next week so it kinda fits' Next steps: we check out if the API works for us. Congrats to the Product(hunt)-led growth! :)
Clemens Rawert
@marc_mengler Thank you, Marc! have a look at the API at https://api.reference.langfuse.com/ + feel free to have your team reach out to me, we're always happy to add endpoints.
Marc Klingen
@marc_mengler thanks Marc (hi from Marc to Marc) 🙏 Please reach out any time if you have questions or feedback, I'd love to chat! For more context on Langfuse 2.0, the recording of our launch week town hall might be interesting:
Some more links: We have noted down why we build Langfuse here (open, no framework/llm lock-in, great API to build custom workflows around it): https://langfuse.com/why Public roadmap: https://langfuse.com/roadmap Public roadmap discussions: https://langufse.com/ideas Thanks again, appreciate your support!
Clemens Rawert
Giveaway: Sign up for Langfuse stickers here: https://langfuse.com/stickers we'll send these in the coming weeks!
Marc Klingen
@clemo_sf I want some 🪢🪢🪢
Muhammad Sarmad Hafeez
Langfuse revolutionizes language learning with its innovative approach on LLM apps. By combining cutting-edge technology with proven language acquisition methods, Langfuse offers a comprehensive platform for learners of all levels. Its adaptive learning algorithms tailor lessons to individual proficiency levels, ensuring efficient and effective progress. With features like immersive practice exercises, real-time feedback, and interactive lessons, Langfuse makes language learning engaging, rewarding, and accessible for users worldwide.
Dan
🔌 Plugged in
We love to use Langfuse to build our RAG systems and get the visibility into what prompts actually hitting the LLM! Btw, the new decorate is awesome
Marc Klingen
@dan_meier1 thanks, the decorator is for sure the biggest upgrade to the Langfuse developer experience in Python! We wrote a more technical blog post on it here: https://langfuse.com/blog/2024-0...
Sebastian Schüller
@clemo_sf @marc_klingen @max_deichmann congrats on the launch! It's awesome to follow your journey which is truly lightspeedy. 🔥
Marc Klingen
@clemo_sf @max_deichmann @sebastian_schuller thanks for your excitement and support, really appreciate it ❤️
Asmitha Rathis
This is very cool! Will share it with my team at QueryPal(https://www.querypal.com), as we start benchmarking and evaluating, we are currently looking into WandB.
Łukasz Myśliński
When I found Langfuse, I was so impressed that I made it my priority to integrate it CVToBlind's product stack. Having the ability to not only track the cost of my prompts, but also compare them between different LLM's, group each calls by various ID's and track individual user usage - this is a killer set of features, all while staying well within the free tier. Their recent addition of Posthog integration allowed for us to track our product usage even better. I did miss one feature to fully support my needs, but since it's open source I could just add that code myself - and that's exactly what I did. Working with @marc_klingen has been great, the code is in a great shape and they definitely have my confidence in serving our prompts for production use. We need more products like this. Best of luck, keep it up!
Marc Klingen
@lukmyslinski thank you so much for your kind words and continued feedback and contributions to Langfuse. We really appreciate it! Let me know if you have additional feedback, would love to chat.
Hamza Zia
Congrats @clemo_sf and team on the launch of LangFuse v2!! I love the major upgrade in the tracing subsystem 🔥
Marc Klingen
@clemo_sf @hamza_zia Thanks Hamza! The decorator-based integration has been a big upgrade to tracing in Langfuse. We wrote a short piece on it here: https://langfuse.com/blog/2024-0...
David Paffenholz
We've been using Langfuse since v1 — and have been loving it! The pace of improvements is crazy. Also highly recommend their Posthog integration to keep all your analytics — including LLMs — in one place.
Marc Klingen
@david_paffenholz1 thanks David! You guys are an inspiration, we’re just trying to ship close to as quickly as you do. More improvements to prompt management are planned as we had no new releases for prompt management this week.
Tevfik Oytun Aloglu
A great product to productionize your LLM applications. Once you create a prototype, the next step is understanding the cost structure, and tracing the paths - and Langfuse helps you to solve those challenges. The new decorators make it easy to track anything easily from your code. Good luck with the launch!
Marc Klingen
@tevfik_oytun_aloglu thanks Tevfik, appreciate your feedback. The decorator has been a big step up recently, glad you like it!
Roman Geugelin
Congrats on the launch, Clemens and team! Been using the product since the start and love the execution speed!! Particularly excited about the new tracing and prompt management features. Excited to explore more!!
Marc Klingen
@roman_geu Thanks Roman! Appreciate your support since day one, no matter if it is product or general founder/life advice. Thank you 🙏
Aqib Ansari
Really happy with the product. It's very intuitive - Traces work very well for Agentic Workflows - Scores is another great feature to help us create datasets for finetuning - Plus, looking forward to your new eval feature!
Marc Klingen
@aqib_ansari thanks Aqib, appreciate your continuous product feedback a lot! It really helps us build the best product and continuously learn what your team needs to build the best agents 🙏
Mike Mahlkow
A bit late here, but I was wondering how you charge for evaluations?
Pablo Jimenez De Parga
Building an LLM solution without langfuse is unreasonable. The product gives visibility on all our traces. The team is always ready to lend a hand as well. Keep building!
Clemens Rawert
@pablo_jimenez_de_parga Thank you, Pablo. It's been an immense pleasure working for you for such a long time now!
Marc Klingen
@pablo_jimenez_de_parga your feedback has been invaluable, thanks team throxy!
Timon Christiansen
Congrats on the launch! Really enjoying the product since day 1 🚀
Clemens Rawert
@timon_christiansen Thank you timon and the whole team fastgen!
Marc Klingen
@timon_christiansen love that you guys actually built your own golang wrapper
Viet Le
So great to see you become more holistic! 🤘🏽
Clemens Rawert
@viet_le 🙏🙏🙏
Marc Klingen
@viet_le thanks for your support since day -1 🙏
Henry Heng
Highly recommend Langfuse! Been partnering with them on integrating it into our platform, lots of users love it!
Marc Klingen
@henryheng94 thanks Henry! Love what you built with flowise and the feedback by the super users who really cared about the flowise x Langfuse integration and sent tons of feedback. Thanks everyone! Side note: we need to get that llamaindex js integration going for you :)
Stefan Faistenauer
Congrats on the launch! Langfuse is really an amazing tool to get llm apps production-ready, glad to see it getting so much traction on here.
Marc Klingen
@stefan_faistenauer1 thanks Stefan! That’s our core mission, help everyone launch and build faster
Aleksandr Iakubovich
Langfuse is production ready application for LLM Observability and LLMops. Thank you for awesome open source application!
Marc Klingen
@aleksandr_iakubovich thanks Aleksandr! Let me know if you have any feedback or questions