Subscribe
Sign in
Hi guys very curious to know what your net profit % is if you are using llms?
Saw an article recently which suggested that people integrating gbt,gemini etc are facing this problem of managing the cost of these llms as they are very expensive
6
Replies
Best
kennethmarko
Absolutely, managing costs while leveraging the power of LLMs is a significant challenge. The balance involves several key factors:
1. Usage Efficiency: Optimizing how often and for what purposes LLMs are used can help control costs. For example, using LLMs for tasks that truly benefit from their capabilities rather than routine or low-value tasks.
2. Model Selection: Choosing the right size and type of model for specific applications can impact costs. Smaller models or fine-tuned versions may be more cost-effective for certain tasks compared to larger, more general models.
3. Infrastructure Costs: The cost of running LLMs, including cloud infrastructure and computational resources, can add up. Effective management of these resources, such as through batch processing or serverless options, can help keep expenses under control.
4. Scalability: Implementing solutions that can scale efficiently with demand without a linear increase in costs is crucial. Techniques like caching responses or using hybrid models can help in this regard.
5. Monitoring and Optimization: Regularly monitoring usage and performance metrics allows for fine-tuning and adjustments to reduce unnecessary expenditure.
Balancing these factors requires ongoing adjustments and strategic planning to maximize the benefits of LLMs while keeping costs in check.
Report
Share
i'm experimenting with some techniques to lower the cost for my upcomig product
I read a research paper called Frugal Gpt there are some techniques to lower the cost.
do check it out
Our experience has been that integrating language models has helped us improve efficiency and accuracy, which indirectly boosts profits.
I’m exploring it for my business and wondering if it’s worth the investment.
Profit margins heavily depend on use case and architecture. Running LLMs yourself cost effectively is still very challenging. For a low volume app, maybe 20-30% after infra costs. For high volume, likely single digit % or even losing money initially. Using APIs like OpenAI is more predictable, maybe 50%+ depending on pricing. Definitely a balancing act! What's worked for others?