Works with OpenAI, Anthropic, Anyscale and more. The monitor pings completions, embeddings, moderation and other APIs every 3-5 minutes and proactively alerts if it finds error responses continuously.
Opening up our 🚨 LLM downtime monitoring tool to the community:
We started to maintain this because we were tired of running into API errors without warning. Figured it could help other developers stay in the loop on API performance too.