Awesome-LLMOps

🎉 An awesome & curated list of best LLMOps tools.

☸️ Easy, advanced inference platform for large language models on Kubernetes.

AlphaTrion is an open-source framework to help build GenAI applications, including experiment tracking, adaptive model routing, prompt optimization and performance evaluation.

✨ Donation Plan

🚀 Got a brilliant idea? Let's build something extraordinary together.