Tag
llmops-database
18 posts with this tag
- The Experimentation Phase Is Over: Key Findings from 1,200 Production DeploymentsAnalysis of 1,200 production LLM deployments reveals six key patterns separating successful teams from those stuck in demo mode: context engineering over prompt engineering, infrastructure-based guardrails, rigorous evaluation practices, and the recognition that software engineering fundamentals—not frontier models—remain the primary predictor of success.LLMOpsagentsbest-practices+1Alex Strick van Linschoten2025
- What 1,200 Production Deployments Reveal About LLMOps in 2025LLMOpsagentsevaluation+2Alex Strick van Linschoten2025
- LLMOps in Production: Another 419 Case Studies of What Actually WorksExplore 419 new real-world LLMOps case studies from the ZenML database, now totaling 1,182 production implementations—from multi-agent systems to RAG.LLMOpsgenaiagents+1Alex Strick van Linschoten2025
- Langfuse vs Phoenix: Which One’s the Better Open-Source Framework (Compared)In this Langfuse vs Phoenix guide, we conclude which open-source framework fits your LLMs stack by comparing features, integration, and pricing.discoveryLLMOpsopen-source+1Hamza Tahir2025
- We Tried and Tested 10 Best Vector Databases for RAG PipelinesDiscover the 10 best data vector databases for RAG pipelines.LLMOpsRAGmlops+1Hamza Tahir2025
- CrewAI vs AutoGen: Which One Is the Best Framework to Build AI Agents and ApplicationsIn this Crewai vs Autogen article, we explain the difference between the two and conclude which one is the best to build AI agents and applications.LLMOpsagentsframework+1Hamza Tahir2025
- The Annotated Guide to the Maven Evals Course (by way of the LLMOps Database)Lessons from the Maven Evals course are combined with 50+ real-world case studies from ZenML's LLMOps Database to show how companies like Discord, GitHub, and Coursera implement the Three Gulfs model and Analyze-Measure-Improve lifecycle to transform failing LLM systems into production-ready applications.evaluationgenaillmAlex Strick van Linschoten2025
- LLMOps in Production: 287 More Case Studies of What Actually Works287 latest curated summaries of LLMOps use cases in industry, from tech to healthcare to finance and more. This blog also highlights some of the trends observed across the case studies.LLMOpsgenaiagents+1Alex Strick van Linschoten2025
- LLMOps in Production: 457 Case Studies of What Actually WorksA comprehensive overview of lessons learned from the world's largest database of LLMOps case studies (457 entries as of January 2025), examining how companies implement and deploy LLMs in production. Through nine thematic blog posts covering everything from RAG implementations to security concerns, this article synthesizes key patterns and anti-patterns in production GenAI deployments, offering practical insights for technical teams building LLM-powered applications.LLMOpsllmproduction+2Alex Strick van Linschoten2025
- Production LLM Security: Real-world Strategies from Industry Leaders 🔐Learn how leading companies like Dropbox, NVIDIA, and Slack tackle LLM security in production. This comprehensive guide covers practical strategies for preventing prompt injection, securing RAG systems, and implementing multi-layered defenses, based on real-world case studies from the LLMOps database. Discover battle-tested approaches to input validation, data privacy, and monitoring for building secure AI applications.securityllmLLMOps+1Alex Strick van Linschoten2025
- Optimizing LLM Performance and Cost: Squeezing Every Drop of ValueThis comprehensive guide explores strategies for optimizing Large Language Model (LLM) deployments in production environments, focusing on maximizing performance while minimizing costs. Drawing from real-world examples and the LLMOps database, it examines three key areas: model selection and optimization techniques like knowledge distillation and quantization, inference optimization through caching and hardware acceleration, and cost optimization strategies including prompt engineering and self-hosting decisions. The article provides practical insights for technical professionals looking to balance the power of LLMs with operational efficiency.LLMOpsproductiongenaiAlex Strick van Linschoten2025
- The Evaluation Playbook: Making LLMs Production-ReadyA comprehensive exploration of real-world lessons in LLM evaluation and quality assurance, examining how industry leaders tackle the challenges of assessing language models in production. Through diverse case studies, the post covers the transition from traditional ML evaluation, establishing clear metrics, combining automated and human evaluation strategies, and implementing continuous improvement cycles to ensure reliable LLM applications at scale.LLMOpsllmwandb+1Alex Strick van Linschoten2024
- Prompt Engineering & Management in Production: Practical Lessons from the LLMOps DatabasePractical lessons on prompt engineering in production settings, drawn from real LLMOps case studies. It covers key aspects like designing structured prompts (demonstrated by Canva's incident review system), implementing iterative refinement processes (shown by Fiddler's documentation chatbot), optimizing prompts for scale and efficiency (exemplified by Assembled's test generation system), and building robust management infrastructure (as seen in Weights & Biases' versioning setup). Throughout these examples, the focus remains on systematic improvement through testing, human feedback, and error analysis, while balancing performance with operational costs and complexity.llmLLMOpsRAG+2Alex Strick van Linschoten2024
- LLM Agents in Production: Architectures, Challenges, and Best PracticesAn in-depth exploration of LLM agents in production environments, covering key architectures, practical challenges, and best practices. Drawing from real-world case studies in the LLMOps Database, this article examines the current state of AI agent deployment, infrastructure requirements, and critical considerations for organizations looking to implement these systems safely and effectively.LLMOpsagentsRAGAlex Strick van Linschoten2024
- Building Advanced Search, Retrieval, and Recommendation Systems with LLMsDiscover how embeddings power modern search and recommendation systems with LLMs, using case studies from the LLMOps Database. From RAG systems to personalized recommendations, learn key strategies and best practices for building intelligent applications that truly understand user intent and deliver relevant results.best-practicesinfrastructureLLMOps+2Alex Strick van Linschoten2024
- Building LLM Applications that Know What They're Talking About 🔓🧠Explore real-world applications of Retrieval Augmented Generation (RAG) through case studies from leading companies in the ZenML LLMOps Database. Learn how RAG enhances LLM applications with external knowledge sources, examining implementation strategies, challenges, and best practices for building more accurate and informed AI systems.RAGLLMOpsllm+1Alex Strick van Linschoten2024
- Demystifying LLMOps: A Practical Database of Real-World Generative AI ImplementationsThe LLMOps Database offers a curated collection of 300+ real-world generative AI implementations, providing technical teams with practical insights into successful LLM deployments. This searchable resource includes detailed case studies, architectural decisions, and AI-generated summaries of technical presentations to help bridge the gap between demos and production systems.best-practiceseducationllm+3Alex Strick van Linschoten2024
- LLMOps Lessons Learned: Navigating the Wild West of Production LLMs 🚀Explore key insights and patterns from 300+ real-world LLM deployments, revealing how companies are successfully implementing AI in production. This comprehensive analysis covers agent architectures, deployment strategies, data infrastructure, and technical challenges, drawing from ZenML's LLMOps Database to highlight practical solutions in areas like RAG, fine-tuning, cost optimization, and evaluation frameworks.best-practicesgenaillm+2Alex Strick van Linschoten2024
Showing 1–12 of 18
AI orchestration,
on the infra you choose
Get new posts by email
New posts and product updates, sent when we publish. No spam.
By subscribing, you agree to our privacy policy.