ZenML
Blog
Empowering ZenML Pro Infrastructure Management: Our Journey from Spacelift to ArgoCD
Case Studies

Empowering ZenML Pro Infrastructure Management: Our Journey from Spacelift to ArgoCD

The combination of ZenML and Neptune can streamline machine learning workflows and provide unprecedented visibility into experiments. ZenML is an extensible framework for creating production-ready pipelines, while Neptune is a metadata store for MLOps. When combined, these tools offer a robust solution for managing the entire ML lifecycle, from experimentation to production. The combination of these tools can significantly accelerate the development process, especially when working with complex tasks like language model fine-tuning. This integration offers the ability to focus more on innovating and less on managing the intricacies of your ML pipelines.

Andrei VishniakovAndrei Vishniakov
Oct 11, 20244 mins
Streamlining Model Deployment with ZenML and BentoML
MLOps

Streamlining Model Deployment with ZenML and BentoML

This blog post discusses the integration of ZenML and BentoML in machine learning workflows, highlighting their synergy that simplifies and streamlines model deployment. ZenML is an open-source MLOps framework designed to create portable, production-ready pipelines, while BentoML is an open-source framework for machine learning model serving. When combined, these tools allow data scientists and ML engineers to streamline their workflows, focusing on building better models rather than managing deployment infrastructure. The combination offers several advantages, including simplified model packaging, local and container-based deployment, automatic versioning and tracking, cloud readiness, standardized deployment workflow, and framework-agnostic serving.

Jayesh SharmaJayesh Sharma
Oct 10, 20245 mins
Automating Lightning Studio ML Pipelines For Fine Tuning LLM (s)
LLMs

Automating Lightning Studio ML Pipelines For Fine Tuning LLM (s)

In the AI world, fine-tuning Large Language Models (LLMs) for specific tasks is becoming a critical competitive advantage. Combining Lightning AI Studios with ZenML can streamline and automate the LLM fine-tuning process, enabling rapid iteration and deployment of task-specific models. This approach allows for the creation and serving of multiple fine-tuned variants of a model, with minimal computational resources. However, scaling the process requires resource management, data preparation, hyperparameter optimization, version control, deployment and serving, and cost management. This blog post explores the growing complexity of LLM fine-tuning at scale and introduces a solution that combines the flexibility of Lightning Studios with the automation capabilities of ZenML.

Hamza TahirHamza Tahir
Oct 9, 202406 mins
Navigating the MLOps Galaxy: ZenML meets Neptune for advanced Experiment Tracking
Tutorials

Navigating the MLOps Galaxy: ZenML meets Neptune for advanced Experiment Tracking

The combination of ZenML and Neptune can streamline machine learning workflows and provide unprecedented visibility into experiments. ZenML is an extensible framework for creating production-ready pipelines, while Neptune is a metadata store for MLOps. When combined, these tools offer a robust solution for managing the entire ML lifecycle, from experimentation to production. The combination of these tools can significantly accelerate the development process, especially when working with complex tasks like language model fine-tuning. This integration offers the ability to focus more on innovating and less on managing the intricacies of your ML pipelines.

Hamza TahirHamza Tahir
Sep 21, 20246 mins
Boost Your MLOps Efficiency: Integrate ZenML and Comet for Better Experiment Tracking

Boost Your MLOps Efficiency: Integrate ZenML and Comet for Better Experiment Tracking

This blog post discusses the integration of ZenML and Comet, an open-source machine learning pipeline management platform, to enhance the experimentation process. ZenML is an extensible framework for creating portable, production-ready pipelines, while Comet is a platform for tracking, comparing, explaining, and optimizing experiments and models. The combination offers seamless experiment tracking, enhanced visibility, simplified workflow, improved collaboration, and flexible configuration. The process involves installing ZenML and enabling Comet integration, registering the Comet experiment tracker in the ZenML stack, and customizing experiment settings.

Hamza TahirHamza Tahir
Sep 19, 20245 mins
AWS MLOps Made Easy: Integrating ZenML for Seamless Workflows
MLOps

AWS MLOps Made Easy: Integrating ZenML for Seamless Workflows

Machine Learning Operations (MLOps) is crucial in today's tech landscape, even with the rise of Large Language Models (LLMs). Implementing MLOps on AWS, leveraging services like SageMaker, ECR, S3, EC2, and EKS, can enhance productivity and streamline workflows. ZenML, an open-source MLOps framework, simplifies the integration and management of these services, enabling seamless transitions between AWS components. MLOps pipelines consist of Orchestrators, Artifact Stores, Container Registry, Model Deployers, and Step Operators. AWS offers a suite of managed services, such as ECR, S3, and EC2, but careful planning and configuration are required for a cohesive MLOps workflow.

Jayesh SharmaJayesh Sharma
Sep 11, 202417 mins

Popular Topics

zenmlmlopsevergreenllmLLMOpstoolingbigger-pictureagentsllmops-databaseintegrationsmachine-learninggenaiai-generatedsales-learningzenml-projectpodcastpipelinesapplied-zenmlreleaseopen-source
+93 more topics
deploymentbest-practicescloudrelease-notesdevopsproductionawsmonitoringRAGnewsletterstackssagemakernewseducationLatest NewsKubernetesmodel-control-planegcppythonThought LeadershipinfrastructuredashboardAzuretech-startupevaluationpipelinehuggingfacefoundationmodelsnlpautomationorchestratorsmlops pipelinecompliancesecurityAzureMLbitesizelegacyframeworkCommunity postairflowwandbbentomldeep learningmcpai-actteamsabmmodalfinetuningsummarizationneptunecomputer-visioncompetitionskillshealthcaretime-seriesdefenseenergyenterpriseocrbatch-processingpromultimodaldocumentationvertexaivisualizationData Scientistgitopslightning aideepchecksData brickscometskypilotvscodedata-engineeringTerraformModel trainingMachine learning modelsKubeflowmlstacksmonth-of-mlopspytorchkserveedgeannotationdatacicdmlflowseldonethicsservingtestingreproducibility