Software Engineering

Newsletter Edition #3 - State of Open Source

Hamza Tahir
May 13, 2024
3 mins

Hello lovely people! We're back with another banger! Lots to get through, including musings on open source, more LLMOps stuff, and how hard creating a professional YouTube video can be! Let's dive in.

State of Open Source

According to Synopsys, 96% of all codebases contain open-source software. Despite being so prevalent, it's no secret that the open source world is in turmoil, trying to reconcile its open roots with the ever-increasing demands for commercialization. The last few years have seen major OSS players switch tactics, and lean in towards more restrictive licensing. Here are some examples:

While “classical” OSS companies choose to go closed, in the world of GenAI and LLMs, we see the battle raging differently. Every week, a new OSS model comes out that competes with the likes of OpenAI, evidenced most dramatically by Llama 3 by Meta and IBM’s Granite Family. These models are basically all hosted on HuggingFace, a company which is unabashedly open source. However, proprietary models still lead the pack, with GPT-4o launched just yesterday bringing realtime, omnichannel LLM capabilities to the world.

It’s hard to predict how all this will play out. What I can say with confidence is that ZenML is open source and freely available under Apache 2.0, and we plan to keep it this way. We're putting our energy more into innovating on that tenuous line between the OSS and Cloud offering. Reaffirming our commitment to OSS, we recently open sourced our new dashboard. We hope that taking such actions gives assurances to the community that we will stick by our open source roots.

Computer Vision Webinar

Last week, we conducted our first webinar, talking about building the data flywheel for computer vision.  It went really well, with lots of crowd participation. Can't wait to host the next one!

Watch the recording now

ZenML Product Corner

Open sourcing our new dashboard

Last week brought the HUGE news that we finally unfiied the cloud and open source dashboards! The new OSS dashboard brings a fresh new modern design, and is way easier to use than the old one. Upgrade ZenML today, you won't want to miss out on this one!

Learn More

Multi-GPU LLM finetuning with PEFT

We have a brand new ZenML project by Andrei, which features a pipeline that fine-tunes Mistral using PEFT. The cool thing about this is that this works in a multi-gpu, distributed setting. Check it out!

See code

Reranking for better retrieval with LLMs

Rerankers are a crucial component of retrieval systems that use LLMs. In the latest chapter of the LLMOps guide, Alex walks us through implementing rerankers from scratch.

Read more

Fresh from the community

Churn prediction MLOps project

Community member jitxs is working on a churn prediciton project using ZenML. It has some nice work and Streamlit to demo the app. Nice work Harsh!

See code

Amazing user interviews

We had an absolute blast talking many new users about onboarding on ZenML, and we learned a lot! Hopefully, these learnings go right back into the product and make it better for everyone. Thank you to the participants, and please note we are still looking for more people who are willing to do a 30-minute user interview with us - register now!

Register for a user interview

We're on YouTube!

Featuring a brand-new MLOps tutorial in 11 minutes!

  • Working with Renat Gabitov and the team at Represent, we recorded a "Zero to Hero" video tutorial using ZenML.
  • The video is professionally edited and shot, and features yours truly. It took me two hours to shoot, and made me appreciate how tough being a full-time YouTuber can be!
  • Like and subscribe on YouTube to show the love!

Watch Tutorial


If you have any questions or need assistance, feel free to join our Slack community.

Happy Developing!

Hamza Tahir

Looking to Get Ahead in MLOps & LLMOps?

Subscribe to the ZenML newsletter and receive regular product updates, tutorials, examples, and more articles like this one.
We care about your data in our privacy policy.