Sign Language Detection with YOLOv5
All Projects

Sign Language Detection with YOLOv5

End-to-end computer vision pipeline that trains a YOLOv5 model to detect and recognize American Sign Language alphabet in real-time images, with deployment to Vertex AI.

Sign Language Detection with YOLOv5
Project
Sign Language Detection with YOLOv5
Project ID
sign-language-detection-yolov5

Use this id to create a new project in ZenML

Pipelines
Training Pipeline

Pipeline that loads data from Roboflow, augments it, and trains a YOLOv5 model on Vertex AI.

Deployment Pipeline

Pipeline that loads the trained model, builds a BentoML bundle, and deploys it to Vertex AI.

Inference Pipeline

Pipeline that loads test data and runs predictions using the deployed model.

Recommended Stack
  • Orchestrator: local
  • Artifact Store: gcp
  • Step Operator: vertex
Tools
zenml mlflow gcp bentoml vertex-ai-16c14 docker
Tags
computer-vision object-detection real-time-processing model-deployment
Details

This project demonstrates how AI can bridge communication gaps for the deaf community by automatically recognizing American Sign Language (ASL) alphabet signs in real-time images. Using computer vision and modern MLOps practices, I've built an end-to-end pipeline that can detect and interpret ASL signs with high accuracy.

What It Does

The system uses YOLOv5, a state-of-the-art object detection algorithm, to identify and classify hand signs representing the ASL alphabet. This enables real-time translation of sign language into text, making communication more accessible for deaf individuals.

How It Works

The project leverages ZenML to orchestrate a sophisticated machine learning workflow: - **Data Processing:** Automatically downloads and prepares ASL alphabet images from Roboflow - **Data Augmentation:** Enhances training data using Albumentations to improve model robustness - **GPU-Accelerated Training:** Trains the YOLOv5 model on Google Vertex AI with GPU support - **Experiment Tracking:** Records all training metrics and parameters with MLflow - **Deployment:** Packages the model with BentoML for production-ready inference - **Inference Pipeline:** Provides a streamlined way to make predictions on new images

This project showcases how modern MLOps practices can be applied to create AI solutions that make a real difference in people's lives, while demonstrating advanced skills in computer vision, cloud computing, and machine learning engineering.

Unify Your ML and LLM Workflows

Open-source foundation, no vendor lock-in
Works with any infrastructure
Upgrade to managed Pro features