Free MLOps course from DataTalks.Club
-
Updated
Jun 10, 2026 - Jupyter Notebook
#
model-monitoring
Here are 284 public repositories matching this topic...
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
data-science machine-learning data-validation pandas-dataframe jupyter-notebook html-report hacktoberfest data-quality mlops model-monitoring data-drift llm generative-ai llmops
-
Updated
May 2, 2026 - Jupyter Notebook
Open-source observability for your GenAI or LLM application, based on OpenTelemetry
python open-source monitoring metrics ml datascience help-wanted observability good-first-issue artifical-intelligence model-monitoring opentelemetry open-telemetry opentelemetry-python llm good-first-issues generative-ai llmops
-
Updated
Jul 13, 2026 - Python
Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.
python data-science machine-learning deep-learning data-validation pandas-dataframe jupyter-notebook ml pytorch html-report model-validation mlops model-monitoring data-drift
-
Updated
Dec 28, 2025 - Python
nannyml: post-deployment data science in python
visualization python data-science machine-learning monitoring deep-learning jupyter-notebook ml data-analysis machinelearning performance-monitoring performance-estimation mlops model-monitoring data-drift postdeploymentdatascience
-
Updated
Jul 12, 2025 - Python
Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry
javascript open-source typescript monitoring metrics nextjs ml datascience observability model-monitoring opentelemetry opentelemetry-javascript generative-ai llmops
-
Updated
Jun 18, 2026 - TypeScript
⚓ Eurybia monitors model drift over time and securizes model deployment with data validation
python machine-learning data-validation html-report drift domain-classifier production-machine-learning drift-detection model-monitoring data-drift model-drift datadrift-classifier
-
Updated
Mar 23, 2026 - Jupyter Notebook
High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included
rust open-source ml artificial-intelligence datascience observability model-monitoring opentelemetry llm generative-ai llmops
-
Updated
Jul 16, 2026 - Rust
[Not Actively Maintained] Whitebox is an open source E2E ML monitoring platform with edge capabilities that plays nicely with kubernetes
python kubernetes machine-learning monitoring accuracy recall k8s confusion-matrix observability f1-score explainable-ai xai accuracy-score mlops mlflow accuracy-metrics explainability model-monitoring ml-monitoring modelops
-
Updated
Jul 11, 2023 - Python
MLOps workshop with Amazon SageMaker
machine-learning sagemaker amazon-sagemaker sagemaker-deployment tensorflow2 model-monitoring sagemaker-processing sagemaker-studio mlops-workshop sagemaker-pipelines
-
Updated
Mar 25, 2025 - Jupyter Notebook
Free Open-source ML observability course for data scientists and ML engineers. Learn how to monitor and debug your ML models in production.
data-quality-checks data-quality production-machine-learning mlops model-monitoring machine-learning-operations model-performance data-drift ml-pipelines ml-monitoring ml-observability llmops
-
Updated
Dec 17, 2023 - Jupyter Notebook
A curated list of awesome open source tools and commercial products for monitoring data quality, monitoring model performance, and profiling data 🚀
data-science machine-learning deep-learning datascience dataops data-management data-cleaning model-management concept-drift data-quality aiops machine-learning-platform data-monitoring mlops model-monitoring model-performance data-drift model-explainability model-drift
-
Updated
May 7, 2024
A toolkit for evaluating and monitoring AI models in clinical settings
machine-learning deep-learning evaluation healthcare physionet mimic-iii electronic-health-record clinical-research eicu-crd clinical-data clinical-decision-support drift-detection model-monitoring data-drift omop-cdm mimic-iv electronic-medical-record
-
Updated
Jul 27, 2026 - Python
The official python package for NimbleBox. Exposes all APIs as CLIs and contains modules to make ML 🌸
data-science machine-learning model-management model-deployment model-serving ml-infrastructure mlops ml-service model-monitoring ml-platform practical-mlops mlops-workflow mlops-pipeline mlops-tool mlops-automation
-
Updated
Oct 2, 2023 - Python
🚀 Stream inferences of real-time ML models in production to any data lake (Experimental)
-
Updated
Jun 10, 2022 - Python
Version, share, deploy, and monitor models.
-
Updated
Jul 1, 2026 - Python
A Python client to interact with Arize API
performance-monitoring data-quality-monitoring model-monitoring ml-monitoring model-explainability ai-monitoring drift-monitoring ml-observability ai-observability model-performance-management ai-roi
-
Updated
Jul 28, 2026 - Python
"1 config, 1 command from Jupyter Notebook to serve Millions of users", Full-stack On-Premises MLOps system for Computer Vision from Data versioning to Model monitoring and drift detection.
python api docker website machine-learning ui monitoring computer-vision system deep-learning deployment jupyter workspace full-stack data-versioning on-premise mlops drift-detection model-monitoring ml-platform
-
Updated
Aug 12, 2024 - Jupyter Notebook
面向 OpenAI 兼容模型接口的模型状态监控面板，支持公开状态页、后台管理、SQLite 持久化、重试策略和 Docker 部署。
react nodejs docker sqlite self-hosted status-page vite model-monitoring api-monitoring openai-compatible
-
Updated
Apr 7, 2026 - TypeScript
OpenLLM Monitor is a plug-and-play, real-time observability dashboard for monitoring and debugging LLM API calls across OpenAI, Ollama, OpenRouter, and more. Tracks tokens, latency, cost, retries, and lets you replay prompts — fully open-source and self-hostable.
nlp machine-learning sdk ai monitoring openai model-evaluation plug-and-play model-monitoring model-performance llm ollama openllm
-
Updated
Jul 7, 2026 - JavaScript
Improve this page
Add a description, image, and links to the model-monitoring topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the model-monitoring topic, visit your repo's landing page and select "manage topics."