Draft:MLflow

MLflow
Initial releaseJune 5, 2018 (2018-06-05)
Written inPython, JavaScript, TypeScript, Java, R
TypeAI engineering platform, LLMOps, MLOps
LicenseApache License 2.0
Websitemlflow.org
Repositorygithub.com/mlflow/mlflow

MLflow is an open source platform for machine learning, LLM applications, and AI agents. Originally developed for machine learning lifecycle management, it provides experiment tracking, a model packaging format, a model registry, and model deployment functionality. Later releases expanded the platform to support LLM applications and AI agents, adding tools for observability, evaluation, prompt management, and LLM access control. Originally created by Databricks and first released in June 2018,[1] MLflow is licensed under the Apache License 2.0 and is a Linux Foundation project.[2][3]

Capabilities

Machine learning

For machine learning and deep learning workflows, MLflow covers the development lifecycle from experimentation to deployment. It provides experiment tracking for logging and comparing model parameters, metrics, and files across training runs. Models can be packaged in a standardized format compatible with frameworks including scikit-learn, PyTorch, TensorFlow, and Spark ML, and managed through a model registry.[4][5] MLflow also supports hyperparameter optimization and model serving via REST APIs.

AI agents and LLMs

MLflow 3.0, released in June 2025, added support for building and deploying AI agents and LLM applications.[6][7] According to project documentation, the release introduced tools for capturing execution traces compatible with the OpenTelemetry standard, an evaluation framework measuring response quality using LLM-as-a-judge scoring and human feedback, versioned storage for prompt templates, and an AI gateway for routing requests and controlling access to LLM providers such as OpenAI, Anthropic, and Google Gemini.[8][9]

History

Notable releases
Version Date Notes
0.1.0 June 2018 Initial release, announced at the Databricks Spark+AI Summit.[10][11][12]
1.0 June 2019 Added loss curve tracking, performance improvements, and Windows support.[13][14][15] The Model Registry was introduced shortly thereafter.[16]
2.0 November 2022 Introduced a model evaluation SDK, overhauled UI, and pre-built ML training pipelines.[17][18]
3.0 June 2025 Added tracing, evaluation, prompt management, and gateway features for AI agents and LLM applications.[19][6]

Adoption

MLflow is offered or supported by several vendors and cloud platforms. Databricks, the company that originally created MLflow, offers it as a managed service within its data and AI platform.[20] Amazon Web Services integrated MLflow within Amazon SageMaker,[21] and Azure Machine Learning supports MLflow tracking and model deployment natively.[22] Canonical released Charmed MLflow, an enterprise distribution for Ubuntu.[23] InfoWorld included MLflow in its annual Best Open Source Software awards in 2019[24] and 2021.[25]

References

  1. ^ "MLflow 0.1.0". PyPI. 2018-06-05. Retrieved 2026-03-14.
  2. ^ "LF AI & Data Landscape". Retrieved 2026-03-14.
  3. ^ "MLflow is now a Linux Foundation project". InfoWorld. 2020-06-25. Retrieved 2026-03-14.
  4. ^ Schlegel, Marius; Sattler, Kai-Uwe (2022). "Management of Machine Learning Lifecycle Artifacts: A Survey". ACM SIGMOD Record. Retrieved 2026-03-14.
  5. ^ "Machine learning operations landscape: platforms and tools". Artificial Intelligence Review. Springer Nature. 2025. Retrieved 2026-03-14.
  6. ^ a b "Announcing MLflow 3.0". MLflow. 2025-06-09. Retrieved 2026-03-14.
  7. ^ "Databricks Data + AI Summit 2025: Five takeaways for data professionals, developers". InfoWorld. 2025-06-01. Retrieved 2026-03-14.
  8. ^ "MLflow Tracing". Retrieved 2026-03-14.
  9. ^ "MLflow AI Gateway". Retrieved 2026-03-14.
  10. ^ "Introducing MLflow: An Open Source Machine Learning Platform". Databricks. 2018-06-05. Retrieved 2026-03-14.
  11. ^ "MLflow: A System for Machine Learning Lifecycle Management" (PDF). IEEE Data Engineering Bulletin. 2018. Retrieved 2026-03-14.
  12. ^ "Databricks releases MLflow, runtime for ML and Databricks Delta at Spark + AI Summit". SD Times. 2018-06-06. Retrieved 2026-03-14.
  13. ^ "MLflow 1.0.0". GitHub. Retrieved 2026-03-14.
  14. ^ "Announcing the MLflow 1.0 Release". Databricks. 2019-06-06. Retrieved 2026-03-14.
  15. ^ "Databricks wants one tool to rule all AI systems – coincidentally, its own MLflow tool". The Register. 2019-06-07. Retrieved 2026-03-14.
  16. ^ "Introducing the MLflow Model Registry". Databricks. 2019-10-17. Retrieved 2026-03-14.
  17. ^ "MLflow 2.0.1". GitHub. Retrieved 2026-03-14.
  18. ^ "Announcing Availability of MLflow 2.0". Linux Foundation. Retrieved 2026-03-14.
  19. ^ "MLflow 3.0". GitHub. Retrieved 2026-03-14.
  20. ^ "MLflow guide". Databricks. Retrieved 2026-03-14.
  21. ^ "AWS brings managed open source MLflow to Amazon SageMaker". VentureBeat. Retrieved 2026-03-14.
  22. ^ "MLflow and Azure Machine Learning". Microsoft. Retrieved 2026-03-14.
  23. ^ "Canonical Launches Charmed MLflow to Simplify Management and Maintenance of ML Workflows". InfoQ. 2023-10-01. Retrieved 2026-03-14.
  24. ^ "The best open source software of 2019". InfoWorld. 2019-10-01. Retrieved 2026-03-14.
  25. ^ "The best open source software of 2021". InfoWorld. 2021-10-01. Retrieved 2026-03-14.

Category:AI software Category:Open-source artificial intelligence Category:Software using the Apache license Category:Artificial intelligence Category:Free and open-source software Category:Linux Foundation projects

Content Disclaimer

Informasi ini disarikan dari Wikipedia dan disajikan kembali untuk tujuan edukasi. Konten tersedia di bawah lisensi CC BY-SA 3.0. Kami tidak bertanggung jawab atas ketidakakuratan data yang bersumber dari kontribusi publik tersebut.

  1. The information displayed on this website is sourced in part or in whole from Wikipedia and has been adapted for the purpose of restating it. We strive to provide accurate and relevant information, however:
  2. There is no guarantee of absolute accuracy. Wikipedia is an open, collaborative project that can be edited by anyone, so information is subject to change.
  3. It is not intended to constitute professional advice. The content displayed is for informational and educational purposes only. For important decisions (e.g., medical, legal, or financial), please consult a professional.
  4. Content copyright. Wikipedia is licensed under the Creative Commons Attribution-ShareAlike License (CC BY-SA). This means that content may be reused with appropriate attribution and shared under a similar license.
  5. Responsible use. Any risk arising from the use of information from this website is entirely the responsibility of the user.