
Evidently AI is an open-source platform for evaluating, testing, and monitoring machine learning and large language models, focused on ensuring the quality, safety, and reliability of AI systems in production.
It provides evaluation and testing for ML models and LLMs, monitoring of data and model performance, and generation of visual reports, with support for specialized capabilities such as RAG system testing and adversarial testing.
Primarily targeted at data scientists, ML engineers, algorithm researchers, and enterprise tech teams that need to deploy and monitor reliable AI solutions.
Evidently AI offers a free open-source version (Python library) and also provides Evidently Cloud, a paid cloud service platform, as well as customized consulting services.
By continuously tracking data drift, prediction quality, and other metrics, and using built-in test suites and visualization dashboards, helping users promptly detect changes in model performance and potential issues.
Opinly AI is an AI-powered competitive intelligence and SEO growth platform that automates monitoring of competitor data and provides actionable insights to help businesses optimize their marketing strategies and boost search traffic.
Confident AI is a platform focused on evaluating and observability for large language models, helping engineers and product teams systematically test, monitor, and optimize the performance and reliability of their AI applications.

Lightly Vision AI is a computer vision–focused intelligent data management and model training platform designed to boost AI development efficiency and model performance by improving data quality. It provides end-to-end tools—from data selection and annotation to model training and edge deployment—helping machine learning teams handle large-scale vision data more efficiently.

Lunary AI is a platform for AI application developers that focuses on observability, prompt management, and performance evaluation tools. It helps teams build, monitor, and optimize AI applications in production, boosting development efficiency and reliability.

Latitude AI is an open-source LLM development platform for product teams, designed to help you build, deploy, and operate reliable AI applications, lowering the technical barrier to adopting large language models.

Openlayer AI is a unified AI governance and observability platform designed to help enterprises securely and compliantly build, test, deploy, and monitor machine learning and large language model systems, boosting deployment confidence and operational efficiency.

OpenLIT AI is an open-source observability platform based on OpenTelemetry, purpose-built for generative AI and LLM applications, helping developers monitor, debug, and optimize the performance and cost of their AI workloads.

Freeplay AI is a development and operations platform for enterprise AI engineering teams, focused on helping teams efficiently build, test, monitor and optimize applications powered by large language models. The platform provides collaborative development, production observability and continuous optimization tools to standardize workflows and improve the reliability and iteration speed of AI applications.
Laminar AI is an open-source AI engineering and observability platform that helps developers build, monitor, evaluate, and optimize applications and agents based on large language models.

Langtrace AI is an open-source observability and evaluation platform that helps developers monitor, debug, and optimize applications built on large language models, turning AI prototypes into reliable enterprise-grade products.