DEV Community

Cover image for These 5 Open Source AI Startups are changing the AI Landscape
fast-d3v
fast-d3v

Posted on

These 5 Open Source AI Startups are changing the AI Landscape

With the growing AI Market. We’ve got a lot of changes coming up with us.

Lately, I have been pondering about the latest startups that are making significant progress in various fields. These startups are involved in groundbreaking work, ranging from enhancing data interactivity to exploring the potential of Large Language Models in Operations- a new concept known as LLM Ops. Additionally, I am fascinated by the advancements in search engines and generative AI, which are revolutionizing the way we interact with technology.

Many of them, I’ve seen on DEV.to, and then I thought of trying their projects. I’m surprised by the effort and innovation these companies drive.

Pezzo: Developer-First AI Platform

Pezzo: Developer-First AI Platform

GitHub Repository: Pezzo on GitHub

Website: Pezzo

Description:
Pezzo is an open-source, cloud-native LLMOps platform tailored for developers. It revolutionizes AI operations by offering streamlined prompt design, version management, instant delivery, and more. This platform enables efficient observation and monitoring of AI operations, significant cost and latency reductions, seamless collaboration, and immediate delivery of AI changes.

Key Features:

  • Prompt Management: Centralized management and version control for prompts, allowing instant deployment to production.
  • Observability: Provides detailed insights into AI operations, optimizing spending, speed, and quality.
  • Troubleshooting: Real-time inspection of prompt executions, minimizing debugging efforts.
  • Collaboration: Facilitates synchronized teamwork for impactful AI feature delivery.

Join the Community:
Become a part of Pezzo's innovative journey by joining their Discord community. Contribute to their mission and support them by starring their GitHub repository!

Give Pezzo a Star on GitHub 🌟 and join the revolution in AI operations!

⭐️ Pezzo on GitHub

Swirl: AI-Powered Multi-Source Search Platform

Swirl: AI-Powered Multi-Source Search Platform<br>

GitHub Repository: Swirl on GitHub

Website: Swirl

Description:
Swirl is an innovative open-source software that leverages AI to search across multiple content and data sources simultaneously. It ranks results using AI, fetches the most relevant parts, and employs Generative AI to provide answers derived from your own data. This tool is particularly useful for integrating and extracting valuable insights from various data sources.

Key Features:

  • AI-Driven Search: Simultaneously searches across multiple sources, delivering AI-ranked results.
  • Generative AI Integration: Uses top search results to prompt Generative AI for comprehensive answers.
  • Diverse Data Source Connectivity: Connects to databases (SQL, NoSQL, Google BigQuery), public data services, and enterprise sources like Microsoft 365, Jira, Miro, etc.
  • Customizable and Expandable: Offers a flexible platform for data enrichment, entity analysis, and integrating unstructured data for various applications.

Join the Community:
Engage with the Swirl community and contribute your ideas! Join the Swirl Slack Community, and support their growth by starring their repository.

Star Swirl on GitHub and become part of this exciting AI search evolution! 🌟

⭐️ Swirl on GitHub

DeepEval: LLM Evaluation Framework

DeepEval

GitHub Repository: DeepEval on GitHub

Website: Confident AI

Description:
DeepEval is an open-source evaluation framework for Large Language Models (LLMs). It simplifies evaluating LLM applications, similar to how Pytest operates for unit testing. DeepEval stands out by offering a range of evaluation metrics tailored for LLMs, making it a production-ready alternative for rigorous performance assessment.

Key Features:

  • Diverse Evaluation Metrics: Offers a large variety of metrics evaluated by LLMs or computed via statistical methods and NLP models.
  • Custom Metric Creation: Allows easy creation of custom metrics, seamlessly integrated into DeepEval's ecosystem.
  • Bulk Dataset Evaluation: Facilitates evaluation of entire datasets with minimal coding effort.
  • Integration with Confident AI: Enables instant observability into evaluation results and comparison of different hyperparameters.

Star DeepEval on GitHub and contribute to the advancement of LLM evaluation frameworks! 🌟

⭐️ DeepEval on GitHub

LiteLLM: Universal LLM API Interface

LiteLLM

GitHub Repository: LiteLLM on GitHub

Website: LiteLLM Documentation

Description:
LiteLLM is an open-source tool that enables users to call various LLM APIs using a unified OpenAI format. It supports a wide range of providers like Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate, and more, offering a streamlined approach to work with over 100 LLMs. This tool is essential for simplifying the integration and utilization of different LLMs in a consistent and efficient manner.

Key Features:

  • Universal API Format: Facilitates calling different LLM APIs using the standardized OpenAI format.
  • Wide Range of Supported LLMs: Compatible with numerous LLM providers, including major ones like OpenAI, Azure, Cohere, and HuggingFace.
  • Consistent Output and Exception Mapping: Ensures uniform output structure and maps common exceptions across providers to OpenAI exception types.
  • Ease of Use: Enables bulk operations and simplifies interactions with LLMs, making it more accessible for various applications.

Join the Community:
Get involved with LiteLLM's development and share your improvements! Clone the repository, make your changes, and submit a PR.

Star LiteLLM on GitHub and streamline your work with LLMs today! 🌟

⭐️ LiteLLM on GitHub

Qdrant: High-Performance Vector Database for AI

Qdrant

GitHub Repository: Qdrant on GitHub

Website: Qdrant

Description:
Qdrant is a high-performance, large-scale vector database tailored for the next generation of AI applications. It is a vector similarity search engine and database that provides a production-ready service with an easy-to-use API. Qdrant is particularly effective for neural-network or semantic-based matching, faceted search, and other applications requiring efficient handling of vectors with associated payloads.

Key Features:

  • Rich Data Types and Query Planning: Supports diverse data types and query conditions, including string matching, numerical ranges, geo-locations, and more, with efficient query planning leveraging payload information.
  • Hardware Acceleration and Write-Ahead Logging: Utilizes modern CPU architectures for faster performance and ensures data persistence and reliability.
  • Distributed Deployment: Supports horizontal scaling with multiple Qdrant machines forming a cluster, coordinated through the Raft protocol.
  • Integrations: Easily integrates with platforms like Cohere, DocArray, LangChain, LlamaIndex, and even OpenAI's ChatGPT retrieval plugin.

Join the Community:
Become a part of the Qdrant community and contribute to this innovative project. Join their Discord.
Star Qdrant on GitHub and help shape the future of vector databases in AI! 🌟

⭐️ Qdrant on GitHub


A Heartfelt Thank You

Your interest in exploring and understanding the diverse topics these startups are working on. Being part of their community will surely help you grow and understand different software and artificial intelligence areas.

Top comments (18)

Collapse
 
srbhr profile image
Saurabh Rai

Excellent list of OSS Startups. Some are hiring; readers should check out their communities and GitHub pages.

Collapse
 
fast profile image
fast-d3v

Yeah, thank you for letting me know about it. I'm sure readers will find it helpful.

Collapse
 
forkedsofar profile image
Johann Abberton

Thanks for informing.

Collapse
 
nathan_tarbert profile image
Nathan Tarbert

Nice list. I’m already a fan of Swirl but I’ve also been using Pezzo too. Really cool!

Collapse
 
fast profile image
fast-d3v

Yes, Swirl is awesome and Pezzo is cool as well. Open Source Companies for the win.

Collapse
 
alyonkka profile image
Alyonkka

Awesome!

Collapse
 
fast profile image
fast-d3v

Thanks 🙏

Collapse
 
garrrikkotua profile image
Igor Kotua

Amazing list, thank you! Especially love Swirl and Qdrant, awesome tools

Collapse
 
fast profile image
fast-d3v
Collapse
 
fernandezbaptiste profile image
Bap

🤩 Love this list!

Collapse
 
fast profile image
fast-d3v

Thank you, Quine is also an amazing platform. I'll urge these companies to singn-up and get ready!!

Collapse
 
guybuildingai profile image
Jeffrey Ip

Wow! Can't believe we got featured, creator of DeepEval here :)

Collapse
 
fast profile image
fast-d3v

Yes, DeepEval is an awesome framework, thanks for creating it!!

Collapse
 
ridiculonculator profile image
Sally O • Edited

This is a solid list. I would also recommend:

TruLens for LLM app eval and testing: github.com/truera/trulens
Zilliz (Milvus) for vector database: github.com/milvus-io/milvus
LlamaIndex for app orchestration: github.com/run-llama/llama_index

Collapse
 
krrishdholakia profile image
Krish Dholakia

Nice list! Maintainer of LiteLLM here

Collapse
 
gisakha profile image
Gisakha Giovanni

Nice, which on will hire me?

Collapse
 
uliyahoo profile image
uliyahoo

Hey! love this article. Looking to get in touch with you. Let me know where I can find you :)

Collapse
 
gought profile image
Castore Marchesi

DeepEval:

A simple and easy-to-use API
A wide range of out-of-the-box metrics
Support for custom metrics
The ability to run tests in parallel
The ability to generate reports