Milvus is an open-source vector database designed for building Retrieval-Augmented Generation (RAG) applications. By combining Milvus with SambaNova LLMs, you can create scalable, high-performance RAG pipelines.

​
Prerequisites

​
Installation and setup

  1. Create a virtual environment
python -m venv .venv
source .venv/bin/activate
  1. Install dependencies
pip install openai
pip install pymilvus
pip install langchain-sambanova
  1. Set your SambaNova API key
export api_key="your-sambanova-api-key"

​
Example use cases

  • Build Retrieval-Augmented Generation (RAG) systems
  • Store and query embeddings efficiently
  • Combine SambaNova LLMs with Milvus for scalable knowledge retrieval

​
Example notebooks

You can explore example notebooks to learn how to build RAG systems with SambaCloud and Milvus: These guides walk you through setting up and integrating the systems to create a functional RAG application.