Excited to announce Swiftide 0.12 π A Rust library for building AI applications using retrieval augmented generation.
Retrieving the most relevant information for a given query is the key challenge in when building AI applications. Research and our own experience shows that similarity search on vectors is not enough. The idea behind hybrid search is fairly simple:
Retrieve n documents with similarity search
Retrieve n documents with another kind of search (ie full text, sparse vectors)
Rerank the documents for relevancy
Take the top k documents
Swiftide can now do hybrid search with #Qdrant, supports filters in search, load parquet files for indexing (i.e. from #HuggingFace) and is a lot faster!
Trumpets and a big thanks to @ephraimkunz for his first contribution! Read the full release post here, check us out on github
Top comments (0)