hub / github.com/datastaxdevs/conference-2024-devoxx

github.com/datastaxdevs/conference-2024-devoxx @main

Chat with this repo

repository ↗ · DeepWiki ↗ · + Follow

289 symbols 838 edges 85 files ⚖ custom 68 documented · 24% ● updated 16mo ago★ 611 open issues

Browse by type

⨍ Functions 185◇ Types & classes 104

What it actually does AI analysis from the code graph — generated when you open this

loading…

README

🧑🏻‍💻 🧑🏾‍💻 From naive to advanced RAG: The complete guide 👩🏿‍💻 👩‍💻

ℹ️ About this Session

It’s easy to get started with Retrieval Augmented Generation, but you’ll quickly be disappointed with the generated answers: inaccurate or incomplete, missing context or outdated information, bad text chunking strategy, not the best documents returned by your vector database, and the list goes on.

After meeting thousands of developers across Europe, we’ve explored those pain points, and will share with you how to overcome them. As part of the team building a vector database we are aware of the different flavors of searches (semantic, meta-data, full text, multimodal) and embedding model choices. We have been implementing RAG pipelines across different projects and frameworks and are contributing to LangChain4j.

In this deep-dive, we will examine various techniques using LangChain4j to bring your RAG to the next level: with semantic chunking, query expansion & compression, metadata filtering, document reranking, data lifecycle processes, and how to best evaluate and present the results to your users.

⏲️ Duration : 3 hours

🎓 Level Intermediate

📋 Table of Demos

Extension points exported contracts — how you extend this code

Stemmer (Interface)

A language stemmer. [4 implementers]

devoxx-rag-naive-to-advanced/src/main/java/devoxx/rag/rerank/bm25/stemmer/Stemmer.java

RelevanceChecker (Interface)

Evaluate how an embedding is relevant. @param item to validates, it could be the embeddings or the text chunks [3 implementers]

devoxx-rag-naive-to-advanced/src/main/java/devoxx/rag/evaluation/relevance/RelevanceChecker.java

RankedResultsEvaluator (Interface)

Interface for evaluating ranked results. [2 implementers]

devoxx-rag-naive-to-advanced/src/main/java/devoxx/rag/evaluation/RankedResultsEvaluator.java

Similarity (Interface)

(no doc) [3 implementers]

devoxx-rag-naive-to-advanced/src/main/java/devoxx/rag/similarity/Similarity.java

Assistant (Interface)

This is an "AI Service". It is a Java service with AI capabilities/features. It can be integrated into your code like an

devoxx-rag-naive-to-advanced/src/main/java/devoxx/rag/Assistant.java

browse all types & interfaces →

Core symbols most depended-on inside this repo

↓ 13 filesBM25

BM25 (Best Matching 25) is a ranking function used by search engines to rank matching documents according to their relevance to a …

devoxx-rag-naive-to-advanced/src/main/java/devoxx/rag/rerank/bm25/BM25.java

↓ 12 filesReciprocalRankFusion

Implements Reciprocal Rank Fusion (RRF) to combine ranked results.

devoxx-rag-naive-to-advanced/src/main/java/devoxx/rag/rerank/rrf/ReciprocalRankFusion.java

↓ 6 filesSimilarity

devoxx-rag-naive-to-advanced/src/main/java/devoxx/rag/similarity/Similarity.java

↓ 4 filesRelevanceChecker

Evaluate how an embedding is relevant. @param item to validates, it could be the embeddings or the text chunks depending on the …

devoxx-rag-naive-to-advanced/src/main/java/devoxx/rag/evaluation/relevance/RelevanceChecker.java

↓ 3 filesStemmer

A language stemmer.

devoxx-rag-naive-to-advanced/src/main/java/devoxx/rag/rerank/bm25/stemmer/Stemmer.java

↓ 3 filesRankedResultsEvaluator

Interface for evaluating ranked results.

devoxx-rag-naive-to-advanced/src/main/java/devoxx/rag/evaluation/RankedResultsEvaluator.java

browse all functions →

Shape

Method 185

Class 90

Interface 12

Enum 2

Languages

Java100%

Modules by API surface

devoxx-rag-naive-to-advanced/src/test/java/devoxx/rag/AbstractDevoxxTest.java15 symbols

devoxx-rag-naive-to-advanced/src/main/java/devoxx/rag/rerank/bm25/BM25.java11 symbols

devoxx-rag-naive-to-advanced/src/test/java/devoxx/rag/_4_advanced_rag_query/_49_agentic_RAG.java9 symbols

devoxx-rag-naive-to-advanced/src/test/java/devoxx/rag/_1_introduction/_10_chat_language_model.java8 symbols

devoxx-rag-naive-to-advanced/src/test/java/devoxx/rag/_4_advanced_rag_query/_48_sample_function_calling.java7 symbols

devoxx-rag-naive-to-advanced/src/test/java/devoxx/rag/_4_advanced_rag_query/_48_2_sample_function_calling_weather.java7 symbols

devoxx-rag-naive-to-advanced/src/test/java/devoxx/rag/_3_advanced_rag_ingestion/_37_hypothetical_questions_embedding.java7 symbols

devoxx-rag-naive-to-advanced/src/test/java/devoxx/rag/_3_advanced_rag_ingestion/_30_loader_and_parsers.java7 symbols

devoxx-rag-naive-to-advanced/src/test/java/devoxx/rag/_4_advanced_rag_query/_45_2_vectordb_similarity.java6 symbols

devoxx-rag-naive-to-advanced/src/main/java/devoxx/rag/rerank/bm25/stemmer/StemmerSnowBall.java6 symbols

devoxx-rag-naive-to-advanced/src/main/java/devoxx/rag/rerank/bm25/Bm25ScoringModel.java6 symbols

devoxx-rag-naive-to-advanced/src/main/java/devoxx/rag/evaluation/RankedResults.java6 symbols

For agents

$ claude mcp add conference-2024-devoxx \
  -- python -m otcore.mcp_server <graph>

⬇ download graph artifact

github.com/datastaxdevs/conference-2024-devoxx @main

🧑🏻‍💻 🧑🏾‍💻 From naive to advanced RAG: The complete guide 👩🏿‍💻 👩‍💻

📋 Table of Demos

Extension points exported contracts — how you extend this code

Core symbols most depended-on inside this repo

Shape

Languages

Modules by API surface

For agents

Ask about this repo answers extend the page