Skip to content

Commit

Permalink
RAG
Browse files Browse the repository at this point in the history
  • Loading branch information
JoseRFJuniorLLMs committed Jul 16, 2024
1 parent 450a71a commit 1cb59bc
Show file tree
Hide file tree
Showing 25 changed files with 103 additions and 211 deletions.
209 changes: 31 additions & 178 deletions .obsidian/workspace.json
Original file line number Diff line number Diff line change
Expand Up @@ -4,162 +4,16 @@
"type": "split",
"children": [
{
"id": "769ca4a09705c16b",
"id": "fc3e78df25d9ccc8",
"type": "tabs",
"children": [
{
"id": "102c8828856b0385",
"id": "f20e6fb70605a945",
"type": "leaf",
"state": {
"type": "markdown",
"type": "image",
"state": {
"file": "RAG/RAG Re-Ranking.md",
"mode": "source",
"source": false
}
}
},
{
"id": "a974719fe1cc1577",
"type": "leaf",
"state": {
"type": "markdown",
"state": {
"file": "Rerank.md",
"mode": "source",
"source": false
}
}
},
{
"id": "79d7e976d5aefe23",
"type": "leaf",
"state": {
"type": "markdown",
"state": {
"file": "Embedding Mode.md",
"mode": "source",
"source": false
}
}
},
{
"id": "0ffcf615f0cbc21b",
"type": "leaf",
"state": {
"type": "markdown",
"state": {
"file": "Generation.md",
"mode": "source",
"source": false
}
}
},
{
"id": "ab7851afd5287f85",
"type": "leaf",
"state": {
"type": "markdown",
"state": {
"file": "Augmentation.md",
"mode": "source",
"source": false
}
}
},
{
"id": "b89d155e74f30af0",
"type": "leaf",
"state": {
"type": "markdown",
"state": {
"file": "Retrieval.md",
"mode": "source",
"source": false
}
}
},
{
"id": "650ae950226baa04",
"type": "leaf",
"state": {
"type": "markdown",
"state": {
"file": "LLM-Generated Content.md",
"mode": "source",
"source": false
}
}
},
{
"id": "e741fa0af705d39b",
"type": "leaf",
"state": {
"type": "markdown",
"state": {
"file": "Structured Data.md",
"mode": "source",
"source": false
}
}
},
{
"id": "9fb7b72f30a1174a",
"type": "leaf",
"state": {
"type": "markdown",
"state": {
"file": "Semi-Structured Data.md",
"mode": "source",
"source": false
}
}
},
{
"id": "534c379a76c45e97",
"type": "leaf",
"state": {
"type": "markdown",
"state": {
"file": "Unstructured Data.md",
"mode": "source",
"source": false
}
}
},
{
"id": "f26fc6ef64c3497f",
"type": "leaf",
"state": {
"type": "markdown",
"state": {
"file": "Nearest Neighbor Search.md",
"mode": "source",
"source": false
}
}
},
{
"id": "4cf08a4a78060b22",
"type": "leaf",
"state": {
"type": "markdown",
"state": {
"file": "Vector Database.md",
"mode": "source",
"source": false
}
}
},
{
"id": "41aca8d94e448ba8",
"type": "leaf",
"state": {
"type": "markdown",
"state": {
"file": "Text Embedding.md",
"mode": "source",
"source": false
"file": "img/20240715214731.png"
}
}
}
Expand Down Expand Up @@ -213,7 +67,7 @@
}
],
"direction": "horizontal",
"width": 300
"width": 400.5
},
"right": {
"id": "5612a97ef8df680b",
Expand All @@ -229,7 +83,7 @@
"state": {
"type": "backlink",
"state": {
"file": "RAG/RAG Re-Ranking.md",
"file": "img/20240715214731.png",
"collapseAll": false,
"extraContext": false,
"sortOrder": "alphabetical",
Expand All @@ -246,7 +100,7 @@
"state": {
"type": "outgoing-link",
"state": {
"file": "RAG/RAG Re-Ranking.md",
"file": "img/20240715214731.png",
"linksCollapsed": false,
"unlinkedCollapsed": true
}
Expand All @@ -269,7 +123,7 @@
"state": {
"type": "outline",
"state": {
"file": "RAG/RAG Re-Ranking.md"
"file": "img/20240715214731.png"
}
}
}
Expand All @@ -290,45 +144,44 @@
"command-palette:Open command palette": false
}
},
"active": "102c8828856b0385",
"active": "fbb748057362cd65",
"lastOpenFiles": [
"Rerank.md",
"img/20240715210016.png",
"README.md",
"RAG/Advanced RAG LimaIndex & Claude 3.md",
"RAG/Adaptive RAG.md",
"LLMs/Self-Learning LLMs.md",
"LLMs/Methods for improving LLMs.md",
"LLMs/LLMs APP.md",
"LLMs/How LLMs Are Built.md",
"LLMs/Enhancing LLMs.md",
"LLMs/Components of an LLMs.md",
"LLMs/Agent LLMs Calls.md",
"AUC.md",
"AI frameworks.md",
"img/rag_enhancement.png",
"img/20240716000730.png",
"RAG/RAG Re-Ranking.md",
"Rerank.md",
"Pasted image 20240716000853.png",
"img/Pasted image 20240716000730.png",
"LLMs/LLMs APP.md",
"RAG/RAG vs FineTuning.md",
"img/Pasted image 20240716000624.png",
"img/20240716000624.png",
"Accuracy.md",
"RAG/Advanced RAG LimaIndex & Claude 3.md",
"FineTuning",
"img/Pasted image 20240716000446.png",
"img/20240716000446.png",
"RAG/Text Splitting RAG.md",
"NLP/Service used for NLP in Microsoft Azure.md",
"img/Pasted image 20240716000406.png",
"img/20240716000406.png",
"RAG/RAG Stack.md",
"Embedding Mode.md",
"img/Pasted image 20240716000053.png",
"img/20240716000053.png",
"RAG/RAG implementing.md",
"Generation.md",
"Augmentation.md",
"Retrieval.md",
"img/Pasted image 20240715235811.png",
"img/20240715235811.png",
"RAG/RAG Retrieval Sources.md",
"LLM-Generated Content.md",
"Structured Data.md",
"Semi-Structured Data.md",
"Unstructured Data.md",
"img/Pasted image 20240715235013.png",
"LLMs/LLMs, chunking strategies.md",
"img/Pasted image 20240715234606.png",
"RAG/RAG Using Llama 3.md",
"img/Pasted image 20240715222653.png",
"RAG/AI Agents Use Case.md",
"RAG/Systematic RAG Workflow.md",
"LLMs/Agent LLMs Calls.md",
"RAG/Text & Knowledge Graph Embeddings.md",
"RAG/Two-Stage Rretrieval System.md",
"img/20240715235013.png",
"LangChain",
"LLMs",
"NLP",
Expand Down
2 changes: 1 addition & 1 deletion LLMs/Agent LLMs Calls.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
![[Pasted image 20240715222340.png]]LLM Agents are a capable framework bringing LLM performance to the next level.
![[20240715222340.png]]LLM Agents are a capable framework bringing LLM performance to the next level.

Agent framework leverages a Large Language Model to act as a decision engine capable of solving complex tasks by multi-stage reasoning.

Expand Down
2 changes: 1 addition & 1 deletion LLMs/Developing an LLMs.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
![[Pasted image 20240715221155.png]]
![[20240715221155.png]]

Stage 1: Building
Stage 2: Pre-training
Expand Down
2 changes: 1 addition & 1 deletion LLMs/LLMs APP.md
Original file line number Diff line number Diff line change
@@ -1 +1 @@
![[Pasted image 20240716000730.png]]
![[20240716000730.png]]
2 changes: 1 addition & 1 deletion LLMs/LLMs, chunking strategies.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
![[Pasted image 20240715234606.png]]
![[20240715234606.png]]

[[LLMs, chunking strategies]]

2 changes: 1 addition & 1 deletion LLMs/LLMs.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,4 +13,4 @@ Chunking
Embedding
Vector Database

![[Pasted image 20240715210016.png]]
![[20240715210016.png]]
2 changes: 1 addition & 1 deletion LLMs/Self-Learning LLMs.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
![[Pasted image 20240715215838.png]]
![[20240715215838.png]]

Self-learning LLM framework enables an LLM to independently learn previously unknown knowledge through self-assessment of their own hallucinations.

Expand Down
2 changes: 1 addition & 1 deletion NLP/Semantic Search.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
![[Pasted image 20240715221527.png]]
![[20240715221527.png]]


[[Text Embedding]]: The first step is to convert the text data (documents, queries, etc.) into high-dimensional vector representations using a pre-trained language model like BERT, GPT, or custom models. These vectors capture the semantic meaning of the text in a dense numerical form.
Expand Down
2 changes: 1 addition & 1 deletion RAG/AI Agents Use Case.md
Original file line number Diff line number Diff line change
@@ -1 +1 @@
![[Pasted image 20240715222611.png]]
![[20240715222611.png]]
2 changes: 1 addition & 1 deletion RAG/Advanced RAG LimaIndex & Claude 3.md
Original file line number Diff line number Diff line change
@@ -1 +1 @@
![[Pasted image 20240716000446.png]]
![[20240716000446.png]]
2 changes: 1 addition & 1 deletion RAG/Advanced RAG Techniques.md
Original file line number Diff line number Diff line change
@@ -1 +1 @@
![[Pasted image 20240715220423.png]]
![[20240715220423.png]]
2 changes: 1 addition & 1 deletion RAG/Advanced RAG.md
Original file line number Diff line number Diff line change
@@ -1 +1 @@
![[Pasted image 20240715214731.png]]
![[20240715214731.png]]
2 changes: 1 addition & 1 deletion RAG/Knowledge Graph RAG with SingleStore.md
Original file line number Diff line number Diff line change
@@ -1 +1 @@
![[Pasted image 20240715221947.png]]
![[20240715221947.png]]
2 changes: 1 addition & 1 deletion RAG/Modular RAG Framework.md
Original file line number Diff line number Diff line change
@@ -1 +1 @@
![[Pasted image 20240715220117.png]]
![[20240715220117.png]]
2 changes: 1 addition & 1 deletion RAG/RAG Retrieval Sources.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
![[Pasted image 20240715235013.png]]
![[20240715235013.png]]

[[Unstructured Data]] (Text): This includes plain text documents, web pages, and other free-form textual sources.

Expand Down
2 changes: 1 addition & 1 deletion RAG/RAG Stack.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
![[Pasted image 20240716000053.png]]
![[20240716000053.png]]

But to make RAG work perfectly, here are some key points to consider:
1. Quality of External Knowledge Source
Expand Down
2 changes: 1 addition & 1 deletion RAG/RAG Using Llama 3.md
Original file line number Diff line number Diff line change
@@ -1 +1 @@
![[Pasted image 20240715222653.png]]
![[20240715222653.png]]
2 changes: 1 addition & 1 deletion RAG/RAG implementing.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
![[Pasted image 20240715235811.png]]
![[20240715235811.png]]

Retrieval component, Augmentation component, Generation component.

Expand Down
2 changes: 1 addition & 1 deletion RAG/RAG vs FineTuning.md
Original file line number Diff line number Diff line change
@@ -1 +1 @@
![[Pasted image 20240716000624.png]]
![[20240716000624.png]]
2 changes: 1 addition & 1 deletion RAG/Systematic RAG Workflow.md
Original file line number Diff line number Diff line change
@@ -1 +1 @@
![[Pasted image 20240715222528.png]]
![[20240715222528.png]]
2 changes: 1 addition & 1 deletion RAG/Text & Knowledge Graph Embeddings.md
Original file line number Diff line number Diff line change
@@ -1 +1 @@
![[Pasted image 20240715222256.png]]
![[20240715222256.png]]
2 changes: 1 addition & 1 deletion RAG/Text Splitting RAG.md
Original file line number Diff line number Diff line change
@@ -1 +1 @@
![[Pasted image 20240716000406.png]]
![[20240716000406.png]]
2 changes: 1 addition & 1 deletion RAG/Two-Stage Rretrieval System.md
Original file line number Diff line number Diff line change
@@ -1 +1 @@
![[Pasted image 20240715222219.png]]
![[20240715222219.png]]
2 changes: 1 addition & 1 deletion RAG/Types of Embedding Models for RAG.md
Original file line number Diff line number Diff line change
@@ -1 +1 @@
![[Pasted image 20240715220454.png]]
![[20240715220454.png]]
Loading

0 comments on commit 1cb59bc

Please sign in to comment.