How to Set Up Basic RAG

Modified on Sun, 18 Feb, 2024 at 5:55 AM

 To set up basic RAG via Vext, you need to perform three tasks:

  1. Add a Data Set and a Data Source
  2. Add a "Search Data Set" action
  3. Add a "Generate a Response" action


Add a Data Set and a Data Source

The most important piece of an RAG (retrieval augmented generation) is to import the data/file. You can check here for the walk through.


Add a "Search Data Set" action to the AI Project

Once you've added a Data Set and at least one Data Source, you can now create (or select) an AI project and add a "Search Data Set" action to refer to the Data Set. You can check here for the walk through.


Add a "Generate a Response" action to the AI Project

You will need to add an LLM behind the "Search Data Set" action to generate meaningful response based on the retrieved data. You can check here for the walk through.



Bonus: Why Adding LLM behind the "Search Data Set" action?

Vext "AI Project" works like a chain, each action's output will become the input for the next action. So for a standard RAG, it looks like:

  1. User input
  2. Search Data Set using user input
  3. Provide retrieved data to LLM for generation
  4. Output

So it's critical to put the LLM behind the data retrieval action so it has the retrieved data for the question.

Was this article helpful?

That’s Great!

Thank you for your feedback

Sorry! We couldn't be helpful

Thank you for your feedback

Let us know how can we improve this article!

Select at least one of the reasons
CAPTCHA verification is required.

Feedback sent

We appreciate your effort and will try to fix the article