Deep Papers
Deep Papers
Arize AI
RAFT: Adapting Language Model to Domain Specific RAG
44 minutes Posted Jun 28, 2024 at 8:00 pm.
0:00
44:01
Download MP3
Show notes
Where adapting LLMs to specialized domains is essential (e.g., recent news, enterprise private documents), we discuss a paper that asks how we adapt pre-trained LLMs for RAG in specialized domains. SallyAnn DeLucia is joined by Sai Kolasani, researcher at UC Berkeley’s RISE Lab (and Arize AI Intern), to talk about his work on RAFT: Adapting Language Model to Domain Specific RAG. RAFT (Retrieval-Augmented FineTuning) is a training recipe that improves an LLM’s ability to answer questions ...