This is a talk that @rlancemartin gave at a few recent meetups on RAG in the era of long context LLMs. With context windows growing to 1M tokens, there have been many questions about whether RAG is “dead.“ We pull together threads from a few different recent projects to take a stab at addressing this. We review some current limitations with long context LLM fact reasoning & retrieval (using multi-needle in a haystack analysis), but also discuss some likely shifts in the RAG landscape due to expanding context windows (approaches for doc-centric indexing and RAG “flow engineering“).
Slides:
Highlighted references:
1/ Multi-needle analysis w/ @GregKamradt
2/ RAPTOR (@parthsarthi03 et al)
3/ Dense-X / multi-representation indexing (@tomchen0 et al)
4/ Long context embeddings (@JonSaadFalcon, @realDanFu, @simran_s_arora)
5/ Self-RAG (@AkariAsai et al), C-RAG (Shi-Qi Yan et al)
(edited)
Timepoints:
0:20 - Context windows are getting longer
2:10 - Multi-needle in a haystack
9:30 - How might RAG change?
12:00 - Query analysis
13:07 - Document-centric indexing
16:23 - Self-reflective RAG
19:40 - Summary
1 view
281
71
5 months ago 00:03:19 1
Simon & Marianna Khorolskiy – Не вините Бога
5 months ago 00:04:02 1
Cola - Pallor Tricks (Official Music Video)
5 months ago 00:17:20 1
Official SHOCKED By What JUST EMERGED In Alaska!
5 months ago 00:03:18 1
Rag’n’Bone Man - Human (Official Video)
5 months ago 00:08:27 1
How I eliminated the constant stimulation in my life. (and I feel so much better!)
5 months ago 00:03:39 1
The White Stripes - The Hardest Button To Button (Official Music Video)
5 months ago 00:17:02 1
How to Write Letters for Children - Teaching Writing ABC for Preschool - Alphabet for Kids
5 months ago 00:02:50 1
Calvin Harris, Rag’n’Bone Man - Lovers In A Past Life (Official Video)
5 months ago 00:00:51 2
Arcade Paradise VR | Meta Quest Release Date Trailer
6 months ago 00:04:47 1
The Entertainer
6 months ago 00:05:02 1
Duran Duran - New Moon On Monday (Official Music Video)
6 months ago 01:10:48 1
Live from Grey Fox Bluegrass Festival (full set) - July 20, 2019 l Tommy Emmanuel
6 months ago 01:01:52 1
Nokie Edwards (the Ventures) Guitar Concert - full show Official rock ’n roll / country music video
6 months ago 00:03:11 1
Chase Atlantic - ALEYUH (Official Music Video)
6 months ago 00:18:48 1
Every performance of SENSATIONAL Winner MO ADENIRAN on The Voice UK!
6 months ago 00:04:50 1
Why The U.S Confederacy Still Exists, but in Brazil
6 months ago 00:05:02 1
The Unexpected Silence: A Summer Without Rod Wave
6 months ago 00:04:41 1
Режу старые рубашки и шью из лоскутов к Пасхе. Лоскутное шитье, квилт, апликация.
6 months ago 00:21:08 1
RAG for long context LLMs
6 months ago 00:02:49 1
Für Elise with a RagTime twist
6 months ago 00:18:14 1
💈ASMR BARBER - Perfect SKIN FADE tutorial!
6 months ago 01:32:49 1
The GREAT Muammar Gaddafi documentary (GOLD DINAR)
6 months ago 00:44:24 1
CIA Covers Up Nord Stream Bombing & Corruption Continues in Ukraine - Brian Rose & Seymour Hersh
6 months ago 00:08:48 1
He lay alone like a rag, surrounded by flies, Inability to open eyes...