Decision Transformer: Reinforcement Learning via Sequence Modeling (Research Paper Explained)
#decisiontransformer #reinforcementlearning #transformer
Proper credit assignment over long timespans is a fundamental problem in reinforcement learning. Even methods designed to combat this problem, such as TD-learning, quickly reach their limits when rewards are sparse or noisy. This paper reframes offline reinforcement learning as a pure sequence modeling problem, with the actions being sampled conditioned on the given history and desired future rewards. This allows the authors to use recent advances in sequence modeling using Transformers and achieve competitive results in Offline RL benchmarks.
OUTLINE:
0:00 - Intro & Overview
4:15 - Offline Reinforcement Learning
10:10 - Transformers in RL
14:25 - Value Functions and Temporal Difference Learning
20:25 - Sequence Modeling and Reward-to-go
27:20 - Why this is ideal for offline RL
31:30 - The context length problem
34:35 - Toy example: Shortest path from random walks
41:00 - Discount factors
45:50 - Experimental Results
49:25 - Do you need to know the be
23 views
42
7
4 months ago 02:01:47 1
IL EST TEMPS D’EXPOSER CLAIREMENT LA SUPERCLASSE MONDIALE ET APATRIDE | MICHEL GEOFFROY | GPTV
4 months ago 04:43:51 1
LA RUSSIE DE POUTINE EST-ELLE CONTRÔLÉE PAR LES LOUBAVITCH ? | PIERRE HILLARD | GPTV
4 months ago 02:01:40 1
URGENT : LES LOIS PRO-PÉDOPHILES ARRIVENT TRÈS BIENTÔT ! | LAURENCE KAYSER | GÉOPOLITIQUE PROFONDE
4 months ago 00:06:18 1
Top Metaverse Projects | Metaverse Projects | Crypto Metaverse Projects
4 months ago 00:03:57 1
SPX Options Trading Made Easy: Strategies for Profits!💰
4 months ago 00:04:07 1
SPX Options: My Secret to Earning Over $12K Passively! 💰
4 months ago 00:04:35 1
SPX Options Trading Made Easy: Over 11K+ Profit Strategies! 💰
4 months ago 00:03:16 1
SPX Options Trading: My Secret to Earning Over $12K Passively! 💰
4 months ago 00:03:06 1
How I Earn Over $12K Passively with SPX Options Trading: My Secret! 🔴
4 months ago 00:06:56 1
Optimus Prime helps you overcome your sense of hopelessness...#optimusprime #transformers #hope
4 months ago 00:03:18 1
SPX Options Live Trading: Watch How I Made Over $6,000 in Just 2 Months! 🔴
4 months ago 00:05:15 1
InsideOptions Review: $8000+ Profit with David Chau SPX Strategy!🔴
4 months ago 00:03:15 1
This Buy Sell Indicator Tradingview Gives ACCURATE Signals
4 months ago 00:35:58 1
LGBT, TRANS, WOKE: VERS LA BANALISATION DE LA PÉDOPHILIE ? | LAURENCE KAYSER | GÉOPOLITIQUE PROFONDE
4 months ago 00:14:46 1
Après La Fin Tragique, Catherine Et William Prennent Leur Décision Finale
4 months ago 00:34:14 1
SILENCE Your Ultimate Weapon for Self-Control | The Complete Guide to Stoic Strategy