Can Wikipedia Help Offline Reinforcement Learning? (Paper Explained)
#wikipedia #reinforcementlearning #languagemodels
Transformers have come to overtake many domain-targeted custom models in a wide variety of fields, such as Natural Language Processing, Computer Vision, Generative Modelling, and recently also Reinforcement Learning. This paper looks at the Decision Transformer and shows that, surprisingly, pre-training the model on a language-modelling task significantly boosts its performance on Offline Reinforcement Learning. The resulting model achieves higher scores, can get away with less parameters, and exhibits superior scaling properties. This raises many questions about the fundamental connection between the domains of language and RL.
OUTLINE:
0:00 - Intro
1:35 - Paper Overview
7:35 - Offline Reinforcement Learning as Sequence Modelling
12:00 - Input Embedding Alignment & other additions
16:50 - Main experimental results
20:45 - Analysis of the attention patterns across models
32:25 - More experimental results (scaling properties, ablations, etc.)
37:30 - Final th
4 views
3
3
3 months ago 00:01:39 1
The Expansion of NATO Every Year ( 1949 - 2023 )
3 months ago 01:14:39 1
Jimmy Carl Black - When do we get paid?
3 months ago 00:08:34 1
Pet Shop Boys - It’s a Sin (Moreno J Remix) New video other video has a Age-restricted
3 months ago 00:08:07 1
Lipps Inc. - Funkytown (Moreno J Remix)
3 months ago 00:07:34 1
Matia Bazar - Ti Sento (Moreno J Remix)
3 months ago 00:02:34 1
♫ BIGGEST CONCERTS Comparison ♫ 3D
3 months ago 00:15:49 1
Hair Transplant In Hyderabad | Best Cost Clinic & Results Of Hair Transplant Surgery In Hyderabad
3 months ago 00:03:34 1
Hair Transplant In Chennai | Best Clinic Surgeon Cost & Results Of Hair Transplant Of Chennai
3 months ago 00:08:50 1
Europe - The Final Countdown (Moreno J Remix)
3 months ago 00:09:48 1
Louisiana Mandates BIBLICAL LAW In EVERY Classroom
3 months ago 00:10:16 1
Suicide - Dream baby dream (Long Version) (1979) full 12” Single
3 months ago 00:55:45 1
Galaxy S23 📱 Soft Spoken Unboxing ASMR
3 months ago 00:12:49 1
Evidence That Pluto and Triton Are Actually Long Lost Siblings