Home Creators Posts Import Register Favorites Logout
haven't archived this post yet. have a subscription? use the importer!

Content

How do you get a reinforcement learning agent to do what you want, when you can't write a reward function that specifies it?

https://www.youtube.com/watch?v=PYylPRX6z4Q

Files

Previews only

Training AI Without Writing A Reward Function, with Reward Modelling

How do you get a reinforcement learning agent to do what you want, when you can't actually write a reward function that specifies what that is? The paper: https://arxiv.org/pdf/1706.03741.pdf The blogpost: https://openai.com/blog/deep-reinforcement-learning-from-human-preferences/ Thanks to my wonderful patrons: https://www.patreon.com/robertskmiles Thanks to my patrons: James Gladamas Steef Scott Worley Jordan Medina Simon Strandgaard JJ Hepboin Pedro A Ortega Said Polat Chris Canal Jake Ehrlich Kellen lask Francisco Tolmasky Michael Andregg David Reid Robert Daniel Pickard Peter Rolf Chad Jones Richárd Nagyfi Jason Hise Phil Moyer Shevis Johnson Erik de Bruijn Alec Johnson Clemens Arbesser Ludwig Schubert Bryce Daifuku Allen Faure Eric James Qeith Wreid https://www.patreon.com/robertskmiles https://www.patreon.com/robertskmiles https://www.patreon.com/robertskmiles Jonatan R Ingvi Gautsson Michael Greve Julius Brash Tom O'Connor Robin Green Laura Olds Jon Halliday Paul Hobbs Jeroen De Dauw Lupuleasa Ionuț Tim Neilson Eric Scammell Igor Keller Ben Glanton anul kumar sinha Sean Gibat Cooper Lawton Will Glynn Tyler Herrmann Tomas Sayder Ian Munro Jérôme Beaulieu Nathan Fish Taras Bobrovytsky Anne Buit Vaskó Richárd Sebastian Birjoveanu Euclidean Plane Andrew Harcourt DGJono robertvanduursen Dmitri Afanasjev Marcel Ward Andrew Weir Ben Archer Kabs Miłosz Wierzbicki Tendayi Mawushe Jannik Olbrich Anne Kohlbrenner Jussi Männistö Wr4thon Martin Ottosen Archy de Berker Marc Pauly Andy Kobre Brian Gillespie Poker Chen Kees Darko Sperac Truls Paul Moffat Anders Öhrt Marco Tiraboschi Michael Kuhinica Fraser Cain Robin Scharf Seth Brothwell Kasper Schnack Klemen Slavic Patrick Henderson Oct todo22 Melisa Kostrzewski Hendrik Daniel Munter Graham Henry Duncan Orr Bryan Egan Robert Hildebrandt James Fowkes Alan Bandurka Ben H Tatiana Ponomareva Michael Bates Simon Pilkington Dion Gerald Bridger Petr Smital Daniel Kokotajlo Fionn Yuchong Li Diagon Parker Lund Paul Emmerich Russell schoen Andreas Blomqvist Bertalan Bodor David Morgan Jeremy Ben Schultz Zannheim Daniel Eickhardt lyon549 HD Ihor Mukha 14zRobot Ivan Arne Strasser Jason Cherry Igor (Kerogi) Kostenko Isaac Boates Thomas Dingemanse Davy Ker Alexander Brown Devon Bernard Ted Stokes James Helms Matheson Bayley

Comments

Anonymous

Excellent, mate. This felt dense and meaty in a really good way - I know it's only a couple of minutes longer than a lot of your videos, but it felt a lot is packed in there. The concepts chained together really nicely, and the gags were top notch. Looking forward to the follow-up video. Thanks!

Anonymous

In the spirit of the model outlined: - You are the agent. - A provisional reward function to which you referred made you focus on integrity and Patreon. - To me as the human this looks like good behaviour by the agent.