Tom Schaul

Cited by

	All	Since 2016
Citations	14198	12995
h-index	34	32
i10-index	59	45

4600

2300

1150

3450

20102011201220132014201520162017201820192020202165 114 170 149 221 353 528 1132 2308 3381 4530 1048

Public access

View all

21 articles

0 articles*

available

not available

Based on funding mandates

Co-authors

David SilverGoogle DeepMindVerified email at google.com
Juergen SchmidhuberThe Swiss AI Lab IDSIA / USI & SUPSIVerified email at idsia.ch
Hado van HasseltResearch Scientist, DeepMind; Honorary Professor, UCLVerified email at google.com
Daan WierstraPrincipal Scientist, DeepMindVerified email at google.com
Nando de FreitasCIFAR & DeepMindVerified email at google.com
Tobias GlasmachersVerified email at idsia.ch
Julian TogeliusAssociate Professor of Computer Science and Engineering, New York University; co-founder, modl.aiVerified email at nyu.edu
Rémi MunosDeepMindVerified email at inria.fr
Joseph ModayilComputing Science, University of AlbertaVerified email at cs.ualberta.ca
koray kavukcuogluDeepMindVerified email at kavukcuoglu.org
Will DabneyDeepMindVerified email at google.com
Andre BarretoResearch Scientist, Google DeepMindVerified email at google.com
Simon LucasResearch Scientist, Facebook; Professor of Artificial Intelligence, Queen Mary University of LondonVerified email at qmul.ac.uk
Marc LanctotResearch Scientist, Google DeepMindVerified email at google.com
Max JaderbergDeepMindVerified email at robots.ox.ac.uk
Jan PetersProfessor for Intelligent Autonomous Systems at Technische Universität DarmstadtVerified email at ias.tu-darmstadt.de
Alexander (Sasha) VezhnevetsResearch Scientist, Google DeepMindVerified email at google.com
Marc G. BellemareGoogle BrainVerified email at google.com
Simon OsinderoSenior Staff Scientist @ DeepMindVerified email at google.com
Yann LeCunChief AI Scientist at Facebook & Silver Professor at the Courant Institute, New York UniversityVerified email at cs.nyu.edu

Tom Schaul

Senior Staff Research Scientist, DeepMind

Verified email at nyu.edu - Homepage

Reinforcement Learning Neural Networks Deep Learning Deep Reinforcement Learning Game AI


Title Sort by citations Sort by year Sort by title	Cited by Cited by	Year
Prioritized Experience Replay T Schaul, J Quan, I Antonoglou, D Silver International Conference on Learning Representations (ICLR), 2016	1907	2016
Dueling Network Architectures for Deep Reinforcement Learning Z Wang, T Schaul, M Hessel, H van Hasselt, M Lanctot, N de Freitas International Conference on Machine Learning (ICML), 2016	1719	2016
Learning to learn by gradient descent by gradient descent M Andrychowicz, M Denil, S Gomez, MW Hoffman, D Pfau, T Schaul, ... Neural Information Processing Systems (NIPS), 2016	1143	2016
Rainbow: Combining Improvements in Deep Reinforcement Learning M Hessel, J Modayil, H Van Hasselt, T Schaul, G Ostrovski, W Dabney, ... AAAI Conference on Artificial Intelligence, 2018	898	2018
Grandmaster level in StarCraft II using multi-agent reinforcement learning O Vinyals, I Babuschkin, WM Czarnecki, M Mathieu, A Dudzik, J Chung, ... Nature 575 (7782), 350–354, 2019	744	2019
Reinforcement learning with unsupervised auxiliary tasks M Jaderberg, V Mnih, WM Czarnecki, T Schaul, JZ Leibo, D Silver, ... International Conference on Learning Representations (ICLR), 2017	735	2017
Unifying Count-Based Exploration and Intrinsic Motivation MG Bellemare, S Srinivasan, G Ostrovski, T Schaul, D Saxton, R Munos Neural Information Processing Systems (NIPS), 2016	721	2016
Universal value function approximators T Schaul, D Horgan, K Gregor, D Silver International Conference on Machine Learning (ICML-15), 1312-1320, 2015	519	2015
StarCraft II: A New Challenge for Reinforcement Learning O Vinyals, T Ewalds, S Bartunov, P Georgiev, AS Vezhnevets, M Yeo, ... arXiv preprint arXiv:1708.04782, 2017	490	2017
Feudal networks for hierarchical reinforcement learning AS Vezhnevets, S Osindero, T Schaul, N Heess, M Jaderberg, D Silver, ... International Conference on Machine Learning (ICML), 2017	454	2017
Deep Q-learning from Demonstrations T Hester, M Vecerik, O Pietquin, M Lanctot, T Schaul, B Piot, D Horgan, ... AAAI Conference on Artificial Intelligence, 2018	442	2018
PyBrain T Schaul, J Bayer, D Wierstra, Y Sun, M Felder, F Sehnke, T Rückstieß, ... Journal of Machine Learning Research 11 (Feb), 743-746, 2010	431	2010
No more pesky learning rates T Schaul, S Zhang, Y LeCun International Conference on Machine Learning (ICML'13), 2013	405	2013
Natural evolution strategies D Wierstra, T Schaul, J Peters, J Schmidhuber IEEE Congress on Evolutionary Computation (IEEE World Congress on …, 2008	302	2008
Natural evolution strategies D Wierstra, T Schaul, T Glasmachers, Y Sun, J Peters, J Schmidhuber The Journal of Machine Learning Research 15 (1), 949-980, 2014	289	2014
AlphaStar: Mastering the Real-Time Strategy Game StarCraft II O Vinyals, I Babuschkin, J Chung, M Mathieu, M Jaderberg, W Czarnecki, ... (DeepMind blog), 2019	288	2019
Successor features for transfer in reinforcement learning A Barreto, W Dabney, R Munos, J Hunt, T Schaul, D Silver, H van Hasselt Neural Information Processing Systems (NIPS), 2017	255	2017
The 2014 General Video Game Playing Competition D Perez, S Samothrakis, J Togelius, T Schaul, S Lucas, A Couëtoux, ... Computational Intelligence and AI in Games, 2015	218*	2015
The predictron: End-to-end learning and planning D Silver, H van Hasselt, M Hessel, T Schaul, A Guez*, T Harley, ... International Conference on Machine Learning (ICML), 2017	194	2017
A video game description language for model-based or interactive learning T Schaul Conference on Computational Intelligence in Games (IEEE-CIG), 1-8, 2013	192	2013

The system can't perform the operation now. Try again later.

Articles 1–20

Citations per year

Duplicate citations

Merged citations

Add co-authorsCo-authors

Upload PDF

Follow this author

Cited by

Co-authors