Tom Schaul

Cited by

	All	Since 2017
Citations	22589	20792
h-index	40	38
i10-index	68	55

6000

3000

1500

4500

201020112012201320142015201620172018201920202021202261 108 157 156 229 366 532 1158 2361 3494 4849 5712 3179

Public access

View all

23 articles

0 articles

available

not available

Based on funding mandates

Co-authors

Hado van HasseltResearch Scientist, DeepMind; Honorary Professor, UCLVerified email at google.com
David SilverDeepMind, UCLVerified email at google.com
Juergen SchmidhuberKing Abdullah University of Science and Technology / The Swiss AI Lab, IDSIA / University of LuganoVerified email at kaust.edu.sa
Daan WierstraPrincipal Scientist, DeepMindVerified email at google.com
Nando de FreitasCIFAR & DeepMindVerified email at google.com
Tobias GlasmachersVerified email at idsia.ch
Julian TogeliusAssociate Professor of Computer Science and Engineering, New York University; co-founder, modl.aiVerified email at nyu.edu
Will DabneyDeepMindVerified email at google.com
Joseph ModayilComputing Science, University of AlbertaVerified email at cs.ualberta.ca
Andre BarretoResearch Scientist, Google DeepMindVerified email at google.com
koray kavukcuogluDeepMindVerified email at kavukcuoglu.org
Rémi MunosDeepMindVerified email at inria.fr
Simon LucasResearch Scientist, Meta; Professor of Artificial Intelligence, Queen Mary University of LondonVerified email at qmul.ac.uk
Max JaderbergIsomorphic LabsVerified email at robots.ox.ac.uk
Simon OsinderoSenior Staff Scientist @ DeepMindVerified email at google.com
Wojciech Marian CzarneckiIsomorphic LabsVerified email at google.com
Diana BorsaDeepMindVerified email at google.com
Jan PetersProfessor for Intelligent Autonomous Systems at Technische Universität DarmstadtVerified email at ias.tu-darmstadt.de
Marc G. BellemareGoogle BrainVerified email at google.com
Yann LeCunChief AI Scientist at Facebook & Silver Professor at the Courant Institute, New York UniversityVerified email at cs.nyu.edu

Tom Schaul

Senior Staff Scientist, DeepMind

Verified email at nyu.edu - Homepage

Reinforcement Learning Neural Networks Deep Learning Deep Reinforcement Learning Game AI


Title Sort by citations Sort by year Sort by title	Cited by Cited by	Year
Prioritized Experience Replay T Schaul, J Quan, I Antonoglou, D Silver International Conference on Learning Representations (ICLR), 2016	3093	2016
Dueling Network Architectures for Deep Reinforcement Learning Z Wang, T Schaul, M Hessel, H van Hasselt, M Lanctot, N de Freitas International Conference on Machine Learning (ICML), 2016	2919	2016
Grandmaster level in StarCraft II using multi-agent reinforcement learning O Vinyals, I Babuschkin, WM Czarnecki, M Mathieu, A Dudzik, J Chung, ... Nature 575 (7782), 350–354, 2019	2130	2019
Rainbow: Combining Improvements in Deep Reinforcement Learning M Hessel, J Modayil, H Van Hasselt, T Schaul, G Ostrovski, W Dabney, ... AAAI Conference on Artificial Intelligence, 2018	1623	2018
Learning to learn by gradient descent by gradient descent M Andrychowicz, M Denil, S Gomez, MW Hoffman, D Pfau, T Schaul, ... Neural Information Processing Systems (NeurIPS), 2016	1609	2016
Unifying Count-Based Exploration and Intrinsic Motivation MG Bellemare, S Srinivasan, G Ostrovski, T Schaul, D Saxton, R Munos Neural Information Processing Systems (NeurIPS), 2016	1115	2016
Reinforcement learning with unsupervised auxiliary tasks M Jaderberg, V Mnih, WM Czarnecki, T Schaul, JZ Leibo, D Silver, ... International Conference on Learning Representations (ICLR), 2017	1068	2017
Universal value function approximators T Schaul, D Horgan, K Gregor, D Silver International Conference on Machine Learning (ICML-15), 1312-1320, 2015	799	2015
StarCraft II: A New Challenge for Reinforcement Learning O Vinyals, T Ewalds, S Bartunov, P Georgiev, AS Vezhnevets, M Yeo, ... arXiv preprint arXiv:1708.04782, 2017	778	2017
Deep Q-learning from Demonstrations T Hester, M Vecerik, O Pietquin, M Lanctot, T Schaul, B Piot, D Horgan, ... AAAI Conference on Artificial Intelligence, 2018	757	2018
Natural evolution strategies D Wierstra, T Schaul, T Glasmachers, Y Sun, J Peters, J Schmidhuber The Journal of Machine Learning Research 15 (1), 949-980, 2014	731	2014
Feudal networks for hierarchical reinforcement learning AS Vezhnevets, S Osindero, T Schaul, N Heess, M Jaderberg, D Silver, ... International Conference on Machine Learning (ICML), 2017	717	2017
No more pesky learning rates T Schaul, S Zhang, Y LeCun International Conference on Machine Learning (ICML'13), 2013	485	2013
PyBrain T Schaul, J Bayer, D Wierstra, Y Sun, M Felder, F Sehnke, T Rückstieß, ... Journal of Machine Learning Research 11 (Feb), 743-746, 2010	464	2010
AlphaStar: Mastering the Real-Time Strategy Game StarCraft II O Vinyals, I Babuschkin, J Chung, M Mathieu, M Jaderberg, W Czarnecki, ... (DeepMind blog), 2019	433	2019
Successor features for transfer in reinforcement learning A Barreto, W Dabney, R Munos, J Hunt, T Schaul, D Silver, H van Hasselt Neural Information Processing Systems (NeurIPS), 2017	386	2017
The 2014 General Video Game Playing Competition D Perez, S Samothrakis, J Togelius, T Schaul, S Lucas, A Couëtoux, ... Computational Intelligence and AI in Games, 2015	255*	2015
The predictron: End-to-end learning and planning D Silver, H van Hasselt, M Hessel, T Schaul, A Guez*, T Harley, ... International Conference on Machine Learning (ICML), 2017	253	2017
A video game description language for model-based or interactive learning T Schaul Conference on Computational Intelligence in Games (IEEE-CIG), 1-8, 2013	231	2013
General Video Game AI: Competition, Challenges and Opportunities D Perez-Liebana, S Samothrakis, J Togelius, T Schaul, SM Lucas AAAI What's Hot, 2016	190	2016

The system can't perform the operation now. Try again later.

Articles 1–20

Citations per year

Duplicate citations

Merged citations

Add co-authorsCo-authors

Follow

Cited by

Co-authors