Tom Schaul

Cited by

	All	Since 2018
Citations	30965	27955
h-index	42	40
i10-index	75	63

7000

3500

1750

5250

2011201220132014201520162017201820192020202120222023108 149 165 228 367 535 1146 2367 3504 4832 5692 6032 5499

Public access

View all

20 articles

0 articles

available

not available

Based on funding mandates

Co-authors

David SilverDeepMind, UCLVerified email at google.com
Juergen SchmidhuberKing Abdullah University of Science and Technology / The Swiss AI Lab, IDSIA / University of LuganoVerified email at kaust.edu.sa
Daan WierstraPrincipal Scientist, DeepMindVerified email at google.com
Nando de FreitasCIFAR & DeepMindVerified email at google.com
Tobias GlasmachersVerified email at idsia.ch
Oriol VinyalsResearch Scientist at Google DeepMindVerified email at google.com
Will DabneyDeepMindVerified email at google.com
Julian TogeliusAssociate Professor of Computer Science and Engineering, New York University; co-founder, modl.aiVerified email at nyu.edu
Joseph ModayilDeepMindVerified email at cs.ualberta.ca
Andre BarretoResearch Scientist, Google DeepMindVerified email at google.com
Rémi MunosDeepMindVerified email at inria.fr
koray kavukcuogluDeepMindVerified email at kavukcuoglu.org
Diana BorsaDeepMindVerified email at google.com
Simon LucasProfessor of Artificial Intelligence, Queen Mary University of LondonVerified email at qmul.ac.uk
Simon OsinderoPrincipal Scientist (Director) @ DeepMindVerified email at google.com
Max JaderbergHead of ML, Isomorphic LabsVerified email at robots.ox.ac.uk
Jan PetersProfessor for Intelligent Autonomous Systems at Technische Universität DarmstadtVerified email at ias.tu-darmstadt.de
Marc G. BellemareGoogle BrainVerified email at google.com
Yann LeCunChief AI Scientist at Facebook & Silver Professor at the Courant Institute, New York UniversityVerified email at cs.nyu.edu
Karen SimonyanCo-Founder and Chief Scientist at Inflection AIVerified email at inflection.ai

Tom Schaul

Senior Staff Scientist, DeepMind

Verified email at nyu.edu - Homepage

Reinforcement Learning Deep Learning Deep Reinforcement Learning Game AI Exploration


Title Sort by citations Sort by year Sort by title	Cited by Cited by	Year
Prioritized Experience Replay T Schaul, J Quan, I Antonoglou, D Silver International Conference on Learning Representations (ICLR), 2016	4307	2016
Dueling Network Architectures for Deep Reinforcement Learning Z Wang, T Schaul, M Hessel, H van Hasselt, M Lanctot, N de Freitas International Conference on Machine Learning (ICML), 2016	4280	2016
Grandmaster level in StarCraft II using multi-agent reinforcement learning O Vinyals, I Babuschkin, WM Czarnecki, M Mathieu, A Dudzik, J Chung, ... Nature 575 (7782), 350–354, 2019	3670	2019
Rainbow: Combining Improvements in Deep Reinforcement Learning M Hessel, J Modayil, H Van Hasselt, T Schaul, G Ostrovski, W Dabney, ... AAAI Conference on Artificial Intelligence, 2018	2328	2018
Learning to learn by gradient descent by gradient descent M Andrychowicz, M Denil, S Gomez, MW Hoffman, D Pfau, T Schaul, ... Neural Information Processing Systems (NeurIPS), 2016	2106	2016
Unifying Count-Based Exploration and Intrinsic Motivation MG Bellemare, S Srinivasan, G Ostrovski, T Schaul, D Saxton, R Munos Neural Information Processing Systems (NeurIPS), 2016	1513	2016
Reinforcement learning with unsupervised auxiliary tasks M Jaderberg, V Mnih, WM Czarnecki, T Schaul, JZ Leibo, D Silver, ... International Conference on Learning Representations (ICLR), 2017	1305	2017
Deep Q-learning from Demonstrations T Hester, M Vecerik, O Pietquin, M Lanctot, T Schaul, B Piot, D Horgan, ... AAAI Conference on Artificial Intelligence, 2018	1095	2018
Universal value function approximators T Schaul, D Horgan, K Gregor, D Silver International Conference on Machine Learning (ICML-15), 1312-1320, 2015	1088	2015
StarCraft II: A New Challenge for Reinforcement Learning O Vinyals, T Ewalds, S Bartunov, P Georgiev, AS Vezhnevets, M Yeo, ... arXiv preprint arXiv:1708.04782, 2017	1004	2017
Feudal networks for hierarchical reinforcement learning AS Vezhnevets, S Osindero, T Schaul, N Heess, M Jaderberg, D Silver, ... International Conference on Machine Learning (ICML), 2017	946	2017
Natural evolution strategies D Wierstra, T Schaul, T Glasmachers, Y Sun, J Peters, J Schmidhuber The Journal of Machine Learning Research 15 (1), 949-980, 2014	940	2014
Successor features for transfer in reinforcement learning A Barreto, W Dabney, R Munos, JJ Hunt, T Schaul, D Silver, ... Neural Information Processing Systems (NeurIPS), 2017	554	2017
No more pesky learning rates T Schaul, S Zhang, Y LeCun International Conference on Machine Learning (ICML'13), 2013	543	2013
AlphaStar: Mastering the Real-Time Strategy Game StarCraft II O Vinyals, I Babuschkin, J Chung, M Mathieu, M Jaderberg, W Czarnecki, ... (DeepMind blog), 2019	533	2019
PyBrain T Schaul, J Bayer, D Wierstra, Y Sun, M Felder, F Sehnke, T Rückstieß, ... Journal of Machine Learning Research 11 (Feb), 743-746, 2010	475	2010
The predictron: End-to-end learning and planning D Silver, H van Hasselt, M Hessel, T Schaul, A Guez*, T Harley, ... International Conference on Machine Learning (ICML), 2017	318*	2017
The 2014 General Video Game Playing Competition D Perez, S Samothrakis, J Togelius, T Schaul, S Lucas, A Couëtoux, ... Computational Intelligence and AI in Games, 2015	279*	2015
A video game description language for model-based or interactive learning T Schaul Conference on Computational Intelligence in Games (IEEE-CIG), 1-8, 2013	262	2013
General Video Game AI: Competition, Challenges and Opportunities D Perez-Liebana, S Samothrakis, J Togelius, T Schaul, SM Lucas AAAI What's Hot, 2016	216	2016

The system can't perform the operation now. Try again later.

Articles 1–20

Citations per year

Duplicate citations

Merged citations

Add co-authorsCo-authors

Follow

Cited by

Co-authors