Tom Schaul

Cited by

	All	Since 2016
Citations	16095	14854
h-index	35	33
i10-index	60	46

4800

2400

1200

3600

20102011201220132014201520162017201820192020202163 106 155 152 228 350 527 1124 2322 3380 4732 2716

Public access

View all

21 articles

0 articles*

available

not available

Based on funding mandates

Co-authors

David SilverGoogle DeepMindVerified email at google.com
Hado van HasseltResearch Scientist, DeepMind; Honorary Professor, UCLVerified email at google.com
Juergen SchmidhuberThe Swiss AI Lab, IDSIA, University of LuganoVerified email at idsia.ch
Daan WierstraPrincipal Scientist, DeepMindVerified email at google.com
Tobias GlasmachersVerified email at idsia.ch
Nando de FreitasCIFAR & DeepMindVerified email at google.com
Rémi MunosDeepMindVerified email at inria.fr
Julian TogeliusAssociate Professor of Computer Science and Engineering, New York University; co-founder, modl.aiVerified email at nyu.edu
Joseph ModayilComputing Science, University of AlbertaVerified email at cs.ualberta.ca
Will DabneyDeepMindVerified email at google.com
koray kavukcuogluDeepMindVerified email at kavukcuoglu.org
Andre BarretoResearch Scientist, Google DeepMindVerified email at google.com
Max JaderbergDeepMindVerified email at robots.ox.ac.uk
Simon LucasResearch Scientist, Facebook; Professor of Artificial Intelligence, Queen Mary University of LondonVerified email at qmul.ac.uk
Simon OsinderoSenior Staff Scientist @ DeepMindVerified email at google.com
Marc G. BellemareGoogle BrainVerified email at google.com
Diana BorsaDeepMindVerified email at google.com
Jan PetersProfessor for Intelligent Autonomous Systems at Technische Universität DarmstadtVerified email at ias.tu-darmstadt.de
Wojciech Marian CzarneckiResearch Scientist at DeepMindVerified email at google.com
Yann LeCunChief AI Scientist at Facebook & Silver Professor at the Courant Institute, New York UniversityVerified email at cs.nyu.edu

Tom Schaul

Senior Staff Research Scientist, DeepMind

Verified email at nyu.edu - Homepage

Reinforcement Learning Neural Networks Deep Learning Deep Reinforcement Learning Game AI


Title Sort by citations Sort by year Sort by title	Cited by Cited by	Year
Prioritized Experience Replay T Schaul, J Quan, I Antonoglou, D Silver International Conference on Learning Representations (ICLR), 2016	2201	2016
Dueling Network Architectures for Deep Reinforcement Learning Z Wang, T Schaul, M Hessel, H van Hasselt, M Lanctot, N de Freitas International Conference on Machine Learning (ICML), 2016	2008	2016
Learning to learn by gradient descent by gradient descent M Andrychowicz, M Denil, S Gomez, MW Hoffman, D Pfau, T Schaul, ... Neural Information Processing Systems (NIPS), 2016	1246	2016
Rainbow: Combining Improvements in Deep Reinforcement Learning M Hessel, J Modayil, H Van Hasselt, T Schaul, G Ostrovski, W Dabney, ... AAAI Conference on Artificial Intelligence, 2018	1075	2018
Grandmaster level in StarCraft II using multi-agent reinforcement learning O Vinyals, I Babuschkin, WM Czarnecki, M Mathieu, A Dudzik, J Chung, ... Nature 575 (7782), 350–354, 2019	1021	2019
Unifying Count-Based Exploration and Intrinsic Motivation MG Bellemare, S Srinivasan, G Ostrovski, T Schaul, D Saxton, R Munos Neural Information Processing Systems (NIPS), 2016	811	2016
Reinforcement learning with unsupervised auxiliary tasks M Jaderberg, V Mnih, WM Czarnecki, T Schaul, JZ Leibo, D Silver, ... International Conference on Learning Representations (ICLR), 2017	810	2017
Universal value function approximators T Schaul, D Horgan, K Gregor, D Silver International Conference on Machine Learning (ICML-15), 1312-1320, 2015	597	2015
Natural evolution strategies D Wierstra, T Schaul, T Glasmachers, Y Sun, J Peters, J Schmidhuber The Journal of Machine Learning Research 15 (1), 949-980, 2014	578	2014
StarCraft II: A New Challenge for Reinforcement Learning O Vinyals, T Ewalds, S Bartunov, P Georgiev, AS Vezhnevets, M Yeo, ... arXiv preprint arXiv:1708.04782, 2017	565	2017
Deep Q-learning from Demonstrations T Hester, M Vecerik, O Pietquin, M Lanctot, T Schaul, B Piot, D Horgan, ... AAAI Conference on Artificial Intelligence, 2018	524	2018
Feudal networks for hierarchical reinforcement learning AS Vezhnevets, S Osindero, T Schaul, N Heess, M Jaderberg, D Silver, ... International Conference on Machine Learning (ICML), 2017	521	2017
PyBrain T Schaul, J Bayer, D Wierstra, Y Sun, M Felder, F Sehnke, T Rückstieß, ... Journal of Machine Learning Research 11 (Feb), 743-746, 2010	443	2010
No more pesky learning rates T Schaul, S Zhang, Y LeCun International Conference on Machine Learning (ICML'13), 2013	430	2013
AlphaStar: Mastering the Real-Time Strategy Game StarCraft II O Vinyals, I Babuschkin, J Chung, M Mathieu, M Jaderberg, W Czarnecki, ... (DeepMind blog), 2019	340	2019
Successor features for transfer in reinforcement learning A Barreto, W Dabney, R Munos, J Hunt, T Schaul, D Silver, H van Hasselt Neural Information Processing Systems (NIPS), 2017	287	2017
The 2014 General Video Game Playing Competition D Perez, S Samothrakis, J Togelius, T Schaul, S Lucas, A Couëtoux, ... Computational Intelligence and AI in Games, 2015	225*	2015
The predictron: End-to-end learning and planning D Silver, H van Hasselt, M Hessel, T Schaul, A Guez*, T Harley, ... International Conference on Machine Learning (ICML), 2017	213	2017
A video game description language for model-based or interactive learning T Schaul Conference on Computational Intelligence in Games (IEEE-CIG), 1-8, 2013	197	2013
Exponential natural evolution strategies T Glasmachers, T Schaul, S Yi, D Wierstra, J Schmidhuber Genetic and evolutionary computation conference (GECCO), 393-400, 2010	159	2010

The system can't perform the operation now. Try again later.

Articles 1–20

Citations per year

Duplicate citations

Merged citations

Add co-authorsCo-authors

Follow this author

Cited by

Co-authors