Scholar
Richard S. Sutton
Google Scholar ID: 6m4wv6gAAAAJ
Keen, Amii, and University of Alberta
artificial intelligence
reinforcement learning
machine learning
cognitive science
computer science
Follow
Homepage
↗
Google Scholar
↗
Citations & Impact
All-time
Citations
87,865
H-index
68
i10-index
177
Publications
20
Co-authors
23
list available
Contact
CV
Open ↗
Publications
4 items
Average-reward reinforcement learning in semi-Markov decision processes via relative value iteration
2025
Cited
0
Swift-Sarsa: Fast and Robust Linear Control
2025
Cited
0
Asynchronous Stochastic Approximation and Average-Reward Reinforcement Learning
arXiv.org · 2024
Cited
0
MetaOptimize: A Framework for Optimizing Step Sizes and Other Meta-parameters
arXiv.org · 2024
Cited
3
Resume (English only)
Academic Achievements
Turing Award recipient (shared with Andy Barto), with an official ACM award video
Co-author of the seminal textbook 'Reinforcement Learning: An Introduction'
Developed multiple RL courses (e.g., CMPUT 397, 609) and the RL MOOC
Extensive publication record (available via Google Scholar)
Authored influential blog posts on intelligence, AI verification, and predictive minds (e.g., 'The Bitter Lesson')
Created open-source RL tools such as Tile Coding Software
Proposed theoretical frameworks like '14 principles of experience-oriented intelligence'
Submitted key research proposals (e.g., 2025 CCAI-chair proposal, 2022 NSERC technical proposal)
Research Experience
Research Scientist at Keen Technologies
Professor in the Department of Computing Science, University of Alberta
Principal Investigator of the Reinforcement Learning and Artificial Intelligence (RLAI) Lab
Canada CIFAR AI Chair at the Alberta Machine Intelligence Institute (Amii)
Chief Scientific Advisor at Amii
Founder of Openmind Research Institute
Chief Scientific Officer at ExperienceFlow
Co-authors
23 total
Co-author 1
Satinder Singh
Google DeepMind / U. of Michigan
Doina Precup
DeepMind and McGill University
Patrick M. Pilarski
Professor, University of Alberta, Amii (Alberta Machine Intelligence Institute)
A. Rupam Mahmood
University of Alberta, Amii
Co-author 6
Adam White
University of Alberta, Amii (Alberta Machine Intelligence Institute)
Csaba Szepesvari
DeepMind & University of Alberta
×
Welcome back
Sign in to Agora
Welcome back! Please sign in to continue.
Email address
Password
Forgot password?
Continue
Do not have an account?
Sign up