Program | Speakers | Registration | Organizers | Venue

The first Human-aligned AI Summer School will be held in Prague from 2nd to 5th August. The focus of the first year will be on “learning from humans,” including subtopics such as inverse reinforcement learning, modeling bounded rational agents and latest trends in AI alignment research.

Format of the school

The school is focused on teaching approaches and frameworks, less on presentation of latest research results. The content of the school is mostly technical - it is assumed the attendees understand current ML approaches such as deep learning. The intended audience of the school are researchers interested in learning more about the AI alignment topics, PhDs, researchers working in ML/AI outside academia, and talented students.

Program (beta)

Thu 2nd
Morning session
Venue: Faculty of Mathematics and Physics

9:00-10:00 Registration
10:00-11:00 Opening session

11:00-11:20 Coffee break
11:20-12:00 Overview of the school program (Jan Kulveit)

Lunch & afternoon session.
Venue: Snemovni 7 event space

12:30-14:00 Lunch (catered)

14:00-15:30 Value learning (Daniel Filan)
15:30-15:50 Coffee break
16:00-17:00 Value learning (Daniel Filan)
17:00-18:00 Probability, utility and Jeffrey-Bolker rotation (Abram Demski)

Evening program:
Venue: Snemovni 7

19:00-21:30 Welcome reception

Fri 3rd
Venue: Snemovni 7 event space

9:30-11:00 Bounded rationality (Daniel Braun)
11:00-11:20 Coffee break
11:20-12:30 Bounded rationality (Daniel Braun)

12:30-13:30 Lunch (catered)

13:30-14:30 Bounded rationality (Filip Matějka)
14:30-15:00 Coffee break
15:30-17:00 Bounded rationality (Daniel Filan)
17:00-17:20 Coffee break
17:20-18:00 Fireside chat

(Dinner individually)

Evening program
Baroque refectory of the Dominican cloister

20:00-22:00 Cello concerto (light refreshments will be served after the concert)

Sat 4th
Venue: Snemovni 7 event space

9:30-10:0 Lightning talks (early career researchers)

11:00-11:20 Coffee break
11:20-12:30 Impact measures and side effects (Victoria Krakovna)

12:30-14:00 Lunch (catered)

14:00-15:40 Embedded agents (Abram Demski)
15:40-16:00 Coffee break
17:00-18:00 Lightning talks (early career researchers) Evening program
Venue: Lucerna

19:00-22:00 School dinner on the roof of Lucerna palace

Sun 5th
Venue: Snemovni 7 event space

9:30-11:00 Strategic considerations in AI development (Miles Brundage)
11:00-11:20 Coffee break
11:20-12:40 Panel discussion (Miles Brundage,Victoria Krakovna,Daniel Filan,Abram Demski)

12:40-14:20 Lunch (catered)

14:20-14:50 Closing session (Jan Kulveit)


Daniel Alexander Braun
Professor of Learning Systems, Ulm University

Daniel Braun is Professor of Learning Systems at Ulm University. He habilitated in neural and behavioral biology and cognitive science at the Eberhard Karls Universität Tübingen. Previously, he was a visiting PhD student and postdoctoral research associate in the Computational and Biological Learning Laboratory Cambridge University and a visiting scientist in the Computational Learning and Motor Control Laboratory at the University of Southern California. In 2011 he was awarded an Emmy-Noether-fellowship by the Deutsche Forschungsgemeinschaft to establish the independent research group “Sensorimotor Learning and Decision-making” at the Max-Planck-Institutes for Biological Cybernetics and Intelligent Systems in Tübingen. In 2015 he was awarded an ERC Starting Grant “BRISC: Bounded rationality in sensorimotor coordination”. He has doctorates in natural science and philosophy from the Albert-Ludwigs-Universität, Freiburg, in the subject areas of computational neuroscience and philosophy of mind respectively.

His research interests include cognitive modelling, decision-making and bounded rationality,a abstraction and structural learning, sensorimotor learning and control, learning robots and biological information processing

Filip Matějka
Associate Professor with Tenure, CERGE-EI
Research Fellow, Center for Economic and Policy Research, London

Filip Matějka is an Associate Professor with Tenure at CERGE, Charles University, Prague, and a Researcher at the Economics Institute of the Czech Academy of Sciences. He obtained his Ph.D in applied mathematics from Princeton University and M.A. in Physics from Charles University in Prague.. Previously, he was a visiting Researcher, UC Berkeley, and visiting scholar at New York University. He was awarded ERC Starting Grant "Behavioral and Policy Implications of Rational Inattention" and in 2016 won The Neuron Award for promising young scientists.

His research areas are information economics, theory of rational inattention, behavioral economics and macroeconomics.

Victoria Krakovna
Research Scientist, DeepMind
Co-founder, Future of Life Institute

Viktoriya Krakovna is a research scientist in AI safety at DeepMind, and co-founder of the Future of Life Institute. Her PhD thesis in statistics and machine learning at Harvard University focused on building interpretable models. Viktoriya gained numerous distinctions for her accomplishments in math competitions, including a silver medal at the International Mathematical Olympiad and the Elizabeth Lowell Putnam prize.

Daniel Filan
PhD student, CHAI

Daniel Filan is currently pursuing his PhD at CHAI, University of California under Stuart Russell, working on mathematics relevant to the AI alignment problem. His latest publications include Modeling Agents with Probabilistic Programs (together with Owain Evans, Andreas Stuhlmuller, and John Salvatier) and Self-Modification of Policy and Utility Function in Rational Agents (together with Tom Everitt, Mayank Daswani, and Marcus Hutter). Previously he studied he theory of reinforcement learning, mathematics, and theoretical physics at the Australian National University. In a program similar to research masters degree, he wrote a thesis on "Resource-bounded Complexity-based Priors for Agents", under Marcus Hutter.

Abram Demski
Researcher, Machine Intelligence Research Institute

Abram Demski is a researcher at the Machine Intelligence Research Institute. His research to date has focused on cognitive architectures and artificial general intelligence. He is interested in filling in the gaps that exist in formal theories of rationality, especially those concerned with what humans are doing when reasoning semi-formally about mathematics.

Miles Brundage
Research Fellow, Future of Humanity Institute, Oxford

Miles Brundage is Research Fellow at FHI and a PhD candidate in Human and Social Dimensions of Science and Technology at Arizona State University. He is also affiliated with the Consortium for Science, Policy, and Outcomes (CSPO), the Virtual Institute of Responsible Innovation (VIRI), and the Journal of Responsible Innovation (JRI). His recent research focuses on the societal implications of artificial intelligence.
Prior to starting graduate school, he worked at the Advanced Research Projects Agency - Energy (ARPA-E) for two years, and interned for the Institute for Human and Machine Cognition (IHMC).

Registration and fees

Registration is closed.


The conference is organized by Program: Jan Kulveit (main coordinator), Tomáš Gavenčiak,Jan Romportl
Operations: Hana Kalivodova


Faculty of Mathematics and Physics, Charles University
Malostranske náměstí 25, Praha 1
First floor - the way from the building entrance will be signposted.

Sněmovní 7 event & coworking space
Sněmovní 7, Praha 1

Baroque Refectory of the Dominican Convent of St. Giles (Fri concert)
Dominikánský klášter u sv. Jiljí Jilská 7a, Praha 1

Rooftop of the Lucerna Palace (school dinner)
Lucerna, Stepanska 61
Entrance is via Štěpánska street opposite to the Big hall entrance. Take the elevator to the 4th floor and walk to the 5th. Lucerna