Si-Qi LIU Senior Research Engineer @ DeepMind Previously CentraleSupélec, Oxford.

About

During the day I'm a Research Engineer at DeepMind where I work on challenging open problems in machine learning and artificial intelligence. My current focus sits at the intersection of Reinforcement Learning, Multi-Agent, Game Theory and Continuous Control.

I grew up in China, moved to France in 2011 to study and I'm now living and working in London.

Publications

Emergent Coordination though Competition

Siqi Liu, Guy Lever, Josh Merel, Saran Tunyasuvunakool, Nicolas Heess, Thore Graepel

ICLR 2019 | paper | website | code

Hierarchical Visuomotor Control of Humanoids

Josh Merel, Arun Ahuja, Vu Pham, Saran Tunyasuvunakool, Siqi Liu, Dhruva Tirumala, Nicolas Heess, Greg Wayne

ICLR 2019 | paper | demo

Reinforcement Learning Agents acquire Flocking and Symbiotic Behaviour in Simulated Ecosystems

Peter Sunehag, Guy Lever, Siqi Liu, Josh Merel, Nicolas Heess, Joel Z Leibo, Edward Hughes, Tom Eccles, Thore Graepel

ALIFE 2019 | paper

The Body is not a Given: Joint Agent Policy Learning and Morphology Evolution

Dylan Banarse, Yoram Bachrach, Siqi Liu, Chrisantha Fernando, Nicolas Heess, Pushmeet Kohli, Guy Lever, Thore Graepel

AAMAS 2019 | paper

Observational Learning by Reinforcement Learning

Diana Borsa, Nicolas Heess, Bilal Piot, Siqi Liu, Leonard Hasenclever, Remi Munos, Olivier Pietquin

AAMAS 2019 | paper

Improved Image Captioning via Policy Gradient Optimization of SPIDER

Siqi Liu, Zhenhai Zhu, Ning Ye, Sergio Guadarrama, Kevin Murphy

ICCV 2017 | paper | oral

Reading

Busy Person Patterns | link

James F. Kile, Donald J. Little, Samir Shah

Patterns that help you make the most out of your time.

Laws of Tech: Commoditize Your Complement | link

Interesting take: commoditizing your complement leads to lasting monopoly in tech.

Baby-Sitting the Economy | link

Paul Krugman

A simple analogy for economic cycles for non-economist.

Career

Mar 2017 - Present
Senior Research Engineer @ DeepMind
Jul 2016 - Nov 2016
Research Intern @ Google Research
Machine Intelligence (Mountain View)
Jun 2015 - Sep 2015
Software Engineer Intern @ Google
Adwords Optimization (New York)
Feb 2015 - Jun 2015 (part-time)
Consultant Engineer @ Collabora Ltd
LibreOffice for Android
Jun 2014 - Sep 2014
Software Engineer Intern @ Google
Knowledge Graph (Zurich)

Education

2015 - 2016
MSc in Computer Science, with distinction.
2013 - 2016
MEng (Diplôme d'Ingénieur), classement A (1st)
2011 - 2013
Génie Informatique, GPA 4.99/5