We discuss Sony AI's accomplishment of creating a novel AI agent that can beat professional racers in Gran Turismo. Some topics include:
- The crafting of rewards to make the agent behave nicely
- What is QR-SAC?
- How to deal with "rare" experiences in the replay buffer

Link to paper: https://www.nature.com/articles/s41586-021-04357-7