Week 1

2023/01/09 - 2023/01/15

Multi-Agent Connected Autonomous Driving (MACAD)

• A Review: https://arxiv.org/abs/2203.07676
• An RL env: https://github.com/praveen-palanisamy/macad-gym

OpenAI Gym environment

• Environments:

  • Hete Ncom | Inde | PO Intrx MA | TLS 1B2C1P TWN3-v0

  • Homo Ncom | Inde | PO Intrx MA | SS 3C TWN3-v0

• Observation Space: Images (168 x 168 x 3).

• Action Space: 9 discrete actions.

RL Methods

Baseline

Discrete Action Space:

• Deep Q (2013)
• A2C / A3C (2016)

Continuous Action Space:

• DDPG (2015)
• TRPO & PPO (2017)

Advanced

Continuous Action Space:

• SAC (2018)
• TD3 (2019)

Other Platforms

• https://github.com/oxwhirl/smac
• https://github.com/facebookresearch/nocturne