This write-up describes some elements of the general functioning of the rl_games reinforcement learning library. It also provides a guide on extending rl_games with new environments and algorithms ...