[nicrusso7]

Well done! Btw I do agree with you regarding the knowledge transfer on the real robot platform. The open source design is built to work with very cheap servos and the alinement is not quite easy too.

As you, I was totally new to RL when I started (almost 1 year ago) - I’m a DevOps engineer during the day :) The goal of this project for me is learning ML more than build a product - that’s why the limited focus on hw implementation. Anyway, there are examples on the web on how to run the policies on the real world robot (even using ROS) - maybe in the future I’ll digging in this topic as well!