[phunehehe0]

I presume it's 3 dimensions for each joint, so 10^3 * 10^3 * 10^3

[liuzhy71]

I think the problem is exaggerated. Even with three ball joints, the action space is not that large since there are constraints on the velocity of the joints. They have to move gradually. So the actual action space is a lot smaller. A lot RL problem has similar continuity constraints, cuz in real world we are dealing with time series signals. I am not a expert in the RL domain yet, so I open myself to any opinion.