Comments (3)
mfe7
commented on August 23, 2024
a couple thoughts:
how often are the agent actions being updated? the training occurs at dt=0.2sec but in our experiments we use dt=0.1 for execution, which leads to much better performance.
what is the model for robot dynamics? in training, our agents set their heading angle and velocity directly, so any extra acceleration-type constraints would cause the policy to be less useful.
the agents were trained in crowds of up to 10 agents, but we saw good results in a few 20-agent setups. i wouldn't expect it be super reliable in generic 20-agent cases, especially if the simulator isn't quite like the one from training.
the lack of symmetry is puzzling, since all agents should be moving identically and receiving identical observations (assuming they started in the same states). any idea if there is something in your simulation that would lead to asymmetric network inputs?
from cadrl_ros.
20chase
commented on August 23, 2024
Hi Michael,
Thanks for your kind reply. The frequency of the execution is 10hz and any dynamics constraint didn't be introduced.
The problem is that the observations for the RNN input computed by the observe function in the agent class have different order although the position and velocity information is symmetry. In this case, the RNN will output different commands for them. Here is a simple example.
agent_num 0 obs:
[ 2. 10. -0. 1. 0.36 2.5 4.33 0. 0. 0.36 0.72 4.28
2.5 -4.33 0. 0. 0.36 0.72 4.28 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. ]
agent_num 1 obs:
[ 2. 10. 0. 1. 0.36 2.5 -4.33 0. 0. 0.36 0.72 4.28
2.5 4.33 0. 0. 0.36 0.72 4.28 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. ]
agent_num 2 obs:
[ 2. 10. 0. 1. 0.36 2.5 4.33 0. 0. 0.36 0.72 4.28
2.5 -4.33 0. 0. 0.36 0.72 4.28 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. ]
agent_num 3 obs:
[ 2. 10. 0. 1. 0.36 2.5 4.33 0. 0. 0.36 0.72 4.28
2.5 -4.33 0. 0. 0.36 0.72 4.28 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. ]
agent_num 4 obs:
[ 2. 10. -0. 1. 0.36 2.5 -4.33 0. 0. 0.36 0.72 4.28
2.5 4.33 0. 0. 0.36 0.72 4.28 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. ]
agent_num 5 obs:
[ 2. 10. -0. 1. 0.36 2.5 4.33 0. 0. 0.36 0.72 4.28
2.5 -4.33 0. 0. 0.36 0.72 4.28 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0. 0.
0. 0. 0. ]
==> poses:
[[ 5. 0. -3.142]
[ 2.5 4.33 -2.094]
[-2.5 4.33 -1.047]
[-5. 0. -0. ]
[-2.5 -4.33 1.047]
[ 2.5 -4.33 2.094]]
==> action:
[array([1. , 0.26179939]), array([1., 0.]), array([1. , 0.26179939]), array([1. , 0.26179939]), array([1., 0.]), array([1. , 0.26179939])]
After "unifying" the input, the trajectory can be plotted as below:
from cadrl_ros.
mfe7
commented on August 23, 2024
@20chase not sure if still useful, but looking at this the agent sizes seem quite small in the picture, so maybe they are outside the range it was trained on (i think 0.2-0.8m radius if i remember correctly?). also your observations only have a couple agents in them - with that many agents the observation vector should be quite dense.
from cadrl_ros.
Related Issues (20)
- How to train the network? HOT 1
- The problem of running code HOT 2
- from ford_msgs.msg import PedTrajVec, NNActions, PlannerMode, Clusters HOT 4
- 'launch/cadrl_node.launch' HOT 14
- The datasets 'Dropbox folder' can not open HOT 2
- Generate observation data from sensors HOT 7
- need a help professor HOT 11
- Can it run on Ubuntu 20.04 with noetic? HOT 4
- Regarding tf installed in conda HOT 1
- Sir, I have some questions about CADRL. HOT 3
- ./build_docker.sh error! HOT 3
- Simulation results in GA3C-CADRL HOT 2
- preset_testCases HOT 6
- Train directly in ros simulator? HOT 1
- Question regarding pose information HOT 2
- Some problems about how to replicate the results HOT 2
- How to consider map? HOT 2
- Training Code HOT 1
- Socially Aware Motion Planning HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cadrl_ros.