Comments (5)
I managed to make LATR run on NuScene but unfortunately, the prediction that I get for the lanes (20 for x, 20 for z and 20 for vis) is wrong, and i am getting all vis values equal to -1.28999 (something like that). It is very strange since they are all the same and all < 0.
I have checked and the problem might come from the lidar2image matrix, but I am not quite sure on which data the model needs in inference besides the image.
Apparently it labels all the data with visible value < 0.
This is a visualization of all the lanes that are generated without masking off the lanes with vis < 0.
from latr.
Hi, @samueleruffino99. As far as I know, NuScenes has no 3D lane annotations like OpenLane dataset. If you want to train the model on NuScenes dataset, labels are required. And for your visualization: First, for lanes, invisible parts should be filtered aligning with the training setting. Second, sounds like you are using the OpenLane data config (including camera extrinsics and intrinsics) and model to evaluate on nuscenes. This can cause troubles, as data are based on different settings.
from latr.
Hi, actually I would just like to run inference on Nuscenes. But apparently when I am genereating the 2D canvas from the 3D plane I am not getting points inside the resize 2D image and vis outputs are all fixed to a values that is < 0 (and so masked off).
But If I change the model such that it does not mask vis values < 0 that is the output that I am getting from the predicted lines (I think they are always 40 predictions). I think I am converting correctly the projection matrics because at least I can project onto the image the 3D lanes like I showed you.
from latr.
Do you think it might works simply taking your model (trained on OpenLane) and test iot on nuscenes?
I would really appreciate if you have time to answer :)
from latr.
Hi, @samueleruffino99, excuse me,could you please share some visualization methods related to this work? I can't get the input parameters from the output of LATR to transmit to the function named 'save_result_new' in the class which is called 'Visualizer' of [PersFormer]. Thanks a lot !!!
from latr.
Related Issues (20)
- CUDA out of memory HOT 4
- RuntimeError on Evaluating Model on OpenLane Dataset HOT 2
- MMCV==1.5.0 is used but incompatible. Please install mmcv>=2.0.0rc4 HOT 6
- visualization HOT 8
- Python version HOT 2
- Inference on a custom data HOT 2
- camera coordinate system definition? HOT 3
- Projection of Ground Truths to Flat Surface
- Sync BatchNorm costs lots of time and cause code unworkable HOT 1
- DV-3DLane
- Inquiry Regarding Available Docker Images
- lane visualization
- Setting of optimizer
- mmdet and mmdet3d for environmental construction HOT 2
- Array dimension error
- How to run in cpu environment
- validate error
- LICENSE
- Possible Bug in ONCE-3DLanes evaluation
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from latr.