Git Product home page Git Product logo

openocc's Introduction

Hi there 👋

I'm Wenzhao Zheng, a postdoctoral fellow at BAIR, UC Berkeley, working with by Prof. Kurt Keutzer. I received my Ph.D. and B.S. from Tsinghua University, supervised by Jie Zhou and Jiwen Lu.

Previous Efforts

We build the first academic surround-camera 3D occupancy prediction model TPVFormer🎉.

Current Interests

🦙Large Models + 🚙Autonomous Driving -> 🤖AGI

  • 🦙 Large Models: Efficient/Small LLMs, Multimodal Models, Video Generation Models, Large Action Models...
  • 🚙 Autonomous Driving: 3D Occupancy Prediction, End-to-End Driving, World Models, 3D Scene Reconstruction...

Collaborations

If you want to work with me (in person or remotely) at 🐻UC Berkeley (Co-supervised by Prof. Kurt Keutzer), 💜Tsinghua University (Co-supervised by Prof. Jiwen Lu), and/or 🔴Peking University (Co-supervised by Prof. Shanghang Zhang), feel free to drop me an email at [email protected]. I could support GPUs if we are a good fit.

openocc's People

Contributors

huang-yh avatar wzzheng avatar zuosc19 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

openocc's Issues

support of more models

Hello, will this repo provide support for more methods, such as VoxFormer, SurroundOcc? Thanks.

When I ran the tpvformer_lidarseg_dim128_r50_800_3DOPC.py, the following bug happened.

Traceback (most recent call last):
File "/root/.vscode-server/extensions/ms-python.python-2023.6.1/pythonFiles/lib/python/debugpy/_vendored/pydevd/pydevd.py", line 3489, in
main()
File "/root/.vscode-server/extensions/ms-python.python-2023.6.1/pythonFiles/lib/python/debugpy/_vendored/pydevd/pydevd.py", line 3482, in main
globals = debugger.run(setup['file'], None, None, is_module)
File "/root/.vscode-server/extensions/ms-python.python-2023.6.1/pythonFiles/lib/python/debugpy/_vendored/pydevd/pydevd.py", line 2510, in run
return self._exec(is_module, entry_point_fn, module_name, file, globals, locals)
File "/root/.vscode-server/extensions/ms-python.python-2023.6.1/pythonFiles/lib/python/debugpy/_vendored/pydevd/pydevd.py", line 2517, in _exec
globals = pydevd_runpy.run_path(file, globals, 'main')
File "/root/.vscode-server/extensions/ms-python.python-2023.6.1/pythonFiles/lib/python/debugpy/_vendored/pydevd/_pydevd_bundle/pydevd_runpy.py", line 321, in run_path
return _run_module_code(code, init_globals, run_name,
File "/root/.vscode-server/extensions/ms-python.python-2023.6.1/pythonFiles/lib/python/debugpy/_vendored/pydevd/_pydevd_bundle/pydevd_runpy.py", line 135, in _run_module_code
_run_code(code, mod_globals, init_globals,
File "/root/.vscode-server/extensions/ms-python.python-2023.6.1/pythonFiles/lib/python/debugpy/_vendored/pydevd/_pydevd_bundle/pydevd_runpy.py", line 124, in _run_code
exec(code, run_globals)
File "./train.py", line 339, in
main(0, args)
File "./train.py", line 219, in main
model_outputs = my_model(**model_inputs)
File "/qcraft-vepfs-01/qcraft-vepfs-01/Perception/perception-users/lixiaodong/anaconda3/envs/OpenOcc/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1102, in _call_impl
return forward_call(*input, **kwargs)
File "/qcraft-vepfs-01/qcraft-vepfs-01/Perception/perception-users/lixiaodong/anaconda3/envs/OpenOcc/lib/python3.8/site-packages/mmcv/runner/fp16_utils.py", line 98, in new_func
return old_func(*args, **kwargs)
File "/qcraft-vepfs-01/Perception/perception-users/liwei/OpenOcc/model/segmentor/tpv_segmentor.py", line 36, in forward
outs = self.encoder(**results)
File "/qcraft-vepfs-01/qcraft-vepfs-01/Perception/perception-users/lixiaodong/anaconda3/envs/OpenOcc/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1102, in _call_impl
return forward_call(*input, **kwargs)
File "/qcraft-vepfs-01/Perception/perception-users/liwei/OpenOcc/model/encoder/tpvformer/tpvformer_encoder.py", line 201, in forward
# forward layers
File "/qcraft-vepfs-01/Perception/perception-users/liwei/OpenOcc/model/encoder/tpvformer/tpvformer_encoder.py", line 125, in forward_layers
reference_points_cam, tpv_mask = point_sampling(
File "/qcraft-vepfs-01/Perception/perception-users/liwei/OpenOcc/model/encoder/tpvformer/utils.py", line 143, in point_sampling
lidar2img = lidar2img.view(
RuntimeError: shape '[1, 1, 6, 1, 4, 4]' is invalid for input of size 192
ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 1) local_rank: 0 (pid: 1538708) of binary: /qcraft-vepfs-01/qcraft-vepfs-01/Perception/perception-users/lixiaodong/anaconda3/envs/OpenOcc/bin/python

AttributeError: 'NuScenes3DOPC' object has no attribute 'loader'

When I ran the tpvformer_lidarseg_dim128_r50_800_3DOPC.py, the following bug happened.

File "/media/re/2384a6b4-4dae-400d-ad72-9b7044491b55/openmmlab/occ/OpenOcc/train.py", line 111, in main
label_str = train_dataset_loader.dataset.loader.nuScenes_label_name
AttributeError: 'NuScenes3DOPC' object has no attribute 'loader'

It seems that train_datasetloader.dataset doesn't have the attribute 'loader'.

What's wrong with that?

support of more models

Hello, will this repo provide support for more methods, such as VoxFormer, SurroundOcc? Thanks.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.