Git Product home page Git Product logo

ntnu-arl / underwater-datasets Goto Github PK

View Code? Open in Web Editor NEW
18.0 6.0 1.0 239.58 MB

Underwater Dataset for Visual-Inertial Methods and data with transitioning between multiple refractive media.

License: BSD 3-Clause "New" or "Revised" License

bluerov2 low-light-vision multi-camera refractive-index underwater-datasets underwater-drone underwater-robotics visual-inertial-odometry visual-odometry underwater-stereo-camera

underwater-datasets's Introduction

Multi Camera Underwater Visual Inertial Dataset

License: BSD-3

About

This is an underwater dataset consisting of multiple onboard sensors, mainly, 5 Camera and IMU ( Alphasense Core Research Developent Kit),a Pressure Sensor, and actuator commands from an ROV piloted in an indoor facility (MC-lab). A total of 24 trajectories are collected with following characteristics:

  • 4 Motion patterns with length 100-120m
  • External illumination ranging from 100 to 700 lux
  • Onboard illumination at 3 gradual levels

Additionally, we provide trajectories with varying media (Air, Water).

Updates / News

  • Apr 7 2024: Added 6 trajectrories (2 lighing conditions x 3 motion patterns) with peicewise-continuous ground-truth from motion capture. Link: Subset 3
  • Nov 29 2023: Uploaded undertwater dataset with multi-camera imu system for underwater VIO and camera models. Link: Subset 1 and Subset 2

Varying illumination at 6 levels

5 Camera and IMU

Cam0 Cam1 Cam2 Cam3 Cam4

Ariel: Underwater robot with multi-camera imu and compute suite

Robot in water System Description

Motion Patterns

Shape Distance Travelled (m) Mean Linear Velocity (m/s) Mean Angular Velocity (rad/s)
Rectangular 120 0.25 0.12
Infinity 108 0.45 0.16
Dumb-bell 110 0.45 0.20
Dumb-bell w/ Transverse Motion 110 0.25 0.11

Trajectories with Visual Inetrial Data

Subset 1: Motion Patterns

The first subset contains 24 trajectories with 4 motion patterns and varying illumination.

Each of the trajectory contains following data in ROS bag format:

  1. Camera | fps: 20Hz | resolution: 540p*720p | format: Mono8 | Topics:
/alphasense_driver_ros/cam0  # Front Stereo Pair: Right
/alphasense_driver_ros/cam1  # Front Stereo Pair: Left
/alphasense_driver_ros/cam2  # Top Camera
/alphasense_driver_ros/cam3  # Right Side Camera
/alphasense_driver_ros/cam4  # Left Side Camera
  1. IMU (synced with cameras) | fps: 200Hz | Topics:
/alphasense_driver_ros/imu
  1. IMU on FCU (Pixhawk) | fps: 50Hz | Topics:
/mavros/imu/data
  1. Pressure Sensor | fps: 50Hz | Topics:
/mavros/imu/static_pressure
  1. Actuator output PWM | fps: 50Hz | Topics:
/mavros/rc/out # ch 1-8 thrusters, ch 9-10 for Lumen LED

The collective data can be found (1-18) and (19-24), whereas the following table contains link to each trajectory:

Motion Pattern 1 (Rectangular)

Shape Distance Travelled (m) Mean Linear Velocity (m/s) Mean Angular Velocity (rad/s)
Rectangular 120 0.25 0.12

No. Illumination Duration (s) Size (Gb) Link
1 E0+O1 460 18.1 link
2 E0+O2 456 17.8 link
3 E0+O3 392 15.3 link
4 E1+O3 386 15.1 link
5 E1+O2 443 17.3 link
6 E1+O1 395 15.4 link

Motion Pattern 2 (Infinity)

Shape Distance Travelled (m) Mean Linear Velocity (m/s) Mean Angular Velocity (rad/s)
Infinity 108 0.45 0.16

No. Illumination Duration (s) Size (Gb) Link
7 E1+O1 251 9.8 link
8 E1+O2 252 9.8 link
9 E1+O3 262 10.2 link
10 E0+O3 281 11.0 link
11 E0+O2 279 10.9 link
12 E0+O1 263 10.2 link

Motion Pattern 2 (Dumbbell)

Shape Distance Travelled (m) Mean Linear Velocity (m/s) Mean Angular Velocity (rad/s)
Dumb-bell 110 0.45 0.20

No. Illumination Duration (s) Size (Gb) Link
13 E0+O1 251 9.8 link
14 E0+O2 252 9.8 link
15 E0+O3 262 10.2 link
16 E1+O3 281 11.0 link
17 E1+O2 279 10.9 link
18 E1+O1 263 10.2 link

Motion Pattern 2 (Dumbbell w/ Transverse Motion)

Shape Distance Travelled (m) Mean Linear Velocity (m/s) Mean Angular Velocity (rad/s)
Dumbbell w/ Transverse Motion 110 0.25 0.11

No. Illumination Duration (s) Size (Gb) Link
19 E1+O1 251 9.8 link
20 E1+O2 252 9.8 link
21 E1+O3 262 10.2 link
22 E0+O3 281 11.0 link
23 E0+O2 279 10.9 link
24 E0+O1 263 10.2 link

Illumination Details: External light has two levels E0 corresponding to 100 - 300 lux and E1 corresponding to 400-700 lux measured outside and above water surface. Onboard light varies between three incremental levels, O1, O2, and O3, corresponinding to 20%, 40%, 60% pwm level of the Lumen Subsea LED (Max: 1500 lumens) respectively.

Subset 2: Trajectories with Varying Media (Air, Water)

The second subset contains 6 trajectories with varying media (Air, Water).

Trajectory Duration Size Link
1 173 2.6 link
2 126 1.9 link

Camera IMU Calibration

The cameras were calibrated using the Kalibr toolbox. The calibration data is provided in the following table with the links for each camera intrinsics and extrinsics.

Camera Intrinsics (Air) Intrinsics (Water) Extrinsics
cam0, cam1(Stereo Pair) link link link
cam3 link link link
cam4 link link link

Subset 3: Trajectories with Ground-truth from Motion Capture

No. Illumination Duration (s) Size (Gb) Motion Pattern Link
1 E1+O1 370 14.5 Rectangular link
2 E1+O1 374 14.7 Infinity/Figure "8" link
3 E1+O1 318 12.5 Dumbbell link
4 E0+O1 405 15.9 Rectangular link
5 E0+O1 401 15.7 Infinity/Figure "8" link
6 E0+O1 302 11.6 Dumbbell link

Reference

If you use this work in your research, please cite the publications as follows:

An Online Self-calibrating Refractive Camera Model with Application to Underwater Odometry

@misc{singh2023online,
      title={An Online Self-calibrating Refractive Camera Model with Application to Underwater Odometry}, 
      author={Mohit Singh and Mihir Dharmadhikari and Kostas Alexis},
      year={2023},
      eprint={2310.16658},
      archivePrefix={arXiv},
      primaryClass={cs.RO}
}

Contact

You can contact us for any question:

underwater-datasets's People

Contributors

kostas-alexis avatar mohit505git avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar

Forkers

ouyaming

underwater-datasets's Issues

Can your provide the IMU coordinate on platform and the tilt angle of alphasense?

Hi Mohit Singh,
Thanks for sharing the data.
Although in calibration file, IMU to Cam0 is provided, but the reference frame is not clearly shown in figure.

Based on the data, I guess the IMU coordinate is lilke this:
ๅ›พ็‰‡

However, I want to aligh gravity of IMU to the ground, so can you provide the accurate tilt angle of the IMU?
Or, any static data recorded when the platform is staticly placed on the ground?

Thanks.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.