Git Product home page Git Product logo

bicycle_vision's Introduction

CAR-BAC Bicycle Rear View Vision

CAR-BAC (Car Approaching Rearview Bicycle Alert Camera) enhances bicyclists' safety by improving situational awareness when riding in traffic with motor vehicles. It detects vehicles approaching from behind and emits an audible alert when a vehicle approach exceeds a threshold. Thus CAR-BAC can help the cyclist maintain full 360-degree awareness, even if he/she might be reacting simultaneously to threats ahead of the bicycle.

The system is built around a Raspberry Pi 4 single-board computer, powered by a LiPO battery pack. These devices are placed in the bicyclist's saddle bag. A 5 MP Arducam image sensor is connected and mounted to the seatpost facing aft. A Google Coral Edge TPU runs the SSDLite object detection algorithm on data from the video feed. Vehicle detections are passed to a SORT tracker and then a linear classifier that identifies approaching vehicle tracks. The system alerts the cyclist audibly by sounding a buzzer attached to the Pi's GPIO pin.

Here we demonstrate a viable prototype for CAR-BAC. We have entered CAR-BAC in the Eyes on Edge: tinyML Vision Challenge, sponsored by the tinyML foundation. Our paper provides a full description of the solution, and it details possible enhancements to be pursued in future iterations. Enhancements fall into three categories: size/weight/power (SWaP) reduction, algorithm improvements, and additional features.

Team members: Amy Dexter, Robert Kraig, Neil Tender, Steve Milligan

Components of CAR-BAC system:

CAR BACK

CAR-BAC fitted on bike:

Car Back on Bike

Detection examples. Red boxes indicate approaching vehicles, while green boxes signify vehicles that are not approaching.

Detection examples

Directory structure:

├── CAR-BAC Final Report.docx.pdf - detailed description of project 
├── BicycleCamBOM.xlsx            - bill of materials
├── coral
│   ├── models                    - TFLite models for Coral TPU
│   ├── test_data                 - example test data
│   ├── process_video.py          - script to process pre-recorded video
│   ├── run_live.py               - script to process live video (main application)
│   ├── sort_tracker.py           - implements SORT tracking algorithm
│   └── utils.py                  - utility functions invoked by top-level scripts
├── pi_scripts
│   ├── camera.py                 - script to capture live video and record to file
│   ├── start_script_on_boot.txt  - instructions to configure Pi to run script on bootup
├── photos                        - photos of CAR-BAC
├── videos                        - demo videos of CAR-BAC
├── README.md                     - this README

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.