This code runs a face detection models as well as a binary classifier mask/no mask on camera footage from a raspberry Pi to detect whether a person is wearing or not their mask.

For each event - i.e., someone not wearing their mask - we store an event in a local SQLite database.

My alertDispatcher project proposes a service to publish those events to a Kafka topic.

Hardware

• A Raspberry Pi 4 model B with 4Go of RAM and at least 2Go storage available on the SD card (untested on 2Go RAM models but should work) - required.
• A Camera compatible wth the Pi (I used the Pi Camera Module V2) - required.
• A Coral USB accelerator to speed up model inference on your Pi - nice to have but not mandatory.
• A fan and heat dissipating components are highly recommended to avoid overheating (my ventilated Pi in its protective case never goes above 38°C while running the inference code and the alertDispatcher).

Software

• You have setup your Pi with an operating system (I used NOOBS).
• Your Pi has python 3.7 installed. Run `which python3` -V to see which version of python3 you have.

  sudo add-apt-repository ppa:deadsnakes/ppa
  sudo apt-get update
  sudo apt-get install python3.7

• Install SQLite 3 on your Pi.

  sudo apt-get update
  sudo apt-get upgrade
  sudo apt-get install sqlite3

Then you can create the database using the command sqlite alert.db. Create the alert table using the SQL commands from the schema.sql file of this project.

1. Create a virtual env in this project folder, let's call it venv and activate it:

python3 -m venv venv
source venv/bin/activate

2. Install dependencies, if on your development machine, use dev-requirements.txt instead of requirements.txt since requirements.txt requires the pi camera module.

pip install -r requirements.txt

3. For TensorFlow Lite (TF Lite) runtime on your Pi, check out Tensorflow Quickstart for the latest instructions. Running the following command worked for me to install the TF Lite runtime.

pip install https://dl.google.com/coral/python/tflite_runtime-2.1.0.post1-cp37-cp37m-linux_armv7l.whl

4. Install lib for Coral USB accelerator following the getting started doc of Coral

Use pytest, cd to the test folder and run pytest:

cd tests && pytest serialization.py

Running the detect_mask.py script will start capture the video feed from the Pi camera and capture alerts.

python detect_mask.py

I provide you with two pretrained models, a widely available face detection model (ssd_mobilenet_v2) and a binary classifier mask/no mask I trained. (See under the models/ folder. They are optimized to run on the Coral USB edge TPU accelerator.

You can retrain you own classification model using your coral device, see Coral - retrain classification

For the mask/no mask dataset, I used the one provided on the Face Mask Detection project

For the training, I ued Google AutoML Vision to generate a model compatible with my Pi and USB accelerator, detailed example here

This repository hosts the code for the first part of the project; detecting the events at the edge. It can be completed by the following projects.

• alertDispatcher a Go module designed to run at the edge, especially a Raspberry Pi 4 B with 4Go of RAM. The alertDispatcher polls the local SQLite event store and publishes them to a Kafka topic.

• alertIngress an Go module designed to run on a server, consuming from a Kafka topic where edge devices pushes their events. Each event consumed by the alert Ingress are archived in PostgresSQL and pushed to a notification service.

• notifyMask a Go module designed to run on a server, sending email notification to a system administrator when an event occurs.