The opensourcecomputervision from tspannhw

tspannhw / opensourcecomputervision Goto Github PK

View Code? Open in Web Editor NEW

Open Source Computer Vision with TensorFlow, MiniFi, Apache NiFi, OpenCV, Apache Tika and Python For processing images from IoT devices like Raspberry Pis, NVidia Jetson TX1, NanoPi Duos and more which are equipped with attached cameras or external USB webcams, we use Python to interface via OpenCV and PiCamera. From there we run image processing at the edge on these IoT device using OpenCV and TensorFlow to determine attributes and image analytics. A pache MiniFi coordinates running these Python scripts and decides when and what to send from that analysis and the image to a remote Apache NiFi server for additional processing. At the Apache NiFi cluster in the cluster it routes the images to one processing path and the JSON encoded metadata to another flow. The JSON data (with it's schema referenced from a central Schema Registry) is routed and routed using Record Processing and SQL, this data in enriched and augment before conversion to AVRO to be send via Apache Kafka to SAM. Streaming Analytics Manager then does deeper processing on this stream and others including weather and twitter to determine what should be done on this data. References https://community.hortonworks.com/articles/103863/using-an-asus-tinkerboard-with-tensorflow-and-pyth.html https://community.hortonworks.com/articles/118132/minifi-capturing-converting-tensorflow-inception-t.html https://github.com/tspannhw/rpi-noir-screen https://community.hortonworks.com/articles/77988/ingest-remote-camera-images-from-raspberry-pi-via.html https://community.hortonworks.com/articles/107379/minifi-for-image-capture-and-ingestion-from-raspbe.html https://community.hortonworks.com/articles/58265/analyzing-images-in-hdf-20-using-tensorflow.html

License: Apache License 2.0

Python 80.56% Shell 2.30% HTML 17.15%

opensourcecomputervision's Introduction

Timothy Spann

Principal Developer Advocate - Milvus - Zilliz

Youtube Channel: https://www.youtube.com/@FLiP-Stack

See my full details here: https://github.com/tspannhw/SpeakerProfile

Tim Spann is the Principal Developer Advocate for Milvus @ Zilliz, the Big Data Zone leader and blogger at DZone and an experienced data engineer with 15 years of experience. He runs the Future of Data Princeton meetup as well as other events. He has spoken at Philly Open Source, ApacheCon in Montreal, Strata NYC, Oracle Code NYC, IoT Fusion in Philly, meetups in Princeton, NYC, Philly, Berlin and Prague, DataWorks Summits in San Jose, Berlin and Sydney.

Milvus, Unstructured Data Processing, Open Source Vector Database, towhee, Attu, Milvus CLI, Milvus Backup, Milvus Sizing Tool, feder, GPTCache, Hugging Face, Python, LLM, Pytorch, LangChain, RAG, Ollama.

Upcoming Events: Conferences, Meetups, ...

🔭 I’m currently working on talks on Milvus, towhee, Attu, GPTCache, HuggingFace, NiFi, Kafka, Flink, Iceberg, Ozone, Pulsar, Pinot, ...
🌱 I’m currently learning Milvus.
👯 I’m looking to collaborate on FLANK-AIM Stack (Flink + NiFi + Kafka - AI - Milvus)
💬 Ask me about Milvus, Unstructured Data Processing, towhee, Attu, Vector Databases, RAG, Apache NiFi, Apache Flink, Apache Kafka, Apache Pulsar, Apache Iceberg, Cloud Native Data, Unified Data Ingest, Streaming, Messaging, IoT, Java Deep Learning, Edge Devices, Big Data
📫 How to reach me: @PaasDev https://dev.to/tspannhw
😄 Pronouns: They call him, "Tim"
⚡ Fun fact: Cats
⚡ Meet Me Online: https://www.meetup.com/unstructured-data-meetup-new-york/
Articles: https://www.datainmotion.dev/
Everything Apache NiFi: https://github.com/tspannhw/EverythingApacheNiFi
Everything Apache Milvus: https://github.com/tspannhw/EverythingMilvus