Git Product home page Git Product logo

oslabs-beta / kafkaview Goto Github PK

View Code? Open in Web Editor NEW
47.0 3.0 1.0 82.27 MB

KafkaView is an open-source Kafka visualizer and data monitoring tool designed to simplify the Kafka ecosystem for developers.

Home Page: https://kafkaview.com

License: MIT License

JavaScript 82.95% HTML 0.40% CSS 16.02% Dockerfile 0.63%
css docker docker-compose eslint express html javascript jmx-exporter node prometheus react webpack kafkaview

kafkaview's Introduction

KafkaView - Kafka Visualizer and Data Monitoring Tool

About

JavaScript Apache Kafka Prometheus Node Express React React-Router Chart.js Babel Webpack Docker esLint

Welcome to KafkaView, the open-source tool designed to simplify the Kafka ecosystem for developers and data engineers. Kafka, renowned for its powerful event streaming capabilities, often presents a steep learning curve due to its complex data flow and lack of intuitive monitoring interfaces. KafkaView is here to change that. Visit our website here KafkaView.com

Table of Contents

Description

KafkaView is an intuitive monitoring tool designed to simplify the complexity of Apache Kafka, one of the most potent and prevalent event streaming platforms. Despite Kafka's widespread use, its intricate data flow and ecosystem can be challenging to grasp, and the platform traditionally lacks a user-friendly interface for monitoring. This often makes onboarding a daunting task for new users.

With KafkaView, users gain access to real-time updates that offer a clear view of crucial metrics for Kafka cluster management. This includes visualizing the rate at which data is produced to brokers and tracking the volume of messages across various topics. KafkaView aims to demystify Kafka's operations, presenting a more approachable structure for your Kafka projects.

Especially beneficial for newcomers, KafkaView features a dedicated informational section. This segment provides a detailed overview of the Kafka ecosystem, complete with easy-to-understand descriptions of its components. By making Kafka's inner workings more transparent, KafkaView facilitates a smoother learning curve and enhances the monitoring experience for users at all levels of experience.

Installation

  1. Clone our repository to your local machine by typing the following command into your terminal:
git clone https://github.com/oslabs-beta/KafkaView.git
  1. Open the repo with your favorite IDE. Once complete install the dependencies for our application by typing into your terminal:
  • npm install

    Then type the following command to start the server:

  • npm start

Note

Our application should automatically open a web browser window with our home page. You should also see a confirmation message in your terminal that the server has started. If you are encountering an issue here, check if you typed 'npm install' or verify your current repository is correct. Once you have verified everything installed correctly and the server is running, navigate to our home page by clicking this link: localhost:8080

  1. Add your Prometheus server by typing in the ip address and exposed port of your server.


Note

If you would like to demo KafkaView without a prometheus-configured kafka cluster, open kafka-metrics folder and follow steps in the Readme.txt to use our provided setup.

  1. Congrats! You can now explore the Kafka ecosystem! You will find a variety of metrics right at your fingertips, including live updates on under-replicated partitions and the total count of messages being transmitted. You can navigate to other metrics by clicking the links at the top of the page.


  1. If you would like to learn more about the kafka ecosystem, click on the Kafka Information page. Enjoy!

Roadmap

  • Expand range of metrics. If you would like to see something missing, consider contributing to the project.
  • Alert system that send a message to users when a metric reaches a critical threshold
  • Expand support for other Kafka controller systems
  • Containerize entire project

Contact

a photo of Byrce Kelly
Byrce Kelly
GitHub
LinkedIn
a photo of Chris Johnson
Chris Johnson
GitHub
LinkedIn
a photo of Joseph Defesh
Joseph Dafesh
GitHub
LinkedIn
a photo of Sean Nguyen
Sean Nguyen
GitHub
LinkedIn

License

By contributing, you are agreeing that your contributions will be licensed under the MIT License.

kafkaview's People

Contributors

johnson-chris00 avatar brycek2 avatar seannguyen96 avatar josephdafesh avatar

Stargazers

M Konop avatar  avatar Justin Tzu-Hung Lin avatar Victoria Obregon avatar Anthony Herrera avatar  avatar Alexander David avatar Isaac Bocage avatar Claire H avatar  avatar Eunice Kim avatar Jenny Ouk avatar King-Hur Wu avatar Cathy Luong avatar  avatar  avatar hay nocik avatar Aaron Brown avatar Dawit Merid avatar Solomon Moon avatar Zack Daniels avatar Chris Everett avatar Justin Fung avatar rob sinz avatar Roderick de Leon avatar Allison Scott avatar  avatar Kevin Can avatar Alex Palazzo avatar Amir Munoz avatar  avatar Jake Johnson avatar Connie Johnson avatar Donald Twiford avatar Andrew avatar Jaime de Venecia avatar  avatar Ariel Maor avatar Vicky Hoang avatar Charmie Dubongco avatar  avatar Tanner Robertson avatar Zoren avatar  avatar  avatar  avatar  avatar

Watchers

Schno Mozingo avatar  avatar  avatar

Forkers

johnson-chris00

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.