Git Product home page Git Product logo

ahmedehabb / speaknews Goto Github PK

View Code? Open in Web Editor NEW
0.0 1.0 1.0 232.38 MB

Interactive news summarizer system that leverages avatar narration and text to speech conversion techniques.

Python 4.47% Jupyter Notebook 94.18% Kotlin 0.01% Ruby 0.02% Swift 0.01% Objective-C 0.01% Dart 1.32%
abstractive-summarization extractive-summarization genre-classification lipsync sentiment-analysis summarization text-to-speech transformers

speaknews's Introduction

Speak News Graduation Project

Abstract

Traditional news reading methods often feel tedious and time consuming, leading to decreased engagement and information overload. To address these challenges, we present an interactive news summarizer system that leverages avatar narration and text to speech conversion techniques. Our solution aims to revolutionize news consumption by providing concise news summaries that can be effortlessly listened to or visually experienced through avatars. Recognizing the growing dissatisfaction with traditional news reading formats and the need for efficient information consumption, our system tackles these issues head on. By utilizing advanced natural language processing and machine learning techniques, we automatically generate comprehensive news summaries, condensing key information from articles. Our application offers users an enhanced news consumption experience by providing concise news summaries through avatar narration and text to speech conversion. Users can effortlessly listen to or visually experience news articles, overcoming the boredom and time constraints associated with traditional reading methods. By condensing key information using advanced natural language processing techniques, our system ensures accurate and digestible summaries. The integration of text to speech conversion generates immersive audio, while avatar narration offers a visually engaging alternative. Users will benefit from efficient and personalized news consumption, catering to their preferences and enabling them to stay informed conveniently.

Project Poster

Full System Block Diagram

block diagram

Models

Summarization Module

Extractive Summarization Module

Modifying BERT encoder to fit the Summarization task

image-20230614003147958

Abstractive Summarization Module

Encoder-Decoder Transformer Model

image-20230614003444224

Text to Speech Module

The Full Text-To-Speech Module Architecture

image-20230614003612048

Sentiment Analysis Module

The Sentiment Analysis Module Architecture

image-20230614003759569

Avatar Generation Module

The Full Lib Syncing Module Architecture

image-20230614003657220

Datasets

The following datasets were used for the comparative analysis: • LJ Speech for Tacotron Model. • CNN Daily Mail for Text Summarizer. • BBC LRS 2 Lip syncing dataset for Avatar Generation. • Twitter Sentiment dataset for text sentiment analysis.

Evaluation Metrics

Results

Usage

To run the project, run the following commands:

    

Contributers

speaknews's People

Contributors

abdallahwaseem avatar ahmedehabb avatar mohamedafifi13 avatar yousefqadry avatar

Watchers

 avatar

Forkers

abdallahwaseem

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.