This project extracts the text from an article using Python Article Library and uses NLTK (Natural Language Processing Toolkit) to preprocess the text and extract the most common words in the article

• Newspaper3k: tool to scrape article
• NLTK: tool to process text

• Scrape articles with newspaper3k

from newspaper import Article

url = 'https://mystudentvoices.com/it-took-me-2-years-to-get-1000-followers-life-lessons-ive-learned-throughout-the-journey-9bc44f2959f0'
article = Article(url)

article.download()

• Find the publish date

article.publish_date

• Extract image
• Find the author
• Find the keywords
• Find the summary
• Preprocessing with NLTK
  • Tokenize text
  • Lowercase and remove stopwords
• Visualization the frequency of words with Matplotlib

Find the Medium article for this repository here