dataaccess2020 / capstone_marazzini Goto Github PK

• Scrape the articles on the websites
• analyze the most frequent word
• create a word visualization
• analysis of the results

To display in a more efficient way the most frequent words in each article, I wanted to create a Venn Diagram so that we could also see the overlaps, but unfortunately with the package VennDiagram, you can only see the number of elements inside the circles and not the words so in my case it would have been useless.

When I scraped the text of the articles from the websites, the results was a vector containing 30+ elements because each paragraph was separated. Since I wanted to create a data frame, I needed to put the split paragraph of each article into one single text. To do so I used the str_c function of the package stringr, the problem is that I had to put manually each paragraph, since the loop I created didn't work. But this solution is neither elegant nor practical.