Quick and dirty public Telegram group message scraper
$ python3 tgscrape.py <groupname> [minid] [maxid]To dump all messages in the group fun_with_friends type:
$ python3 tgscrape.py fun_with_friendsYou can specify the message id you want to start and stop. For instance, to dump messages with id's 1000 through 2000 type:
$ python3 tgscrape.py fun_with_friends 1000 2000If you want to start at message id 1000 and dump all messages after it, just skip the last parameter:
$ python3 tgscrape.py fun_with_friends 1000Retrieved messages are stored in json format in the conversations folder.
$ python3 tgscape_cli.py <groupname>The following is the list and description of available commands:
Commands:
search <terms> search words or strings (in quotes) in messages and names
all returns all dumped messages
last <num> returns last <num> messages (default: 10)
date <date> returns all messages for a date (format: YYYY-MM-DD)
wordcloud returns the top 20 words (wordlen > 3)
exit exits the program
help this
If you want to search all messages and names containing either "foo" and "bar" type:
> search foo bar
If you want to search all messages and names containing the string "foo bar" type:
> search "foo bar"
To read all messages written on January 3rd, 2018, type:
> date 2018-03-01
BeautifulSoup4
To install dependencies:
$ pip install -r requirements.txt
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent