albertincx / formatbot1 Goto Github PK

View Code? Open in Web Editor NEW

174.0 2.0 20.0 418 KB

Make instant view easily and fast, from any article on the internet in the best messenger ever Telegram

License: GNU General Public License v3.0

JavaScript 100.00%

telegram telegram-bot instantview mercury-parser cloudamqp bot mongodb rabbitmq nodejs telegraf

formatbot1's Introduction

formatbot1's People

Contributors

Stargazers

Watchers

formatbot1's Issues

Hint: add proxy config If the program runs in LAN or China.

Anyone who wants to run this program in the local area network or China(GFW), should modify these places:

src/config/bot.js

...
var httpsAgent = require('socks5-https-client/lib/Agent');
...

const opts = {
    channelMode: true,
    telegram: {
        agent: new httpsAgent({
            socksHost: '127.0.0.1', // Defaults to 'localhost'.
            socksPort: 1085, // Defaults to 1080.
        }),
    },
};

src/api/utils/makeTelegaph.js

...
var httpsAgent = require('socks5-https-client/lib/Agent');
...

return fetch('https://api.telegra.ph/createPage', {
    body: JSON.stringify(body),
    method: 'POST',
    headers: { 'content-type': 'application/json' },
    agent: new httpsAgent({
      socksHost: '127.0.0.1', // Defaults to 'localhost'.
      socksPort: 1085, // Defaults to 1080.
    })
})

Change content parser

@mozilla/readability is better than @postlight/mercury-parser

here is an example page: https://www.douban.com/people/166039423/status/3594363157/

@mozilla/readability can get main content but @postlight/mercury-parser can't.

main content is:

example's source code

var fs = require('fs')
var { Readability } = require('@mozilla/readability')
var Mercury = require('@postlight/mercury-parser')
var { JSDOM } = require('jsdom')

// source html is from: https://www.douban.com/people/166039423/status/3594363157/
var html = fs.readFileSync('t.html', 'utf8')

var doc = new JSDOM(html)

var reader = new Readability(doc.window.document)
var article = reader.parse()

console.log('mozilla_____', article)

Mercury.parse(
  'https://www.douban.com/people/166039423/status/3594363157/',
  {
    html,
  }
)
  .then((res) => {
    console.log('mercury_____', res)
  })
  .catch((err) => {
    console.log('mercury_____', err)
  })

Sorry, but your link (https://mp.weixin.qq.com/s/xxxxxx) is broken, restricted, or content is empty

InstantViewBot  | availableOne true
InstantViewBot  | elTime 223
InstantViewBot  | 223s, 214ms test1DEV
InstantViewBot  | queue job undefined
InstantViewBot  | reset start2
InstantViewBot  | merc
InstantViewBot  | before san 349
InstantViewBot  | length 70
InstantViewBot  | domed 126
InstantViewBot  | Error: empty ivlink
InstantViewBot  |     at Object.makeIvLink (/app/src/api/utils/ivMaker.js:45:11)
InstantViewBot  |     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
InstantViewBot  |     at async jobMessage (/app/src/api/routes/format/index.js:434:11)
InstantViewBot  | error = broken https://mp.weixin.qq.com/s/xxxxxxx Error: empty ivlink

how to fix it?
Thanks!

Feature Request: Allowed Users

Setting allowed users of the bot to avoid too much server traffic.

albertincx / formatbot1 Goto Github PK

formatbot1's Introduction

formatbot1's People

Contributors

Stargazers

Watchers

Forkers

formatbot1's Issues

Hint: add proxy config If the program runs in LAN or China.

Change content parser

Sorry, but your link (https://mp.weixin.qq.com/s/xxxxxx) is broken, restricted, or content is empty

Feature Request: Allowed Users

Recommend Projects

React

Vue.js

Typescript

TensorFlow

Django

Laravel

D3

Recommend Topics

javascript

web

server

Machine learning

Visualization

Game

Recommend Org

Facebook

Microsoft

Google

Alibaba

D3

Tencent