robotty / recent-messages2 Goto Github PK

Add a ?since= query parameter to the /api/v2/recent-messages/:channel endpoint.

This new parameter should make it so only messages received after this timestamp are returned.

Should combine with the limit parameter, still.

This would be useful in a scenario where a client was briefly disconnected from Twitch chat and wishes to fill in the missed messages after a successful reconnect, without having to request messages based upon a guessed limit parameter or an unnecessarily highly-set limit parameter.

See Chatterino/chatterino2#4989

The original message from twitch:

@badge-info=predictions/YES,subscriber/1;
badges=predictions/blue-1,subscriber/0,sub-gifter/10;
color=#FF0000;
display-name=NotoriousRobEG;
emotes=;
first-msg=0;
flags=;
id=32b02467-7424-47ae-9feb-c20ee9789f9d;
mod=0;
returning-chatter=0;
room-id=39763722;
subscriber=1;
tmi-sent-ts=1673747902193;
turbo=0;
user-id=192901116;
user-type= :[email protected] PRIVMSG #star0chris :Ain beat getting over it yesterday

Same line stored in RM2:

@mod=0;
color=#FF0000;
user-type=;
user-id=192901116;
first-msg=0;
badges=predictions/blue-1,subscriber/0,sub-gifter/10;
subscriber=1;
flags=;
emotes=;
tmi-sent-ts=1673747902193;
turbo=0;
room-id=39763722;
historical=1;
rm-received-ts=1673747902506;
badge-info=predictions/YES,
subscriber/1;
returning-chatter=0;
id=32b02467-7424-47ae-9feb-c20ee9789f9d;
display-name=NotoriousRobEG :[email protected] PRIVMSG #star0chris :Ain beat getting over it yesterday

Why everything is shuffled around?

vs

Every single line starts differently. Why?

Building the master branch is currently not possible as the https://github.com/RAnders00/warp dependency cannot be fetched. cargo build fails with the following error:

error: failed to get `warp` as a dependency of package `recent-messages2 v0.1.0 (/home/leon/Projects/recent-messages2)`

Caused by:
  failed to load source for dependency `warp`

Caused by:
  Unable to update https://github.com/RAnders00/warp?branch=v030-backports#b6475f57

Caused by:
  failed to fetch into: /home/leon/.cargo/git/db/warp-e1f8cd67c8f62af6

Caused by:
  failed to authenticate when downloading repository

  * attempted to find username/password via git's `credential.helper` support, but failed

  if the git CLI succeeds then `net.git-fetch-with-cli` may help here
  https://doc.rust-lang.org/cargo/reference/config.html#netgit-fetch-with-cli

Caused by:
  failed to acquire username/password from local configuration

It's in seconds instead of nanoseconds

https://github.com/robotty/recent-messages2/security/policy

Upon deleting a single message from a user (instead of timing them out, banning or clearing chat) Twitch returns target-msg-id tag containing ID of the single message that has been deleted in CLEARMSG message.

Example (I deleted my message in my own chat):
@login=zneix;room-id=;target-msg-id=91061af6-fad1-49a1-8b33-0c131cc297b6;tmi-sent-ts=1626452108291 :tmi.twitch.tv CLEARMSG #zneix :-tags

As spotted on https://recent-messages.robotty.de/api I see that ?clearchat_to_notice=true covers three msg-ids for different kinds of CLEARCHAT messages (rm-clearchat rm-timeout rm-permaban), but CLEARMSG isn't taken into account at all.
While I realize it is another message, other than CLEARCHAT, I think it's worth taking CLEARMSG messages into account while using ?clearchat_to_notice=true param or introducing something like ?clearmsg_to_notice=true.

I'd suggest adding handling for those kinds of messages and introducing of a new msg-id, e.g.: rm-msg or rm-msg-deleted.

For example, if a user enables this, their messages are filtered out in all channels (not recorded, possibly replaced with a marker that a message was omitted here for privacy reasons).

https://gist.github.com/RAnders00/68d0955d205d65d4352b9d73d7946f17

and potentially come up with a way to let third parties authenticate programmatically :)

Suggested by @Leppunen

Since couple days ago all my ips lost access to chat history api and I get "Error: RemoteHostClosedError" error
cant even open robotty.de anymore

Statically linked binary + built web frontend files.

title.

• twitch-irc - v2.0.0
• mobc - v0.7.0
• mobc-postgres - v0.7.0
• tokio-postgres https://github.com/sfackler/rust-postgres/blob/master/tokio-postgres/CHANGELOG.md
• warp seanmonstar/warp#753
• hyper - in v0.14.0 https://github.com/hyperium/hyper/blob/master/CHANGELOG.md
• refinery - in v0.5.0
• simple-process-stats in v1.0.0 - https://github.com/robotty/simple-process-stats/blob/master/CHANGELOG.md
• reqwest - in 0.11.0

Apparently I forgot to say that