damoeb / feedless Goto Github PK
View Code? Open in Web Editor NEWMiddleware to create RSS feeds, filter existing feeds and transform them (e.g. fulltext or media detection)
Home Page: https://feedless.org
License: Other
Middleware to create RSS feeds, filter existing feeds and transform them (e.g. fulltext or media detection)
Home Page: https://feedless.org
License: Other
Some browser don't render xmls or just Show the Source code.
https://github.com/damoeb/feedless/blob/master/docs/self-hosting.md#start-all-in-one-image
Alternatively if you want JavaScript support use the
feedless:aio-chrome
image. This image includes a chrome browser for headless rendering.
Is it possible to provide the more open Chromium as an alternative... or switch to it altogether?
I am sorry if that's double posting but....
It seems that the image is still not available for docker, is it me or there is no image indeed?
PS P:\feedle> docker run --env-file=feedless.env --network=bridge -it damoeb/feedless:aio
Unable to find image 'damoeb/feedless:aio' locally
docker: Error response from daemon: manifest for damoeb/feedless:aio not found: manifest unknown: manifest unknown.
See 'docker run --help'.
Hello!
Perhaps it's possible, but I read filters.md and couldn't make it out.
For instance, what if I want to filter #title by a more than one strings (like Apple, Samsung etc.).
Or is it possible to add this as an idea in the future?
Many thanks for a really useful product!
I'm trying to have feedless installed locally, but I'm unable to and I don't have enough knowledge to know what is not working. (I'm trying to learn it by using it.) As I've understood that podman
is a subset of what docker can do and almost a drop in recplacement that I already had installed, I went with that at first, but failed. Next, I tried a few things. At the very end, I executed step 2 to 4 consecutively and failed as usually at the fourth. Below you find a log of all my commands and outputs.
The error I often get is (and ended step 4 with) .
docker: Error response from daemon: manifest for damoeb/feedless:aio not found: manifest unknown: manifest unknown.
See 'docker run --help'.
Also, I'm using sudo
with docker
, but I don't see that in the setup guide, which is concerning me and giving me the feeling other things are wrong. However, I had just installed docker in this very log (through apt), so I would expect it to be configured correctly.
vendillah deborah ~ cd Downloads/
vendillah deborah ~/Downloads cd Install\ folders/
vendillah deborah ../Install folders mkdir feedless
vendillah deborah ../Install folders cd feedless
vendillah deborah ../feedless echo 'POSTGRES_USER=postgres
> POSTGRES_PASSWORD=admin
> POSTGRES_DB=feedless
> APP_DATABASE_URL=jdbc:postgresql://postgres-db:5432/${POSTGRES_DB}
> ' > feedless.env
vendillah deborah ../feedless ls
feedless.env
vendillah deborah ../feedless podman run --env-file=feedless.env --network=feedless-net -it damoeb/feedless:aio
✔ docker.io/damoeb/feedless:aio
Trying to pull docker.io/damoeb/feedless:aio...
Error: initializing source docker://damoeb/feedless:aio: reading manifest aio in docker.io/damoeb/feedless: manifest unknown: manifest unknown
vendillah deborah ../feedless podman run --env-file=feedless.env --network=feedless-net -it damoeb/feedless:aio
✔ quay.io/damoeb/feedless:aio
Trying to pull quay.io/damoeb/feedless:aio...
Error: initializing source docker://quay.io/damoeb/feedless:aio: reading manifest aio in quay.io/damoeb/feedless: unauthorized: access to the requested resource is not authorized
vendillah deborah ../feedless sudo podman run --env-file=feedless.env --network=feedless-net -it damoeb/feedless:aio
[sudo] Mot de passe de vendillah :
✔ quay.io/damoeb/feedless:aio
Trying to pull quay.io/damoeb/feedless:aio...
Error: initializing source docker://quay.io/damoeb/feedless:aio: reading manifest aio in quay.io/damoeb/feedless: unauthorized: access to the requested resource is not authorized
vendillah deborah ../feedless docker run --env-file=feedless.env --network=feedless-net -it damoeb/feedless:aio
La commande « docker » n'a pas été trouvée, mais peut être installée avec :
sudo snap install docker # version 20.10.24, or
sudo apt install docker.io # version 24.0.5-0ubuntu1~20.04.1
Voir « snap info docker » pour des versions additionelles.
vendillah deborah ../feedless podman --version
podman version 3.4.2
vendillah deborah ../feedless apt list | grep podman
WARNING: apt does not have a stable CLI interface. Use with caution in scripts.
podman-machine-cni/inconnu,now 100:0.0.0-1 amd64 [installé, automatique]
podman-machine-cni/inconnu 100:0.0.0-1 arm64
podman-machine-cni/inconnu 100:0.0.0-1 armhf
podman-machine-cni/inconnu 100:0.0.0-1 ppc64el
podman-machine-cni/inconnu 100:0.0.0-1 s390x
podman-plugins/inconnu,now 100:1.2.0-1 amd64 [installé, automatique]
podman-plugins/inconnu 100:1.2.0-1 arm64
podman-plugins/inconnu 100:1.2.0-1 armhf
podman-plugins/inconnu 100:1.2.0-1 ppc64el
podman-plugins/inconnu 100:1.2.0-1 s390x
podman-rootless/inconnu 100:3.4.2-5 amd64
podman-rootless/inconnu 100:3.4.2-5 arm64
podman-rootless/inconnu 100:3.4.2-5 armhf
podman-rootless/inconnu 100:3.4.2-5 ppc64el
podman-rootless/inconnu 100:3.4.2-5 s390x
podman/inconnu,now 100:3.4.2-5 amd64 [installé]
podman/inconnu 100:3.4.2-5 arm64
podman/inconnu 100:3.4.2-5 armhf
podman/inconnu 100:3.4.2-5 ppc64el
podman/inconnu 100:3.4.2-5 s390x
vendillah deborah ../feedless sudo apt install docker
Lecture des listes de paquets... Fait
Construction de l'arbre des dépendances
Lecture des informations d'état... Fait
Les paquets supplémentaires suivants seront installés :
wmdocker
Les NOUVEAUX paquets suivants seront installés :
docker wmdocker
0 mis à jour, 2 nouvellement installés, 0 à enlever et 57 non mis à jour.
Il est nécessaire de prendre 14,3 ko dans les archives.
Après cette opération, 58,4 ko d'espace disque supplémentaires seront utilisés.
Souhaitez-vous continuer ? [O/n] y
Réception de :1 http://be.archive.ubuntu.com/ubuntu focal/universe amd64 wmdocker amd64 1.5-2 [13,0 kB]
Réception de :2 http://be.archive.ubuntu.com/ubuntu focal/universe amd64 docker all 1.5-2 [1.316 B]
14,3 ko réceptionnés en 0s (49,0 ko/s)
Sélection du paquet wmdocker précédemment désélectionné.
(Lecture de la base de données... 328191 fichiers et répertoires déjà installés.)
Préparation du dépaquetage de .../wmdocker_1.5-2_amd64.deb ...
Dépaquetage de wmdocker (1.5-2) ...
Sélection du paquet docker précédemment désélectionné.
Préparation du dépaquetage de .../archives/docker_1.5-2_all.deb ...
Dépaquetage de docker (1.5-2) ...
Paramétrage de wmdocker (1.5-2) ...
Paramétrage de docker (1.5-2) ...
Traitement des actions différées (« triggers ») pour man-db (2.9.1-1) ...
vendillah deborah ../feedless docker run --env-file=feedless.env --network=feedless-net -it damoeb/feedless:aio
La commande « docker » n'a pas été trouvée, mais peut être installée avec :
sudo snap install docker # version 20.10.24, or
sudo apt install docker.io # version 24.0.5-0ubuntu1~20.04.1
Voir « snap info docker » pour des versions additionelles.
vendillah deborah ../feedless sudo apt remove docker
Lecture des listes de paquets... Fait
Construction de l'arbre des dépendances
Lecture des informations d'état... Fait
Le paquet suivant a été installé automatiquement et n'est plus nécessaire :
wmdocker
Veuillez utiliser « sudo apt autoremove » pour le supprimer.
Les paquets suivants seront ENLEVÉS :
docker
0 mis à jour, 0 nouvellement installés, 1 à enlever et 57 non mis à jour.
Après cette opération, 9.216 o d'espace disque seront libérés.
Souhaitez-vous continuer ? [O/n] Y
(Lecture de la base de données... 328201 fichiers et répertoires déjà installés.)
Suppression de docker (1.5-2) ...
vendillah deborah ../feedless sudo apt install docker.io
Lecture des listes de paquets... Fait
Construction de l'arbre des dépendances
Lecture des informations d'état... Fait
Le paquet suivant a été installé automatiquement et n'est plus nécessaire :
wmdocker
Veuillez utiliser « sudo apt autoremove » pour le supprimer.
Les paquets supplémentaires suivants seront installés :
bridge-utils containerd pigz runc ubuntu-fan
Paquets suggérés :
ifupdown aufs-tools btrfs-progs cgroupfs-mount | cgroup-lite debootstrap docker-doc rinse zfs-fuse | zfsutils
Les NOUVEAUX paquets suivants seront installés :
bridge-utils containerd docker.io pigz runc ubuntu-fan
0 mis à jour, 6 nouvellement installés, 0 à enlever et 57 non mis à jour.
Il est nécessaire de prendre 62,9 Mo dans les archives.
Après cette opération, 266 Mo d'espace disque supplémentaires seront utilisés.
Souhaitez-vous continuer ? [O/n] Y
Réception de :1 http://be.archive.ubuntu.com/ubuntu focal/universe amd64 pigz amd64 2.4-1 [57,4 kB]
Réception de :2 http://be.archive.ubuntu.com/ubuntu focal/main amd64 bridge-utils amd64 1.6-2ubuntu1 [30,5 kB]
Réception de :3 http://be.archive.ubuntu.com/ubuntu focal-updates/main amd64 runc amd64 1.1.7-0ubuntu1~20.04.1 [3.819 kB]
Réception de :4 http://be.archive.ubuntu.com/ubuntu focal-updates/main amd64 containerd amd64 1.7.2-0ubuntu1~20.04.1 [32,5 MB]
Réception de :5 http://be.archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 24.0.5-0ubuntu1~20.04.1 [26,4 MB]
Réception de :6 http://be.archive.ubuntu.com/ubuntu focal-updates/main amd64 ubuntu-fan all 0.12.13ubuntu0.1 [34,4 kB]
62,9 Mo réceptionnés en 34s (1.824 ko/s)
Préconfiguration des paquets...
Sélection du paquet pigz précédemment désélectionné.
(Lecture de la base de données... 328198 fichiers et répertoires déjà installés.)
Préparation du dépaquetage de .../0-pigz_2.4-1_amd64.deb ...
Dépaquetage de pigz (2.4-1) ...
Sélection du paquet bridge-utils précédemment désélectionné.
Préparation du dépaquetage de .../1-bridge-utils_1.6-2ubuntu1_amd64.deb ...
Dépaquetage de bridge-utils (1.6-2ubuntu1) ...
Sélection du paquet runc précédemment désélectionné.
Préparation du dépaquetage de .../2-runc_1.1.7-0ubuntu1~20.04.1_amd64.deb ...
Dépaquetage de runc (1.1.7-0ubuntu1~20.04.1) ...
Sélection du paquet containerd précédemment désélectionné.
Préparation du dépaquetage de .../3-containerd_1.7.2-0ubuntu1~20.04.1_amd64.deb ...
Dépaquetage de containerd (1.7.2-0ubuntu1~20.04.1) ...
Sélection du paquet docker.io précédemment désélectionné.
Préparation du dépaquetage de .../4-docker.io_24.0.5-0ubuntu1~20.04.1_amd64.deb ...
Dépaquetage de docker.io (24.0.5-0ubuntu1~20.04.1) ...
Sélection du paquet ubuntu-fan précédemment désélectionné.
Préparation du dépaquetage de .../5-ubuntu-fan_0.12.13ubuntu0.1_all.deb ...
Dépaquetage de ubuntu-fan (0.12.13ubuntu0.1) ...
Paramétrage de runc (1.1.7-0ubuntu1~20.04.1) ...
Paramétrage de bridge-utils (1.6-2ubuntu1) ...
Paramétrage de pigz (2.4-1) ...
Paramétrage de containerd (1.7.2-0ubuntu1~20.04.1) ...
Paramétrage de ubuntu-fan (0.12.13ubuntu0.1) ...
Created symlink /etc/systemd/system/multi-user.target.wants/ubuntu-fan.service → /lib/systemd/system/ubuntu-fan.service.
Paramétrage de docker.io (24.0.5-0ubuntu1~20.04.1) ...
Traitement des actions différées (« triggers ») pour systemd (245.4-4ubuntu3.22) ...
Traitement des actions différées (« triggers ») pour man-db (2.9.1-1) ...
vendillah deborah ../feedless docker run --env-file=feedless.env --network=feedless-net -it damoeb/feedless:aio
docker: permission denied while trying to connect to the Docker daemon socket at unix:///var/run/docker.sock: Post "http://%2Fvar%2Frun%2Fdocker.sock/v1.24/containers/create": dial unix /var/run/docker.sock: connect: permission denied.
See 'docker run --help'.
vendillah deborah ../feedless docker run --help
# Help ...
vendillah deborah ../feedless podman network create -d bridge feedless-net
/home/vendillah/.config/cni/net.d/feedless-net.conflist
vendillah deborah ../feedless podman run --env-file=feedless.env --network=feedless-net --hostname=postgres -d postgres:15
✔ quay.io/postgres:15
Trying to pull quay.io/postgres:15...
Error: initializing source docker://quay.io/postgres:15: reading manifest 15 in quay.io/postgres: StatusCode: 404, <!doctype html>
<html lang=en>
<title>404 Not Foun...
vendillah deborah ../feedless docker network create -d bridge feedless-net
permission denied while trying to connect to the Docker daemon socket at unix:///var/run/docker.sock: Post "http://%2Fvar%2Frun%2Fdocker.sock/v1.24/networks/create": dial unix /var/run/docker.sock: connect: permission denied
vendillah deborah ../feedless podman run --env-file=feedless.env --network=feedless-net --hostname=postgres -d postgres:15
✔ docker.io/library/postgres:15
Trying to pull docker.io/library/postgres:15...
Getting image source signatures
Copying blob 0887062b031b done
Copying blob 136c0aa94f90 done
Copying blob 834a7fce6be7 done
Copying blob 99d820fe3716 done
Copying blob 1f7ce2fa46ab done
Copying blob 7424befe58d6 done
Copying blob 343a6a92954a done
Copying blob 54fbafc0c84c done
Copying blob 0780e4ae473b done
Copying blob 0e0518459d99 done
Copying blob eddd58e4f8a1 done
Copying blob 97c5119aca7d done
Copying blob a97ae632ca42 done
Copying config 8cde386e2e done
Writing manifest to image destination
Storing signatures
99265b381d71ba84ba4e1e1f08c18181353dd9af70292feb2d05221f2d794db7
vendillah deborah ../feedless podman run --env-file=feedless.env --network=feedless-net -it damoeb/feedless:aio
✔ docker.io/damoeb/feedless:aio
Trying to pull docker.io/damoeb/feedless:aio...
Error: initializing source docker://damoeb/feedless:aio: reading manifest aio in docker.io/damoeb/feedless: manifest unknown: manifest unknown
vendillah deborah ../feedless podman run --env-file=feedless.env --network=feedless-net -it damoeb/feedless:aio
✔ quay.io/damoeb/feedless:aio
Trying to pull quay.io/damoeb/feedless:aio...
Error: initializing source docker://quay.io/damoeb/feedless:aio: reading manifest aio in quay.io/damoeb/feedless: unauthorized: access to the requested resource is not authorized
vendillah deborah ../feedless podman run --env-file=feedless.env --network=feedless-net -it damoeb/feedless:aio --log-level debug
✔ docker.io/damoeb/feedless:aio
Trying to pull docker.io/damoeb/feedless:aio...
Error: initializing source docker://damoeb/feedless:aio: reading manifest aio in docker.io/damoeb/feedless: manifest unknown: manifest unknown
vendillah deborah ../feedless podman list
Error: unrecognized command `podman list`
Try 'podman --help' for more information.
vendillah deborah ../feedless podman --help
# Help ...
vendillah deborah ../feedless podman container list
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
99265b381d71 docker.io/library/postgres:15 postgres 14 minutes ago Up 14 minutes ago strange_edison
vendillah deborah ../feedless podman container --help
# Help ...
vendillah deborah ../feedless podman kill 99265b381d71
99265b381d71
vendillah deborah ../feedless podman rm 99265b381d71
99265b381d71ba84ba4e1e1f08c18181353dd9af70292feb2d05221f2d794db7
vendillah deborah ../feedless podman container list
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
vendillah deborah ../feedless docker network create -d bridge feedless-net
permission denied while trying to connect to the Docker daemon socket at unix:///var/run/docker.sock: Post "http://%2Fvar%2Frun%2Fdocker.sock/v1.24/networks/create": dial unix /var/run/docker.sock: connect: permission denied
vendillah deborah ../feedless sudo docker network create -d bridge feedless-net
[sudo] Mot de passe de vendillah :
890a2e4bddafdf3f97a233f8964594a072f1b07c6565cd538369aeaa074ac57d
vendillah deborah ../feedless docker run --env-file=feedless.env --network=feedless-net --hostname=postgres -d postgres:15
docker: permission denied while trying to connect to the Docker daemon socket at unix:///var/run/docker.sock: Post "http://%2Fvar%2Frun%2Fdocker.sock/v1.24/containers/create": dial unix /var/run/docker.sock: connect: permission denied.
See 'docker run --help'.
vendillah deborah ../feedless sudo docker run --env-file=feedless.env --network=feedless-net --hostname=postgres -d postgres:15
Unable to find image 'postgres:15' locally
15: Pulling from library/postgres
1f7ce2fa46ab: Pull complete
7424befe58d6: Pull complete
136c0aa94f90: Pull complete
99d820fe3716: Pull complete
834a7fce6be7: Pull complete
0887062b031b: Pull complete
343a6a92954a: Pull complete
54fbafc0c84c: Pull complete
0780e4ae473b: Pull complete
0e0518459d99: Pull complete
eddd58e4f8a1: Pull complete
97c5119aca7d: Pull complete
a97ae632ca42: Pull complete
Digest: sha256:da76f1e3d9a1728600f062ba02d8e46b9c521012e87d402ce03e38ef0389979f
Status: Downloaded newer image for postgres:15
4dff5ac4b668e81101ca822079a44c5fba4eb130e087154837a6bbc8e2b9a55c
vendillah deborah ../feedless docker run --env-file=feedless.env --network=feedless-net -it damoeb/feedless:aio
docker: permission denied while trying to connect to the Docker daemon socket at unix:///var/run/docker.sock: Post "http://%2Fvar%2Frun%2Fdocker.sock/v1.24/containers/create": dial unix /var/run/docker.sock: connect: permission denied.
See 'docker run --help'.
vendillah deborah ../feedless sudo docker run --env-file=feedless.env --network=feedless-net -it damoeb/feedless:aio
Unable to find image 'damoeb/feedless:aio' locally
docker: Error response from daemon: manifest for damoeb/feedless:aio not found: manifest unknown: manifest unknown.
See 'docker run --help'.
Can anybody help me out?
curl: (6) Could not resolve host: richrss.migor.org
Have tried to get a feed, containing new posts in this forum topic. And here are screenshots
Sirs:
When I went to the site, there seems to be an issue where the app update pop-up is stuck in a recurring loop.
Allow to share buckets and feeds as public, all entities are private. Native Feeds without authentication should be shared publicly without any transformations.
google requires ssl and a review of the app
Social login adds a dependency that is I contrast to an open self-hosting solution.
Find a mechanism to access websites behind auth layers. The simplest, most extensible way is to provide a field for a header map.
opml, rss-proxy, youtube,...
I've followed the self-hosting guide up to starting the image, neither option works:
[user@fedora feedless]$ docker run --env-file=feedless.env --network=feedless-net -it damoeb/feedless:aio
Unable to find image 'damoeb/feedless:aio' locally
docker: Error response from daemon: manifest for damoeb/feedless:aio not found: manifest unknown: manifest unknown.
See 'docker run --help'.
[user@fedora feedless]$ docker run --env-file=feedless.env --network=feedless-net damoeb/feedless:aio-chromium
Unable to find image 'damoeb/feedless:aio-chromium' locally
docker: Error response from daemon: manifest for damoeb/feedless:aio-chromium not found: manifest unknown: manifest unknown.
See 'docker run --help'.
I assume that the images don't exist.
Optional profile plugin to rewrite youtube to invidious and twitter to nitter as a start
In order to harden, generalize project and to question some of the conceptual descisions taken, I want to reevaluate the code based on some verticals that could be implemented on top of feedless
feed from a page fragment and render pixel, markup or text. As part of this implement a retention strategy size=2, cause deduplication happens on client using article id.
Create one big test flow
Including a migration video from rss-proxy to feedless and archive rss-proxy repo
I am trying to build the image by trial and error in my forked branch.
https://github.com/yellowsoar/feedless/tree/build_image
Still trying to build the image.
find . -type d -ipath "*node_modules*" -exec ls -d "{}" \; -exec rm -rf {} \;
export DOCKER_DEFAULT_PLATFORM=linux/amd64 \
&& docker build \
--file Dockerfile.build \
--tag=feedless:build-7.6.3-jdk17 \
. \
&& docker run \
--name build_feedless \
--rm \
--user root \
--volume "$PWD":/home/gradle/project \
--workdir /home/gradle/project \
feedless:build-7.6.3-jdk17 \
gradle build \
--rerun-tasks \
--scan \
-i
Please help me to make it work.
Some websites don't allow/support head requests. This will raise an error, although this behavior is just an optimization.
Currently the insights into feed/item resolution is bad aside from logs, it only shows that there is an error but not what.
All feeds could be viewed as one structure. You could specify articles by providing parameters like {feedid},{articletypes}
Right now just by using the provided documentation I am not able to build it and I don't seem to be the only one.
Can you make the installation process simpler?
Better documentation or/and simpler installation with a docker image already build.
Thank you.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.