Comments (9)
a-mcf
commented on July 28, 2024
You can see failed pods here, and also note that NextCloud has alot of restarts:
NAME READY STATUS RESTARTS AGE
pod/nextcloud-metrics-59bc579c96-dxmsv 1/1 Running 0 7d18h
pod/nextcloud-mariadb-0 1/1 Running 0 7d18h
pod/nextcloud-cron-27362150--1-9p9f2 0/1 Error 0 3h17m
pod/nextcloud-cron-27362150--1-r68ng 0/1 Error 0 3h17m
pod/nextcloud-cron-27362150--1-f7s7c 0/1 Error 0 3h17m
pod/nextcloud-cron-27362150--1-6hm79 0/1 Error 0 3h17m
pod/nextcloud-cron-27362150--1-kkt4l 0/1 Error 0 3h17m
pod/nextcloud-cron-27362150--1-84nbv 0/1 Error 0 3h17m
pod/nextcloud-cron-27362150--1-mw87s 0/1 Error 0 3h17m
pod/nextcloud-cron-27362155--1-ncvz2 0/1 Error 0 3h12m
pod/nextcloud-cron-27362155--1-9x2kr 0/1 Error 0 3h12m
pod/nextcloud-cron-27362155--1-n8k2v 0/1 Error 0 3h12m
pod/nextcloud-cron-27362155--1-2r6r2 0/1 Error 0 3h12m
pod/nextcloud-cron-27362155--1-gw6mf 0/1 Error 0 3h12m
pod/nextcloud-cron-27362155--1-gdcs4 0/1 Error 0 3h12m
pod/nextcloud-cron-27362155--1-f4972 0/1 Error 0 3h12m
pod/nextcloud-cron-27362160--1-gndkv 0/1 Error 0 3h7m
pod/nextcloud-cron-27362160--1-ts6k6 0/1 Error 0 3h7m
pod/nextcloud-cron-27362160--1-xrzc4 0/1 Error 0 3h7m
pod/nextcloud-cron-27362160--1-98n8j 0/1 Error 0 3h7m
pod/nextcloud-cron-27362160--1-xzjlc 0/1 Error 0 3h7m
pod/nextcloud-cron-27362160--1-cbshr 0/1 Error 0 3h7m
pod/nextcloud-cron-27362160--1-6plsw 0/1 Error 0 3h7m
pod/nextcloud-cron-27362165--1-9c5kx 0/1 Error 0 3h2m
pod/nextcloud-cron-27362165--1-lk2mz 0/1 Error 0 3h2m
pod/nextcloud-cron-27362165--1-f85jk 0/1 Error 0 3h2m
pod/nextcloud-cron-27362165--1-lpgjq 0/1 Error 0 3h2m
pod/nextcloud-cron-27362165--1-l87p8 0/1 Error 0 3h2m
pod/nextcloud-cron-27362165--1-dxjnx 0/1 Error 0 3h2m
pod/nextcloud-cron-27362165--1-bd8qc 0/1 Error 0 3h2m
pod/nextcloud-cron-27362180--1-272bv 0/1 Error 0 167m
pod/nextcloud-cron-27362180--1-rjvxg 0/1 Error 0 167m
pod/nextcloud-cron-27362180--1-lpc4g 0/1 Error 0 167m
pod/nextcloud-cron-27362180--1-5zddm 0/1 Error 0 167m
pod/nextcloud-cron-27362180--1-gm5nc 0/1 Error 0 167m
pod/nextcloud-cron-27362180--1-plmxf 0/1 Error 0 167m
pod/nextcloud-cron-27362180--1-vs4j4 0/1 Error 0 167m
pod/nextcloud-5db9fd9bf-6fzm5 1/1 Running 168 (142m ago) 7d18h
pod/nextcloud-cron-27362340--1-4xmmb 0/1 Completed 0 7m18s
pod/nextcloud-cron-27362345--1-dvxsz 0/1 Completed 0 2m18s
It looks like NC is throwing 503s
> kubectl logs pod/nextcloud-cron-27362150--1-9p9f2 -n nextcloud
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
curl: (22) The requested URL returned error: 503
from k3s-gitops.
a-mcf
commented on July 28, 2024
The nextcloud logs show some intermittent errors regarding name resolution. I think these occured while updating kube-prometheus-stack and may be a consequence of only having on master, or of that master being underpowered. Here are recycle times from yesterday:
Saturday, January 8, 2022 11:44:17 AM
Saturday, January 8, 2022 11:44:17 AM
Saturday, January 8, 2022 11:44:17 AM
Saturday, January 8, 2022 11:44:17 AM
Saturday, January 8, 2022 3:27:57 PM
Saturday, January 8, 2022 3:27:57 PM
Saturday, January 8, 2022 3:27:57 PM
Saturday, January 8, 2022 4:54:42 PM
Saturday, January 8, 2022 4:54:42 PM
Saturday, January 8, 2022 4:54:47 PM
Saturday, January 8, 2022 4:54:47 PM
Saturday, January 8, 2022 4:54:47 PM
Saturday, January 8, 2022 4:55:52 PM
Saturday, January 8, 2022 4:55:52 PM
Saturday, January 8, 2022 4:59:12 PM
Saturday, January 8, 2022 4:59:07 PM
Saturday, January 8, 2022 5:34:17 PM
Saturday, January 8, 2022 5:34:17 PM
Saturday, January 8, 2022 5:43:43 PM
Saturday, January 8, 2022 5:43:43 PM
While this could just be related to events failing while tinkering with the cluster yesterday, there have been some nextcloud restarts, the last of which doesn't correspond to anything in particular, except for some possible k3s upgrades happening. I'm going to need to mop this up for now and swing back later if I'm still getting alerts.
from k3s-gitops.
a-mcf
commented on July 28, 2024
Found this:
[Mon Jan 10 10:09:44.387577 2022] [mpm_prefork:notice] [pid 1] AH00170: caught SIGWINCH, shutting down gracefully
This is apparently a signal used for console resize, and something that Apache uses for graceful shutdown. So, the question is, "is there an issue where sigwinch is being called by mistake, or is there an issue and Apache is trying to gracefully fail?" -- we'll see.
from k3s-gitops.
a-mcf
commented on July 28, 2024
There is some discussion here about an alternate way to run cron:
https://github.com/nextcloud/helm/issues/55
from k3s-gitops.
a-mcf
commented on July 28, 2024
I think I'm going to try aping some stuff from this config. It's using the alpine image and just starting crond off to the side.
https://github.com/sseneca/k8s-server/blob/master/nextcloud/release.yaml
from k3s-gitops.
a-mcf
commented on July 28, 2024
I switched the container and got it to come up, but with 503 errors. This is likely to the user running as a different account under alpine / nginx. Nextcloud doesn't allow you to create the user, so nfs permissions would need to be set on the other end.
I'm going to flip this back to apache for the time being and see what happens. I suspect I'll still get restarts, but it's not critical right now.
from k3s-gitops.
a-mcf
commented on July 28, 2024
The hack that starts crond inside the container didn't work with the apache container. So, my choices will be to:
- Deal with ajax cron
- Wait for the sidecar container to get merged (and also for the new flux release with helm 3.72)
- Sort out the perms and switch alpine.
For now, I'm going to deploy this as-is and see what my stability looks like.
from k3s-gitops.
a-mcf
commented on July 28, 2024
When it rains, it pours. Was also locked out because the 2fa app got disabled during the upgrade. Fixed it with this:
kubectl exec -n nextcloud --stdin --tty nextcloud-756fd6564f-sgc64 -- su -p www-data -s /bin/bash -c '/var/www/html/occ app:update --all'
2067 kubectl exec -n nextcloud --stdin --tty nextcloud-756fd6564f-sgc64 -- su -p www-data -s /bin/bash -c '/var/www/html/occ app:enable twofactor_u2f'
from k3s-gitops.
a-mcf
commented on July 28, 2024
I'm going to go with the new owncloud instead. I'll revisit this if I redeploy nextcloud.
from k3s-gitops.
Related Issues (20)
- Nextcloud Helm Release Incompatiblity HOT 2
- Consolidated MySQL DB?
- Switch from GNU make to Task
- Fix: PVCs in state: "Lost" HOT 6
- Research Prometheus Alert Rules
- Investigate Weave Scope HOT 1
- Renovate Dashboard
- figure out why the cert-manager CRD isn't working. HOT 2
- Investigate GitLeaks
- Investigate Istio HOT 2
- Investigate AudioBookShelf HOT 1
- Set up notifications with flux. HOT 2
- Investigate https://github.com/kubernetes/node-problem-detector HOT 1
- Investigate trivy for container security scanning
- MetalLB 0.13.x doesn't work with tailscale HOT 2
- Migrate off of KAH Charts
- CRDs for Loki
- Get rid of CRDS directory. HOT 1
- Storage issues with Longhorn after upgrade to 1.25 HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from k3s-gitops.