Comments (5)
qw1mb0
commented on June 30, 2024
Thank you for your feedback!
However, these logs have no information about ClickHouse's crash. Can you please provide "describe" for your pod? If PVC has been also used, please provide describe PVC as well. It will help us to investigate this issue.
from loghouse.
valentin2105
commented on June 30, 2024
So,
After small investigations,
The container crash due of Liveness probe that doesn't pass :
Started container
pulling image "flant/loghouse-clickhouse:latest"
Liveness probe failed: dial tcp [1404:f210:d:83::8404:d35f]:9000: getsockopt: connection refused
So I have made this change : <listen_host>::</listen_host>
Now, the clickhouse server seem running fine, but now the backend pod crash due of failed to load command: puma.
Puma starting in single mode...
* Version 3.10.0 (ruby 2.3.4-p301), codename: Russell's Teapot
* Min threads: 0, max threads: 16
* Environment: production
* Listening on tcp://0.0.0.0:9292
Use Ctrl-C to stop
- Gracefully stopping, waiting for requests to finish
=== puma shutdown: 2017-11-02 23:38:54 +0000 ===
- Goodbye!
bundler: failed to load command: puma (/usr/local/bundle/bin/puma)
SignalException: SIGTERM
/usr/local/bundle/gems/puma-3.10.0/lib/puma/launcher.rb:397:in `block in setup_signals'
/usr/local/bundle/gems/puma-3.10.0/lib/puma/single.rb:106:in `join'
/usr/local/bundle/gems/puma-3.10.0/lib/puma/single.rb:106:in `run'
/usr/local/bundle/gems/puma-3.10.0/lib/puma/launcher.rb:183:in `run'
/usr/local/bundle/gems/puma-3.10.0/lib/puma/cli.rb:77:in `run'
/usr/local/bundle/gems/puma-3.10.0/bin/puma:10:in `<top (required)>'
/usr/local/bundle/bin/puma:17:in `load'
/usr/local/bundle/bin/puma:17:in `<top (required)>'
from loghouse.
qw1mb0
commented on June 30, 2024
Sorry for the long wait, as can be seen from the errors, the backend came SIGTERM, which is sent when livenessprobe makes a mistake.
Can you provide a describe pod?
from loghouse.
diafour
commented on June 30, 2024
Reproduce this behavior on local cluster with loghouse-dashboard image built from master branch :(
Puma starting in single mode...
* Version 3.10.0 (ruby 2.3.4-p301), codename: Russell's Teapot
* Min threads: 0, max threads: 16
* Environment: production
! Unable to load application: Clickhouse::QueryError: Got status 404 (expected 200): Code: 81, e.displayText() = DB::Exception: Database logs doesn't exist, e.what() = DB::Exception
bundler: failed to load command: puma (/usr/local/bundle/bin/puma)
Clickhouse::QueryError: Got status 404 (expected 200): Code: 81, e.displayText() = DB::Exception: Database logs doesn't exist, e.what() = DB::Exception
/usr/local/bundle/bundler/gems/clickhouse-6b00d0459d06/lib/clickhouse/connection/client.rb:70:in `request'
/usr/local/bundle/bundler/gems/clickhouse-6b00d0459d06/lib/clickhouse/connection/client.rb:30:in `post'
/usr/local/bundle/bundler/gems/clickhouse-6b00d0459d06/lib/clickhouse/connection/query.rb:10:in `execute'
/usr/local/bundle/bundler/gems/clickhouse-6b00d0459d06/lib/clickhouse/connection/query.rb:48:in `exists_table'
/app/lib/loghouse_query/table.rb:46:in `table_exists?'
/app/lib/loghouse_query/table.rb:50:in `create_table_with_migration!'
/app/config/clickhouse.rb:9:in `<top (required)>'
/app/config/boot.rb:21:in `require_relative'
/app/config/boot.rb:21:in `<top (required)>'
/app/application.rb:1:in `require_relative'
/app/application.rb:1:in `<top (required)>'
config.ru:1:in `require_relative'
config.ru:1:in `block in <main>'
/usr/local/bundle/gems/rack-2.0.4/lib/rack/builder.rb:55:in `instance_eval'
/usr/local/bundle/gems/rack-2.0.4/lib/rack/builder.rb:55:in `initialize'
config.ru:in `new'
config.ru:in `<main>'
/usr/local/bundle/gems/rack-2.0.4/lib/rack/builder.rb:49:in `eval'
/usr/local/bundle/gems/rack-2.0.4/lib/rack/builder.rb:49:in `new_from_string'
/usr/local/bundle/gems/rack-2.0.4/lib/rack/builder.rb:40:in `parse_file'
/usr/local/bundle/gems/puma-3.10.0/lib/puma/configuration.rb:314:in `load_rackup'
/usr/local/bundle/gems/puma-3.10.0/lib/puma/configuration.rb:243:in `app'
/usr/local/bundle/gems/puma-3.10.0/lib/puma/runner.rb:138:in `load_and_bind'
/usr/local/bundle/gems/puma-3.10.0/lib/puma/single.rb:87:in `run'
/usr/local/bundle/gems/puma-3.10.0/lib/puma/launcher.rb:183:in `run'
/usr/local/bundle/gems/puma-3.10.0/lib/puma/cli.rb:77:in `run'
/usr/local/bundle/gems/puma-3.10.0/bin/puma:10:in `<top (required)>'
/usr/local/bundle/bin/puma:17:in `load'
/usr/local/bundle/bin/puma:17:in `<top (required)>'
from loghouse.
diafour
commented on June 30, 2024
Oops. That is a different story.
clickhouse pod started slowly and loghouse-init-db job failed. kubectl replace --force thi job, delete loghouse pod and loghouse has RUNNING state.
from loghouse.
Related Issues (20)
- Clickhouse doesn't respect cpu and memory limits HOT 1
- hierarchical JSON in log HOT 2
- Display multiline values with "pre" attribute HOT 1
- Helm chart: Clickhouse should be managed by StatefulSet instead of Deployment HOT 2
- Persistent volumes should be initialized
- Export in CSV file doesn't work HOT 3
- jessie-updates: 404 Not Found HOT 1
- Logs are not displayed on the dashboard
- Is there docker only (without kubernetes) installation method ? HOT 1
- Error deploying loghouse to GKE HOT 4
- Propose to add docker-compose file HOT 1
- Migrate release process to Github Actions
- Example configuration for external clickhouse? HOT 7
- Can Fluentd we swapped out for Fluent Bit by just changing the values.yaml image? HOT 1
- Helm chart is not compatible with the current cert-manager stable release HOT 1
- Unable to filter by label containing slash / symbol
- loghouse support containerd and fluent bit ?
- Logs UI
- PVC settings can't parse HOT 1
- Clickhouse still not respecting CPUShares in the latest version HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from loghouse.