[Bug]: Postgres metrics stopped working in latest update about netdata HOT 5 CLOSED

Can I get an update on this? This is still completely broken.

from netdata.

@cacraig what version of the Netdata agent are you currently running? And I presume all non-postgres metrics are being displayed properly?

Also could you please execute the troubleshooting steps mentioned in the documentation and share the output with us.

https://learn.netdata.cloud/docs/collecting-metrics/databases/postgresql#troubleshooting

Sorry for the delayed response on this, the long weekend has made it a bit hard to move fast here. The engineering team will start investigating on Monday and the above information (if you can share it) will be helpful.

I also checked if this is reproducible on our demo space, and I don't see the issue. Postgres metrics are being displayed accurately (This is running Netdata Agent:v1.45.0-75-nightly)

https://app.netdata.cloud/spaces/netdata-demo/rooms/postgresql

from netdata.

Hey @shyamvalsan - Running v1.45.1 .

This is what I see with ./go.d.plugin -d -m postgres.

INF module/job.go:267 stopped collector=postgres job=local
CONFIG go.d:collector:postgres:local create accepted job /collectors/jobs discovered 'discoverer=net_listeners,host=localhost,file=/usr/lib/netdata/conf.d/go.d/sd/net_listeners.conf' 'schema get enable disable update restart test' 0x0000 0x0000

DBG jobmgr/manager.go:293 creating postgres[local] job, config: map[__provider__:sd:net_listeners __source__:discoverer=net_listeners,host=localhost,file=/usr/lib/netdata/conf.d/go.d/sd/net_listeners.conf __source_type__:discovered autodetection_retry:0 dsn:postgresql://[email protected]:5432/postgres module:postgres name:local priority:70000 update_every:1] component="job manager"
ERR postgres/postgres.go:127 error on pinging the Postgres database [postgresql://[email protected]:5432/postgres]: failed to connect to `host=127.0.0.1 user=netdata database=postgres`: failed SASL auth (FATAL: password authentication failed for user "netdata" (SQLSTATE 28P01)) collector=postgres job=local
ERR module/job.go:238 check failed collector=postgres job=local
CONFIG go.d:collector:postgres:local status failed

CONFIG go.d:collector:pgbouncer:local create accepted job /collectors/jobs discovered 'discoverer=net_listeners,host=localhost,file=/usr/lib/netdata/conf.d/go.d/sd/net_listeners.conf' 'schema get enable disable update restart test' 0x0000 0x0000

WRN jobmgr/dyncfg.go:380 dyncfg: enable: module pgbouncer job local: failed to apply config: can not find pgbouncer module component="job manager"
CONFIG go.d:collector:pgbouncer:local status failed

The charts were all working before the last update. This is occurring on all of our servers with postgres.

Thanks!

• Colin

from netdata.

@cacraig moving this to netdata/netdata repo since this seems an Agent issue and asking some further details to help the team troubleshoot this:

• Installation method
  
• System info Provide information about your system. To get this information, execute one of the following commands based on your OS:

# Linux
uname -a; grep -HvE "^#|URL" /etc/*release
# BSD
uname -a; uname -K
# macOS
uname -a; sw_vers

• Netdata build info _Provide Netdata Agent version and build info. To get this information, execute: _

netdata -W buildinfo
# If get "netdata: command not found", try (required running Netdata)
$(ps aux | grep -m1 -E -o "[a-zA-Z/]+netdata ") -W buildinfo

@ilyam8 in the meantime, is there something useful from the debug output that could hepl start the investigation?

from netdata.

ERR postgres/postgres.go:127 error on pinging the Postgres database [postgresql://[email protected]:5432/postgres]: failed to connect to host=127.0.0.1 user=netdata database=postgres: failed SASL auth (FATAL: password authentication failed for user "netdata" (SQLSTATE 28P01)) collector=postgres job=local

@cacraig how did you configure auth? Did you use passwordless unix connection? Do you have

local   all             postgres                                trust

in pg_hba.conf?

from netdata.