Comments (1)
Hi! 👋
I think the main issue here is that Alertmanager cannot close incidents if all alerts in a group are silenced.
When silencing alerts for an active incident, you need to take care and make sure the incident is closed in your IRM (Opsgenie). If you leave the incident open, and new alerts are sent from Alertmanager to the same incident, you may or may not get paged for them.
I also recommend checking your Opsgenie configuration, as it sounds like the incident might have been left open by mistake? This shouldn't happen as you should be paged at regular intervals for active incidents until they are resolved.
To answer some of your questions:
Add group creation time to group_by hash
This won't work I'm afraid. Consider the case where the system clock on two Alertmanager servers are out of sync by 1ns. You will have different group creation times on each Alertmanager server, creating duplicate incidents in your IRM.
A new batch of alerts should not be grouped into an already resolved group
Given it had been a week since the last alert was resolved, and I assume there were no other active alerts in the group during that time, Alertmanager would have created a new group for these new alerts. However, group keys are deterministic, and if a group is "re-opened" it will re-use the same group key. This is intentional.
from alertmanager.
Related Issues (20)
- Microsoft deprecating Teams webhooks, new "Workflows" uses incompatible schema HOT 34
- Discord webhook : Cannot send an empty message HOT 4
- Feature Request: Enable Sending AdaptiveCards to Webex for Enhanced Alert Notifications
- Feature Request: Google cloud storage module
- Release a feature from a main branch HOT 2
- Inhibition rules evaluation performance on many target alerts HOT 5
- MS Teams alert card does not show info on mobile interface HOT 11
- Decode plus sign ('+') as a space (' ' or '%20') when decoding silence filters
- [Feature Request] Add `visibleTo` field to OpsGenie integration HOT 3
- [feature request] matchers to work with annotations HOT 1
- Multiple vulnerabilities detected (govulncheck)
- Test certificates expiring in <2y
- Feature Request: Consider a Global Restriction on Silence Duration HOT 1
- Incorrect silence queryDuration metric HOT 1
- The gossip function is not working in webhook_configs.
- Add Metric Buckets for Notification Latency HOT 6
- Add docker tags for major/minor/patch versions HOT 3
- SMTP notifier does not await submission completion HOT 2
- Alertmanager sending duplicate notifications after 'resolved' notification when running with multiple replicas
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from alertmanager.