hyperjumptech/monika

Asymmetric Recovery

Closed this issue · 0 comments

sapiderman commented

Describe the bug

  1. When identical probes encounter incident, notifications sent to all of them.
  2. But when Recovered, only one notification is sent.

To Reproduce
Steps to reproduce the behavior:

  1. use the following config:
probes:
  - id: 'mock-1'
    name: 'local-test'
    requests:
      - url: http://0.0.0.0:7001/v1/hello
    alerts:
      - assertion: response.status != 200
        message: message 11

  - id: 'mock-2'
    name: 'local-test-no-alert'
    requests:
      - url: http://0.0.0.0:7001/v1/hello

  - id: 'mock-3'
    name: 'local-test-no-alert'
    requests:
      - url: http://0.0.0.0:7001/v1/hello
  1. Disable the local server (0.0.0.0)
  2. Expect 3 incident notifications sent
  3. Turn back on the local server (0.0.0.0)
  4. Expect 3 recovery notifications sent... but only one received

Screenshots

  1. Startup and Incident
    image

  2. Recovery:
    image

  3. Email, startup, incident, recovery notifications.
    image

Desktop (please complete the following information):

  • OS: Linux Ubuntu 22.04
  • From src: main brnach