nixos-upgrade.service: send notification on failure #396

Open
opened 2026-06-21 18:15:04 +02:00 by oysteikt · 4 comments
Owner

webhooks to a matrix room or via sendmail maybe, it's not extremely important but would be nice to know.

webhooks to a matrix room or via sendmail maybe, it's not extremely important but would be nice to know.
oysteikt added the nixoslogging labels 2026-06-21 18:15:04 +02:00
oysteikt added this to the Kanban project 2026-06-21 18:15:04 +02:00
Owner

When we talked about this before, we found that one obvious solution is to use our log monitoring to alert on certain journald log lines, for example if certain services/timers fail. This lets us use a single, central service made explicitly for monitoring and alerting, rather than tacking webhooks onto every service on every host.

When we talked about this before, we found that one obvious solution is to use our log monitoring to alert on certain journald log lines, for example if certain services/timers fail. This lets us use a single, central service made explicitly for monitoring and alerting, rather than tacking webhooks onto every service on every host.
Author
Owner

We could do something inbetween so we don't become dependent on a single machine maybe. What about setting up services.journalwatch in base and having them send to one or more common hooks or email addresses?

We could do something inbetween so we don't become dependent on a single machine maybe. What about setting up `services.journalwatch` in `base` and having them send to one or more common hooks or email addresses?
Author
Owner

That being said though, anything is better than nothing.

That being said though, anything is better than nothing.
Owner

we should notify when its older than x or something. We had an exporter and dashboard and everything on the old ildkule 😢

we should notify when its older than x or something. We had an exporter and dashboard and everything on the old ildkule 😢
Sign in to join this conversation.
3 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Drift/issues#396