Commit Graph

45 Commits

Author SHA1 Message Date
Felix Albrigtsen 55e8f01d1d Upgrade ildkule (!36)
Eval nix flake / evals (push) Failing after 3h12m29s Details
This PR is made while moving Ildkule from PVE on joshua, to Openstack on stack.it.ntnu.no.

- The main monitoring dashboard is moved from https://ildkule.pvv.ntnu.no to https://grafana.pvv.ntnu.no.
- A new service is added: uptime-kuma on https://uptime.pvv.ntnu.no.
- The (hardware) configuration for ildkule is updated to fit the new virtualization environment, boot loader, network interfaces, etc.
- Metrics exporters on other hosts should be updated to allow connections from the new host

As this is the first proper server running on openstack, and therefore outside our main IP range, we might discover challenges in our network structure. For example, the database servers usually only allow connections from this range, so Ildkule can no longer access it. This should be explored, documented and/or fixed as we move more services.

Reviewed-on: #36
Co-authored-by: Felix Albrigtsen <felix@albrigtsen.it>
Co-committed-by: Felix Albrigtsen <felix@albrigtsen.it>
2024-04-21 23:36:25 +02:00
Oystein Kristoffer Tveit 065992620e treewide: nginx optimizations
Eval nix flake / evals (push) Failing after 1m47s Details
Eval nix flake / evals (pull_request) Failing after 1m54s Details
2024-04-10 22:06:44 +02:00
Oystein Kristoffer Tveit 3caa66fb64
rename input: unstable -> nixpkgs-unstable
Eval nix flake / evals (push) Successful in 3m3s Details
2023-11-05 01:22:48 +01:00
Oystein Kristoffer Tveit 34a16149f8 ildkule: add config for prometheus_mysqld_exporter
There's a PR waiting to add this module to nixpkgs,
so we should enable this once it gets merged.
2023-07-10 00:06:27 +02:00
Daniel Lovbrotte Olsen 699569249a ildkule: adjust matrix version annotations for nixos matrix module 2023-06-20 14:01:44 +02:00
Daniel Lovbrotte Olsen e73b7d2cd1 ildule: fix upstream dashboard variables 2023-06-20 13:46:00 +02:00
Daniel Lovbrotte Olsen ff30477e86 ildule: Update matrix dashboard from upstream 2023-06-20 13:20:42 +02:00
Daniel Lovbrotte Olsen dfd827ee74 Clean up jokum removal 2023-05-23 04:29:45 +02:00
Felix Albrigtsen 1335ab1d4b Add metrics exporters to bekkalokk 2023-05-21 04:03:14 +02:00
Felix Albrigtsen 2568800794 Add andresbu to node-exporter targets 2023-03-12 00:41:36 +01:00
Daniel Lovbrotte Olsen 70f4777696 fix synapse dashboard 2023-03-04 05:11:40 +01:00
Daniel Lovbrotte Olsen db69d28b42 Revert "metrics: Fix Synapse dashboard"
This reverts commit beb8df8fc7.
2023-03-04 03:14:54 +01:00
Daniel Lovbrotte Olsen 6cf831a347 switch to networkd 2023-03-04 00:44:30 +01:00
Daniel Lovbrotte Olsen beb8df8fc7 metrics: Fix Synapse dashboard
Some of the panels were set to the wrong
datasource

Additionally since we don't do MAU limits,
I moved the relevant MAU panel to Overview
2023-02-01 22:54:54 +01:00
Oystein Kristoffer Tveit efc8eb7ffc
ildkule: add postgres exporter for knakelibrak 2023-01-26 02:16:52 +01:00
Felix Albrigtsen 84b57bb4db Provision go dashboard for gogs 2023-01-23 14:48:26 +01:00
Felix Albrigtsen b4e74a3959 Add node and gogs metrics collection to prometheus 2023-01-23 13:12:46 +01:00
Oystein Kristoffer Tveit a78f120a65
explicitly state nginx listen addresses 2023-01-22 17:46:48 +01:00
Oystein Kristoffer Tveit 3880190577
ildkule: add postgres dashboard to grafana 2023-01-22 02:28:19 +01:00
Oystein Kristoffer Tveit 171fea39bc
ildkule: switch grafana db from sqlite to postgres 2023-01-22 02:18:21 +01:00
Oystein Kristoffer Tveit 2bc5d7d91e
ildkule: set up postgres metrics exporter 2023-01-22 00:47:22 +01:00
Oystein Kristoffer Tveit a7408b8800
ildkule: restructure prometheus config 2023-01-21 20:08:36 +01:00
Oystein Kristoffer Tveit ad75cb0c88
Restructure values file to separate hosts from services 2023-01-21 19:54:20 +01:00
Daniel Lovbrotte Olsen 94fc936251 ildkule: use ip addressess from values.nix 2023-01-21 11:45:05 +01:00
Felix Albrigtsen ecfde9f56a Update ildkule IPv6-address 2023-01-20 11:40:42 +01:00
Daniel Lovbrotte Olsen efed13c810 Revert "metrics: stop parsing prometheus labels from url"
This reverts commit 1524b6b10c.

Prometheus doesn't allow scraping from uris only socketAddresses
The relabeling is to change the internal labels to trick it to read
from a url
2023-01-20 05:04:16 +01:00
Oystein Kristoffer Tveit 1524b6b10c
metrics: stop parsing prometheus labels from url 2023-01-20 01:15:45 +01:00
Daniel Lovbrotte Olsen 1330c9575f metrics/dashboards/synapse: update default timeframe 2023-01-17 18:57:32 +01:00
Daniel Lovbrotte Olsen 4a82d22a56 Merge branch 'jokum_logs' of Drift/pvv-nixos-config into main 2023-01-17 18:50:41 +01:00
Daniel Lovbrotte Olsen 524bbdb78b ildkule/dashboard/synapse: Make zooming out on the cpu graph aggregate max cpu instead of avg 2023-01-17 17:37:44 +01:00
Daniel Lovbrotte Olsen 5b798b2f1d jokum: enable metric exporters 2023-01-17 17:28:47 +01:00
Daniel Lovbrotte Olsen e4cb215d39 Simplify networking configs
Introduces values.nix, a place to store information relevant across systems
2023-01-17 17:28:11 +01:00
Felix Albrigtsen e679c7d27a Add bicep and hildring to monitoring 2023-01-17 13:47:48 +01:00
Felix Albrigtsen 084313e01d Add ildkule to prometheus targets 2023-01-14 22:45:01 +01:00
Felix Albrigtsen 40c67c6153 Removed motd extras 2022-12-20 23:15:52 +01:00
Felix Albrigtsen f6cc25cdaf Add synapse monitoring with prometheus 2022-12-20 23:11:46 +01:00
Felix Albrigtsen a45a08db57 Cleanup ildkule configs 2022-12-20 23:11:46 +01:00
Felix Albrigtsen fcdce57a3d SSL and loki network config 2022-12-20 18:11:32 +01:00
Felix Albrigtsen c0b5932432 Improve grafana config, enable boltdb-shipper 2022-12-20 18:11:32 +01:00
Felix Albrigtsen ed46e9af61 Add a default dashboard 2022-12-20 18:11:32 +01:00
Felix Albrigtsen a2f71ba120 ildkule-grafana upgrades 2022-12-20 18:11:32 +01:00
Felix Albrigtsen 2236863f09 Add a new metrics stack 2022-12-20 18:11:32 +01:00
Felix Albrigtsen 1de68ee0e2 ildkule: hardware-configuration.nix 2022-12-20 18:11:28 +01:00
Felix Albrigtsen 1429a1b51b Simplify nginx on ildkule 2022-12-20 18:06:49 +01:00
Felix Albrigtsen 6b1f0eb090 Add host ildkule 2022-12-17 21:51:43 +01:00