Commit Graph

60 Commits

Author SHA1 Message Date
3bdfb4c297 Add function to make paths from flake root
No more ../../../../../../
2024-11-17 00:08:02 +01:00
2d52ebce52 Ildkule: hardware-config: use UUIDs 2024-11-09 21:42:44 +01:00
11f6ef0572 Ildkule: Move monitoring state directories to data volume 2024-11-09 15:21:12 +01:00
0f77a42e34 Grafana: Add Gitea Dashbaord [sic] 2024-09-14 20:28:35 +02:00
c64d28fc26 Prometheus: Monitor gitea metrics 2024-09-14 20:21:12 +02:00
47d7b88a05 ildkule/prometheus: consolidate scrape jobs and label with hostname for base info 2024-09-05 14:14:28 +02:00
ca287b95c9 Ildkule/openstack: fix networking
Removes systemd-networkd, and configures proper ipv4 and ipv6 in
openstack.
2024-09-05 00:24:22 +02:00
669733309b ildkule: get systemd stats from more machines 2024-09-03 13:10:36 +02:00
4ed12573ff ildkule: fix system activation by disabling smartd 2024-09-03 13:07:58 +02:00
b4c602e31c metrics: install systemd exporter 2024-09-02 23:12:24 +02:00
8610a59f35
base.nix: split into multiple files 2024-08-31 22:28:17 +02:00
9dbf5d56f5 fix whitespacing issues 2024-08-04 04:37:23 +02:00
1714681532 statix fix 2024-08-04 01:46:00 +02:00
2030d4de39 fix-openstack-networking (!47)
Fix networking in Openstack.

This rewrites the systemd-networkd config, fixing both dhcp and manual address/route configurations.
Now, everything should behave predictably, routing NTNU-internal and NTNU-global addresses separately and properly across both ipv4 and ipv6.

Reviewed-on: #47
2024-07-31 11:23:00 +02:00
ca2deed668 WIP: all: Update to nixos-24.05 2024-06-30 01:55:25 +02:00
55e8f01d1d Upgrade ildkule (!36)
Some checks failed
Eval nix flake / evals (push) Failing after 3h12m29s
This PR is made while moving Ildkule from PVE on joshua, to Openstack on stack.it.ntnu.no.

- The main monitoring dashboard is moved from https://ildkule.pvv.ntnu.no to https://grafana.pvv.ntnu.no.
- A new service is added: uptime-kuma on https://uptime.pvv.ntnu.no.
- The (hardware) configuration for ildkule is updated to fit the new virtualization environment, boot loader, network interfaces, etc.
- Metrics exporters on other hosts should be updated to allow connections from the new host

As this is the first proper server running on openstack, and therefore outside our main IP range, we might discover challenges in our network structure. For example, the database servers usually only allow connections from this range, so Ildkule can no longer access it. This should be explored, documented and/or fixed as we move more services.

Reviewed-on: #36
Co-authored-by: Felix Albrigtsen <felix@albrigtsen.it>
Co-committed-by: Felix Albrigtsen <felix@albrigtsen.it>
2024-04-21 23:36:25 +02:00
065992620e treewide: nginx optimizations
Some checks failed
Eval nix flake / evals (push) Failing after 1m47s
Eval nix flake / evals (pull_request) Failing after 1m54s
2024-04-10 22:06:44 +02:00
3caa66fb64
rename input: unstable -> nixpkgs-unstable
All checks were successful
Eval nix flake / evals (push) Successful in 3m3s
2023-11-05 01:22:48 +01:00
34a16149f8 ildkule: add config for prometheus_mysqld_exporter
There's a PR waiting to add this module to nixpkgs,
so we should enable this once it gets merged.
2023-07-10 00:06:27 +02:00
699569249a ildkule: adjust matrix version annotations for nixos matrix module 2023-06-20 14:01:44 +02:00
e73b7d2cd1 ildule: fix upstream dashboard variables 2023-06-20 13:46:00 +02:00
ff30477e86 ildule: Update matrix dashboard from upstream 2023-06-20 13:20:42 +02:00
dfd827ee74 Clean up jokum removal 2023-05-23 04:29:45 +02:00
1335ab1d4b Add metrics exporters to bekkalokk 2023-05-21 04:03:14 +02:00
2568800794 Add andresbu to node-exporter targets 2023-03-12 00:41:36 +01:00
70f4777696 fix synapse dashboard 2023-03-04 05:11:40 +01:00
db69d28b42 Revert "metrics: Fix Synapse dashboard"
This reverts commit beb8df8fc7.
2023-03-04 03:14:54 +01:00
6cf831a347 switch to networkd 2023-03-04 00:44:30 +01:00
beb8df8fc7 metrics: Fix Synapse dashboard
Some of the panels were set to the wrong
datasource

Additionally since we don't do MAU limits,
I moved the relevant MAU panel to Overview
2023-02-01 22:54:54 +01:00
efc8eb7ffc
ildkule: add postgres exporter for knakelibrak 2023-01-26 02:16:52 +01:00
84b57bb4db Provision go dashboard for gogs 2023-01-23 14:48:26 +01:00
b4e74a3959 Add node and gogs metrics collection to prometheus 2023-01-23 13:12:46 +01:00
a78f120a65
explicitly state nginx listen addresses 2023-01-22 17:46:48 +01:00
3880190577
ildkule: add postgres dashboard to grafana 2023-01-22 02:28:19 +01:00
171fea39bc
ildkule: switch grafana db from sqlite to postgres 2023-01-22 02:18:21 +01:00
2bc5d7d91e
ildkule: set up postgres metrics exporter 2023-01-22 00:47:22 +01:00
a7408b8800
ildkule: restructure prometheus config 2023-01-21 20:08:36 +01:00
ad75cb0c88
Restructure values file to separate hosts from services 2023-01-21 19:54:20 +01:00
94fc936251 ildkule: use ip addressess from values.nix 2023-01-21 11:45:05 +01:00
ecfde9f56a Update ildkule IPv6-address 2023-01-20 11:40:42 +01:00
efed13c810 Revert "metrics: stop parsing prometheus labels from url"
This reverts commit 1524b6b10c.

Prometheus doesn't allow scraping from uris only socketAddresses
The relabeling is to change the internal labels to trick it to read
from a url
2023-01-20 05:04:16 +01:00
1524b6b10c
metrics: stop parsing prometheus labels from url 2023-01-20 01:15:45 +01:00
1330c9575f metrics/dashboards/synapse: update default timeframe 2023-01-17 18:57:32 +01:00
4a82d22a56 Merge branch 'jokum_logs' of Drift/pvv-nixos-config into main 2023-01-17 18:50:41 +01:00
524bbdb78b ildkule/dashboard/synapse: Make zooming out on the cpu graph aggregate max cpu instead of avg 2023-01-17 17:37:44 +01:00
5b798b2f1d jokum: enable metric exporters 2023-01-17 17:28:47 +01:00
e4cb215d39 Simplify networking configs
Introduces values.nix, a place to store information relevant across systems
2023-01-17 17:28:11 +01:00
e679c7d27a Add bicep and hildring to monitoring 2023-01-17 13:47:48 +01:00
084313e01d Add ildkule to prometheus targets 2023-01-14 22:45:01 +01:00
40c67c6153 Removed motd extras 2022-12-20 23:15:52 +01:00