Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Ported monitoring stack to k3s #449

Open
wants to merge 102 commits into
base: feature/k3s-ansible-init
Choose a base branch
from
Open

Ported monitoring stack to k3s #449

wants to merge 102 commits into from

Commits on Sep 19, 2024

  1. Added prometheus operator role compatible with state_dir (still needs… 

    … more affinity)
    @wtripp180901
    wtripp180901 committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    108fa7c View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2024

  1. Merge branch 'feature/k3s-ansible-init' into feature/k3s-monitoring

    @wtripp180901
    wtripp180901 committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    8f2977c View commit details
    Browse the repository at this point in the history

  2. Added node selectors for non-exporter pods

    @wtripp180901
    wtripp180901 committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    9836ef8 View commit details
    Browse the repository at this point in the history

  3. Added services for monitoring

    @wtripp180901
    wtripp180901 committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    d790b2b View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. WIP porting prometheus rolevars

    @wtripp180901
    wtripp180901 committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    10af75d View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. Added ingress for monitoring services

    @wtripp180901
    wtripp180901 committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    7b29a3b View commit details
    Browse the repository at this point in the history

  2. Refactored + re-enabled external labels (not sure if working)

    @wtripp180901
    wtripp180901 committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    b959e92 View commit details
    Browse the repository at this point in the history

  3. replaced monitoring in site.yml and fixed sslip IPs

    @wtripp180901
    wtripp180901 committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    560eb96 View commit details
    Browse the repository at this point in the history

  4. Added slurm exporter service to k3s

    @wtripp180901
    wtripp180901 committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    0106a95 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. Added ood exporter to k3s

    @wtripp180901
    wtripp180901 committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    a4dca77 View commit details
    Browse the repository at this point in the history

  2. added grafana metrics

    @wtripp180901
    wtripp180901 committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    6081d77 View commit details
    Browse the repository at this point in the history

  3. fixed alertmanager status

    @wtripp180901
    wtripp180901 committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    84fd355 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. Dashboards now installed into k3s (dataources not configured yet)

    @wtripp180901
    wtripp180901 committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    e2d1c62 View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2024

  1. Merge branch 'feature/k3s-ansible-init' into feature/k3s-monitoring

    @wtripp180901
    wtripp180901 committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    cce35a9 View commit details
    Browse the repository at this point in the history

  2. Added slurmstats datasource

    @wtripp180901
    wtripp180901 committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    7afdc1d View commit details
    Browse the repository at this point in the history

  3. enabled ips for monitoring services (except prometheus)

    @wtripp180901
    wtripp180901 committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    b3020ca View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2024

  1. Added grafana to state directory and made port configurable

    @wtripp180901
    wtripp180901 committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    0dff07f View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2024

  1. grafana can now be reverse proxied by ood

    @wtripp180901
    wtripp180901 committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    f7e555b View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2024

  1. Ported grafana rolevars

    @wtripp180901
    wtripp180901 committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    d142a9f View commit details
    Browse the repository at this point in the history

  2. Added slack integration default

    @wtripp180901
    wtripp180901 committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    7fa3609 View commit details
    Browse the repository at this point in the history

  3. Ported alertmanager rolevars

    @wtripp180901
    wtripp180901 committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    96edb79 View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2024

  1. Merge branch 'feature/k3s-ansible-init' into feature/k3s-monitoring

    @wtripp180901
    wtripp180901 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    123c573 View commit details
    Browse the repository at this point in the history

  2. removed k3s ingress

    @wtripp180901
    wtripp180901 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    b13311a View commit details
    Browse the repository at this point in the history

  3. Services now exposed/proxied via nodeports

    @wtripp180901
    wtripp180901 committed Oct 8, 2024
    Configuration menu
    Copy the full SHA
    01718ee View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2024

  1. Removed grafana servicemonitor and moved nodeports to helm config

    @wtripp180901
    wtripp180901 committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    74bd3ba View commit details
    Browse the repository at this point in the history

  2. grafana admin now definable

    @wtripp180901
    wtripp180901 committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    e724b5d View commit details
    Browse the repository at this point in the history

  3. Now adds additional rules correctly

    @wtripp180901
    wtripp180901 committed Oct 9, 2024
    Configuration menu
    Copy the full SHA
    9c359d9 View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2024

  1. Merge branch 'feature/k3s-ansible-init' into feature/k3s-monitoring

    @wtripp180901
    wtripp180901 committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    04a5bf3 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2024

  1. Merge branch 'feature/k3s-ansible-init' into feature/k3s-monitoring

    @wtripp180901
    wtripp180901 committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    7f4862c View commit details
    Browse the repository at this point in the history

  2. Merge branch 'feature/k3s-ansible-init' into feature/k3s-monitoring

    @wtripp180901
    wtripp180901 committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    2b97d32 View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2024

  1. Removed monitoring binaries from build

    @wtripp180901
    wtripp180901 committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    337c101 View commit details
    Browse the repository at this point in the history

  2. bump for CI test

    @wtripp180901
    wtripp180901 authored Oct 14, 2024
    Configuration menu
    Copy the full SHA
    dd1e464 View commit details
    Browse the repository at this point in the history

  3. ported node-exporter vars

    @wtripp180901
    wtripp180901 committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    cc6bef1 View commit details
    Browse the repository at this point in the history

  4. non-atomic helm install for ci test

    @wtripp180901
    wtripp180901 committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    21a8d25 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'feature/k3s-monitoring' of github.com:stackhpc/ansible-… 

    …slurm-appliance into feature/k3s-monitoring
    @wtripp180901
    wtripp180901 committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    e1355de View commit details
    Browse the repository at this point in the history

  6. fixed hostnames not recognised by selector and defaulted slack integr… 

    …ation off
    @wtripp180901
    wtripp180901 committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    76842f1 View commit details
    Browse the repository at this point in the history

  7. fixed k3s hostnames properly

    @wtripp180901
    wtripp180901 committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    185eafb View commit details
    Browse the repository at this point in the history

Commits on Oct 15, 2024

  1. increased control node CI memory

    @wtripp180901
    wtripp180901 committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    10d4e93 View commit details
    Browse the repository at this point in the history

  2. Refactored monitoring config and removed redundant groups

    @wtripp180901
    wtripp180901 committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    d1e8c0a View commit details
    Browse the repository at this point in the history

  3. updated dashboard defaults

    @wtripp180901
    wtripp180901 committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    96723f8 View commit details
    Browse the repository at this point in the history

  4. fixed caas cluster name

    @wtripp180901
    wtripp180901 committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    bf9a473 View commit details
    Browse the repository at this point in the history

  5. nodeselectors now use custom labels

    @wtripp180901
    wtripp180901 committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    fdb5c23 View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. fixed (?) grafana zenith proxy

    @wtripp180901
    wtripp180901 committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    4bffe4b View commit details
    Browse the repository at this point in the history

  2. bump images

    @wtripp180901
    wtripp180901 authored Oct 16, 2024
    Configuration menu
    Copy the full SHA
    b0f856e View commit details
    Browse the repository at this point in the history

  3. added old recording rules to defaults

    @wtripp180901
    wtripp180901 committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    12e1166 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'feature/k3s-monitoring' of github.com:stackhpc/ansible-… 

    …slurm-appliance into feature/k3s-monitoring
    @wtripp180901
    wtripp180901 committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    9ab06a6 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2024

  1. fixed openhpc dashboard

    @wtripp180901
    wtripp180901 committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    5f89be8 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. Refactored and fixed slack integration

    @wtripp180901
    wtripp180901 committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    2d1dab5 View commit details
    Browse the repository at this point in the history

  2. removed unused config options

    @wtripp180901
    wtripp180901 committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    43f27a5 View commit details
    Browse the repository at this point in the history

  3. review suggestions 

    Co-authored-by: Steve Brasier <[email protected]>
    @wtripp180901 @sjpb
    wtripp180901 and sjpb authored Oct 18, 2024
    Configuration menu
    Copy the full SHA
    bb928ad View commit details
    Browse the repository at this point in the history

  4. updated defaults

    @wtripp180901
    wtripp180901 committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    db91120 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'feature/k3s-monitoring' of github.com:stackhpc/ansible-… 

    …slurm-appliance into feature/k3s-monitoring
    @wtripp180901
    wtripp180901 committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    34a779b View commit details
    Browse the repository at this point in the history

  6. removed grafana data volume

    @wtripp180901
    wtripp180901 committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    7e1370d View commit details
    Browse the repository at this point in the history

  7. set default dashboard to slurm exporter

    @wtripp180901
    wtripp180901 committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    934ec7a View commit details
    Browse the repository at this point in the history

  8. added play to remove unwanted default dashboards

    @wtripp180901
    wtripp180901 committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    a03f7f9 View commit details
    Browse the repository at this point in the history

  9. updated grafana groupvars

    @wtripp180901
    wtripp180901 committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    886c22d View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2024

  1. added node exporter collection config

    @wtripp180901
    wtripp180901 committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    c4fa2a6 View commit details
    Browse the repository at this point in the history

  2. removed unenforced volume size config option

    @wtripp180901
    wtripp180901 committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    3e1f019 View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2024

  1. ondemand grafana proxying now conditional on ondemand having groups d… 

    …efined
    @wtripp180901
    wtripp180901 committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    8d242f7 View commit details
    Browse the repository at this point in the history

  2. standardised control ip resolution

    @wtripp180901
    wtripp180901 committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    e6fbda8 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'feature/k3s-ansible-init' into feature/k3s-monitoring

    @wtripp180901
    wtripp180901 authored Oct 22, 2024
    Configuration menu
    Copy the full SHA
    8b93aa2 View commit details
    Browse the repository at this point in the history

  4. reduced collectors to minimal set

    @wtripp180901
    wtripp180901 committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    e6a4e4b View commit details
    Browse the repository at this point in the history

  5. updated docs

    @wtripp180901
    wtripp180901 committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    e5dff96 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'feature/k3s-ansible-init' into feature/k3s-monitoring

    @wtripp180901
    wtripp180901 committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    ce90ab0 View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. bump images

    @wtripp180901
    wtripp180901 authored Oct 23, 2024
    Configuration menu
    Copy the full SHA
    4c44261 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'feature/k3s-ansible-init' into feature/k3s-monitoring

    @wtripp180901
    wtripp180901 authored Oct 23, 2024
    Configuration menu
    Copy the full SHA
    29614fe View commit details
    Browse the repository at this point in the history

  3. monitoring stack images now pre-pulled

    @wtripp180901
    wtripp180901 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    f93348e View commit details
    Browse the repository at this point in the history

  4. moved monitoring pre-pulls to role

    @wtripp180901
    wtripp180901 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    e8d2e81 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'feature/k3s-monitoring' of github.com:stackhpc/ansible-… 

    …slurm-appliance into feature/k3s-monitoring
    @wtripp180901
    wtripp180901 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    311bbbc View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2024

  1. fixed build typo

    @wtripp180901
    wtripp180901 committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    d002454 View commit details
    Browse the repository at this point in the history

  2. removed unused groupvars

    @wtripp180901
    wtripp180901 committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    991613e View commit details
    Browse the repository at this point in the history

  3. removed cloudalchemy roles from install

    @wtripp180901
    wtripp180901 committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    b4b69b5 View commit details
    Browse the repository at this point in the history

  4. bump images

    @wtripp180901
    wtripp180901 authored Oct 24, 2024
    Configuration menu
    Copy the full SHA
    b0f48fd View commit details
    Browse the repository at this point in the history

  5. fixed some incompatibilities with old metrics

    @wtripp180901
    wtripp180901 committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    ec57a21 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'feature/k3s-monitoring' of github.com:stackhpc/ansible-… 

    …slurm-appliance into feature/k3s-monitoring
    @wtripp180901
    wtripp180901 committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    df946dd View commit details
    Browse the repository at this point in the history

  7. removed container internal networking devices from grafana

    @wtripp180901
    wtripp180901 committed Oct 24, 2024
    Configuration menu
    Copy the full SHA
    a0edab7 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. openhpc dashboard now job agnostic

    @wtripp180901
    wtripp180901 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    8acc2b5 View commit details
    Browse the repository at this point in the history

  2. added local copy of slurm exporter dashboard without container networ… 

    …k devices
    @wtripp180901
    wtripp180901 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    ee945b5 View commit details
    Browse the repository at this point in the history

  3. set default dashboard to slurm jobs

    @wtripp180901
    wtripp180901 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    46d95ef View commit details
    Browse the repository at this point in the history

  4. added ansible to migrate cloudalchemy data to KPS

    @wtripp180901
    wtripp180901 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    b2b673f View commit details
    Browse the repository at this point in the history

  5. updated docs

    @wtripp180901
    wtripp180901 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    d712f69 View commit details
    Browse the repository at this point in the history

Commits on Oct 29, 2024

  1. merge conflicts

    @wtripp180901
    wtripp180901 committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    d0c8781 View commit details
    Browse the repository at this point in the history

  2. merge

    @wtripp180901
    wtripp180901 committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    f23c2fc View commit details
    Browse the repository at this point in the history

  3. cleaned up dashboard role

    @wtripp180901
    wtripp180901 committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    2d16356 View commit details
    Browse the repository at this point in the history

  4. moved image pre-pull list to rolevar

    @wtripp180901
    wtripp180901 committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    c6b221e View commit details
    Browse the repository at this point in the history

  5. doc changes + opensearch datasource now based on opensearch group

    @wtripp180901
    wtripp180901 committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    d1c915e View commit details
    Browse the repository at this point in the history

  6. made kps default dashboards more configurable

    @wtripp180901
    wtripp180901 committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    b6be009 View commit details
    Browse the repository at this point in the history

  7. bump image up to date with main

    @wtripp180901
    wtripp180901 committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    206134d View commit details
    Browse the repository at this point in the history

  8. newline

    @wtripp180901
    wtripp180901 committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    8364eb8 View commit details
    Browse the repository at this point in the history

  9. bumped caas minimum control node ram

    @wtripp180901
    wtripp180901 committed Oct 29, 2024
    Configuration menu
    Copy the full SHA
    603e818 View commit details
    Browse the repository at this point in the history

Commits on Nov 11, 2024

  1. reduced disk footprint of container pe-pulls

    @wtripp180901
    wtripp180901 committed Nov 11, 2024
    Configuration menu
    Copy the full SHA
    c4a4847 View commit details
    Browse the repository at this point in the history

  2. merge

    @wtripp180901
    wtripp180901 committed Nov 11, 2024
    Configuration menu
    Copy the full SHA
    040e569 View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2024

  1. moved image pulls to tasks

    @wtripp180901
    wtripp180901 committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    a2540f2 View commit details
    Browse the repository at this point in the history

  2. moved prometheus install to host group

    @wtripp180901
    wtripp180901 committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    cd281f3 View commit details
    Browse the repository at this point in the history

  3. Review docs suggestions 

    Co-authored-by: Steve Brasier <[email protected]>
    @wtripp180901 @sjpb
    wtripp180901 and sjpb authored Nov 12, 2024
    Configuration menu
    Copy the full SHA
    774f608 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'feature/k3s-monitoring' of github.com:stackhpc/ansible-… 

    …slurm-appliance into feature/k3s-monitoring
    @wtripp180901
    wtripp180901 committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    80a0e21 View commit details
    Browse the repository at this point in the history

  5. added readme link

    @wtripp180901
    wtripp180901 committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    6506e7e View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2024

  1. file name and defaults changes

    @wtripp180901
    wtripp180901 committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    a6d8edc View commit details
    Browse the repository at this point in the history

  2. disambiguated default addresses

    @wtripp180901
    wtripp180901 committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    5864b56 View commit details
    Browse the repository at this point in the history

  3. separated prometheus recording and alerting rules

    @wtripp180901
    wtripp180901 committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    15b77db View commit details
    Browse the repository at this point in the history

  4. adding alertmanager docs

    @wtripp180901
    wtripp180901 committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    acf0c0d View commit details
    Browse the repository at this point in the history

  5. merge

    @wtripp180901
    wtripp180901 committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    b7d9c48 View commit details
    Browse the repository at this point in the history