yudaike/openSUSE-release-tools
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,316 Commits 2 Branches 12 Tags
Commit Graph

44 Commits

Author SHA1 Message Date
Jimmy Berry
7492b109e5 metrics/access/aggregate: process and summarize image totals by product. 
Accessible in new measurement prefixed by 'image'.
 2018-09-14 15:53:30 -05:00
Jimmy Berry
c84add0bf7 metrics/access/aggregate: extract merge_product_plus_key() from merge(). 2018-09-14 15:52:05 -05:00
Jimmy Berry
dc9afe2adf metrics/access/ingest: detect product image paths and included in dump. 2018-09-14 15:50:37 -05:00
Jimmy Berry
6203b52a42 metrics/grafana/access: remove left-over raw queries. 
For some reason Grafana does not remove these from data structure even
though they no longer represent current state.
 2018-09-14 15:49:56 -05:00
Jimmy Berry
f80d3ff03f metrics/access/aggregate: include Leap 15.1 in published metrics. 2018-09-14 15:48:12 -05:00
Jimmy Berry
c47bb4c902 Utilize CacheManager for all existing caches. 2018-09-04 15:19:02 -05:00
Jimmy Berry
92d5c2c6f8 metrics: provide initial telegraf setup for ingesting historical snapshots. 2018-08-29 16:49:12 -05:00
Jimmy Berry
d91ce3f2b2 metrics/access/aggregate: write zeros for empty product data. 
Since the aggregation is not done by influxdb a fill option is not
available and instead needs to be performed manually. As such the order of
writing must be from oldest to newest so that the list of product seen
before can be kept and missing products for a given interval can be filled.
 2018-06-21 10:41:37 -05:00
Jimmy Berry
6df56b1e08 metrics/access/ingest: update pattern to handle most recent log format. 2018-06-21 08:15:26 -05:00
Jimmy Berry
2ab5065f93 metrics/grafana/access: add explanation about loss of custom log format. 2018-06-21 08:15:19 -05:00
Jimmy Berry
8a59f4a862 metrics/access/aggregate: change PONTIFEX base URL based on poo#36862. 2018-06-20 16:38:22 -05:00
Jimmy Berry
138facc961 metrics/grafana/access: remove broken datasource templating from export. 
Unresolved upstream issue that makes the export unusable on a new system.
 2018-06-20 16:38:10 -05:00
Jimmy Berry
2e93b6c3bd metrics/access/aggregate: remove left over sprintf() from PONTIFEX lines. 
The directory was broken out from PONTIFEX and LANGLEY which made sprintf()
no longer necessary. Still works, but a waste.
 2018-06-20 16:32:43 -05:00
Jimmy Berry
625fa382fa metrics/access/aggregate: skip the current day since the logs are incomplete. 2018-06-20 16:30:20 -05:00
Jimmy Berry
56dbcb1d53 metrics/access: add summary README.md. 2018-06-18 22:13:29 -05:00
Jimmy Berry
da56d9213b metrics/grafana: add access dashboard and data source. 
Utilized by metrics/access tool.
 2018-06-18 22:13:22 -05:00
Jimmy Berry
3d7bb16489 metrics/access: initial aggregate script. 2018-06-18 21:29:43 -05:00
Jimmy Berry
6fecfcb128 metrics/access: initial ingest script. 2018-06-18 21:29:23 -05:00
Jimmy Berry
7bd42dc200 metrics/grafana/release: score yaxis max 100. 
With scores reaching near 100 :) the auto axis is leaving margin.
 2018-06-01 15:56:52 -05:00
Jimmy Berry
bb1cd23f46 metrics/annotation/leap:15.0: update final release date. 2018-05-18 11:00:32 -05:00
Jimmy Berry
29c9a000f8 metrics/grafana/dashboard: remove y-axis max from "Weekly Revisions". 2018-04-25 22:22:23 -05:00
Jimmy Berry
94fefafdf3
Merge pull request #1507 from jberry-suse/metrics-dashboard-last 
metrics/grafana/dashboard: change all selectors to last (plus cleanups)
 2018-04-25 21:52:44 -05:00
Jimmy Berry
6e74ae62fd metrics: dashboard: include revisions graph. 2018-04-24 19:24:52 -05:00
Jimmy Berry
568249b0d1 metrics/grafana/dashboard: add release schedule annotation. 2018-04-24 19:10:45 -05:00
Jimmy Berry
52693a6204 metrics/grafana/dashboard: include dashboard description. 2018-04-24 19:10:12 -05:00
Jimmy Berry
ed927994b2 metrics/grafana/dashboard: change all selectors to last. 2018-04-24 19:09:52 -05:00
Jimmy Berry
fe2e20a747
Merge pull request #1498 from jberry-suse/metrics-dashboard 
metrics: walk dashboard revisions and extract metrics from relevant files
 2018-04-23 19:03:04 -05:00
Jimmy Berry
6d46e97dbe
Merge pull request #1500 from jberry-suse/metrics-grafana-sizing-tweaks 
metrics: grafana sizing tweaks
 2018-04-23 18:42:10 -05:00
Jimmy Berry
f11979f01e metrics/grafana/staging: move legend to right side on pie charts. 
Necessary post Grafana 5.x migration.
 2018-04-20 17:06:50 -05:00
Jimmy Berry
b9f8f79a9f metrics/grafana/review: increase hieght on lists to accomodate size. 
Necessary post Grafana 5.x migration.
 2018-04-20 17:06:19 -05:00
Jimmy Berry
9f8cdc63e5 metrics/grafana/release: increase width to 100% grid width. 2018-04-20 17:05:46 -05:00
Jimmy Berry
0ec3569d70 metrics/grafana: add dashboard.json. 2018-04-20 16:33:56 -05:00
Jimmy Berry
09f843edcc metrics/annotation: add openSUSE:Leap:15.0 schedule. 2018-04-20 16:15:46 -05:00
Jimmy Berry
8dd2694617 metrics: switch over to grafana 5.x provisioning. 
Provides both dashboards and datasources.
 2018-03-09 17:16:46 -06:00
Jimmy Berry
c10dec54dd metrics: remove TW snapshots graph from release dashboard. 2018-03-09 16:37:32 -06:00
Jimmy Berry
f9166bf390 metrics: migrate grafana dashboards to 5.x format. 2018-03-09 16:37:07 -06:00
Jimmy Berry
da5bfafb42 metrics: provide release metrics ingestion and dashboard. 2018-03-09 00:34:01 -06:00
Jimmy Berry
9a6b483948 metrics/grafana/review: include opensuse-review-team who graphs. 2017-11-08 17:38:10 -06:00
Jimmy Berry
586b177a97 metrics/grafana/review: default to openSUSE:Factory. 2017-11-08 17:38:10 -06:00
Jimmy Berry
736bfa235e metrics/grafana/review: disable annotations by default. 2017-11-08 17:38:10 -06:00
Jimmy Berry
6aafeba0c1 metrics/grafana/staging: "Project stats" to "Totals" 2017-11-08 17:38:10 -06:00
Jimmy Berry
41c3c6948d metrics/grafana/staging: remove 1s interval as it causes RAM issues. 2017-11-08 17:38:05 -06:00
Jimmy Berry
c01a8a71ed metrics/grafana: standardize title prefix with 'OSRT: '. 2017-11-08 17:33:24 -06:00
Jimmy Berry
cb24f27eec Initial metrics ingestion, processing, write to influxdb, and grafana dashboards. 
A lot of room for improvement and additional metrics that can be extracted.
Including non-final state requests would allow for analyzing the current
staging state instead of only historical state. Additionally, the current
state can be used to present an activity log.

Handling incremental updates is non-trivial given the deltas are evaluated
and stored in sum state. A few possible approaches, but likely not worth
the hassle given the relatively short processing time and infrequent desire
to update data (daily at minimum).
 2017-10-06 16:08:33 -05:00