yudaike/openSUSE-release-tools
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
6,542 Commits 2 Branches 12 Tags
Commit Graph

65 Commits

Author SHA1 Message Date
Oliver Kurz
32442c979e metrics: telegraf: Fix URL for openqa.opensuse.org after machines were moved to openSUSE internal network 
Related progress issue: https://progress.opensuse.org/issues/102975
 2021-12-08 12:19:49 +01:00
Douglas DeMaio
ce4a3e37ab
Merge pull request #2670 from witekest/add_grafana_comment 
Add note about missing IPv4 logs. Thanks @witekest
 2021-11-19 13:08:27 +01:00
Witek Bedyk
41a023db74 Add note about missing IPv4 logs 2021-11-19 12:02:41 +01:00
Witek Bedyk
3eae2f73c7 Skip empty cache files 2021-11-18 13:37:56 +01:00
Witek Bedyk
c8d2cf77ce Fix handling missing log files 2021-11-18 13:14:56 +01:00
Ludwig Nussel
cc4280d0f6 metrics: add sample Apache vhost config 2021-02-08 11:23:24 +01:00
Ludwig Nussel
cb668a6e39 metrics: accept more flavors 2021-02-08 11:13:45 +01:00
coogor
af4f972e0c
Update aggregate.php 
Prepare for Leap 15.3
 2020-12-12 10:31:40 +01:00
Witek Bedyk
2ec3b0c823 Add schedule for Leap 15.1, 15.2 and 15.3 2020-12-02 16:43:07 +01:00
Witek Bedyk
17ac7481e4 metrics: Update product pattern to match Leap 15.2 2020-11-11 16:28:23 +01:00
Witek Bedyk
d9736fb662
Revert "Retrieve packages download statistics" 2020-08-26 11:09:13 +02:00
Douglas DeMaio
f6a30eed20
Merge pull request #2464 from witekest/packages 
Retrieve packages download statistics
 2020-08-26 10:49:30 +02:00
Witek Bedyk
d4d03287d6 Bugfixes 
* do not iterate over the end of an array in check_next_element
* include openSUSE 15.2 as valid product
* fix packages list files path
 2020-07-29 17:44:54 +02:00
Witek Bedyk
4fe6d771cc [metrics-access] Fix packages path 2020-07-28 13:47:57 +02:00
Witek Bedyk
9d4a45e576 Optimize searching access logs 
* Use binary search for parsing accessed packages
* Write packages statistics to InfluxDB
 2020-07-24 16:55:29 +02:00
Witek Bedyk
adc3750f2b Parse and count packages 2020-07-16 11:00:01 +02:00
Oliver Kurz
6af31b4c8d metrics/grafana/openqa: Add openSUSE Leap 15.1 and 15.2 
Not sure if there are further changes necessary, e.g. internal changes
to influxdb or whatever data source should provide the data.
 2020-07-06 10:06:54 +02:00
Jimmy Berry
2d55674621 metrics/grafana/openqa: set minimum interval of 10s to avoid gaps. 
Since data is collected at the same interval it avoids grouping at smaller
intervals when zoomed in which reveals gaps between the data points.
 2018-10-19 09:50:14 -05:00
Stephan Kulow
5d3688e569 metrics: Fetch openqa jobs in influxdb format 2018-10-16 06:40:57 +02:00
Jimmy Berry
e246ca69d8 metrics/access/aggregate: correct empty seen key handling. 
Set everything up, but never filled in keys.
 2018-09-17 17:37:35 -05:00
Jimmy Berry
5c410b7c76 metrics/grafana/access: add new row and graphs for image totals by product. 
Includes a new variable for switching which product is displayed.
Unfortunately, there is no way to hide the variable within a row and it
seems like over-kill to create a separate dashboard.
 2018-09-14 15:55:02 -05:00
Jimmy Berry
7492b109e5 metrics/access/aggregate: process and summarize image totals by product. 
Accessible in new measurement prefixed by 'image'.
 2018-09-14 15:53:30 -05:00
Jimmy Berry
c84add0bf7 metrics/access/aggregate: extract merge_product_plus_key() from merge(). 2018-09-14 15:52:05 -05:00
Jimmy Berry
dc9afe2adf metrics/access/ingest: detect product image paths and included in dump. 2018-09-14 15:50:37 -05:00
Jimmy Berry
6203b52a42 metrics/grafana/access: remove left-over raw queries. 
For some reason Grafana does not remove these from data structure even
though they no longer represent current state.
 2018-09-14 15:49:56 -05:00
Jimmy Berry
f80d3ff03f metrics/access/aggregate: include Leap 15.1 in published metrics. 2018-09-14 15:48:12 -05:00
Jimmy Berry
c47bb4c902 Utilize CacheManager for all existing caches. 2018-09-04 15:19:02 -05:00
Jimmy Berry
92d5c2c6f8 metrics: provide initial telegraf setup for ingesting historical snapshots. 2018-08-29 16:49:12 -05:00
Jimmy Berry
d91ce3f2b2 metrics/access/aggregate: write zeros for empty product data. 
Since the aggregation is not done by influxdb a fill option is not
available and instead needs to be performed manually. As such the order of
writing must be from oldest to newest so that the list of product seen
before can be kept and missing products for a given interval can be filled.
 2018-06-21 10:41:37 -05:00
Jimmy Berry
6df56b1e08 metrics/access/ingest: update pattern to handle most recent log format. 2018-06-21 08:15:26 -05:00
Jimmy Berry
2ab5065f93 metrics/grafana/access: add explanation about loss of custom log format. 2018-06-21 08:15:19 -05:00
Jimmy Berry
8a59f4a862 metrics/access/aggregate: change PONTIFEX base URL based on poo#36862. 2018-06-20 16:38:22 -05:00
Jimmy Berry
138facc961 metrics/grafana/access: remove broken datasource templating from export. 
Unresolved upstream issue that makes the export unusable on a new system.
 2018-06-20 16:38:10 -05:00
Jimmy Berry
2e93b6c3bd metrics/access/aggregate: remove left over sprintf() from PONTIFEX lines. 
The directory was broken out from PONTIFEX and LANGLEY which made sprintf()
no longer necessary. Still works, but a waste.
 2018-06-20 16:32:43 -05:00
Jimmy Berry
625fa382fa metrics/access/aggregate: skip the current day since the logs are incomplete. 2018-06-20 16:30:20 -05:00
Jimmy Berry
56dbcb1d53 metrics/access: add summary README.md. 2018-06-18 22:13:29 -05:00
Jimmy Berry
da56d9213b metrics/grafana: add access dashboard and data source. 
Utilized by metrics/access tool.
 2018-06-18 22:13:22 -05:00
Jimmy Berry
3d7bb16489 metrics/access: initial aggregate script. 2018-06-18 21:29:43 -05:00
Jimmy Berry
6fecfcb128 metrics/access: initial ingest script. 2018-06-18 21:29:23 -05:00
Jimmy Berry
7bd42dc200 metrics/grafana/release: score yaxis max 100. 
With scores reaching near 100 :) the auto axis is leaving margin.
 2018-06-01 15:56:52 -05:00
Jimmy Berry
bb1cd23f46 metrics/annotation/leap:15.0: update final release date. 2018-05-18 11:00:32 -05:00
Jimmy Berry
29c9a000f8 metrics/grafana/dashboard: remove y-axis max from "Weekly Revisions". 2018-04-25 22:22:23 -05:00
Jimmy Berry
94fefafdf3
Merge pull request #1507 from jberry-suse/metrics-dashboard-last 
metrics/grafana/dashboard: change all selectors to last (plus cleanups)
 2018-04-25 21:52:44 -05:00
Jimmy Berry
6e74ae62fd metrics: dashboard: include revisions graph. 2018-04-24 19:24:52 -05:00
Jimmy Berry
568249b0d1 metrics/grafana/dashboard: add release schedule annotation. 2018-04-24 19:10:45 -05:00
Jimmy Berry
52693a6204 metrics/grafana/dashboard: include dashboard description. 2018-04-24 19:10:12 -05:00
Jimmy Berry
ed927994b2 metrics/grafana/dashboard: change all selectors to last. 2018-04-24 19:09:52 -05:00
Jimmy Berry
fe2e20a747
Merge pull request #1498 from jberry-suse/metrics-dashboard 
metrics: walk dashboard revisions and extract metrics from relevant files
 2018-04-23 19:03:04 -05:00
Jimmy Berry
6d46e97dbe
Merge pull request #1500 from jberry-suse/metrics-grafana-sizing-tweaks 
metrics: grafana sizing tweaks
 2018-04-23 18:42:10 -05:00
Jimmy Berry
f11979f01e metrics/grafana/staging: move legend to right side on pie charts. 
Necessary post Grafana 5.x migration.
 2018-04-20 17:06:50 -05:00