yudaike/openSUSE-release-tools
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
7,402 Commits 2 Branches 12 Tags
Commit Graph

92 Commits

Author SHA1 Message Date
Witek Bedyk
79b913ce40 Add Leap 15.6 to access metrics 2024-03-20 12:32:59 +01:00
Witek Bedyk
1e4d1e0059
Fix mkdir permissions argument 
Co-authored-by: Fabian Vogt <fabian@ritter-vogt.de>
 2024-02-21 11:11:26 +01:00
Witek Bedyk
f999eaa4d3 Add IPv4 and IPv6 handling in one file 
Access logs for both protocls are now stored in a single file.
The change refactors the code to handle it properly.
Upgrade InfluxDB client.
 2024-02-05 13:38:04 +01:00
Witek Bedyk
15ef60f313 Disable aggregating over financial year 
Holding all the UID statistics over the whole year consumes too much
memory.
 2023-09-28 16:18:28 +02:00
Witek Bedyk
81e39bbc1e Add backup server URL and update source map 2023-07-05 13:35:49 +02:00
Witek Bedyk
0a2778ad9d Add Leap 15.5 to access metrics 2023-05-24 12:23:34 +02:00
Witek Bedyk
37221978c8 Drop redundant unique_product_flavor 2023-05-08 16:11:07 +02:00
Witek Bedyk
173a53edfa Do not drop the database on every run 2023-05-08 16:08:08 +02:00
Witek Bedyk
776f941efb Fixes 
* getting first array item
* regex group renumbering
* syntax
 2023-05-04 14:03:50 +02:00
Witek Bedyk
a4cb59644e Refactor 'unique_product' object 2023-05-02 17:00:45 +02:00
Witek Bedyk
63682f7a91 Fix merging and syntax errors 2023-05-02 16:59:57 +02:00
Witek Bedyk
e7efe1c06d Write points with flavor tag 
The measurements are now saved with flavor tag.
 2023-05-02 16:59:57 +02:00
Witek Bedyk
908cc8ec32 Parse flavor type to cached data 2023-05-02 16:59:57 +02:00
Witek Bedyk
9602a21050 Aggregate unique flavor access data 2023-05-02 16:59:57 +02:00
Witek Bedyk
47a0d831d9 Filter out access logs with error code 2023-03-29 15:51:42 +02:00
Witek Bedyk
4bd9387196 Make REGEX_LINE backwards compatible 2023-01-25 13:35:52 +01:00
Witek Bedyk
b1f175e5ff Fix regex for access logs parsing 2023-01-24 11:28:50 +01:00
Stephan Kulow
1e3883dc9f More fixes for editor config compliance 2023-01-02 19:44:28 +01:00
Stephan Kulow
551f2f3e59
Merge pull request #2805 from witekest/recreate_db 
Recreate the database on each run
 2022-05-12 09:28:47 +02:00
Witek Bedyk
2929428890 Add annotations to the dashboard 2022-04-22 15:46:00 +02:00
Witek Bedyk
f2f3c04c34 Add annotation datasources 2022-04-22 15:32:01 +02:00
Witek Bedyk
602080590f Add annotations for Leap 15.4 2022-04-22 15:21:04 +02:00
Witek Bedyk
d647bd5222 Update product pattern for Leap 15.4 2022-04-22 15:07:58 +02:00
Witek Bedyk
adc78315a1 Recreate the database on each run 
The purpose is to drop the last measurement on uncompleted aggregation
period.
 2022-04-14 15:20:07 +02:00
Witek Bedyk
67d6cc4729 Write points to the DB only at the end of interval 2022-04-08 20:11:28 +02:00
Witek Bedyk
f6423e6093 Add new aggregation periods to Grafana dashboard 2022-03-30 10:38:36 +02:00
Witek Bedyk
5facf7362d Add aggregates for fiscal quarter and year 2022-03-29 18:07:29 +02:00
Oliver Kurz
32442c979e metrics: telegraf: Fix URL for openqa.opensuse.org after machines were moved to openSUSE internal network 
Related progress issue: https://progress.opensuse.org/issues/102975
 2021-12-08 12:19:49 +01:00
Douglas DeMaio
ce4a3e37ab
Merge pull request #2670 from witekest/add_grafana_comment 
Add note about missing IPv4 logs. Thanks @witekest
 2021-11-19 13:08:27 +01:00
Witek Bedyk
41a023db74 Add note about missing IPv4 logs 2021-11-19 12:02:41 +01:00
Witek Bedyk
3eae2f73c7 Skip empty cache files 2021-11-18 13:37:56 +01:00
Witek Bedyk
c8d2cf77ce Fix handling missing log files 2021-11-18 13:14:56 +01:00
Ludwig Nussel
cc4280d0f6 metrics: add sample Apache vhost config 2021-02-08 11:23:24 +01:00
Ludwig Nussel
cb668a6e39 metrics: accept more flavors 2021-02-08 11:13:45 +01:00
coogor
af4f972e0c
Update aggregate.php 
Prepare for Leap 15.3
 2020-12-12 10:31:40 +01:00
Witek Bedyk
2ec3b0c823 Add schedule for Leap 15.1, 15.2 and 15.3 2020-12-02 16:43:07 +01:00
Witek Bedyk
17ac7481e4 metrics: Update product pattern to match Leap 15.2 2020-11-11 16:28:23 +01:00
Witek Bedyk
d9736fb662
Revert "Retrieve packages download statistics" 2020-08-26 11:09:13 +02:00
Douglas DeMaio
f6a30eed20
Merge pull request #2464 from witekest/packages 
Retrieve packages download statistics
 2020-08-26 10:49:30 +02:00
Witek Bedyk
d4d03287d6 Bugfixes 
* do not iterate over the end of an array in check_next_element
* include openSUSE 15.2 as valid product
* fix packages list files path
 2020-07-29 17:44:54 +02:00
Witek Bedyk
4fe6d771cc [metrics-access] Fix packages path 2020-07-28 13:47:57 +02:00
Witek Bedyk
9d4a45e576 Optimize searching access logs 
* Use binary search for parsing accessed packages
* Write packages statistics to InfluxDB
 2020-07-24 16:55:29 +02:00
Witek Bedyk
adc3750f2b Parse and count packages 2020-07-16 11:00:01 +02:00
Oliver Kurz
6af31b4c8d metrics/grafana/openqa: Add openSUSE Leap 15.1 and 15.2 
Not sure if there are further changes necessary, e.g. internal changes
to influxdb or whatever data source should provide the data.
 2020-07-06 10:06:54 +02:00
Jimmy Berry
2d55674621 metrics/grafana/openqa: set minimum interval of 10s to avoid gaps. 
Since data is collected at the same interval it avoids grouping at smaller
intervals when zoomed in which reveals gaps between the data points.
 2018-10-19 09:50:14 -05:00
Stephan Kulow
5d3688e569 metrics: Fetch openqa jobs in influxdb format 2018-10-16 06:40:57 +02:00
Jimmy Berry
e246ca69d8 metrics/access/aggregate: correct empty seen key handling. 
Set everything up, but never filled in keys.
 2018-09-17 17:37:35 -05:00
Jimmy Berry
5c410b7c76 metrics/grafana/access: add new row and graphs for image totals by product. 
Includes a new variable for switching which product is displayed.
Unfortunately, there is no way to hide the variable within a row and it
seems like over-kill to create a separate dashboard.
 2018-09-14 15:55:02 -05:00
Jimmy Berry
7492b109e5 metrics/access/aggregate: process and summarize image totals by product. 
Accessible in new measurement prefixed by 'image'.
 2018-09-14 15:53:30 -05:00
Jimmy Berry
c84add0bf7 metrics/access/aggregate: extract merge_product_plus_key() from merge(). 2018-09-14 15:52:05 -05:00