21 Commits

Author SHA1 Message Date
Stephan Kulow
551f2f3e59
Merge pull request #2805 from witekest/recreate_db
Recreate the database on each run
2022-05-12 09:28:47 +02:00
Witek Bedyk
d647bd5222 Update product pattern for Leap 15.4 2022-04-22 15:07:58 +02:00
Witek Bedyk
adc78315a1 Recreate the database on each run
The purpose is to drop the last measurement on uncompleted aggregation
period.
2022-04-14 15:20:07 +02:00
Witek Bedyk
67d6cc4729 Write points to the DB only at the end of interval 2022-04-08 20:11:28 +02:00
Witek Bedyk
5facf7362d Add aggregates for fiscal quarter and year 2022-03-29 18:07:29 +02:00
Witek Bedyk
3eae2f73c7 Skip empty cache files 2021-11-18 13:37:56 +01:00
Witek Bedyk
c8d2cf77ce Fix handling missing log files 2021-11-18 13:14:56 +01:00
coogor
af4f972e0c
Update aggregate.php
Prepare for Leap 15.3
2020-12-12 10:31:40 +01:00
Witek Bedyk
17ac7481e4 metrics: Update product pattern to match Leap 15.2 2020-11-11 16:28:23 +01:00
Witek Bedyk
d9736fb662
Revert "Retrieve packages download statistics" 2020-08-26 11:09:13 +02:00
Witek Bedyk
9d4a45e576 Optimize searching access logs
* Use binary search for parsing accessed packages
* Write packages statistics to InfluxDB
2020-07-24 16:55:29 +02:00
Jimmy Berry
e246ca69d8 metrics/access/aggregate: correct empty seen key handling.
Set everything up, but never filled in keys.
2018-09-17 17:37:35 -05:00
Jimmy Berry
7492b109e5 metrics/access/aggregate: process and summarize image totals by product.
Accessible in new measurement prefixed by 'image'.
2018-09-14 15:53:30 -05:00
Jimmy Berry
c84add0bf7 metrics/access/aggregate: extract merge_product_plus_key() from merge(). 2018-09-14 15:52:05 -05:00
Jimmy Berry
f80d3ff03f metrics/access/aggregate: include Leap 15.1 in published metrics. 2018-09-14 15:48:12 -05:00
Jimmy Berry
c47bb4c902 Utilize CacheManager for all existing caches. 2018-09-04 15:19:02 -05:00
Jimmy Berry
d91ce3f2b2 metrics/access/aggregate: write zeros for empty product data.
Since the aggregation is not done by influxdb a fill option is not
available and instead needs to be performed manually. As such the order of
writing must be from oldest to newest so that the list of product seen
before can be kept and missing products for a given interval can be filled.
2018-06-21 10:41:37 -05:00
Jimmy Berry
8a59f4a862 metrics/access/aggregate: change PONTIFEX base URL based on poo#36862. 2018-06-20 16:38:22 -05:00
Jimmy Berry
2e93b6c3bd metrics/access/aggregate: remove left over sprintf() from PONTIFEX lines.
The directory was broken out from PONTIFEX and LANGLEY which made sprintf()
no longer necessary. Still works, but a waste.
2018-06-20 16:32:43 -05:00
Jimmy Berry
625fa382fa metrics/access/aggregate: skip the current day since the logs are incomplete. 2018-06-20 16:30:20 -05:00
Jimmy Berry
3d7bb16489 metrics/access: initial aggregate script. 2018-06-18 21:29:43 -05:00