15e8e74a2f
compare_pkglist: misc improvements
2017-11-14 15:51:44 +08:00
Ludwig Nussel
205bed9c0b
pkglistgen: require obs-service-product_converter
2017-11-13 18:25:16 +01:00
Ludwig Nussel
290a2ed0b8
pkglistgen: add systemd units
2017-11-13 18:18:00 +01:00
Ludwig Nussel
384746715d
pkglistgen: use new cache format of repo_checker
2017-11-13 17:39:52 +01:00
Ludwig Nussel
1ea00d8d8f
pkglistgen: process DVD subproject first
...
the other way around may cause the scheduler to flag the DVD
subproject dirty already.
2017-11-13 16:47:34 +01:00
Ludwig Nussel
b6909435e9
Merge pull request #1253 from lnussel/pkglistgen
...
Pkglistgen: merge and fix unsorted generation
2017-11-12 11:59:03 +01:00
Jimmy Berry
5906e5c5d8
Merge pull request #1255 from jberry-suse/totest-manager-postun-fix
...
dist/spec: appease the exit status gods with || true.
2017-11-10 01:33:10 -06:00
Jimmy Berry
f5dc137134
dist/spec: appease the exit status gods with || true.
2017-11-09 23:47:08 -06:00
Jimmy Berry
13ed915492
Merge pull request #1254 from jberry-suse/spec-scriptlet-simplify
...
dist/spec: only run %systemd_postun for oneshot services (and handle instanced services)
2017-11-09 17:36:42 -06:00
Jimmy Berry
f3d23f31f5
dist/spec: restart totest-manager instances properly.
2017-11-09 17:29:38 -06:00
Jimmy Berry
e45fe4814a
dist/spec: only run %systemd_postun for oneshot services.
2017-11-09 17:29:19 -06:00
Jimmy Berry
f927c5769b
Merge pull request #1251 from jberry-suse/metrics-memory-reduction
...
metrics: reduce memory footprint by over 60%
2017-11-09 16:39:37 -06:00
Jimmy Berry
bcdea6812d
Merge pull request #1240 from lnussel/master
...
Don't die on delete requests
2017-11-09 16:25:19 -06:00
Jimmy Berry
26883b12d2
metrics: rework to store points as named tuple and write in batches.
...
Savings of around 400MB per 10,000 requests. Using a named tuple was the
original approach for this reason, but the influxdb interface requires
dict()s and it seemed silly to spend time converting them. Additionally,
influxdb client already does batching.
Unfortunately, with the amount of data processed for Factory that will
continue to grow this approach is necessary. The dict() final structures
are buffered up to ~1000 before being written and released. Another
benefit of the batching is that influxdb does not allocate memory for the
entire incoming batch.
2017-11-09 16:17:57 -06:00
Jimmy Berry
8a87becd55
metrics: rework request pagination to provide as generator.
...
This prevents the memory required to process to be enough to load all
parsed request element trees at once. Instead only one page of requests
is loaded at a time and the memory freed after processed. The end result
is the memory consumption reduced by just over 20% (current Factory drops
by around 2.5GB).
2017-11-09 16:17:25 -06:00
Jimmy Berry
ab569dfab8
metrics: call ET.clear() to release unneeded memory used by search result.
...
Roughly 1800MB per 10,000 requests saved.
2017-11-09 16:17:25 -06:00
Jimmy Berry
3e191caa84
Merge pull request #1249 from jberry-suse/repo_checker-openqa-only
...
repo_checker: review failed stagings with only openQA failures.
2017-11-09 16:15:38 -06:00
Jimmy Berry
1efadc5f82
Merge pull request #1248 from jberry-suse/metrics-post-deploy-fixes
...
metrics: post deployment tweaks and fixes + opensuse-review-team who graphs
2017-11-09 16:08:56 -06:00
Ludwig Nussel
2110ded1a6
pkglistgen: fix up coolo's code
2017-11-09 15:22:27 +01:00
Ludwig Nussel
48a572ed59
Merge remote-tracking branch 'coolo/create_unsorted'
2017-11-09 15:03:03 +01:00
Ludwig Nussel
3d34370f79
Merge pull request #1252 from lnussel/ttm
...
ttm: publish non-oss for Leap 15 too
2017-11-09 14:57:23 +01:00
Ludwig Nussel
ace4ae06fd
ttm: publish non-oss for Leap 15 too
2017-11-09 14:56:30 +01:00
Ludwig Nussel
312c18024d
Don't die on delete requests
...
Perform src_project checks only on actions that actually have a
src_project
2017-11-09 14:55:07 +01:00
Jimmy Berry
48fe3836a6
repo_checker: review failed stagings with only openQA failures.
...
Build failures may cause false negatives in repo_checker results, but
openQA failures are not relevant and should be ignored.
2017-11-08 23:45:37 -06:00
Jimmy Berry
9a6b483948
metrics/grafana/review: include opensuse-review-team who graphs.
2017-11-08 17:38:10 -06:00
Jimmy Berry
586b177a97
metrics/grafana/review: default to openSUSE:Factory.
2017-11-08 17:38:10 -06:00
Jimmy Berry
736bfa235e
metrics/grafana/review: disable annotations by default.
2017-11-08 17:38:10 -06:00
Jimmy Berry
6aafeba0c1
metrics/grafana/staging: "Project stats" to "Totals"
2017-11-08 17:38:10 -06:00
Jimmy Berry
41c3c6948d
metrics/grafana/staging: remove 1s interval as it causes RAM issues.
2017-11-08 17:38:05 -06:00
Jimmy Berry
c01a8a71ed
metrics/grafana: standardize title prefix with 'OSRT: '.
2017-11-08 17:33:24 -06:00
Jimmy Berry
0201a82722
dist/ci: grafana dir must be owned by grafana user since it writes lock.
2017-11-08 17:24:13 -06:00
Jimmy Berry
dc74b8d0be
dist/spec: correct metrics postun to reference systemctl by absolute path.
2017-11-08 17:23:30 -06:00
Jimmy Berry
d0c298246e
metrics: prefix release schedule file with source dir path.
...
Otherwise, when deployed via package and run via /usr/bin the files are
not found.
2017-11-08 16:43:07 -06:00
Jimmy Berry
593c90038f
Merge pull request #1242 from jberry-suse/metrics-package-rest
...
dist: provide metrics service and timer and install grafana dashboards.
2017-11-03 18:13:10 -05:00
Jimmy Berry
a0c7dc362c
dist: provide metrics service and timer.
2017-11-03 17:59:01 -05:00
Jimmy Berry
10311c12c6
dist: install exported dashboards in grafana dashboard directory.
2017-11-03 17:58:18 -05:00
Jimmy Berry
159790907e
dist: include metrics.py in bindir.
2017-11-03 17:50:24 -05:00
Jimmy Berry
02d5749d28
dist: move package_name variable to Makefile.common.
2017-11-03 17:48:47 -05:00
f5bc6b6c73
Merge pull request #1238 from nilxam/vdelreq_command
...
osc vdelreq: new command lists pending virtually accepted delete request status
2017-11-03 16:42:10 +08:00
6efaa1d3e6
vdelreq: add to the package
2017-11-02 15:53:45 +08:00
3468fe8c1e
osc vdelreq: new command lists pending virtually accepted delete request status
2017-11-02 15:28:37 +08:00
0a45aba664
Merge pull request #1234 from nilxam/remove_2nd_specfile_ring
...
accept_command: remove the ring package if it is 2nd specfile is removed
2017-11-02 14:57:41 +08:00
ab21d5f0e1
Merge pull request #1233 from nilxam/force_must_be_force
...
accept_command: force to accept the staging if --force parameter is given
2017-11-02 14:57:26 +08:00
Jimmy Berry
d8cd193c99
Merge pull request #1231 from jberry-suse/devel-project-list-retry
...
systemd/devel-list: allow three retry attempts to handle regular OBS crash.
2017-10-31 20:01:10 -05:00
Jimmy Berry
990be5dbb3
systemd/devel-list: allow three retry attempts to handle regular OBS crash.
2017-10-31 20:00:34 -05:00
Jimmy Berry
0e1733f868
Merge pull request #1229 from jberry-suse/repo_checker-build-state
...
repo_checker: store and compare build hash to skip more aggressively (similar check for project_only)
2017-10-31 19:34:58 -05:00
Jimmy Berry
9aeb0a4c8e
repo_checker: add newline to cycles comment to format properly.
2017-10-31 18:51:56 -05:00
Jimmy Berry
8767f73eca
repo_checker: project_only place dashboard update behind dryrun check.
2017-10-31 18:51:56 -05:00
Jimmy Berry
b9bb3ce224
repo_checker: project_only ensure project repository is published.
2017-10-31 18:51:56 -05:00
Jimmy Berry
31cf49a09e
repo_checker: store and compare build hash to skip more aggressively.
2017-10-31 18:51:38 -05:00
