3570 Commits

Author SHA1 Message Date
Jimmy Berry
8a87becd55 metrics: rework request pagination to provide as generator.
This prevents the memory required to process to be enough to load all
parsed request element trees at once. Instead only one page of requests
is loaded at a time and the memory freed after processed. The end result
is the memory consumption reduced by just over 20% (current Factory drops
by around 2.5GB).
2017-11-09 16:17:25 -06:00
Jimmy Berry
ab569dfab8 metrics: call ET.clear() to release unneeded memory used by search result.
Roughly 1800MB per 10,000 requests saved.
2017-11-09 16:17:25 -06:00
Jimmy Berry
3e191caa84
Merge pull request #1249 from jberry-suse/repo_checker-openqa-only
repo_checker: review failed stagings with only openQA failures.
2017-11-09 16:15:38 -06:00
Jimmy Berry
1efadc5f82
Merge pull request #1248 from jberry-suse/metrics-post-deploy-fixes
metrics: post deployment tweaks and fixes + opensuse-review-team who graphs
2017-11-09 16:08:56 -06:00
Ludwig Nussel
2110ded1a6 pkglistgen: fix up coolo's code 2017-11-09 15:22:27 +01:00
Ludwig Nussel
48a572ed59 Merge remote-tracking branch 'coolo/create_unsorted' 2017-11-09 15:03:03 +01:00
Ludwig Nussel
3d34370f79
Merge pull request #1252 from lnussel/ttm
ttm: publish non-oss for Leap 15 too
2017-11-09 14:57:23 +01:00
Ludwig Nussel
ace4ae06fd ttm: publish non-oss for Leap 15 too 2017-11-09 14:56:30 +01:00
Ludwig Nussel
312c18024d Don't die on delete requests
Perform src_project checks only on actions that actually have a
src_project
2017-11-09 14:55:07 +01:00
Jimmy Berry
48fe3836a6 repo_checker: review failed stagings with only openQA failures.
Build failures may cause false negatives in repo_checker results, but
openQA failures are not relevant and should be ignored.
2017-11-08 23:45:37 -06:00
Jimmy Berry
9a6b483948 metrics/grafana/review: include opensuse-review-team who graphs. 2017-11-08 17:38:10 -06:00
Jimmy Berry
586b177a97 metrics/grafana/review: default to openSUSE:Factory. 2017-11-08 17:38:10 -06:00
Jimmy Berry
736bfa235e metrics/grafana/review: disable annotations by default. 2017-11-08 17:38:10 -06:00
Jimmy Berry
6aafeba0c1 metrics/grafana/staging: "Project stats" to "Totals" 2017-11-08 17:38:10 -06:00
Jimmy Berry
41c3c6948d metrics/grafana/staging: remove 1s interval as it causes RAM issues. 2017-11-08 17:38:05 -06:00
Jimmy Berry
c01a8a71ed metrics/grafana: standardize title prefix with 'OSRT: '. 2017-11-08 17:33:24 -06:00
Jimmy Berry
0201a82722 dist/ci: grafana dir must be owned by grafana user since it writes lock. 2017-11-08 17:24:13 -06:00
Jimmy Berry
dc74b8d0be dist/spec: correct metrics postun to reference systemctl by absolute path. 2017-11-08 17:23:30 -06:00
Jimmy Berry
d0c298246e metrics: prefix release schedule file with source dir path.
Otherwise, when deployed via package and run via /usr/bin the files are
not found.
2017-11-08 16:43:07 -06:00
Jimmy Berry
593c90038f
Merge pull request #1242 from jberry-suse/metrics-package-rest
dist: provide metrics service and timer and install grafana dashboards.
2017-11-03 18:13:10 -05:00
Jimmy Berry
a0c7dc362c dist: provide metrics service and timer. 2017-11-03 17:59:01 -05:00
Jimmy Berry
10311c12c6 dist: install exported dashboards in grafana dashboard directory. 2017-11-03 17:58:18 -05:00
Jimmy Berry
159790907e dist: include metrics.py in bindir. 2017-11-03 17:50:24 -05:00
Jimmy Berry
02d5749d28 dist: move package_name variable to Makefile.common. 2017-11-03 17:48:47 -05:00
f5bc6b6c73
Merge pull request #1238 from nilxam/vdelreq_command
osc vdelreq: new command lists pending virtually accepted delete request status
2017-11-03 16:42:10 +08:00
6efaa1d3e6 vdelreq: add to the package 2017-11-02 15:53:45 +08:00
3468fe8c1e osc vdelreq: new command lists pending virtually accepted delete request status 2017-11-02 15:28:37 +08:00
0a45aba664
Merge pull request #1234 from nilxam/remove_2nd_specfile_ring
accept_command: remove the ring package if it is 2nd specfile is removed
2017-11-02 14:57:41 +08:00
ab21d5f0e1
Merge pull request #1233 from nilxam/force_must_be_force
accept_command: force to accept the staging if --force parameter is given
2017-11-02 14:57:26 +08:00
Jimmy Berry
d8cd193c99
Merge pull request #1231 from jberry-suse/devel-project-list-retry
systemd/devel-list: allow three retry attempts to handle regular OBS crash.
2017-10-31 20:01:10 -05:00
Jimmy Berry
990be5dbb3 systemd/devel-list: allow three retry attempts to handle regular OBS crash. 2017-10-31 20:00:34 -05:00
Jimmy Berry
0e1733f868
Merge pull request #1229 from jberry-suse/repo_checker-build-state
repo_checker: store and compare build hash to skip more aggressively (similar check for project_only)
2017-10-31 19:34:58 -05:00
Jimmy Berry
9aeb0a4c8e repo_checker: add newline to cycles comment to format properly. 2017-10-31 18:51:56 -05:00
Jimmy Berry
8767f73eca repo_checker: project_only place dashboard update behind dryrun check. 2017-10-31 18:51:56 -05:00
Jimmy Berry
b9bb3ce224 repo_checker: project_only ensure project repository is published. 2017-10-31 18:51:56 -05:00
Jimmy Berry
31cf49a09e repo_checker: store and compare build hash to skip more aggressively. 2017-10-31 18:51:38 -05:00
Jimmy Berry
c32b59bd55
Merge pull request #1230 from jberry-suse/devel-project-search-get_review_list
devel-project: override osc.core.search() to include withfullhistory for get_review_list().
2017-10-31 17:21:12 -05:00
b9bc629a4d accept_command: remove the ring package if it is 2nd specfile is removed 2017-10-31 19:46:53 +08:00
6ffe02ce94 accept_command: force to accept the staging if --force parameter is given
If --force parameter is given, it must to force to change the request state,
otherwise --force does not work if still had pending review.
2017-10-31 13:27:29 +08:00
Stephan Kulow
9cded5cf2d
Merge pull request #1228 from lnussel/pkglistgen
pkglistgen: also output suggested packages
2017-10-28 12:55:11 +02:00
Jimmy Berry
c2955c0233 devel-project: override osc.core.search() to include withfullhistory for get_review_list().
#1206 was a bit to optimistic as the deficiency was only half resolved.
2017-10-27 19:19:58 -05:00
Ludwig Nussel
ee81a524d1 pkglistgen: also output suggested packages 2017-10-27 17:18:37 +02:00
Ludwig Nussel
63cde2632d Merge pull request #1227 from lnussel/pkglistgen
pkglistgen: don't export skip_releases
2017-10-27 16:47:45 +02:00
Ludwig Nussel
319af34c90 pkglistgen: don't export skip_releases
would spoil next iteration in loop
2017-10-26 11:54:59 +02:00
Jimmy Berry
42b8b4d191 Merge pull request #1225 from jberry-suse/memoize-key-include-all-args
osclib/memoize: include first argument, sometimes instance, in cache key.
2017-10-25 17:51:10 -05:00
Jimmy Berry
e39a51821e osclib/memoize: include first argument, sometimes instance, in cache key.
Otherwise, multiple StagingAPI instances which are unique per project
will share caches for short-hand projects. For example:

StagingAPI.project_status('adi:1') called on two different instances will
share a cache.
2017-10-25 17:43:17 -05:00
Jimmy Berry
32d1a97241 Merge pull request #1207 from jberry-suse/obs-docker-compose-test-rebase
Provide local OBS setup, base data creation, test harness, and initial set of tests.
2017-10-24 18:17:25 -05:00
Jimmy Berry
e3150a7626 tests/OBSLocal: invoke scripts using coverage to include in report. 2017-10-24 18:06:33 -05:00
Jimmy Berry
e0491e3aae tests/OBSLocal: split out execute() to provide osc and generic versions. 2017-10-24 18:05:48 -05:00
Jimmy Berry
476fbcd818 tests/OBSLocal: include assertOBS() to clarify OBS status before test.
Otherwise, end up with first OBS call in test failing which does not make
the issue as clear to understand.
2017-10-24 18:05:48 -05:00