3492 Commits

Author SHA1 Message Date
Ludwig Nussel
4f605eb501
Merge pull request #1266 from lnussel/master
Skip maintainer review for certain Leap 15 submissions
2017-11-21 10:52:17 +01:00
Ludwig Nussel
981fe38696 Skip maintainer review for certain Leap 15 submissions 2017-11-20 14:54:49 +01:00
Ludwig Nussel
fc6eb19f41
Merge pull request #1258 from lnussel/pkglistgen
pkglistgen: process DVD subproject first
2017-11-20 14:11:19 +01:00
87649f10f1
Merge pull request #1263 from nilxam/rebuild_support_also
suppkg_rebuild: count Support tag also
2017-11-20 16:10:15 +08:00
Oliver Kurz
8d12fd4f0f ttm: Add support for SLE 15
Example log output of call
`totest-manager.py --project-base SLE --dry --debug --verbose run SUSE:SLE-15:GA`:

```
2017-11-14 23:37:55,711 - totest-manager:267 INFO job sle-15-Installer-DVD-x86_64-Build-foo@bar failed, see https://openqa.suse.de/tests/12345
2017-11-14 23:38:00,308 - totest-manager:478 INFO current_snapshot 123.4: failed
2017-11-14 23:38:00,308 - totest-manager:479 DEBUG new_snapshot 128.1
2017-11-14 23:38:00,308 - totest-manager:480 DEBUG current_qa_version None
2017-11-14 23:38:05,878 - totest-manager:483 DEBUG snapshotable: True
2017-11-14 23:38:06,135 - totest-manager:500 DEBUG totest already publishing
2017-11-14 23:38:06,136 - totest-manager:436 INFO Updating snapshot None
2017-11-14 23:38:06,136 - totest-manager:546 INFO release SUSE:SLE-15:GA/000product (None)
```
2017-11-17 14:29:50 +01:00
67f5d0213b suppkg_rebuild: count Support tag also 2017-11-17 18:52:36 +08:00
6140695f1d
Merge pull request #1261 from nilxam/improve_compare_pkglist
compare_pkglist: misc improvements
2017-11-15 15:28:36 +08:00
cc0bd67365 compare_pkglist: displays deleted package 2017-11-14 18:13:13 +08:00
15e8e74a2f compare_pkglist: misc improvements 2017-11-14 15:51:44 +08:00
Ludwig Nussel
205bed9c0b pkglistgen: require obs-service-product_converter 2017-11-13 18:25:16 +01:00
Ludwig Nussel
290a2ed0b8 pkglistgen: add systemd units 2017-11-13 18:18:00 +01:00
Ludwig Nussel
384746715d pkglistgen: use new cache format of repo_checker 2017-11-13 17:39:52 +01:00
Ludwig Nussel
1ea00d8d8f pkglistgen: process DVD subproject first
the other way around may cause the scheduler to flag the DVD
subproject dirty already.
2017-11-13 16:47:34 +01:00
Ludwig Nussel
b6909435e9
Merge pull request #1253 from lnussel/pkglistgen
Pkglistgen: merge and fix unsorted generation
2017-11-12 11:59:03 +01:00
Jimmy Berry
5906e5c5d8
Merge pull request #1255 from jberry-suse/totest-manager-postun-fix
dist/spec: appease the exit status gods with || true.
2017-11-10 01:33:10 -06:00
Jimmy Berry
f5dc137134 dist/spec: appease the exit status gods with || true. 2017-11-09 23:47:08 -06:00
Jimmy Berry
13ed915492
Merge pull request #1254 from jberry-suse/spec-scriptlet-simplify
dist/spec: only run %systemd_postun for oneshot services (and handle instanced services)
2017-11-09 17:36:42 -06:00
Jimmy Berry
f3d23f31f5 dist/spec: restart totest-manager instances properly. 2017-11-09 17:29:38 -06:00
Jimmy Berry
e45fe4814a dist/spec: only run %systemd_postun for oneshot services. 2017-11-09 17:29:19 -06:00
Jimmy Berry
f927c5769b
Merge pull request #1251 from jberry-suse/metrics-memory-reduction
metrics: reduce memory footprint by over 60%
2017-11-09 16:39:37 -06:00
Jimmy Berry
bcdea6812d
Merge pull request #1240 from lnussel/master
Don't die on delete requests
2017-11-09 16:25:19 -06:00
Jimmy Berry
26883b12d2 metrics: rework to store points as named tuple and write in batches.
Savings of around 400MB per 10,000 requests. Using a named tuple was the
original approach for this reason, but the influxdb interface requires
dict()s and it seemed silly to spend time converting them. Additionally,
influxdb client already does batching.

Unfortunately, with the amount of data processed for Factory that will
continue to grow this approach is necessary. The dict() final structures
are buffered up to ~1000 before being written and released. Another
benefit of the batching is that influxdb does not allocate memory for the
entire incoming batch.
2017-11-09 16:17:57 -06:00
Jimmy Berry
8a87becd55 metrics: rework request pagination to provide as generator.
This prevents the memory required to process to be enough to load all
parsed request element trees at once. Instead only one page of requests
is loaded at a time and the memory freed after processed. The end result
is the memory consumption reduced by just over 20% (current Factory drops
by around 2.5GB).
2017-11-09 16:17:25 -06:00
Jimmy Berry
ab569dfab8 metrics: call ET.clear() to release unneeded memory used by search result.
Roughly 1800MB per 10,000 requests saved.
2017-11-09 16:17:25 -06:00
Jimmy Berry
3e191caa84
Merge pull request #1249 from jberry-suse/repo_checker-openqa-only
repo_checker: review failed stagings with only openQA failures.
2017-11-09 16:15:38 -06:00
Jimmy Berry
1efadc5f82
Merge pull request #1248 from jberry-suse/metrics-post-deploy-fixes
metrics: post deployment tweaks and fixes + opensuse-review-team who graphs
2017-11-09 16:08:56 -06:00
Ludwig Nussel
2110ded1a6 pkglistgen: fix up coolo's code 2017-11-09 15:22:27 +01:00
Ludwig Nussel
48a572ed59 Merge remote-tracking branch 'coolo/create_unsorted' 2017-11-09 15:03:03 +01:00
Ludwig Nussel
3d34370f79
Merge pull request #1252 from lnussel/ttm
ttm: publish non-oss for Leap 15 too
2017-11-09 14:57:23 +01:00
Ludwig Nussel
ace4ae06fd ttm: publish non-oss for Leap 15 too 2017-11-09 14:56:30 +01:00
Ludwig Nussel
312c18024d Don't die on delete requests
Perform src_project checks only on actions that actually have a
src_project
2017-11-09 14:55:07 +01:00
Jimmy Berry
48fe3836a6 repo_checker: review failed stagings with only openQA failures.
Build failures may cause false negatives in repo_checker results, but
openQA failures are not relevant and should be ignored.
2017-11-08 23:45:37 -06:00
Jimmy Berry
9a6b483948 metrics/grafana/review: include opensuse-review-team who graphs. 2017-11-08 17:38:10 -06:00
Jimmy Berry
586b177a97 metrics/grafana/review: default to openSUSE:Factory. 2017-11-08 17:38:10 -06:00
Jimmy Berry
736bfa235e metrics/grafana/review: disable annotations by default. 2017-11-08 17:38:10 -06:00
Jimmy Berry
6aafeba0c1 metrics/grafana/staging: "Project stats" to "Totals" 2017-11-08 17:38:10 -06:00
Jimmy Berry
41c3c6948d metrics/grafana/staging: remove 1s interval as it causes RAM issues. 2017-11-08 17:38:05 -06:00
Jimmy Berry
c01a8a71ed metrics/grafana: standardize title prefix with 'OSRT: '. 2017-11-08 17:33:24 -06:00
Jimmy Berry
0201a82722 dist/ci: grafana dir must be owned by grafana user since it writes lock. 2017-11-08 17:24:13 -06:00
Jimmy Berry
dc74b8d0be dist/spec: correct metrics postun to reference systemctl by absolute path. 2017-11-08 17:23:30 -06:00
Jimmy Berry
d0c298246e metrics: prefix release schedule file with source dir path.
Otherwise, when deployed via package and run via /usr/bin the files are
not found.
2017-11-08 16:43:07 -06:00
Jimmy Berry
593c90038f
Merge pull request #1242 from jberry-suse/metrics-package-rest
dist: provide metrics service and timer and install grafana dashboards.
2017-11-03 18:13:10 -05:00
Jimmy Berry
a0c7dc362c dist: provide metrics service and timer. 2017-11-03 17:59:01 -05:00
Jimmy Berry
10311c12c6 dist: install exported dashboards in grafana dashboard directory. 2017-11-03 17:58:18 -05:00
Jimmy Berry
159790907e dist: include metrics.py in bindir. 2017-11-03 17:50:24 -05:00
Jimmy Berry
02d5749d28 dist: move package_name variable to Makefile.common. 2017-11-03 17:48:47 -05:00
f5bc6b6c73
Merge pull request #1238 from nilxam/vdelreq_command
osc vdelreq: new command lists pending virtually accepted delete request status
2017-11-03 16:42:10 +08:00
6efaa1d3e6 vdelreq: add to the package 2017-11-02 15:53:45 +08:00
3468fe8c1e osc vdelreq: new command lists pending virtually accepted delete request status 2017-11-02 15:28:37 +08:00
0a45aba664
Merge pull request #1234 from nilxam/remove_2nd_specfile_ring
accept_command: remove the ring package if it is 2nd specfile is removed
2017-11-02 14:57:41 +08:00