3408 Commits

Author SHA1 Message Date
Ludwig Nussel
60cdcec090
Merge pull request #1270 from nilxam/ignore_download_files_check
check_source: Ignore download_files failure in some cases
2017-11-27 13:23:42 +01:00
Ludwig Nussel
3368dd555d
Merge pull request #1262 from okurz/feature/use_ttm_for_sle
ttm: Add support for SLE 15
2017-11-27 13:23:10 +01:00
Ludwig Nussel
7c622d7e66
Merge pull request #1273 from nilxam/up_fcc_15
fcc_submitter: update to Leap 15.0
2017-11-27 13:17:07 +01:00
Ludwig Nussel
3d1b9ec784
Merge pull request #1274 from lnussel/pkglistgen
pkglistgen: Optionally include suggested packages too
2017-11-27 13:16:30 +01:00
Ludwig Nussel
ae242fb47d Implement namespace callback for locales
Needs https://github.com/openSUSE/libsolv/issues/231
2017-11-24 13:45:33 +01:00
Ludwig Nussel
3038aa3e91 pkglistgen: Optionally include suggested packages too 2017-11-24 13:43:38 +01:00
f2c58a27a4 fcc_submitter: update to Leap 15.0 2017-11-23 17:08:02 +08:00
Jimmy Berry
ea9f94803a
Merge pull request #1272 from jberry-suse/editor-split
Split EDITOR environment variable to handle flags in prefix.
2017-11-22 09:26:34 -06:00
Jimmy Berry
664f3bbb90 Split EDITOR environment variable to handle flags in prefix. 2017-11-22 09:13:06 -06:00
b428ed3a7d
Merge pull request #1269 from nilxam/submit_from_compare_pkglist
compare_pkglist: Add --submit param to submit new package
2017-11-22 21:00:16 +08:00
4838dbec82 compare_pkglist: Add --submit param to submit new package 2017-11-22 17:30:29 +08:00
7e1b42fe41 check_source: Ignore download_files failure in some cases 2017-11-22 17:29:14 +08:00
Ludwig Nussel
734e3842ab
Merge pull request #1267 from lnussel/master
pkglistgen: require python-solv
2017-11-21 11:28:09 +01:00
Ludwig Nussel
38e5e1de61 pkglistgen: need to expand link 2017-11-21 11:01:12 +01:00
Ludwig Nussel
0399499674 pkglistgen: require python-solv 2017-11-21 10:58:13 +01:00
Ludwig Nussel
0d31ae5082 pkglistgen: Fix script name 2017-11-21 10:53:27 +01:00
Ludwig Nussel
4f605eb501
Merge pull request #1266 from lnussel/master
Skip maintainer review for certain Leap 15 submissions
2017-11-21 10:52:17 +01:00
Ludwig Nussel
981fe38696 Skip maintainer review for certain Leap 15 submissions 2017-11-20 14:54:49 +01:00
Ludwig Nussel
fc6eb19f41
Merge pull request #1258 from lnussel/pkglistgen
pkglistgen: process DVD subproject first
2017-11-20 14:11:19 +01:00
87649f10f1
Merge pull request #1263 from nilxam/rebuild_support_also
suppkg_rebuild: count Support tag also
2017-11-20 16:10:15 +08:00
Oliver Kurz
8d12fd4f0f ttm: Add support for SLE 15
Example log output of call
`totest-manager.py --project-base SLE --dry --debug --verbose run SUSE:SLE-15:GA`:

```
2017-11-14 23:37:55,711 - totest-manager:267 INFO job sle-15-Installer-DVD-x86_64-Build-foo@bar failed, see https://openqa.suse.de/tests/12345
2017-11-14 23:38:00,308 - totest-manager:478 INFO current_snapshot 123.4: failed
2017-11-14 23:38:00,308 - totest-manager:479 DEBUG new_snapshot 128.1
2017-11-14 23:38:00,308 - totest-manager:480 DEBUG current_qa_version None
2017-11-14 23:38:05,878 - totest-manager:483 DEBUG snapshotable: True
2017-11-14 23:38:06,135 - totest-manager:500 DEBUG totest already publishing
2017-11-14 23:38:06,136 - totest-manager:436 INFO Updating snapshot None
2017-11-14 23:38:06,136 - totest-manager:546 INFO release SUSE:SLE-15:GA/000product (None)
```
2017-11-17 14:29:50 +01:00
67f5d0213b suppkg_rebuild: count Support tag also 2017-11-17 18:52:36 +08:00
6140695f1d
Merge pull request #1261 from nilxam/improve_compare_pkglist
compare_pkglist: misc improvements
2017-11-15 15:28:36 +08:00
cc0bd67365 compare_pkglist: displays deleted package 2017-11-14 18:13:13 +08:00
15e8e74a2f compare_pkglist: misc improvements 2017-11-14 15:51:44 +08:00
Ludwig Nussel
205bed9c0b pkglistgen: require obs-service-product_converter 2017-11-13 18:25:16 +01:00
Ludwig Nussel
290a2ed0b8 pkglistgen: add systemd units 2017-11-13 18:18:00 +01:00
Ludwig Nussel
384746715d pkglistgen: use new cache format of repo_checker 2017-11-13 17:39:52 +01:00
Ludwig Nussel
1ea00d8d8f pkglistgen: process DVD subproject first
the other way around may cause the scheduler to flag the DVD
subproject dirty already.
2017-11-13 16:47:34 +01:00
Ludwig Nussel
b6909435e9
Merge pull request #1253 from lnussel/pkglistgen
Pkglistgen: merge and fix unsorted generation
2017-11-12 11:59:03 +01:00
Jimmy Berry
5906e5c5d8
Merge pull request #1255 from jberry-suse/totest-manager-postun-fix
dist/spec: appease the exit status gods with || true.
2017-11-10 01:33:10 -06:00
Jimmy Berry
f5dc137134 dist/spec: appease the exit status gods with || true. 2017-11-09 23:47:08 -06:00
Jimmy Berry
13ed915492
Merge pull request #1254 from jberry-suse/spec-scriptlet-simplify
dist/spec: only run %systemd_postun for oneshot services (and handle instanced services)
2017-11-09 17:36:42 -06:00
Jimmy Berry
f3d23f31f5 dist/spec: restart totest-manager instances properly. 2017-11-09 17:29:38 -06:00
Jimmy Berry
e45fe4814a dist/spec: only run %systemd_postun for oneshot services. 2017-11-09 17:29:19 -06:00
Jimmy Berry
f927c5769b
Merge pull request #1251 from jberry-suse/metrics-memory-reduction
metrics: reduce memory footprint by over 60%
2017-11-09 16:39:37 -06:00
Jimmy Berry
bcdea6812d
Merge pull request #1240 from lnussel/master
Don't die on delete requests
2017-11-09 16:25:19 -06:00
Jimmy Berry
26883b12d2 metrics: rework to store points as named tuple and write in batches.
Savings of around 400MB per 10,000 requests. Using a named tuple was the
original approach for this reason, but the influxdb interface requires
dict()s and it seemed silly to spend time converting them. Additionally,
influxdb client already does batching.

Unfortunately, with the amount of data processed for Factory that will
continue to grow this approach is necessary. The dict() final structures
are buffered up to ~1000 before being written and released. Another
benefit of the batching is that influxdb does not allocate memory for the
entire incoming batch.
2017-11-09 16:17:57 -06:00
Jimmy Berry
8a87becd55 metrics: rework request pagination to provide as generator.
This prevents the memory required to process to be enough to load all
parsed request element trees at once. Instead only one page of requests
is loaded at a time and the memory freed after processed. The end result
is the memory consumption reduced by just over 20% (current Factory drops
by around 2.5GB).
2017-11-09 16:17:25 -06:00
Jimmy Berry
ab569dfab8 metrics: call ET.clear() to release unneeded memory used by search result.
Roughly 1800MB per 10,000 requests saved.
2017-11-09 16:17:25 -06:00
Jimmy Berry
3e191caa84
Merge pull request #1249 from jberry-suse/repo_checker-openqa-only
repo_checker: review failed stagings with only openQA failures.
2017-11-09 16:15:38 -06:00
Jimmy Berry
1efadc5f82
Merge pull request #1248 from jberry-suse/metrics-post-deploy-fixes
metrics: post deployment tweaks and fixes + opensuse-review-team who graphs
2017-11-09 16:08:56 -06:00
Ludwig Nussel
2110ded1a6 pkglistgen: fix up coolo's code 2017-11-09 15:22:27 +01:00
Ludwig Nussel
48a572ed59 Merge remote-tracking branch 'coolo/create_unsorted' 2017-11-09 15:03:03 +01:00
Ludwig Nussel
3d34370f79
Merge pull request #1252 from lnussel/ttm
ttm: publish non-oss for Leap 15 too
2017-11-09 14:57:23 +01:00
Ludwig Nussel
ace4ae06fd ttm: publish non-oss for Leap 15 too 2017-11-09 14:56:30 +01:00
Ludwig Nussel
312c18024d Don't die on delete requests
Perform src_project checks only on actions that actually have a
src_project
2017-11-09 14:55:07 +01:00
Jimmy Berry
48fe3836a6 repo_checker: review failed stagings with only openQA failures.
Build failures may cause false negatives in repo_checker results, but
openQA failures are not relevant and should be ignored.
2017-11-08 23:45:37 -06:00
Jimmy Berry
9a6b483948 metrics/grafana/review: include opensuse-review-team who graphs. 2017-11-08 17:38:10 -06:00
Jimmy Berry
586b177a97 metrics/grafana/review: default to openSUSE:Factory. 2017-11-08 17:38:10 -06:00