4445 Commits

Author SHA1 Message Date
Jimmy Berry
ae01d143c9 dist/ci/obs-build-target: utilize TAR_SCM_TESTMODE to avoid URL check.
See #1732 for details, but summarized the CI uses a local path which
differs from the normal remote URL which causes tar_scm service to
complain and no re-create the obscpio. See
openSUSE/obs-service-tar_scm@44b3bee for the relevant change.
2018-10-17 15:55:26 -05:00
Jimmy Berry
26c6dba22d dist/ci/obs-build-target: stop at first error. 2018-10-17 15:42:55 -05:00
Stephan Kulow
52fc1cac2f
Merge pull request #1731 from coolo/add_openqa
metrics: Fetch openqa jobs in influxdb format
2018-10-17 22:15:20 +02:00
Stephan Kulow
5d3688e569 metrics: Fetch openqa jobs in influxdb format 2018-10-16 06:40:57 +02:00
Jimmy Berry
020d14065e leaper: disable maintainer review addition for incidents.
This was disabled manually in production to effectively run leaper in
"comment-only mode" for maintenance with the expectation that this would
not remain for long. Since it seems it will it makes sense to merge the
state expected to be deployed.
2018-10-15 16:40:26 -05:00
Stephan Kulow
c6ff801c3b
Merge pull request #1728 from nilxam/ignore_patchinfo
check_maintenance_incidents: skip action if the action is for patchinfo
2018-10-15 12:16:59 +02:00
1968b6523c check_maintenance_incidents: skip action if the action is for patchinfo
Action of patchinfo does not have a releaseproject attribute, with bad
luck it might be lists as the first action of an maintenance incident,
we should skip it and try next action.
2018-10-15 17:59:46 +08:00
Stephan Kulow
5b9efe757d Require python-pika in CI 2018-10-12 15:30:54 +02:00
Stephan Kulow
ff84b79171 We need the images repo published to have a status check
We can't generally assume ISOs can be fetched from backend (we can't
have this on IBS), so publish it - and disable the actual publishing
on the staging backend of OBS
2018-10-12 13:00:18 +02:00
Stephan Kulow
8b6b498a0f First connect to AMQP then fetch initial state
This way we don't miss anything - we just have to make sure we're
done within heartbeart interval, or the server will close the connection.
But that's 60 seconds, so we're safe for this bot (and if we fail
once, we have to reconnect)
2018-10-12 11:28:42 +02:00
Stephan Kulow
d5947f5c19 Refactored rabbit-openqa to be based on PubSubConsumer
The base class listens to openSUSE pubsub messages (and can be used
standalone) and rabbit-openqa just overwrites the keys and the on_message
handler
2018-10-12 11:06:54 +02:00
Stephan Kulow
ae7f35c7e2 Adopt pika example on async 2018-10-11 15:10:41 +02:00
Stephan Kulow
61e1049895
Merge pull request #1721 from coolo/catch_unmirrored_repos
pkglistgen: Catch unmirrored repos
2018-10-11 11:38:48 +02:00
37ac71d0bf
Merge pull request #1694 from dirkmueller/master
[ARM 15.1] Include JeOS images in ToTest
2018-10-11 16:51:38 +08:00
Stephan Kulow
dc3201d238 Move unlink_list to pkglistgen class too
It's used in update_repos
2018-10-11 07:43:36 +02:00
Stephan Kulow
e70c071ce9 Move update_repos into Pkglistgen class
We need to track state within the tool, not in the command line
interface
2018-10-11 07:43:36 +02:00
Stephan Kulow
b8e451f8d1 Don't make missing repos (per arch) a fatal error
It's possible we link against repos that do not exist for all archs
2018-10-11 07:43:35 +02:00
5d542a82af
Merge pull request #1724 from Vogtinator/armkubic
Add openSUSE-Tumbleweed-Kubic-dvd5-dvd-aarch64 to openSUSE:Factory:ARM
2018-10-11 07:22:40 +02:00
Stephan Kulow
ceaef3ea88 Moved the ISO replace_string into OBS attributes 2018-10-10 20:59:16 +02:00
Stephan Kulow
a8d7b769c1 Find a sed like syntax for Staging ISOs
This can be moved to remote config
2018-10-10 20:07:21 +02:00
Stephan Kulow
3933e4e302 Package rabbit-openqa
I don't really like the name, but lack alternative ideas
2018-10-10 20:07:21 +02:00
Stephan Kulow
b38a1edc34 Make the names of the openQA checks unique
Prefer 'minimal_x' unless there are 2 (the code doesn't
support more than 2)
2018-10-10 20:07:21 +02:00
Stephan Kulow
b886e28db3 No need to if loop - we do the same for all of openqa 2018-10-10 20:07:21 +02:00
Stephan Kulow
6f5978cab6 Link to failed test modules
SLE unfortunately does not fail atm, so I had to implement leap :)
2018-10-10 20:07:21 +02:00
Stephan Kulow
ecdc60065a Fetch all openQA jobs for the ISO every time
This is ugly on first look, but has several advantages:
- we can more easily support a cold start
- as such we don't need to have a persistant queue and
  can directly bind the routing keys we want
- we do the same on all openqa events, simplifying the code
- we can cope support short names for the checks

The last is the most significant benefit (not yet implemented though).
We can name the openqa jobs RAID1 and gnome and only have to append
the machine name (or other settings) if they conflict
2018-10-10 20:07:21 +02:00
Stephan Kulow
dab6850133 Gather initial buildid of repositories 2018-10-10 20:07:21 +02:00
Stephan Kulow
d1c3e212d7 Add helper bot to listen to rabbit bus and feed OBS with openQA Status
There is an API gap on OBS side atm, so this won't complete:
https://github.com/openSUSE/open-build-service/issues/6035
2018-10-10 20:07:21 +02:00
fa6f388dd4 Add openSUSE-Tumbleweed-Kubic-dvd5-dvd-aarch64 to openSUSE:Factory:ARM 2018-10-10 15:40:58 +02:00
Stephan Kulow
e90ac73952
Merge pull request #1723 from coolo/fix_unsorted
pkglistgen: Fix copy&paste error on uploading results
2018-10-10 11:00:06 +02:00
Stephan Kulow
59d9454134 pkglistgen: Fix copy&paste error on uploading results 2018-10-10 10:46:45 +02:00
Stephan Kulow
97f1eda281
Merge pull request #1722 from coolo/filter_arch_3
Fix overlap calculation: modules only have filtered archs
2018-10-10 07:09:33 +02:00
Stephan Kulow
fb4d63ec3d Fix overlap calculation: modules only have filtered archs 2018-10-10 06:45:14 +02:00
Stephan Kulow
97e58e1732
Merge pull request #1719 from coolo/dont_spam_submitters
Do no longer CC submitters in request comments
2018-10-04 11:29:32 +02:00
Stephan Kulow
caee9053c4
Merge pull request #1718 from coolo/filter_arch_2
pkglistgen: Make sure we don't calculate non-existant architectures i…
2018-10-04 09:58:21 +02:00
Stephan Kulow
e6bf5ccb7b Do no longer CC submitters in request comments
Submitters complain more and more about the spam they're getting from
staging projects - and we rather leave that weapon for actual feedback.

One especially annoying case is if a package is added to one staging project
and then later moved to another, the submitter will receive notifications
of all kind of bots and actions for both staging projects.
2018-10-04 09:52:49 +02:00
Stephan Kulow
a96e864c06 pkglistgen: Make sure we don't calculate non-existant architectures in stagings
Otherwise the package list is not staging specific
2018-10-04 07:00:56 +02:00
Stephan Kulow
5ba0b87577
Merge pull request #1717 from coolo/filter_arch
pkglistgen: only PUT new data if it changed
2018-10-04 06:59:26 +02:00
Stephan Kulow
c4fa49aef2 Refactor conditional_PUT as core function
Introduce source_file_ensure in osclib.core following review in #1717
2018-10-03 07:36:42 +02:00
Stephan Kulow
2d4148f3f2 pkglistgen: only PUT new data if it changed
Otherwise we collect quickly a million revisions with no gain
2018-10-02 06:48:58 +02:00
Ludwig Nussel
f1c8f63900 leaper: block on pending factory submissions also for new packages 2018-10-01 09:57:15 +02:00
Stephan Kulow
39a3f83180
Merge pull request #1711 from coolo/jberry-suse-osclib-core-repository-state
Don't trust _result for repository state
2018-09-29 07:24:06 +02:00
Stephan Kulow
6004636b21
Merge pull request #1714 from jberry-suse/repo-checker-build-failure-check
repo_checker: re-instate staging build failure check after generic rework.
2018-09-29 07:22:51 +02:00
Jimmy Berry
a0de4c5b94 repo_checker: re-instate staging build failure check after generic rework. 2018-09-28 17:27:04 -05:00
Stephan Kulow
f3961e4857 pkglistgen: Only check repository check per arch
(also indent 2 lines due to calling autopep)
2018-09-28 08:05:15 +02:00
Stephan Kulow
4539190af7 Optimize repository_state
The _result view checks way more things than we need, so just iterate
through the architectures of a repository and check the binaryversions
per arch. And combine the sha1sums to one sha1 per repository
2018-09-28 08:05:15 +02:00
Jimmy Berry
2deda1a5f1
Merge pull request #1710 from jberry-suse/osclib-core-repository-state
osclib/core: repository_state(): rework to utilize binarylist view.
2018-09-27 08:24:24 -05:00
Stephan Kulow
ed9afeacc2
Merge pull request #1709 from coolo/fix_repo_pkglistgen
Move creation of the Solver object out of loop
2018-09-27 07:17:33 +02:00
Stephan Kulow
5a1307b98b Move creation of the Solver object out of loop
After time for sle_module_basesystem: before 16.5s, after 9.7s
2018-09-27 07:07:05 +02:00
Jimmy Berry
ea94191d21
Merge pull request #1688 from jberry-suse/kubernetes
[WIP] dist/kubernetes: provide basic ksonnet setup for heroes cluster including check-source and repo-checker modules
2018-09-26 17:27:55 -05:00
Jimmy Berry
73edfb8121 osclib/core: repository_state(): rework to utilize binarylist view.
For whatever reason the state hash only includes the overall publish states
and not the binaries within the repository. As such, rebuilding state
before a  rebuild and after may be the same.
2018-09-26 17:11:45 -05:00