4357 Commits

Author SHA1 Message Date
Stephan Kulow
5ba0b87577
Merge pull request #1717 from coolo/filter_arch
pkglistgen: only PUT new data if it changed
2018-10-04 06:59:26 +02:00
Stephan Kulow
c4fa49aef2 Refactor conditional_PUT as core function
Introduce source_file_ensure in osclib.core following review in #1717
2018-10-03 07:36:42 +02:00
Stephan Kulow
2d4148f3f2 pkglistgen: only PUT new data if it changed
Otherwise we collect quickly a million revisions with no gain
2018-10-02 06:48:58 +02:00
Stephan Kulow
39a3f83180
Merge pull request #1711 from coolo/jberry-suse-osclib-core-repository-state
Don't trust _result for repository state
2018-09-29 07:24:06 +02:00
Stephan Kulow
6004636b21
Merge pull request #1714 from jberry-suse/repo-checker-build-failure-check
repo_checker: re-instate staging build failure check after generic rework.
2018-09-29 07:22:51 +02:00
Jimmy Berry
a0de4c5b94 repo_checker: re-instate staging build failure check after generic rework. 2018-09-28 17:27:04 -05:00
Stephan Kulow
f3961e4857 pkglistgen: Only check repository check per arch
(also indent 2 lines due to calling autopep)
2018-09-28 08:05:15 +02:00
Stephan Kulow
4539190af7 Optimize repository_state
The _result view checks way more things than we need, so just iterate
through the architectures of a repository and check the binaryversions
per arch. And combine the sha1sums to one sha1 per repository
2018-09-28 08:05:15 +02:00
Jimmy Berry
2deda1a5f1
Merge pull request #1710 from jberry-suse/osclib-core-repository-state
osclib/core: repository_state(): rework to utilize binarylist view.
2018-09-27 08:24:24 -05:00
Stephan Kulow
ed9afeacc2
Merge pull request #1709 from coolo/fix_repo_pkglistgen
Move creation of the Solver object out of loop
2018-09-27 07:17:33 +02:00
Stephan Kulow
5a1307b98b Move creation of the Solver object out of loop
After time for sle_module_basesystem: before 16.5s, after 9.7s
2018-09-27 07:07:05 +02:00
Jimmy Berry
ea94191d21
Merge pull request #1688 from jberry-suse/kubernetes
[WIP] dist/kubernetes: provide basic ksonnet setup for heroes cluster including check-source and repo-checker modules
2018-09-26 17:27:55 -05:00
Jimmy Berry
73edfb8121 osclib/core: repository_state(): rework to utilize binarylist view.
For whatever reason the state hash only includes the overall publish states
and not the binaries within the repository. As such, rebuilding state
before a  rebuild and after may be the same.
2018-09-26 17:11:45 -05:00
Stephan Kulow
015677fa45
Merge pull request #1704 from coolo/use_filtered_unsorted
Don't take unsorted.group as reference for SP1 product changes
2018-09-26 10:02:43 +02:00
Stephan Kulow
1527c616dc
Merge pull request #1705 from lnussel/changelog_checker
check_tags_in_requests: factory property is actually an array
2018-09-24 17:35:26 +02:00
Ludwig Nussel
31004b5724 check_tags_in_requests: factory property is actually an array 2018-09-24 16:01:44 +02:00
Stephan Kulow
ea0e6d4aaa Don't take unsorted.group as reference for SP1 product changes
The release managers are actually supposed to maintain the filter list
in unneeded.yml, but that only applies to unsorted.yml not to the unsorted.group
(which is basically unfiltered to be published into OBS's SLE-15)
2018-09-24 15:33:10 +02:00
Stephan Kulow
e409a673ae
Merge pull request #1702 from jberry-suse/pkglistgen-do-update-state-check
pkglistgen: compare repository state to determine when to update solv.
2018-09-21 14:31:35 +02:00
Jimmy Berry
a074572c45 pkglistgen: compare repository state to determine when to update solv.
Since both pkglistgen and repo_checker share the same rpm metadata cache
either may update it first and thus bs_mirrorfull will only contain output
for one of the tools. As such the check in pkglistgen could cause the solv
file to remain stale. Instead write a secondary file containing the
repository state hash and check to see if the file already exists.
2018-09-20 16:38:05 -05:00
Jimmy Berry
35ea0e17fa
Merge pull request #1701 from jberry-suse/metrics-access-timer-old-systemd
systemd/metrics-access.timer: utilize compatible calendar format.
2018-09-20 09:06:42 -05:00
Jimmy Berry
9341b740df systemd/metrics-access.timer: utilize compatible calendar format.
systemd 228 does not support this format and fails to load timer.
2018-09-19 22:22:53 -05:00
Jimmy Berry
38e2d3fa1c
Merge pull request #1699 from jberry-suse/metrics-access-aggregate-empty-keys
metrics/access/aggregate: correct empty seen key handling.
2018-09-18 16:45:12 -05:00
Jimmy Berry
d3afb6806b
Merge pull request #1698 from jberry-suse/core-pseudometa-ensure-fix
osclib/core: project_pseudometa_file_ensure(): correct comparison logic.
2018-09-18 16:26:03 -05:00
Jimmy Berry
aeb3b8ce4d
Merge pull request #1697 from jberry-suse/ReviewBot-delete-break-out-types
check_source: decline all delete project requests and ReviewBot sub-delete check types.
2018-09-18 16:17:44 -05:00
Jimmy Berry
e246ca69d8 metrics/access/aggregate: correct empty seen key handling.
Set everything up, but never filled in keys.
2018-09-17 17:37:35 -05:00
Jimmy Berry
1fc5232c5e osclib/core: project_pseudometa_file_ensure(): correct comparison logic.
Previously, ends up comparing the wrong package, but saving to the correct
one. This ends up with extra blank commits. :(
2018-09-17 17:25:00 -05:00
Jimmy Berry
406fc41a85 ReviewBots: utilize delete_package check where it was already assumed. 2018-09-17 17:15:23 -05:00
Jimmy Berry
658137b9e9 check_source: split out delete repository check to new sub action check. 2018-09-17 17:14:48 -05:00
Jimmy Berry
ecbc806b2d check_source: decline all delete project requests. 2018-09-17 17:13:58 -05:00
Jimmy Berry
d1b630b5da ReviewBot: break down sub-types of delete requests.
Their is very little overlap in the types of reviews one typically wants
to perform on delete requests. Already all of the existing code will crash
if a delete project request is reviewed.
2018-09-17 17:04:44 -05:00
Jimmy Berry
628c1a107d
Merge pull request #1695 from jberry-suse/metrics-images
metrics: add image totals by product to access dashboard.
2018-09-14 16:09:10 -05:00
Jimmy Berry
5c410b7c76 metrics/grafana/access: add new row and graphs for image totals by product.
Includes a new variable for switching which product is displayed.
Unfortunately, there is no way to hide the variable within a row and it
seems like over-kill to create a separate dashboard.
2018-09-14 15:55:02 -05:00
Jimmy Berry
7492b109e5 metrics/access/aggregate: process and summarize image totals by product.
Accessible in new measurement prefixed by 'image'.
2018-09-14 15:53:30 -05:00
Jimmy Berry
c84add0bf7 metrics/access/aggregate: extract merge_product_plus_key() from merge(). 2018-09-14 15:52:05 -05:00
Jimmy Berry
dc9afe2adf metrics/access/ingest: detect product image paths and included in dump. 2018-09-14 15:50:37 -05:00
Jimmy Berry
6203b52a42 metrics/grafana/access: remove left-over raw queries.
For some reason Grafana does not remove these from data structure even
though they no longer represent current state.
2018-09-14 15:49:56 -05:00
Jimmy Berry
f80d3ff03f metrics/access/aggregate: include Leap 15.1 in published metrics. 2018-09-14 15:48:12 -05:00
Jimmy Berry
f5c8b8d4f2 dist/kubernetes: provide README covering basic operation. 2018-09-13 20:26:08 -05:00
Jimmy Berry
287de0347b dist/kubernetes: provide repo-checker module. 2018-09-13 20:26:08 -05:00
Jimmy Berry
ca22d5ea7a dist/kubernetes: provide check-source module. 2018-09-13 20:26:08 -05:00
Jimmy Berry
2ecf813cbd dist/kubernetes: provide base review_bot component prototype. 2018-09-13 20:26:08 -05:00
Jimmy Berry
35836073be dist/kubernetes: provide basic ksonnet setup for heroes cluster. 2018-09-13 20:26:08 -05:00
Jimmy Berry
72b518b8ad dist/kiwi: provide kiwi for building worker-obs container. 2018-09-13 20:26:08 -05:00
Jimmy Berry
ed631a8384 k8s-secret: provide tool to generate kubernetes secrets containing oscrc. 2018-09-13 20:26:08 -05:00
Jimmy Berry
d74c1c69ff osclib/cache_manager: rework base directory handling.
Ensure the returned directory is always created and while continuing to
handle test mode.
2018-09-13 20:26:08 -05:00
Jimmy Berry
4c01a602a7 dist/ci/osc-init: allow output file location to be set via OSCRC env var. 2018-09-13 20:26:08 -05:00
Jimmy Berry
d1022403cb
Merge pull request #1691 from lnussel/check_source
check_source: reset skip_add_reviews for each request
2018-09-13 16:57:31 -05:00
Stephan Kulow
47324ff2fd
Merge pull request #1693 from nilxam/ignore_product_package
check_source: ignore _product package check
2018-09-13 15:07:13 +02:00
dbf31de9af check_source: ignore _product package check 2018-09-13 20:49:56 +08:00
Ludwig Nussel
db9375336b check_source: reset skip_add_reviews for each request
skip_add_reviews needs to be reset, otherwise a single
maintenance_incident request affects the rest of the work queue.
2018-09-12 11:48:23 +02:00