yudaike/openSUSE-release-tools
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
6,948 Commits 2 Branches 12 Tags
Commit Graph

103 Commits

Author SHA1 Message Date
Enno Gotthold
4d15d19f2d
pkglistgen: Add type annotations 2022-10-13 14:46:33 +02:00
Stephan Kulow
92fad0708e Prepare applying pkglistgen diffs on staging accept 
We will check if there are approved pkglistgen comments and if so, apply
them to the target. For this we need to parse the generated markdown, so
refactor both in a common class.

There diff is applied, but not yet commited in this commit
 2022-03-22 09:28:02 +01:00
Stephan Kulow
fbbf357169 pkglistgen: pass the test if the comment was replied to with 'ignore' 
To allow passing multiple staging projects without force accepting
(https://github.com/openSUSE/openSUSE-release-tools/issues/1833)
 2022-03-19 14:03:20 +01:00
Stephan Kulow
830ec65b8f pkglistgen: Fix packages disapparing in comments 2022-03-17 13:45:20 +01:00
Stephan Kulow
bceaa53e13 pkglisten: Generate a comment for staging diffs 
This is the next step towards having multiple submissions to SLE stagings
 2022-03-17 11:16:06 +01:00
Stephan Kulow
0bbf3b2bdf
Merge pull request #2751 from coolo/change_reference 
pkglistgen: If the groups contain a summary-staging.txt evaluate it
 2022-03-15 13:44:45 +01:00
Stephan Kulow
1f85a4aef1 pkglistgen: If the groups contain a summary-staging.txt evaluate it 2022-03-15 13:42:16 +01:00
Stephan Kulow
e77cce849e
Merge pull request #2749 from coolo/fix_missings 
pkglistgen: Remove very noisy debug output
 2022-03-14 09:42:03 +01:00
Stephan Kulow
54e1f9de6c pkglistgen: Remove very noisy debug output 2022-03-14 08:52:48 +01:00
Stephan Kulow
378a00af51 pkglist: Don't exit with 0 if the stagings didn't calculcate lists 2022-03-11 15:42:56 +01:00
Stephan Kulow
c8721fcb13 Fix filtering of unneeded.yml 
The regexps were supposed to match package names, but re.match does not
what I thought it does - it only matches the start of the line not the
end
 2022-03-11 08:08:55 +01:00
Stephan Kulow
b93adbd9c1 pkglistgen: Fix exit values - True is actually bad 2022-03-05 15:58:20 +01:00
Stephan Kulow
1870e989a4 pkglistgen: Only solve one project at a time 
As we deprecated 'all' we can just as well rely on only one project
given (which is also what we do in gocd) to ease error reporting.

The old method of running all projects in a loop stemed from the
old pkglistgen not having a scheduler so we relied on serial execution.
 2022-03-05 08:21:19 +01:00
Stephan Kulow
e3f0a13b96 pkglistgen: Don't exit 1 if we skip weakremovers due to restarted builds 
Since 30daff5613803667be7422056431116e84c07d59 we check if the repos are
still what we expected them to be when we started and stop calculating
weakremovers.inc if the build didn't stay still for the full runtime of
the pkglistgen. But the exception makes it impossible to spot real
failures - so make this a regular exit
 2022-03-04 13:40:29 +01:00
Stephan Kulow
93564783fe pkglistgen: Fix invalid import 2022-03-04 12:32:48 +01:00
Stephan Kulow
313908293f pkglistgen: Deprecate scope 'all' 
Within gocd we run each job on its own worker and don't rely on builtin
loop. So no need to care for a remote config
 2022-03-04 11:27:12 +01:00
Stephan Kulow
7a63f0c3bd Treat all group*.yml like groups.yml 
Fixes #2655
 2022-03-03 16:26:03 +01:00
Stephan Kulow
33da10611b pkglistgen: Also support zstd for weakremovers.inc 2022-02-25 09:43:34 +01:00
Stephan Kulow
7b329f1a57 pkglisten: Add option to remove refresh from target 
- store new files in zstd compression

Fixes #2693
 2022-02-24 11:44:17 +01:00
Stephan Kulow
aaab4af930 Target F401 - Unused imports 2022-02-18 18:29:27 +01:00
Stephan Kulow
f86579642b Target E501 - Line too long 
https://www.flake8rules.com/rules/E501.html - but 79 characters is a
joke
 2022-02-18 18:17:27 +01:00
Stephan Kulow
f38bd3a7ed Target E128 - Continuation line under-indented for visual indent 
https://www.flake8rules.com/rules/E128.html
 2022-02-18 17:35:33 +01:00
Stephan Kulow
27c364b0c9 Target E251 - Unexpected spaces around keyword 
https://www.flake8rules.com/rules/E251.html
 2022-02-18 17:28:13 +01:00
Stephan Kulow
d8f5d0874e Remove E201 - Whitespace after '(' 
https://www.flake8rules.com/rules/E201.html
 2022-02-18 17:23:19 +01:00
Stephan Kulow
529d1dafae Target E302 - add two comment lines before class 2022-02-18 17:15:48 +01:00
Stephan Kulow
579145b52c Target F841 - Remove unused variables 2022-02-18 17:01:38 +01:00
Stephan Kulow
0561e06cb1 Target E261 - two spaces before inline comment 2022-02-18 16:39:16 +01:00
Stephan Kulow
ae734ba555 Fix indent of statements E127 
https://www.flake8rules.com/rules/E127.html
 2022-02-18 14:23:59 +01:00
Stephan Kulow
2de74cfc52 Replace variable name 'l' (x is fine) 
https://www.flake8rules.com/rules/E741.html
 2022-02-18 14:21:59 +01:00
Stephan Kulow
f705a24db1 Only have one statement in a line E701 
https://www.flake8rules.com/rules/E701.html
 2022-02-18 13:42:57 +01:00
Stephan Kulow
cd161f34cd
Merge pull request #2668 from dirkmueller/use_newest_package 
add option to use newest package for resolving dependencies
 2021-11-05 07:56:18 +01:00
Dirk Mueller
f968110f9d add option to use newest package for resolving dependencies 
In some cases we'd like to chose from all available repositories
for selecting the right package. in appliance builds and there
is an OBS-UseUnorderedRepos flag for enabling this behavior. Similarly
product-builds have a flag "use_newest_version" that can be set
to true. pkglistgen needs to know about these variant as well
to properly resolve package dependencies.
 2021-11-04 20:47:23 +01:00
Stephan Kulow
0d7770bce0 pkglistgen: Skip repos without state 
This happens for repos we only inherit for the project config but that
do not build for said architecture
 2021-10-27 09:16:25 +02:00
Stephan Kulow
775f9a42a2 pkglistgen: Keep caching repo solv files but copy them away 
Not caching them kills botmaster's performance. So we need to keep
that but try to avoid races differently by copying the files from
cachedir to local dir.
 2021-10-26 18:48:10 +02:00
Stephan Kulow
30daff5613 pkglistgen: Skip relying on the global cache directory 
The weakremovers.inc is still flickering and the only explanation left
is that other pipelines break the solv file during the (quite long)
runtime of the pkglistgen pipeline.

So stop relying on the solv file in the global cache directory - the
repo itself is not as dangerous, but the solv should live in the working
directory while it's running
 2021-10-26 08:27:01 +02:00
Stephan Kulow
241f7a966a pkglistgen: Do not generate weakremovers if in release package mode 
Technically the weakremovers.inc is part of the release package, but
it can only be calculated in the context of the full product build
 2021-10-24 09:05:33 +02:00
Stephan Kulow
a8f7146baf Remove E713 offense from flaker 2021-09-21 14:20:08 +02:00
Stephan Kulow
de699c125e pkglistgen: Accept i686 as well 2021-09-21 13:54:10 +02:00
Stephan Kulow
ad7e5f960e pkglistgen: replace if not a in with if a not in 2021-09-21 13:53:22 +02:00
Stephan Kulow
35eeb2af2b pkglistgen: Fix architecture handling of weakremovers 
15.3 introduced something unexpected: aarch64, ppc64le and s390x are part
of the repos - and all architectures that aren't native to openSUSE:Factory
are considered to bear dropped packages, e.g. *all of them*

On top of that the setdefault using the same hash caused packages to come
and go for repos, creating unstable output
 2021-09-21 12:29:12 +02:00
Stephan Kulow
b452cfba69 pkglistgen: Automatically merge old update repos 
Too many update repos file slow down the drop list generation by a lot,
so max them per channel to 10 - and collapse them automatically if
needed
 2021-06-18 11:21:29 +02:00
Stephan Kulow
8c963bf3eb pkglistgen: Add a way to merge files from 000update-repos 2021-06-18 08:45:12 +02:00
Stephan Kulow
8da0139b93 pkglistgen: Force outdir for the checkouts 
Otherwise the osc config for checkout_no_colon will interfer where the
files end up and then we can't open them reliable.

Fixes #2559
 2021-05-10 12:21:55 +02:00
Richard Brown
b0817c1741 Revert pkglistgen: ignore bootstrap_copy repo 2021-04-08 12:29:02 +02:00
Ludwig Nussel
e15419a753 pkglistgen: don't die on unset pkglistgen-ignore_repos 2021-04-06 15:18:26 +02:00
Stephan Kulow
6b65b00adf
Merge pull request #2539 from lnussel/master 
pkglistgen: ignore bootstrap_copy repo
 2021-04-06 07:55:08 +02:00
Stephan Kulow
35ff3f9e34 pkglistgen: After solving check all packages listed 
If the packages are already part of the modules that are excluded
(due to dependencies), output an ERROR (which is not fatal atm)

Fixes #2541
 2021-04-01 15:48:37 +02:00
Ludwig Nussel
1cf026aef5 pkglistgen: ignore bootstrap_copy repo 
Never use the bootstrap_copy repo for package solving. Staging content
might be very different so don't confuse the solver.
 2021-03-29 11:44:19 +02:00
Fabian Vogt
440b0f7def Fix repo state error handling in pkglistgen 
repository_arch_state doesn't raise HTTPError for 404 any more, but that's what
pkglistgen uses to skip that repo/arch. Handle None as replacement instead.
 2021-02-15 14:43:37 +01:00
Stephan Kulow
ad9119d4b2 Calculate the i586 DVD as i686 package set 
mozjs is now i686 exclusive and GNOME and KDE depends on it
 2021-01-22 11:24:39 +01:00