yudaike/openSUSE-release-tools
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
7,402 Commits 2 Branches 12 Tags
Commit Graph

120 Commits

Author SHA1 Message Date
Stephan Kulow
775f9a42a2 pkglistgen: Keep caching repo solv files but copy them away 
Not caching them kills botmaster's performance. So we need to keep
that but try to avoid races differently by copying the files from
cachedir to local dir.
 2021-10-26 18:48:10 +02:00
Stephan Kulow
30daff5613 pkglistgen: Skip relying on the global cache directory 
The weakremovers.inc is still flickering and the only explanation left
is that other pipelines break the solv file during the (quite long)
runtime of the pkglistgen pipeline.

So stop relying on the solv file in the global cache directory - the
repo itself is not as dangerous, but the solv should live in the working
directory while it's running
 2021-10-26 08:27:01 +02:00
Stephan Kulow
241f7a966a pkglistgen: Do not generate weakremovers if in release package mode 
Technically the weakremovers.inc is part of the release package, but
it can only be calculated in the context of the full product build
 2021-10-24 09:05:33 +02:00
Stephan Kulow
a8f7146baf Remove E713 offense from flaker 2021-09-21 14:20:08 +02:00
Stephan Kulow
de699c125e pkglistgen: Accept i686 as well 2021-09-21 13:54:10 +02:00
Stephan Kulow
ad7e5f960e pkglistgen: replace if not a in with if a not in 2021-09-21 13:53:22 +02:00
Stephan Kulow
35eeb2af2b pkglistgen: Fix architecture handling of weakremovers 
15.3 introduced something unexpected: aarch64, ppc64le and s390x are part
of the repos - and all architectures that aren't native to openSUSE:Factory
are considered to bear dropped packages, e.g. *all of them*

On top of that the setdefault using the same hash caused packages to come
and go for repos, creating unstable output
 2021-09-21 12:29:12 +02:00
Stephan Kulow
b452cfba69 pkglistgen: Automatically merge old update repos 
Too many update repos file slow down the drop list generation by a lot,
so max them per channel to 10 - and collapse them automatically if
needed
 2021-06-18 11:21:29 +02:00
Stephan Kulow
8c963bf3eb pkglistgen: Add a way to merge files from 000update-repos 2021-06-18 08:45:12 +02:00
Stephan Kulow
8da0139b93 pkglistgen: Force outdir for the checkouts 
Otherwise the osc config for checkout_no_colon will interfer where the
files end up and then we can't open them reliable.

Fixes #2559
 2021-05-10 12:21:55 +02:00
Richard Brown
b0817c1741 Revert pkglistgen: ignore bootstrap_copy repo 2021-04-08 12:29:02 +02:00
Ludwig Nussel
e15419a753 pkglistgen: don't die on unset pkglistgen-ignore_repos 2021-04-06 15:18:26 +02:00
Stephan Kulow
6b65b00adf
Merge pull request #2539 from lnussel/master 
pkglistgen: ignore bootstrap_copy repo
 2021-04-06 07:55:08 +02:00
Stephan Kulow
35ff3f9e34 pkglistgen: After solving check all packages listed 
If the packages are already part of the modules that are excluded
(due to dependencies), output an ERROR (which is not fatal atm)

Fixes #2541
 2021-04-01 15:48:37 +02:00
Ludwig Nussel
1cf026aef5 pkglistgen: ignore bootstrap_copy repo 
Never use the bootstrap_copy repo for package solving. Staging content
might be very different so don't confuse the solver.
 2021-03-29 11:44:19 +02:00
Fabian Vogt
440b0f7def Fix repo state error handling in pkglistgen 
repository_arch_state doesn't raise HTTPError for 404 any more, but that's what
pkglistgen uses to skip that repo/arch. Handle None as replacement instead.
 2021-02-15 14:43:37 +01:00
Stephan Kulow
ad9119d4b2 Calculate the i586 DVD as i686 package set 
mozjs is now i686 exclusive and GNOME and KDE depends on it
 2021-01-22 11:24:39 +01:00
Stephan Kulow
75c001c96d
Merge pull request #2520 from coolo/fix_2517 
pkglistgen: Check the return code of Popen calls
 2021-01-19 16:21:22 +01:00
Stephan Kulow
279c95eaf9 pkglistgen: Check the return code of Popen calls 
Not updating the product in case of failure is preferred over creating
bogus products

Fixes #2517
 2021-01-19 11:41:21 +01:00
Stephan Kulow
2bb1d8a1ce pkglistgen: Allow to set require_all for some groups to disable ignore 
For Factory we want the DVD to catch all (and only require some), but the
smaller products kubic and microos should have a require all policy
 2021-01-15 15:52:54 +01:00
Egbert Eich
3e70de6f4a Check for 'weakremovers.inc' in in group_dir before attempting to move it 
Signed-off-by: Egbert Eich <eich@suse.com>
 2020-05-02 11:43:19 +02:00
Stephan Kulow
f5059c0e07 Support 'required' field for packages 
Fixes #1844
 2020-03-19 14:36:10 +01:00
Stephan Kulow
e3c6ae5f36 Add error message in case upload fails 2020-03-06 10:04:25 +01:00
Dirk Mueller
32ad0adc2d Fix all E22x errors 
This cleans up white spaces around various kinds of operators to be
consistent.
 2019-11-27 11:08:06 +01:00
Stephan Kulow
657d2c87d9 Fix conflicts/obsoletes while picking dependencies 
We ignored conflicts/obsoletes during pool preparation as it got
into the way of finding supplements (due to conflicting packages in
the list). But this way, conflicts were invisible also during dependency
search, leading to wrong packages picked for the package lists in
general.

So add a flag to prepare_pool to explain if we want conflicts or not
 2019-11-05 09:39:10 +01:00
Max Lin
7b8d295abd pkglistgen: fix wrong parsing way on pkglistgen-locale 
Since the data is from project attribute, pkglistgen should not parsing a string.
This change also renamed pkglistgen-local to pkglistgen-locale.
 2019-10-15 19:17:57 +08:00
Andreas Schwab
417fdb35e0 update_repo_handler: properly extract factory build string 2019-08-15 11:20:22 +02:00
Stephan Kulow
778e82b044 Fix some python2/python3 confusion with pkglistgen (for sle) 2019-07-05 09:47:57 +02:00
Stephan Kulow
e4215b5b83 Take pkglistgen from git - avoid deployment loop 2019-05-30 09:26:44 +02:00
Stephan Kulow
29bd141145 Sort architectures to fix #2021 2019-05-16 07:30:21 +02:00
Stephan Kulow
1b20c92d41 pkglistgen: Output strings on the console 2019-05-15 08:49:30 +02:00
Stephan Kulow
c043a2d537 Even more fixes for pkglistgen on python3 2019-05-13 14:09:57 +02:00
Stephan Kulow
df8de99945 Even more python3 fixes for pkglistgen 2019-05-13 08:57:34 +02:00
Stephan Kulow
001e8e32fd Fix update_repo_handler in python3 2019-05-13 07:27:26 +02:00
Stephan Kulow
d0eef97d27 Fix problems with pkglistgen under python3 2019-05-12 21:22:07 +02:00
Stephan Kulow
fec762e5a4 Avoid warning on using .warn (python3) 2019-05-11 14:25:02 +02:00
Stephan Kulow
58d6d7ca16 Python3 fixes 2019-05-04 15:44:44 +02:00
Stephan Kulow
57f15a4609 Avoid gocd warning on 9 minutes without print 
the weak remover code is a little slow, but it's also a lot of data
 2019-03-20 15:04:23 +01:00
Stephan Kulow
b75f6c7f49 pkglistgen: Don't upper case the staging letter 2019-03-11 15:19:43 +01:00
Adrian Schröter
ea93ca27df fix incompatible repo id tagging for openSUSE products 2019-01-30 15:09:58 +01:00
Stephan Kulow
dff9bddfc4 Replace weakremovers.inc in 000release-packages 
But skip it during --only-release-packages as we have to assume the
binaries aren't final
 2019-01-21 16:55:19 +01:00
Stephan Kulow
f7a2d50490 Handle weakremovers.inc special 2019-01-19 19:50:23 +01:00
Stephan Kulow
84445efb65 Fix handle_update_repos for Factory and leap 2019-01-19 12:43:24 +01:00
Stephan Kulow
48179b3617 Store it as susetags light 2019-01-19 09:02:37 +01:00
Stephan Kulow
1b38edb1f3 Refresh solv files for leap 2019-01-19 09:02:35 +01:00
Stephan Kulow
a26301bfa1 pkglistgen: Reset the tool between projects 
So far I only cared for single projects, but never tested all staging
projects in a loop while developing, so I didn't notice the problem
 2019-01-17 20:39:02 +01:00
Stephan Kulow
d2f1832a44 Set some version for staging projects 2019-01-17 15:06:28 +01:00
Stephan Kulow
588cb0d744 pkglistgen: Don't crash in powerpc on i586 entries 2019-01-17 15:06:28 +01:00
Stephan Kulow
998e645bd3 Revert the change to copy_files 2019-01-17 15:06:28 +01:00
Stephan Kulow
1bae4083b2 Don't hardcode architectures - take it from the project 2019-01-17 15:06:28 +01:00