91 Commits

Author SHA1 Message Date
Ludwig Nussel
5d0c024ffe
Merge pull request #1453 from coolo/add_sle_droplist
Add create_sle_weakremovers command
2018-03-23 11:21:43 +01:00
Jimmy Berry
9a26912ab5
Merge pull request #1442 from jberry-suse/pkglistgen-update-hash
pkglistgen: do_dump_solv(): include hash in update solv to avoid download.
2018-03-12 15:55:44 -05:00
Stephan Kulow
78b107e6e5 Add create_sle_weakremovers command
It's similiar but not the same as the droplist for openSUSE, so I created
a fork of the openSUSE command

To be called with the target project as first argument and then a
list of old projects

e.g. create_sle_weakremovers SUSE:SLE-15:GA SUSE:SLE-12-SP3:GA \
SUSE:SLE-12-SP3:Update SUSE:SLE-12-SP2:GA SUSE:SLE-12-SP2:Update ...
2018-03-12 08:20:42 +01:00
Ludwig Nussel
ad6056258f
Merge pull request #1447 from lnussel/pkglistgen
pkglistgen: Fix reading boolean values
2018-03-11 09:22:51 +01:00
Jimmy Berry
f9b7832e8b pkglistgen: do_dump_solv(): include hash in update solv to avoid download. 2018-03-09 11:32:27 -06:00
Jimmy Berry
28b467f4e8 pkglistgen: do_dump_solv(): utilize os.path.join(). 2018-03-09 11:32:27 -06:00
Ludwig Nussel
0f5d25f463 pkglistgen: Fix reading boolean values 2018-03-09 13:50:08 +01:00
Stephan Kulow
fdef876580 Treat stagings differently
This is specific to SLE stagings, but won't hurt in openSUSE stagings
as the products there are hand made anyway
2018-03-09 11:56:21 +01:00
Ludwig Nussel
7484722b2a
Merge pull request #1439 from jberry-suse/pkglistgen-dump_solv-hash-and-flush
pkglistgen: do_dump_solv: flush after write before reading back and verify primary repo gziped content sha256.
2018-03-09 11:00:05 +01:00
9370efc8e4 pkglistgen: Do not run local service check when committing to release package
That check is aiming to check request rather than package, for release package
we indeed had multispecs and multibuild file together, just do not run
local service when committing to release package.
2018-03-09 16:45:37 +08:00
Jimmy Berry
1968a594f7 pkglistgen: do_dump_solv: flush after write before reading back.
Ended up consistently creating a short XML file that created a null section
in solv file that cause pkglistgen drop list generator to create a <NULL>
drop entry.

Always flush() before you read(). :(

It certainly would have been nice if libsolv would have complained about
an invalid XML file rather than just producing garbage as the file just
ended. Then of course mergesolv did not complain and comes back in to
python as '<NULL>'. Failure to validate and multiple levels.
2018-03-08 12:35:36 -06:00
Jimmy Berry
e353d513a6 pkglistgen: do_dump_solv: verify primary repo gziped content sha256. 2018-03-08 12:35:30 -06:00
Jimmy Berry
a5775e6e54 pkglistgen: do_dump_solv: use BytesIo instead of StringIO.
request.content is not a string like request.text.
2018-03-08 12:22:02 -06:00
Jimmy Berry
f56ccb878c
Merge pull request #1406 from jberry-suse/pkglistgen-dump-include-update
pkglistgen: solv_cache_update(): support update repo and 4 way merge (and merge skipping)
2018-02-20 20:47:24 -06:00
Ludwig Nussel
38f2131ab7 pkglistgen: use set_namespaceproviders function
Finally makes inclusion of locale specifc packages possible
https://github.com/openSUSE/libsolv/issues/231
2018-02-19 18:36:18 +01:00
Jimmy Berry
c264ef1a1a pkglistgen: solv_cache_update(): support update repo and 4 way merge. 2018-02-15 14:48:56 -06:00
Jimmy Berry
df2db17852 pkglistgen: do_dump_solv(): support update repos.
Always pull down update repo and only overwrite if changed. Could rework
more extensively to name based on hash of repomd.xml or somesuch, but would
likely also want to remove old versions.
2018-02-15 14:48:56 -06:00
Jimmy Berry
a6c6bbf862 pkglistgen: solv_merge(): allow array of solv files to merge. 2018-02-15 14:48:56 -06:00
Jimmy Berry
45e788d5d5 pkglistgen: solv_merge(): skip when inputs are older than merged. 2018-02-15 14:48:50 -06:00
Stephan Kulow
c6a25fb4f5 autopep8 to fix indenting 2018-02-13 13:30:15 +01:00
Stephan Kulow
f2784b26ad Move package hints into unsorted.yml 2018-02-13 13:28:30 +01:00
Stephan Kulow
b57ec253bb Support unneeded.yml as list of regular expressions
UNWANTED is a bit heavy weapon to filter unsorted.yml, so leave
its role to packages we sure don't want (e.g. -mini and -bootstrap
packages). Packages that are there but would end in unsorted otherwise,
filter by means of package regular expressions in unneeded.yml

The format of that file is yml with a list of groups of regular
expressions.

global:
  - .*-32bit

texlive:
  - texlive.*
2018-02-13 13:28:30 +01:00
Jimmy Berry
d062a7c0c1 pkglistgen: expose pkglistgen-product-family-last config option. 2018-02-12 17:56:29 -06:00
Jimmy Berry
21d9155157 pkglistgen: do_update_and_solve(): check for existence of :DVD instead of rings. 2018-02-09 18:00:58 -06:00
Jimmy Berry
68b5350618 pkglistgen: include some hints about the difference between solv files. 2018-02-06 00:25:46 -06:00
Jimmy Berry
89457bfe8d pkglistgen: integrate drop list creation into update_and_solve.
In order to generate a complete drop list the nonfree repository must also
be cached for both current and published builds. The solv files are then
merged and used to generate drop list.
2018-02-06 00:25:38 -06:00
Jimmy Berry
0c35cd935b pkglistgen: do_dump_solv(): handle old-style product repo format.
This allows for generating solv cache for Leap versions prior to 15.0
which avoids the need to have them checked into git like previous
package-lists repository.
2018-02-06 00:14:38 -06:00
Jimmy Berry
29b60fcda1 pkglistgen: do_create_droplist(): print to file when output_dir available. 2018-02-06 00:14:38 -06:00
Jimmy Berry
9bf4425ce5 pkglistgen: provide update_merge() to combine free and nonfree solv. 2018-02-06 00:14:30 -06:00
Stephan Kulow
93502e851a pkglistegen: Fix overlap generation
Don't remove packages from modules *below* overlap or they are gone for good
2018-02-01 11:56:20 +01:00
Jimmy Berry
f98a78c1ae Remove Vim config in favor of EditorConfig. 2018-01-23 00:48:00 -06:00
Ludwig Nussel
a825608376 pkglistgen: delete kiwis by scope
Replace config option pkglistgen-delete-kiwis by
pkglistgen-delete-kiwis-$scope. The main project needs all kiwis while
in Rings and Stagings we don't want the ftp tree for example.
2018-01-17 14:33:36 +01:00
Ludwig Nussel
67f2773e76 pkglistgen: typo locals vs locales 2018-01-10 17:19:15 +01:00
Ludwig Nussel
cf09e41995 pkglistgen: add correct staging DVD repo 2018-01-10 17:19:15 +01:00
Ludwig Nussel
39946dbc98 pkglistgen: use xdg.BaseDirectory 2018-01-10 11:51:04 +01:00
Jimmy Berry
ba07d6b512 pkglistgen: do_update_and_solve: staging correct :DVD subproject append. 2018-01-09 17:25:24 -06:00
Jimmy Berry
cf2b591c09 pkglistgen: first pass __file__ through realpath due to packaging symlink.
Same setup as repo-checker.py rather than what worked due to wrapper
scripts.
2018-01-09 17:24:38 -06:00
Jimmy Berry
3ae00c11ac pkglistgen: update_and_solve: include step in output for debugging. 2018-01-08 23:16:52 -06:00
Jimmy Berry
bca8b714d8 pkglistgen: update_and_solve: handle --dry for undelete_package(). 2018-01-08 23:16:17 -06:00
Jimmy Berry
590fb39a60 pkglistgen: update_and_solve: include ignore_unresolvable and local options for solve. 2018-01-08 23:16:11 -06:00
Jimmy Berry
8892c0d821 pkglistgen: update_and_solve: set input_dir to group_dir for solve. 2018-01-08 22:46:58 -06:00
Jimmy Berry
5e9392f4a0 pkglistgen: migrate bash scripts to python. 2017-12-21 01:05:55 -06:00
31da422cda
Fix travis failure introduced with 3e5f3b137 2017-12-19 13:15:18 +01:00
Ludwig Nussel
fd7deddcf0
Merge pull request #1302 from coolo/output_overlap
pkglistgen: Actually remove overlapping packages
2017-12-18 10:12:57 +01:00
Ludwig Nussel
290355c08f
Merge pull request #1297 from dirkmueller/master
Add support for non-x86_64 products (Leap 15.0/aarch64)
2017-12-18 10:11:42 +01:00
Stephan Kulow
9fc8ffe21d pkglistgen: Actually remove overlapping packages 2017-12-15 09:03:46 +01:00
3e5f3b1377 Add support for non-x86_64 products (Leap 15.0/aarch64) 2017-12-14 14:41:23 +01:00
Stephan Kulow
1a29bc5073 pkglistgen: Output the overlaping packages into overlap.group 2017-12-13 19:01:34 +01:00
Ludwig Nussel
8e3fcbf952 pkglistgen: dump_solv function 2017-12-07 14:09:53 +01:00
Ludwig Nussel
5cda9f060e pkglistgen: add droplist generator 2017-12-07 14:09:53 +01:00