38 Commits

Author SHA1 Message Date
Steve Kowalik
326a087168 Switch to python3 shebang
With the python shebang remaining as Python 2, switch the scripts to
using Python 3. This also allows us to clean up some imports.
2021-02-03 14:53:42 +11:00
32ad0adc2d Fix all E22x errors
This cleans up white spaces around various kinds of operators to be
consistent.
2019-11-27 11:08:06 +01:00
Stephan Kulow
595e84191e More porting to python3
Travis changed default python to 3.6, which has impact on the way
flake8 checks. So make sure we run fine under flake8 of python 3
2019-04-20 21:16:50 +02:00
Stephan Kulow
ea9061ccf5 Import urllib2 python agnostic 2018-11-16 09:01:45 +01:00
Jimmy Berry
6069245350 Remove SUSE copyright, warranty, and license headers.
Distinct copyrights were left as I do not wish to track down commit
history to ensure it properly documents the copyright holders. Also left
non-GPLv2 licenses and left bs_copy untouched as a mirror from OBS.

Already have a mix of with and without headers and even OBS does not place
on majority of files. If SUSE lawyers have an issue it will come up in
legal review for Factory.
2018-08-23 19:18:06 -05:00
Jimmy Berry
760ddf39e6 osclib/conf: decouple from StagingAPI and always fetch remote config.
As the remote config is no longer optional for SLE and is utilized by
openSUSE to the point were it is dangerous not to load the remote config
it should be required. Currently only certain users call apply_remote()
while this will make it built-in during construction and thus makes the
usage consistent and no longer require StagingAPI.
2018-08-16 21:53:40 -05:00
Ludwig Nussel
0429ee2f69 update-crawler: also log where requests came from 2018-05-14 15:21:05 +02:00
ae801cf76d
Change remaining usage of _product to 000product
All openSUSE distros in developments switched to the new product builder, meaning
they no longer use _product as the package container, but operate on the standardized
name 000product.

Addresses https://progress.opensuse.org/issues/20890
2018-03-29 13:12:35 +02:00
Jimmy Berry
f98a78c1ae Remove Vim config in favor of EditorConfig. 2018-01-23 00:48:00 -06:00
Jimmy Berry
5e7220ddd0 update_crawler: replace get_devel_project() with osclib.core.devel_project_get(). 2018-01-17 18:10:25 -06:00
d1c4801578 Another set of low-noise flake8 cleanups 2017-10-20 20:46:44 +02:00
3cf49d9556 Python 2.6+ / 3.x style except clauses
This newer style except statement allows for compatibility with
Python 3.x and does not harm on python 2.6+.
2017-10-16 22:47:58 +02:00
Ludwig Nussel
fff6edd87e update-crawler: handle devel projects
allow filtering by devel project too
2017-08-08 12:00:49 +02:00
Ludwig Nussel
379eac8d9a update crawler: latest_packages across instances
Hack to make update crawler work for SLE15. Really needs refactoring on
ToolBase.
2017-08-07 14:19:38 +02:00
Ludwig Nussel
b3464662bf Merge pull request #797 from lnussel/updatecrawler
Hack to skip haskell submissions
2017-04-13 16:49:37 +02:00
Ludwig Nussel
65eac1f403 Hack to skip haskell submissions
It's just too much and needs to be submitted manually
2017-04-13 14:56:44 +02:00
Jimmy Berry
2980790cd8 update_crawler: include superseded requests when looking for existing.
Prevents situation that can create a loop of update_crawler requests,
superseded and another update_crawler request.
2017-04-11 14:59:48 -05:00
Ludwig Nussel
aadd3f96eb Expand decimal revisions in requests
Requests may either contain the srcmd5 or the decimal revision. So we
may need to convert the revision to srcmd5.
2016-12-20 09:23:19 +01:00
a716635532 Update version in manager_42 and update_crawler 2016-11-29 16:29:48 +08:00
Ludwig Nussel
bcaa610a67 Handle separate lookup file in :NonFree 2016-06-10 10:59:36 +02:00
Ludwig Nussel
5be0c17f51 Better filtering, new packages
- allow filtering from multiple projects
- option to also submit new packaes
- print skipped packages
2016-06-07 15:11:26 +02:00
Ludwig Nussel
2f8f5fadd5 Add hack for NonFree 2016-06-07 15:11:26 +02:00
Ludwig Nussel
930c30020f Improve maintenance project handling
Only consider "main" packages instead of throwing lots of warnings.
That allows to see the really new packages.
2016-06-07 15:11:26 +02:00
Ludwig Nussel
e2c9620a7b Make update crawler accept list of packages
Also change info requesting strategy. Get list of packges first, then
query them in chunks. That allows to use the unexpanded view and query
less packages in update projects.
2016-05-10 11:20:52 +02:00
Ludwig Nussel
521b61b362 Switch source and target 2016-05-10 11:19:53 +02:00
Ludwig Nussel
95c0cba322 Adjust update crawler for 42.2 2016-05-10 11:19:51 +02:00
Stephan Kulow
ef81f26b64 ignore Factory updates for now 2015-10-11 09:44:21 +02:00
Stephan Kulow
bf51343b0b recreate submit request if the revision is different
possibly we declined an old revision
2015-09-27 08:27:32 +02:00
Stephan Kulow
4b52b31ca2 fix crash 2015-09-21 07:16:24 +02:00
Stephan Kulow
a9aa4426f2 use the lookup file in the update crawler 2015-09-16 10:30:14 +02:00
Stephan Kulow
dccb5d39c4 avoid division for 5XX 2015-08-30 17:00:21 +02:00
Stephan Kulow
f60868b64e also retry in the update crawler 2015-08-30 16:54:20 +02:00
Stephan Kulow
228ee8efa9 check for updates in Factory too 2015-08-24 15:53:19 +02:00
Stephan Kulow
fd7a16965b simplify update_crawler
Just checking verifymd5 for everything in sle12-picks - if sle12 sp1
comes with a version downgrade, we should see it
2015-08-08 15:31:39 +02:00
Stephan Kulow
8ca2fb480a don't submit sub-spec files 2015-08-05 12:00:46 +02:00
Alberto Planas
1aa7db0832 Fix error code and version comparison. 2015-06-24 16:54:46 +02:00
Alberto Planas
4cb085ebe3 Check the version of the package. 2015-06-10 15:02:41 +02:00
Alberto Planas
68e9060818 Add update_crawler.py script
This scripts can analyze two repositories, one that contains
updates, and the other a linked distribution.  Check the last
updated packages and send (if there is not any) a submit request
with the updated package.
2015-05-27 17:15:05 +02:00