Jimmy Berry
cff5befed3
Provide cache for expensive and cache-able staging requests.
...
The two slowest staging API calls are for information that rarely changes.
By caching the result the commands typically execute over twice as fast.
Going further can see improvements of an order of magnitude or more by
caching almost all the GET requests.
In contrast to osclib/memoize.py this cache operates at the HTTP request
level. This has several advantages:
- Caches the expensive part (ie the HTTP request). There are a number of
functions in osc.core and elsewhere that make the same API request, but
process the result differently which would require multiple API calls
using memoize.
- Handles cases were a loader function uses class attributes as input and
output and thus no relevant method parameters or return. An important
example is StagingAPI._generate_ring_packages().
- Storage is project aware which allows caches to be deleted when a project
is known to have changed.
- Due to project awareness, can utilize OBS /statistics/latest_updated API
call to determine which projects need to be expired.
The cache file structure is as follows:
- hostname(apiurl)
- project
- sha1(url)
- sha1(url)
See Cache.PATTERNS for changing the time to live (ttl) or add patterns to
be cached.
2017-01-11 10:23:54 -06:00
Stephan Kulow
72d99f6041
Merge pull request #626 from fschilling/addkgrafthosts
...
Add hosts kgraft22 and kgraft23
2017-01-04 15:08:00 +01:00
schillingf
9db77eeaf0
Add hosts kgraft22 and kgraft23
2017-01-04 14:57:24 +01:00
Ludwig Nussel
7fe0322b70
Merge pull request #624 from jberry-suse/adi-clean
...
adi_command: whitespace cleanup.
2017-01-02 16:36:01 +01:00
Jimmy Berry
0ec78beb93
Remove duplicate ReviewBot.do_project(). ( #621 )
2017-01-02 09:37:35 +01:00
Jimmy Berry
7431af4a72
Rework ReviewBot.CommandLineInterface to provide class option. ( #622 )
...
Alleviates the need for a lot of duplicate code, some of which is already
out-of-sync.
2017-01-02 09:34:13 +01:00
Jimmy Berry
c739687ac0
Remove duplicate ReviewBot.set_request_ids_project() ( #620 )
2017-01-02 09:24:34 +01:00
Jimmy Berry
f75e9bdaf3
adi_command: whitespace cleanup.
...
Tabs vs spaces is even scarier in python.
2016-12-29 16:27:11 -06:00
Stephan Kulow
cc7888ed65
Fix syntax
2016-12-25 07:57:30 +01:00
Ludwig Nussel
ffdb9430f7
Merge pull request #618 from lnussel/crawler
...
Expand decimal revisions in requests
2016-12-23 10:30:11 +01:00
Ludwig Nussel
aadd3f96eb
Expand decimal revisions in requests
...
Requests may either contain the srcmd5 or the decimal revision. So we
may need to convert the revision to srcmd5.
2016-12-20 09:23:19 +01:00
Martin Pluskal
d19b324f5e
Merge pull request #616 from fschilling/kgrafthostupdate
...
Add SUTs kGraft{0g,1a,21}
2016-12-18 12:30:10 +01:00
schillingf
688da5b208
add SUTs kGraft{0g,1a,21}
2016-12-16 15:49:28 +01:00
Ludwig Nussel
6f2edba8d0
Merge pull request #613 from lnussel/manager
...
Catch non-existing project
2016-12-13 16:02:55 +01:00
Ludwig Nussel
37687890ed
Catch non-existing project
...
SP3 doesn't exist yet in OBS
2016-12-13 16:01:57 +01:00
Ludwig Nussel
02f42f567d
Merge pull request #611 from jberry-suse/select-progress
...
Indicate select command progress.
2016-12-12 14:27:26 +01:00
Ludwig Nussel
506b69688f
Merge pull request #610 from lnussel/leaper
...
Adjust leaper for 42.3
2016-12-12 14:16:11 +01:00
Ludwig Nussel
b18ebcaa23
Merge pull request #612 from openSUSE/better_openqa_summary
...
Change incident summary
2016-12-12 14:16:02 +01:00
Stephan Kulow
3c4976fd88
Change incident summary
...
Include all groups counting the passing jobs too (we need a link
to the passing groups to see if SP1 and SP2 were tested)
2016-12-09 14:03:55 +01:00
Jimmy Berry
6e0f2165e0
Indicate select command progress.
2016-12-06 16:40:05 -06:00
Ludwig Nussel
56ee7bb3fe
Adjust leaper for 42.3
2016-12-06 17:00:32 +01:00
Ludwig Nussel
556f9b6b2d
Merge pull request #608 from lnussel/adi
...
Improve adi list output
2016-12-06 15:39:46 +01:00
Ludwig Nussel
f77a7e1650
Merge pull request #607 from lnussel/staging
...
Split config for Leap
2016-12-06 15:39:30 +01:00
Ludwig Nussel
7ec1c1955b
Improve adi list output
2016-12-06 12:59:47 +01:00
Ludwig Nussel
077d3b66f6
Split config for Leap
...
Leap doesn't have ppc in staging so split defaults so we don't need
an .oscrc
2016-12-06 12:57:00 +01:00
Ludwig Nussel
175cde8b20
Merge pull request #606 from andreasstieger/improve_maintainer_review_msg
...
Improve message for multiple maintainer reviews
2016-12-06 12:55:48 +01:00
Ludwig Nussel
7bd0cf38b0
Merge pull request #605 from lnussel/workarounds
...
Add back SLE-workarounds
2016-12-06 12:55:28 +01:00
Andreas Stieger
f5d47c3ded
Improve message for multiple maintainer reviews
2016-12-02 13:39:52 +01:00
Ludwig Nussel
e8a8dbdf8d
Add back SLE-workarounds
...
Not all packages in there are accepted yet so we need to avoid manager42
to mark them as FORK.
2016-11-30 17:44:02 +01:00
Ludwig Nussel
e6fa6c43f0
Merge pull request #602 from nilxam/up_for_423
...
Update version in manager_42 and update_crawler
2016-11-30 17:41:43 +01:00
ba102f22ec
Merge pull request #604 from nilxam/fix_delete_minor
...
Just findall linked tag to instead of search sourceinfo
2016-11-30 20:54:33 +08:00
982bd86c6b
Just findall linked tag to instead of search sourceinfo
...
In this case, sourceinfo is not sub-element but root.
2016-11-30 19:05:31 +08:00
92716f4671
Merge pull request #603 from nilxam/more_decline
...
Decline add_role request or incorrect delete request
2016-11-30 15:59:27 +08:00
6d3324ee81
Decline add_role request or incorrect delete request
2016-11-29 19:57:40 +08:00
a716635532
Update version in manager_42 and update_crawler
2016-11-29 16:29:48 +08:00
Stephan Kulow
4607d725da
Move to requests module ( #601 )
...
urllib is for some reason *much* slower - like minutes instead of microseconds
2016-11-26 06:59:58 +01:00
Stephan Kulow
0f9830606c
Fix link to the failed step ( #600 )
...
Instead of linking to the first step in a failed test, link to the first
failing. openQA uses this route internally to delay parsing details
2016-11-24 12:20:30 +01:00
Stephan Kulow
cd97953f88
Merge pull request #599 from lnussel/dead_code
...
remove dead code
2016-11-22 11:30:14 +01:00
Ludwig Nussel
10c5a1c9e4
Reword decline message
2016-11-22 11:01:56 +01:00
Ludwig Nussel
e04b2c8600
Remove dead code
2016-11-22 10:49:25 +01:00
a7b308ab19
Merge pull request #598 from nilxam/master
...
Sync back the local change
2016-11-22 17:29:48 +08:00
4c3e0095ba
Sync back the local change
2016-11-22 16:06:02 +08:00
94d35c2bf6
Merge pull request #597 from nilxam/better_sol
...
Better and complete way against a6c679d7
2016-11-17 15:19:26 +08:00
3d6d34bbfc
Better and complete way against a6c679d7
2016-11-17 00:53:21 +08:00
d7ceade506
Merge pull request #596 from nilxam/fix_wrong_place
...
Move testdvd status chack part under the condition protect
2016-11-16 21:48:05 +08:00
648ea26744
Merge pull request #595 from DimStar77/fixup
...
Import http_POST for accept_command
2016-11-16 21:42:37 +08:00
a6c679d711
Move testdvd status chack part under the condition protect
2016-11-16 21:33:54 +08:00
e6ecb0cbee
Import http_POST for accept_command
...
Since commit 295fcd we newly also require http_POST in order to
put a new file in place after accepting.
Also add quotes around the fakepkgname when injecting it into the kiwi file.
2016-11-16 13:45:27 +01:00
e0bee2ca11
Do not regenerate pl if the testdvd build is disabled ( #594 )
2016-11-16 12:30:09 +01:00
6f28cb5705
Merge pull request #593 from nilxam/wipe_after_accept
...
Let Test-DVD is invalid in the beginning of the new round
2016-11-16 18:17:25 +08:00
