Commit Graph

36 Commits

Author SHA256 Message Date
Andrii Nikitin
5b41eed05f - Update to version 1.035:
* Add project checkboxes to mirror report (#280)
  * Collect report from subsidiaries (#282)
  * Fix incorrect path in metalink for origin file (#281)
  * Add config CUSTOM_FOOTER_MESSAGE (#283)
  * CircleCI: ignore gh-pages branch (#279)

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=58
2022-06-23 05:00:10 +00:00
Andrii Nikitin
42fa8b9b1f - Update to version 1.034:
* Provide torrent (#278)
  * Add report for projects on mirrors (#276)
  * Fix render when metalink is optional (#277)

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=57
2022-06-07 09:09:07 +00:00
Andrii Nikitin
cb2eabf31f - Update to version 1.033:
* Add various patterns for files for which mirrors shouldnt be used (#275)
  * Fix regexp in latest_misses sql so *-primary.xml wasnt requesting scans (#275)
  * Add MyMirrors menu to openSUSE branding (#275)
  * Introduce MIRRORCACHE_VPN variable which has higher priority thant MIRRORCACHE_VPN_PREFIX (#275)
  * Allow regular users add and manage own mirrors (#274)
  * Add parameter MIRRORCACHE_MAX_PATH (#274)

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=56
2022-05-19 07:18:25 +00:00
Andrii Nikitin
b3e0bceb50 - Update to version 1.032:
* Set MIME type when rendering files (#273)
  * Optimize main sql query so it doesnt create tmp disk tables in mariadb (#272)
  * Force sql plan in job mirror_check_from_stat for mariadb (#272)
  * Add shared guard to schedule jobs to avoid deadlocks in DB (#272)

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=55
2022-05-12 07:33:36 +00:00
Andrii Nikitin
63c68bc0d7 - Update to version 1.031:
* Do not search mirrors for small files with local root (#271)
  * Improve detection of https behind proxy (#271)

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=54
2022-05-05 02:00:13 +00:00
Andrii Nikitin
bcf25a21a8 - Update to version 1.030:
* Local publisher origin in metalink (#267)
  * Ignore work requested by rclone (#268)
  * Use random mirror for unknown countries (#269)
  * Collect statistics for bot activity (#270)

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=53
2022-04-28 04:56:09 +00:00
Andrii Nikitin
e79c1b3ff6 - Update to version 1.029:
* Add support for MariaDB (#265)
  * Fix occasional SQL error when mirrorlist for unknown country (#264)
  * Fix scheduling folder scan if were not accessed for more than month (#263)

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=51
2022-04-21 01:44:36 +00:00
Andrii Nikitin
855d54f6bc - Update to version 1.028:
* Introduce in-application load balancing read queries to DB replica (#262)
  * Fix bigint DB error when inserting hash for big files (#262)
  * Move initialization code from before_server_start to execute earlier (#262)
  * t: Fix unstable test 03-headquarter-subsidiaries-weight1 by correcting expected values (#262)
  * spec: Fix renamed README in the spec file (#262)

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=50
2022-03-30 15:16:47 +00:00
Andrii Nikitin
159079aaeb - Update to version 1.027:
* Fix auto-disabled mirrors may be still used for redirection (#261)
  * Increase logging level for timeouts in PEDANTIC mode (#261)
  * Serve CentOS repodata from root only (#261)

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=49
2022-03-16 16:44:42 +00:00
Andrii Nikitin
929dc64401 - Update to version 1.026:
* Fix message for unknown folder render timeout (#260)
  * Support single-country subsidiaries (#259)
  * Add table server_stability (#258)

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=48
2022-03-09 12:44:57 +00:00
Andrii Nikitin
b2adbb19cf - Update to version 1.025:
* Allow headquarter be in HA subsidiary handling (#255)
  * Stat log after render (#256)
  * Add SMALL_FILE_SIZE to serve small files directly from ROOT_NFS (#254)

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=46
2022-02-10 11:30:38 +00:00
Andrii Nikitin
d26c5ebca6 - Update to version 1.024:
* Allow multiple subsidiaries per region (#250)
  * Add internal timeouts for mirror checks and rendering (#249, #252)

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=44
2022-02-03 09:28:27 +00:00
Andrii Nikitin
29cb4dfe09 - Update to version 1.023:
* Add execution_time to stat table (#247)
  * Publish docs with mkdocs and github actions (#243)
  * Local render when ROOT_NFS (#246)
  * Add support for zsync hashes (#245)
  * Do not use app->static for rendering (#244)

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=42
2022-01-20 07:47:23 +00:00
Andrii Nikitin
b514c4f355 - Update to version 1.022:
* Add experimental route geoip to rewrite baseurl in .repo (#242)
  * Set MirrorCache useragent for scan jobs (#240)
  * Add RestartSec to backstage systemd files (#241)

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=41
2021-12-16 07:16:59 +00:00
Andrii Nikitin
eac3442245 - Update to version 1.021:
* Handle timeouts in mirror_probe_projects (#238)
  * Track projects on mirrors and do skip scans accordingly (#237)

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=40
2021-12-12 13:12:05 +00:00
Andrii Nikitin
845198addb - Update to version 1.020:
* Do not try to find mirror outside region when ROOT_COUNTRY is set (#236)
  * Special handling unversioned media symlinks (#235)
  * Import hash create folder (#233)

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=39
2021-12-09 06:28:59 +00:00
Andrii Nikitin
cec1223bfe - Update to version 1.019:
* Optimize sql for selecting mirror misses (#232)
  * Import hashes (#231)
  * Fix mirrorlist for subsidiary when in the same db with headquarter (#230)

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=38
2021-12-02 05:34:54 +00:00
Andrii Nikitin
9dd58ae67e - Update to version 1.018:
* Fix occasional 404 on subtree mirrorlist
  * Fix not selecting mirrors for unknown country
  * Let Task MirrorProbe work without GeoIP database

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=37
2021-11-25 08:58:15 +00:00
Andrii Nikitin
bb5ef9b455 - Update to version 1.017:
* Find mirror from rest of world
  * Add manual test for subsidiaries

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=36
2021-11-11 09:52:18 +00:00
Andrii Nikitin
6562d15a3e - Update to version 1.016:
* Add script for manual testing download.o.o
  * Add route /rest/scan_tree
  * Add job for recursive scan (#222)
  * Introduce variable MIRRORCACHE_TRUST_ADDR (#221)
  * Add BACKSTAGE_WORKERS parameter to scripts (#220)
  * Fix automatic mirror capability management when two capabilities are disabled for the same mirror (#219)
  * Dont try to find mirror for unversioned Debian files (#218)

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=35
2021-11-04 08:23:29 +00:00
Andrii Nikitin
de09c79261 - Update to version 1.015:
* Add hypnotoad service (#217)
  * Log statistics the old way
  * Add stress tests
  * Add indices on sync_requested and scan_requested to avoid deadlock
  * Allow hash.mtime differ for up to 1 min
  * Rework estimation of inactive jobs count

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=34
2021-10-28 09:01:14 +00:00
e22a78ff9c OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=29 2021-10-21 08:25:07 +00:00
Andrii Nikitin
b2e1bf3daa - Update to version 1.012:
* Rework mirror scan (#211)
  * Fix root redirect in subtree mirrorlist
  * Show only folders from TOP_FOLDERS variable if defined
  * Fix detecting vpn when ipv6 is enabled

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=27
2021-10-14 10:21:47 +00:00
Andrii Nikitin
305849464a - Update to version 1.011:
* Improve openSUSE theme
  * Fix sql error when mirror has no files
  * Introduce hasall mirror capability
  * Change behavior filtering mirrors based on supported IP version
  * Fix mirrorlist for the same region
  * Schedule scan even when Geo for IP is not detected
  * Improve detection of ipv4
  * Fix syntax error after perl upgrade
  * Properly redirect for symlinks in subtree

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=26
2021-10-07 07:04:17 +00:00
bdf128673f Update changes entry: removed duplicates and improved wording
OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=23
2021-09-30 13:15:11 +00:00
Andrii Nikitin
858afb78d7 - Update to version 1.010:
* Add openSUSE design theme
  * Fix parantheses placement, remove unneeded param
  * Create service symlink rcmirrorcache-subtree
  * Fix subtree to work with symlinks
  * dist: package mirrorcache-subtree.service (#199)
  * Add proper handling of local symlinks
  * Erase info about folder on a mirror if it cannot be accessed
  * Always render files from disk for local root
  * Add MIRRORCACHE_PROXY_URL variable
  * Add subtree feature

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=21
2021-09-30 07:50:06 +00:00
aa1945c906 - Update to version 1.009:
* Add proper handling of local symlinks
  * Erase info about folder on a mirror if it cannot be accessed

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=19
2021-09-23 07:35:32 +00:00
Andrii Nikitin
f9006fd2e1 Accepting request 919463 from home:eroca:MirrorCache2
- Update to version 1.008
- Improve packaging, the conf.env is now in /etc/mirrorcache/
  * Add script to generate and update cache.tar.xz

OBS-URL: https://build.opensuse.org/request/show/919463
OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=18
2021-09-16 08:52:52 +00:00
7818415768 Accepting request 918012 from home:eroca:MirrorCache
- Update to version 1.007

- Remove 0001-Fix-one-more-typo-179.patch - included in 1.007

OBS-URL: https://build.opensuse.org/request/show/918012
OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=16
2021-09-14 09:53:03 +00:00
36f728d411 - add 0001-Fix-one-more-typo-179.patch
OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=13
2021-08-16 12:59:50 +00:00
edc5e22392 Accepting request 911818 from home:eroca:branches:MirrorCache
* Switch to manual in _service for the sources (to be able to submit to factory)
* Add changesgenerate service so that `osc service manualrun`
  - gets new sources, extracts everything from dist/rpm
  - create a changes file entry (still needs to be checked as it puts changes from previous releases)
* Add complete changelog

OBS-URL: https://build.opensuse.org/request/show/911818
OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=12
2021-08-12 12:43:25 +00:00
Andrii Nikitin
c190d4d8b9 1.001 2021-07-09
- Fix redirect to https when mirror doesnt have it
  - Verify size on mirrors for files with -Current suffix
  - t: Fix test redirect from landing page when TOP_FOLDERS is set

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=5
2021-07-09 13:55:49 +00:00
Andrii Nikitin
bb45628c9e 1.0 2021-07-08
- Fix render of branding when TOP_FOLDERS is set.
  - Add 'My Statistics' menu item with individual statistics for IP.
  - Internals: use stat table for scheduling jobs.
  - Internals: fix unsafe usage of Datamodule in delayed rendering.

M    MirrorCache.changes

Diff for working copy: .
Index: MirrorCache.changes
===================================================================

--- MirrorCache.changes	(revision 3)
+++ MirrorCache.changes	(working copy)
@@ -1,3 +1,53 @@
+1.0  2021-07-08
+  - Fix render of branding when TOP_FOLDERS is set.
+  - Add 'My Statistics' menu item with individual statistics for IP.
+  - Internals: use stat table for scheduling jobs.
+  - Internals: fix unsafe usage of Datamodule in delayed rendering.
+
+0.9  2021-07-01
+ - ui: Add branding capability and footer info
+ - ui: Render landing page if MIRRORCACHE_TOP_FOLDERS is set
+ - Truncate country code to two letters
+ - Log trailing slash in stat
+ - Fix double stats when no mirror in country
+ - t: Replace repo in docker to openSUSE:infrastructure
+ - salt: switch test to use 15.3
+
+0.8  2021-06-24
+  - Add mirrorlist page, reference it in file listing 'Metadata' column;
+  - Do not require /download prefix when MIRRORCACHE_TOP_FOLDERS is configured;
+  - Fix error "time_bad_sig: Return_to signature is not valid." during openid login by setting secret in Mojo app;
+  - Performance improvements in estimating load on background jobs;
+  - Performance improvements in stat calculation;
+  - [ui] Move mirror statistics to folder status form;
+  - Cleanup audit events, add DB index for that;
+  - Tweak job creating metadata (folder_hashes_create);
+  - Schedule scan when main server serves as a mirror;
+  - Improve handling symlinked files in rsync root;
+  - rpm spec improvements.
+
+0.7  2021-06-03
+  - [ui] Change /logout only on POST message, (before it was on GET).
+  - [ui] Tweak html in file listing.
+  - [ui] Use natural sort in file listing (case insensitive, foo-9 before foo-10).
+  - [internal] Significantly reduce time of guards inside some permanent tasks.
+  - [internal] (Experimental) new task FolderHashesCreate in new queue hashes to collect files metadata and store in db.
+  - [tests] Switch test containers to leap 15.3
+
+0.6  2021-05-27
+  - an audit logs page for admins
+  - new config MIRRORCACHE_AUTH_URL, fake auth for testing
+  - new permanent job mirror_check_from_stat
+  - tests: switch to new reworked environ framework
+
+0.5  2021-04-30
+  - Obsolete MIRRORCACHE_FALLBACK_REDIRECT in favor of MIRRORCACHE_REDIRECT
+  - Adjust github address to openSUSE
+
+0.4  2021-04-29
+  - Collect file size from origin if nginx with indexing
+  - Add favicon and initial version of logo
+
 0.3  2021-04-24
   - Remove column db_sync_for_country from /app/folder

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=4
2021-07-08 08:58:22 +00:00
Andrii Nikitin
03a7e993c8 0.9 2021-07-01
- ui: Add branding capability and footer info
 - ui: Render landing page if MIRRORCACHE_TOP_FOLDERS is set
 - Truncate country code to two letters
 - Log trailing slash in stat
 - Fix double stats when no mirror in country
 - t: Replace repo in docker to openSUSE:infrastructure
 - salt: switch test to use 15.3

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=3
2021-07-01 05:42:36 +00:00
Andrii Nikitin
d1af4fefe4 0.8 2021-06-24
- Add mirrorlist page, reference it in file listing 'Metadata' column;
  - Do not require /download prefix when MIRRORCACHE_TOP_FOLDERS is configured;
  - Fix error "time_bad_sig: Return_to signature is not valid." during openid login by setting secret in Mojo app;
  - Performance improvements in estimating load on background jobs;
  - Performance improvements in stat calculation;
  - [ui] Move mirror statistics to folder status form;
  - Cleanup audit events, add DB index for that;
  - Tweak job creating metadata (folder_hashes_create);
  - Schedule scan when main server serves as a mirror;
  - Improve handling symlinked files in rsync root;
  - rpm spec improvements.

OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=2
2021-06-24 07:29:04 +00:00
9c4f8402dd Accepting request 898516 from home:andriinikitin:MirrorCache
Time to do the switch

OBS-URL: https://build.opensuse.org/request/show/898516
OBS-URL: https://build.opensuse.org/package/show/openSUSE:infrastructure:MirrorCache/MirrorCache?expand=0&rev=1
2021-06-08 17:23:24 +00:00