86f82325d8
Stop importing/exporting scmsync packages/projects
...
Also, allow other-than Factory projects
2024-08-08 10:35:53 +02:00
531dbc7c1b
Add ability to specify non-Factory
...
This is important for devel-project only imports
non-factory is still blocked by assert
2024-08-07 16:55:05 +02:00
Stephan Kulow
dddc54ab1c
Remove ProcessPool from exporting
...
It's ignoring exceptions and makes debugging way too hard to justify
what's happening
2022-11-11 16:33:44 +01:00
Stephan Kulow
7f88e0cc5c
Run in the same process if there is only package
...
Debugging is much easier without Process Pool
2022-11-04 21:02:18 +01:00
Stephan Kulow
a457a16a50
Limit the workers to 8
...
This is hard coding the limit, we may want to make this configurable
but for now the machines supposed to run this code are very similiar
2022-11-04 10:00:28 +01:00
Stephan Kulow
60ced896a3
Fix condition for export
2022-11-04 09:58:36 +01:00
Stephan Kulow
33a5733cb9
Create the git repos in multiple processes
...
Threads appear to be too dangerous for this
2022-11-04 07:48:17 +01:00
Stephan Kulow
ab38332642
Allow to import multiple packages in one go
...
This way we avoid duplicating all startup and SQL queries
2022-11-03 20:14:56 +01:00
Stephan Kulow
ed4b7367eb
Reset branch if the devel branch is based on Factory
...
This happens in packages that change their devel project over time. Then
the commit in the devel project no longer has the parent in the devel branch
but is based on factory
2022-11-03 15:12:07 +01:00
639096b548
optimize cached file locations and add option for cache directory
2022-11-03 14:12:32 +01:00
Stephan Kulow
172242891d
Fix up some code after aplanas' continued review
2022-11-02 15:22:24 +01:00
Stephan Kulow
bbf1bc2fda
Fetch source projects of requests
...
We do not care for current devel project, but for the projects we saw
requests from
2022-11-02 08:50:54 +01:00
Stephan Kulow
8a863498db
Move default repos into a subdirectory that is git ignored
2022-11-02 08:01:22 +01:00
Stephan Kulow
c4654dd896
Split GitExporter out of Importer class
2022-11-02 07:59:25 +01:00
Stephan Kulow
9de0d6e6c5
Rename Exporter to TestExporter to make it more obvious
2022-11-02 07:39:04 +01:00
Stephan Kulow
e6a401d8ac
Remove old history handling
2022-11-01 11:37:30 +01:00
Stephan Kulow
9ed8abad2b
Make database usage the default
...
Some cleanup of no longer used functions
2022-11-01 11:23:40 +01:00
Stephan Kulow
9554fea7e1
Reuse the repository directory by storing a state yaml
...
Not using the database for that so that removing the repository directory will
automatically recreate it
2022-11-01 11:22:58 +01:00
Stephan Kulow
822329279d
Switch to walker for tree print
2022-10-31 07:03:19 +01:00
Stephan Kulow
ce3863e1b5
Add the capability to export the package data as test fixture
2022-10-26 14:13:24 +02:00
Stephan Kulow
8563334b07
Add experimental import into DB
2022-10-17 20:39:03 +02:00
Stephan Kulow
a82562b794
Move modules into lib subdir
2022-10-17 19:56:41 +02:00
Stephan Kulow
e53b030dcf
Split out OBS, ProxySHA256 and Importer
2022-10-17 15:18:04 +02:00
Stephan Kulow
bdc1dc0cc9
Split out History class
2022-10-17 15:02:34 +02:00
Stephan Kulow
13f49f59c9
Split out Git class
2022-10-17 14:55:30 +02:00
Stephan Kulow
40a7675e61
Split Request and Revision
2022-10-17 14:53:39 +02:00
Stephan Kulow
dbc1b6ab0b
Copy over 0def288aa853fb88de061b0402533f226458116b from osrt
2022-10-17 14:46:51 +02:00