Stephan Kulow
1c846e963c
Import files of revisions more reliable and faster
2022-10-26 21:47:39 +02:00
coolo
22b70d8bb7
Merge pull request 'Build a Tree of commits (at least prep it)' ( #4 ) from tree_builder into main
...
Reviewed-on: https://gitea.opensuse.org/importers/git-importer/pulls/4
2022-10-26 19:33:13 +02:00
Stephan Kulow
4dc7e972a2
Make use of db.cursor() in with blocks
2022-10-26 15:49:14 +02:00
Stephan Kulow
217bbcadb5
Run the formatter from make all
2022-10-26 14:57:08 +02:00
Stephan Kulow
1346223822
Reshuffle schema versions after rebase
2022-10-26 14:56:38 +02:00
Stephan Kulow
9dbf3b9094
Import all projects before checking files - otherwise we end with 0s
2022-10-26 14:56:38 +02:00
Stephan Kulow
d961c13614
Ignore commits after the merge
2022-10-26 14:56:38 +02:00
Stephan Kulow
2784171f75
Create fake revisions for every commit in the base of a linked package
...
This is a rather complex operation, but whenever a package changes in
Factory, the inherited package gets a shadow revision consisting of the
3-way merge. If this happens due to a request being accepted, this is
actually in most cases also commited by 'buildservice-autocommit',
so we're making sure this is always happening (and are actually
duplicating revisions in cases that we filter out later as empty
commits).
To differenciate the fake revisions from the real revisions, I add
a fraction part
2022-10-26 14:56:38 +02:00
Stephan Kulow
d17e60a608
Add another table to store linked_revs
...
We need to create fake revisions when packages were touched that are
linked themselves
2022-10-26 14:20:28 +02:00
Stephan Kulow
089b215f4c
Build a revision tree
2022-10-26 14:16:22 +02:00
Stephan Kulow
bc74b6950b
Implement a fileshash function for revision
2022-10-26 14:15:42 +02:00
Stephan Kulow
5bd790e915
Import the fixtures into the test database for queries
2022-10-26 14:15:41 +02:00
Stephan Kulow
ce3863e1b5
Add the capability to export the package data as test fixture
2022-10-26 14:13:24 +02:00
87d9fcc131
Merge pull request 'add a user database' ( #3 ) from user-db into main
...
Reviewed-on: https://gitea.opensuse.org/importers/git-importer/pulls/3
2022-10-26 14:05:47 +02:00
dbeb534108
cleanup context managers
2022-10-26 13:46:02 +02:00
1656d73340
fixed formatting and other suggestions
2022-10-26 11:58:01 +02:00
f14c609db2
Add batch import
2022-10-26 09:30:02 +02:00
bab8309d32
Parse users without email
2022-10-25 10:21:28 +02:00
10cd7e4e38
execute user import
2022-10-24 18:12:44 +02:00
5ed847de8b
added user table and import function
2022-10-21 15:16:34 +02:00
Stephan Kulow
eae411941b
Don't crash on delete requests
2022-10-20 08:57:14 +02:00
Stephan Kulow
988b10e4b7
Add also an index to the requests table
2022-10-20 07:22:48 +02:00
Stephan Kulow
0a3816be67
Create index for request_number
2022-10-20 07:00:26 +02:00
Stephan Kulow
fa9ec8618e
Load requests into the DB - not sure yet what for :)
2022-10-19 16:35:33 +02:00
Stephan Kulow
771595ba85
Catch invalid XML in links
2022-10-18 21:36:58 +02:00
Stephan Kulow
8dcae5df50
Remove debug output
2022-10-18 19:31:41 +02:00
Stephan Kulow
89c0335812
Import file list of revisions
2022-10-18 19:29:25 +02:00
Stephan Kulow
1a750f2171
Testing to fetch it back
2022-10-18 17:58:38 +02:00
Stephan Kulow
d747a3a761
Calculate the linked revision
2022-10-18 15:40:11 +02:00
Stephan Kulow
fb130bbf6f
Import packages links point to
2022-10-18 14:57:23 +02:00
Stephan Kulow
e8094cbc68
Import the link information into an extra table
2022-10-18 13:48:27 +02:00
Stephan Kulow
95412bc834
Prepare link collection
2022-10-18 13:13:52 +02:00
Stephan Kulow
25b45c5073
Split Revision into OBS and DB
2022-10-18 12:17:43 +02:00
Stephan Kulow
c534fb028e
Add a small test case
2022-10-17 20:52:05 +02:00
Stephan Kulow
365696213b
Put all the formatters into a Makefile (just a shell script wrapper)
2022-10-17 20:40:19 +02:00
Stephan Kulow
8563334b07
Add experimental import into DB
2022-10-17 20:39:03 +02:00
Stephan Kulow
a82562b794
Move modules into lib subdir
2022-10-17 19:56:41 +02:00
Stephan Kulow
88322fffae
Split the database config into 2 sections
2022-10-17 19:50:25 +02:00
Stephan Kulow
74fd937732
Add basic postgresql setup
2022-10-17 16:31:48 +02:00
Stephan Kulow
e53b030dcf
Split out OBS, ProxySHA256 and Importer
2022-10-17 15:18:04 +02:00
Stephan Kulow
bdc1dc0cc9
Split out History class
2022-10-17 15:02:34 +02:00
Stephan Kulow
13f49f59c9
Split out Git class
2022-10-17 14:55:30 +02:00
Stephan Kulow
40a7675e61
Split Request and Revision
2022-10-17 14:53:39 +02:00
Stephan Kulow
dbc1b6ab0b
Copy over 0def288aa853fb88de061b0402533f226458116b from osrt
2022-10-17 14:46:51 +02:00