15 Commits

Author SHA1 Message Date
TrisNol
1e23a8d5a3 refactor(data-extraction): Move date_to_iso function to string_tools 2023-09-23 10:51:54 +02:00
TrisNol
77f08cd901 Merge branch 'main' into feature/additional-stammdaten 2023-09-23 10:32:09 +02:00
TrisNol
d6223b4192 refactor(data-extraction): Improve variable naming and exception handling 2023-09-23 10:21:26 +02:00
TrisNol
4e25be5466 test(data-extraction): Introduct load.py test and scrape test 2023-09-23 10:07:15 +02:00
TrisNol
d7f167a868 ignore types mypy 2023-09-21 18:08:20 +02:00
TrisNol
e6af96ea6d test(data-extraction): Host temporary_dir in local env 2023-09-21 17:25:41 +02:00
TrisNol
535c31fc9f test(data-extraction): Change use of TemporaryDirection 2023-09-21 17:16:25 +02:00
TrisNol
56c2ed55ec test(data-extraction): Delay file creation in test_rename_latest_file to avoid same timestamps 2023-09-21 16:54:23 +02:00
TrisNol
7269e7e6a4 test(data-extraction): Cover transform.py 2023-09-18 20:23:19 +02:00
TrisNol
febcd59e39 test(data-extraction): Include first unit tests 2023-09-17 19:20:28 +02:00
ba44b082b8
Data transfer script (#114)
Transfers data betwenn two sql instances.
Limited in data volume. Should be good enough for now.

---------

Co-authored-by: Tim <tim.ronneburg@outlook.de>
2023-09-11 21:10:36 +02:00
d64f53eca9
Script for the transfer of data from Mongo to SQL (#80) 2023-09-11 20:21:35 +02:00
TrisNol
0a374a10f6 test(data-ingestion): Increase coverage on Bundesanzeiger wrapper 2023-09-06 18:11:47 +02:00
TrisNol
f4a4cbc4f2 test(data-ingestion): Test Bundesanzeiger wrapper 2023-09-06 17:48:00 +02:00
TrisNol
1e15656028 refactor: Pull Auditor extraction into Bundesanzeiger utils 2023-08-18 16:21:52 +02:00