Commit Graph
40 Commits
Author SHA1 Message Date
Tristan NoldeandGitHub ebedf7c630 Merge pull request #39 from fhswf/feature/data-extraktion
Feature/data extraktion
2023-07-20 17:11:50 +02:00
TrisNol 1e44197199 add types-tqdm 2023-07-20 16:46:53 +02:00
Tristan NoldeandGitHub 398fac4c43 Update values.yml 2023-07-20 08:33:49 +02:00
Tristan NoldeandGitHub 6a46d58037 Merge pull request #40 from fhswf/feature/k8s
k8s deployment values
2023-07-20 08:16:38 +02:00
TrisNol dcd2a0b8af k8s deployment values 2023-07-20 08:14:20 +02:00
TrisNol a81d3638c5 checkpoint 2023-07-20 08:05:07 +02:00
TrisNol b05088c966 test: utils.mongo 2023-07-16 15:53:01 +02:00
TrisNol 4b5f63ee62 test: Adding unit tests for news_mongo_service 2023-07-16 15:33:54 +02:00
TrisNol b788ee3659 test: Adding unit tests 2023-07-16 11:25:21 +02:00
TrisNol 9da3e4adb9 test: Introducing first unit tests of new Company and News model 2023-07-11 18:03:23 +02:00
TrisNol 52d7f62bbe Merge branch 'main' into feature/data-extraktion 2023-07-11 14:35:20 +02:00
TrisNol ed681d7c47 refactor: Implement linter feedback 2023-07-11 14:20:16 +02:00
TrisNol 4c95550dbf feat(data-extraction): MongoWrapper, DataClasses and services for News and Company data 2023-07-10 18:58:31 +02:00
TrisNol 4c65d37816 Merge main into feature/data-extraction 2023-07-10 17:15:43 +02:00
TrisNol e44385ce3a style: Refactoring imports, adapting MongoConnector to different connection_strings 2023-06-30 20:36:03 +02:00
TrisNol 3cd8860312 adding distric court location to export 2023-06-27 19:49:23 +02:00
TrisNol 421b1e8c87 Bundesanzeiger preparation, Handeslblatt RSS feed export 2023-06-27 19:17:54 +02:00
TrisNol 37fb1b1da3 multi-process scraping, transforming unternehmensregister output 2023-06-25 15:58:53 +02:00
Tristan NoldeandGitHub f691cac9e8 Merge pull request #27 from fhswf/feature/meeting-notes-09-06-2023
docs(meeting-notes): Meeting 09.06.2023
2023-06-19 18:10:59 +02:00
TrisNol c9c7b0cf7a code cleanup, presentation on data extraction 2023-06-19 18:02:34 +02:00
TrisNol 6e31bc62bd mongodb wrapper for managing News objects 2023-06-16 18:50:19 +02:00
TrisNol 5b96bb7e3e adding company ID as well as compatible dataclasses 2023-06-16 18:00:11 +02:00
TrisNol d3d8adabad dockerized mongodb as staging DB 2023-06-15 20:24:39 +02:00
TrisNol 3e737fbac5 first news article data extraction from tagesschau api 2023-06-15 18:04:23 +02:00
TrisNol 058c16b3ff Bulk process Unternehmensregister .xmls 2023-06-11 13:11:44 +02:00
TrisNol 1010b43a5f Extract first stakeholder informationen from Unternehmensregister export 2023-06-09 14:23:56 +02:00
TrisNol e2ad2d475a Traverse all pages 2023-06-09 13:51:36 +02:00
TrisNol d69368318f Download Unternehmensregister export via Selenium 2023-06-09 13:01:46 +02:00
TrisNol 8fce1ffc7e docs(meeting-notes): Meeting 09.06.2023 2023-06-09 10:47:56 +02:00
Tristan NoldeandGitHub 78e5ecb7e4 Add files via upload 2023-05-11 16:09:59 +02:00
Tristan NoldeandGitHub bd9f2369d2 Merge pull request #6 from fhswf/feature/docs-on-timeseries
Feature/docs on timeseries
2023-05-01 12:01:18 +02:00
TrisNol 878e95f5ba resolve merge conflicts 2023-05-01 11:34:50 +02:00
TrisNol 0b4d955d26 feat(data extraction): Scraping data from Bundesanzeiger and parsing the results 2023-05-01 11:33:50 +02:00
TrisNol 0d2ead8a17 docs: Timeseries 2023-05-01 11:33:31 +02:00
TrisNol dd06451e6f feat(data extraction): Scraping data from Bundesanzeiger and parsing the results 2023-05-01 11:30:37 +02:00
TrisNol 7de8b09a11 docs: Timeseries 2023-04-13 18:42:29 +02:00
TrisNol edb5e02378 hotfix(pre-commit): Rename to .yaml, remove default python version 2023-04-12 11:07:27 +02:00
TrisNol a79c5b6560 extended bundesanzeiger API test 2023-04-12 10:58:39 +02:00
TrisNol 1762f41cb1 api tests: Adding previous test results for different apis 2023-04-07 11:51:55 +02:00
TrisNol 09333c00dc docs: Meeting note template created, Tasks for first weekly 2023-04-06 19:11:29 +02:00