Commit Graph

  • f8c111d7e2 Resolve mismatch between staging and prod db data for financials (#211) Philipp Horstenkamp 2023-10-14 17:16:14 +02:00
  • 9f7d714403 Visualize financials (#206) KM-R 2023-10-14 17:08:34 +02:00
  • c8d3c7395b Update docker-compose.yml (#210) Philipp Horstenkamp 2023-10-12 18:09:52 +02:00
  • f65a377d73 fix(data-extraction): Handle malformed date_of_birth fields (#204) Tristan Nolde 2023-10-09 19:15:37 +02:00
  • 68346aff15 Removed error suppression from sql data transformation. (#205) Philipp Horstenkamp 2023-10-09 17:58:20 +02:00
  • 84d0139531 fix(data-extraction): Handle malformed date_of_birth fields TrisNol 2023-10-07 17:01:34 +02:00
  • 7500895982 fix: Add script to fix malformed yearly_result entries (#202) Tristan Nolde 2023-10-07 12:35:29 +02:00
  • 9cc58ba8be fix: Add script to fix malformed yearly_result entries TrisNol 2023-10-07 09:11:43 +02:00
  • 63325e7faa Add constraints to the SQL entities (#186) Philipp Horstenkamp 2023-10-06 18:48:58 +02:00
  • ea9c777217 Enabeling data processing in docker container. (#195) Philipp Horstenkamp 2023-10-06 18:36:29 +02:00
  • b1ca268a62 SQL fixes after new mongo ingest (#199) Philipp Horstenkamp 2023-10-06 18:22:19 +02:00
  • 8bb27f5195 Set the DASH_URL_BASE_PATHNAME in the docker container to be used as a default (#192) Philipp Horstenkamp 2023-10-06 18:13:25 +02:00
  • 5137026fab hotfix(jupiter): Missing port forwarding of mongo container to host (#198) Tristan Nolde 2023-10-06 18:04:21 +02:00
  • 5e737162a7 Update docker-compose.yml Tristan Nolde 2023-10-06 17:59:14 +02:00
  • 54151c5041 hotfix(jupiter): Missing port forwarding of mongo container to host TrisNol 2023-10-06 17:30:18 +02:00
  • ab96c5a01a Switched two docker container off. Philipp Horstenkamp 2023-10-05 22:16:45 +02:00
  • d57007e26b changed volumes for data bases Christian Gawron 2023-10-05 20:41:47 +02:00
  • 09c36960e3 Add an list of missing relation partners to be searched (#171) Philipp Horstenkamp 2023-10-05 19:57:30 +02:00
  • c6f2c7467c Rework the transfer of company data to fit the new data in the mongodb (#188) Philipp Horstenkamp 2023-10-05 19:47:46 +02:00
  • 2152704dfc 175 create person page (#178) KM-R 2023-10-05 18:00:31 +02:00
  • bf7c072e87 Fix/company names with quotes (#187) Tristan Nolde 2023-10-04 20:07:51 +02:00
  • ea89a64a80 Linter update to ruff==0.0.292 (#191) Philipp Horstenkamp 2023-10-04 20:04:59 +02:00
  • 41f2c9f995 Executing black over all jupyter notebook (#190) Philipp Horstenkamp 2023-10-04 20:03:47 +02:00
  • 38d19a835d refactor: Replace last replace with call of dedicated function TrisNol 2023-10-04 19:39:50 +02:00
  • 030ad00c7d Testing speedup with in memory SQLite (#189) Philipp Horstenkamp 2023-10-04 19:36:57 +02:00
  • c2f1670032 refactor: Implement MyPy feedback TrisNol 2023-10-03 16:43:23 +02:00
  • 0dfe95652d refactor: Implement MyPy feedback TrisNol 2023-10-03 16:42:09 +02:00
  • 259259953e refactor: Move quote removal funtion to string utils, adapt to requirements TrisNol 2023-10-03 16:37:54 +02:00
  • 2a446a9937 checkpoint: Remove quotes from company names in relations TrisNol 2023-10-01 21:34:54 +02:00
  • 49498ad7c0 checkpoint: Remove quotes from company name TrisNol 2023-10-01 21:30:19 +02:00
  • aa6c0efc87 docs: Meeting notes for 2023-09-28 (#164) Tristan Nolde 2023-10-03 14:33:08 +02:00
  • 7e9cff046a fix(data-extraction): Parse house-number from street field if possibl… (#179) Tristan Nolde 2023-10-03 14:26:21 +02:00
  • 231513d45d docs: Adding Seminararbeit on Data Extraction TrisNol 2023-10-03 12:38:17 +02:00
  • 0ea233e610 Merge branch 'meetings/2023-09-28' of github.com:fhswf/aki_prj23_transparenzregister into meetings/2023-09-28 TrisNol 2023-10-03 12:17:57 +02:00
  • f58b6dfc23 docs: PR feedback implemented TrisNol 2023-09-30 18:02:43 +02:00
  • dd55b5184c refactor: Initialiased target docs structure TrisNol 2023-09-30 11:13:45 +02:00
  • 0d779db1e8 docs: Update meeting notes TrisNol 2023-09-30 10:42:19 +02:00
  • 1c0b23b85d Update documentations/meeting-notes/Meeting_2023-09-28.md Tristan Nolde 2023-09-30 10:39:40 +02:00
  • e470316373 Update documentations/meeting-notes/Meeting_2023-09-28.md Tristan Nolde 2023-09-30 10:39:29 +02:00
  • 3eeeaeaba9 Update documentations/meeting-notes/Meeting_2023-09-28.md Tristan Nolde 2023-09-28 19:01:22 +02:00
  • 63644e56ae docs: Meeting notes for 2023-09-28 TrisNol 2023-09-28 18:45:50 +02:00
  • 01b4ce00c1 Spellchecking with PyCharm (#133) Philipp Horstenkamp 2023-10-02 20:47:42 +02:00
  • d2d4a436f8 Add a cli interface to choose a configuration (#163) Philipp Horstenkamp 2023-10-02 20:31:42 +02:00
  • 2abe12f027 Add a function to convert DM to EUR (#168) Philipp Horstenkamp 2023-10-02 19:46:17 +02:00
  • 84fb50bad1 Update src/aki_prj23_transparenzregister/utils/data_extraction/unternehmensregister/transform.py Tristan Nolde 2023-10-02 19:23:57 +02:00
  • 56bfc03ac6 docs: PR feedback implemented TrisNol 2023-09-30 18:02:43 +02:00
  • 2aec7ce115 refactor: Initialiased target docs structure TrisNol 2023-09-30 11:13:45 +02:00
  • e94684050b docs: Update meeting notes TrisNol 2023-09-30 10:42:19 +02:00
  • 469f8bdd41 Update documentations/meeting-notes/Meeting_2023-09-28.md Tristan Nolde 2023-09-30 10:39:40 +02:00
  • e551c97130 Update documentations/meeting-notes/Meeting_2023-09-28.md Tristan Nolde 2023-09-30 10:39:29 +02:00
  • 71f442fdc7 Update documentations/meeting-notes/Meeting_2023-09-28.md Tristan Nolde 2023-09-28 19:01:22 +02:00
  • 8151a18efb docs: Meeting notes for 2023-09-28 TrisNol 2023-09-28 18:45:50 +02:00
  • 05472cc16a Added longitude/latitude and positional accuracy to the company data (#180) Philipp Horstenkamp 2023-10-02 17:18:04 +02:00
  • c96462532b Added a pre-commit hook that disallows committing to main. (#181) Philipp Horstenkamp 2023-10-01 21:40:39 +02:00
  • ab26a7a01e fix(data-extraction): Parse house-number from street field if possible, write Straße in full TrisNol 2023-10-01 21:24:17 +02:00
  • b46a52e019 Added a weekly counter similar to all other weeklies to weekly 10. (#165) Philipp Horstenkamp 2023-10-01 15:08:45 +02:00
  • ebf30da778 Removed some superfluous tools from the docker image (#157) Philipp Horstenkamp 2023-09-28 19:06:58 +02:00
  • 4d99601fc6 Optional docs Feature: Changelog (#155) Philipp Horstenkamp 2023-09-28 19:05:05 +02:00
  • 552e1bdf96 Added some metadata to the package (#144) Philipp Horstenkamp 2023-09-28 17:17:01 +02:00
  • 7d6bb8b6f5 Optional: Add auto-walrus (#158) Philipp Horstenkamp 2023-09-28 17:13:42 +02:00
  • 1e2ca627ba Meeting notes 2023-09-14 saschazhu 2023-09-28 12:54:50 +02:00
  • 9566276047 Create multi page layout (#147) KM-R 2023-09-26 18:38:40 +02:00
  • 5fa7cd230a docs: Adding Draw.io on Solution Arch and timeline (#105) Tristan Nolde 2023-09-25 20:55:27 +02:00
  • 9f3f867ff6 fix(pipeline): Add snapd and install drawio in pipeline TrisNol 2023-09-25 20:47:17 +02:00
  • 692c8b15cd Update .github/workflows/documentation.yaml Tristan Nolde 2023-09-25 20:40:41 +02:00
  • fa272e6491 Update .github/workflows/documentation.yaml Tristan Nolde 2023-09-25 20:40:29 +02:00
  • f54c140d98 Update after rebasing Philipp Horstenkamp 2023-09-25 20:39:13 +02:00
  • 2f8942288e Update documentations/index.rst Tristan Nolde 2023-09-25 20:35:57 +02:00
  • dfb93113ac docs: Show relevant pages of draw.io document TrisNol 2023-09-11 17:55:08 +02:00
  • 54dd574fb8 Added the ability to include drawio diagrams into the sphinx docs. (#107) Philipp Horstenkamp 2023-09-09 17:43:23 +02:00
  • 3fad05309f docs: Adding Draw.io on Solution Arch and timeline TrisNol 2023-09-09 15:46:55 +02:00
  • ac1d5760d0 Bugfix/yearly results with string as keys (#153) Tristan Nolde 2023-09-25 20:35:23 +02:00
  • 0fdfcc938a Added 2 Seminararbeiten to sphinx (#154) Philipp Horstenkamp 2023-09-25 20:30:43 +02:00
  • 9cc0654f56 Delete untagged images (#151) Philipp Horstenkamp 2023-09-25 20:28:49 +02:00
  • 5e716801c0 Change usage of black to the official black action (#152) Philipp Horstenkamp 2023-09-25 20:26:02 +02:00
  • 77711d8a2f feat: Add simple wrapper to update particual financial entries TrisNol 2023-09-25 19:34:10 +02:00
  • 7b5cf16e49 feat: Add simple wrapper to update particual financial entries TrisNol 2023-09-25 19:33:23 +02:00
  • 2050b49fde fix(data-extraction): Resolve issue in different Bundesanzeiger formats TrisNol 2023-09-25 18:37:39 +02:00
  • 5bbdf046d2 Ruff fix after merge (#149) Philipp Horstenkamp 2023-09-24 18:38:05 +02:00
  • 091e67de79 build first set of docker container in pipline and place them in the the github registry (#142) Philipp Horstenkamp 2023-09-24 18:32:52 +02:00
  • 5c8d20f4c2 Feature/additional stammdaten (#132) Tristan Nolde 2023-09-24 15:31:17 +02:00
  • 820fb3e52b Repaired the SQL copy and reduced the log volume a bit (#141) Philipp Horstenkamp 2023-09-24 15:11:49 +02:00
  • 81b8752abf Merge branch 'main' into feature/additional-stammdaten TrisNol 2023-09-24 13:49:02 +02:00
  • 282d638c11 refactor: Implement PR feedback TrisNol 2023-09-24 13:46:19 +02:00
  • d9ca808efa Mypy does not validate if type: ignore comments are needed. (#137) Philipp Horstenkamp 2023-09-23 12:44:27 +02:00
  • 5a7472cd3c checkpoint(data-extraction): Adapt load to update exisitng entries in order to keep yearly_results TrisNol 2023-09-23 12:07:07 +02:00
  • 1e23a8d5a3 refactor(data-extraction): Move date_to_iso function to string_tools TrisNol 2023-09-23 10:51:54 +02:00
  • c5a383e903 Pipline / dependency updates (#145) Philipp Horstenkamp 2023-09-23 10:49:14 +02:00
  • 77f08cd901 Merge branch 'main' into feature/additional-stammdaten TrisNol 2023-09-23 10:32:09 +02:00
  • d6223b4192 refactor(data-extraction): Improve variable naming and exception handling TrisNol 2023-09-23 10:21:26 +02:00
  • 4e25be5466 test(data-extraction): Introduct load.py test and scrape test TrisNol 2023-09-23 10:07:15 +02:00
  • 286636dfa4 Reduced the execution of tests and lint actions on pull requests (#143) Philipp Horstenkamp 2023-09-23 09:22:14 +02:00
  • 495cd90d85 Reduced required code coverage to 70% (#140) Philipp Horstenkamp 2023-09-21 18:09:16 +02:00
  • d7f167a868 ignore types mypy TrisNol 2023-09-21 18:08:20 +02:00
  • 3a11a92687 test(data-extraction): Ignore mypy args errors TrisNol 2023-09-21 17:55:20 +02:00
  • 365f74edc1 test(data-extraction): Replace hard-coded seperator with OS specific TrisNol 2023-09-21 17:47:30 +02:00
  • e6af96ea6d test(data-extraction): Host temporary_dir in local env TrisNol 2023-09-21 17:25:41 +02:00
  • 535c31fc9f test(data-extraction): Change use of TemporaryDirection TrisNol 2023-09-21 17:16:25 +02:00
  • 56c2ed55ec test(data-extraction): Delay file creation in test_rename_latest_file to avoid same timestamps TrisNol 2023-09-21 16:54:23 +02:00
  • 487b2f42d1 update data based on selected company (#122) KM-R 2023-09-19 23:45:10 +02:00