Commit Graph

238 Commits

Author SHA1 Message Date
Philipp 7d6bb8b6f5 Optional: Add auto-walrus (#158)
To learn the use of the Walrus opperator this hook integrates it in your
code if it finds a reason for it.
This branch is a suggestion of mine to force the use of the walrus
operaor as an autofix to keep it in mind when programming.
This should not increase the workload for us. It just lets us confront a
new programming tool. It also isn't a rull to be follwed. Just a hook
that looks at your code with an autofix.
2023-09-28 17:13:42 +02:00
saschazhu 1e2ca627ba Meeting notes 2023-09-14 2023-09-28 12:54:50 +02:00
KM-R 9566276047 Create multi page layout (#147)
Created two pages (home and company), page reloads after company
selection in dropdown or clicking the home button.
2023-09-26 18:38:40 +02:00
Tristan Nolde 5fa7cd230a docs: Adding Draw.io on Solution Arch and timeline (#105) 2023-09-25 20:55:27 +02:00
TrisNol 9f3f867ff6 fix(pipeline): Add snapd and install drawio in pipeline 2023-09-25 20:47:17 +02:00
Tristan Nolde 692c8b15cd Update .github/workflows/documentation.yaml
Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
2023-09-25 20:40:41 +02:00
Tristan Nolde fa272e6491 Update .github/workflows/documentation.yaml
Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
2023-09-25 20:40:29 +02:00
Philipp f54c140d98 Update after rebasing 2023-09-25 20:39:13 +02:00
Tristan Nolde 2f8942288e Update documentations/index.rst
Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
2023-09-25 20:38:04 +02:00
TrisNol dfb93113ac docs: Show relevant pages of draw.io document 2023-09-25 20:38:00 +02:00
Philipp 54dd574fb8 Added the ability to include drawio diagrams into the sphinx docs. (#107) 2023-09-25 20:37:59 +02:00
TrisNol 3fad05309f docs: Adding Draw.io on Solution Arch and timeline 2023-09-25 20:37:59 +02:00
Tristan Nolde ac1d5760d0 Bugfix/yearly results with string as keys (#153)
All entries you found have been updated on prod.
2023-09-25 20:35:23 +02:00
Philipp 0fdfcc938a Added 2 Seminararbeiten to sphinx (#154)
Added 2 Seminararbeiten to sphinx
2023-09-25 20:30:43 +02:00
Philipp 9cc0654f56 Delete untagged images (#151)
This change to the pipline deletes untagged / overwritten tags once a
week to keep the memory consumption in the GH registry reasonable.
2023-09-25 20:28:49 +02:00
Philipp 5e716801c0 Change usage of black to the official black action (#152) 2023-09-25 20:26:02 +02:00
TrisNol 77711d8a2f feat: Add simple wrapper to update particual financial entries 2023-09-25 19:34:10 +02:00
TrisNol 7b5cf16e49 feat: Add simple wrapper to update particual financial entries 2023-09-25 19:33:23 +02:00
TrisNol 2050b49fde fix(data-extraction): Resolve issue in different Bundesanzeiger formats 2023-09-25 18:37:39 +02:00
Philipp 5bbdf046d2 Ruff fix after merge (#149) 2023-09-24 18:38:05 +02:00
Philipp 091e67de79 build first set of docker container in pipline and place them in the the github registry (#142)
- added a Dockerfile for the thre containers
- added a workflow step to build and placing the container in the
registry
- added a docker-compose.yaml to use the build images
- added a docker compose to build the images locally and a script for
prebuild steps
2023-09-24 16:32:52 +00:00
Tristan Nolde 5c8d20f4c2 Feature/additional stammdaten (#132)
Feature/additional stammdaten
2023-09-24 15:31:17 +02:00
Philipp 820fb3e52b Repaired the SQL copy and reduced the log volume a bit (#141)
- Added a cli interface to the SQL copy
- Repaired the SQL copy function
- Added the SQL copy function to the scripts
- Reduced the logging verbosity
2023-09-24 15:11:49 +02:00
TrisNol 81b8752abf Merge branch 'main' into feature/additional-stammdaten 2023-09-24 13:49:02 +02:00
TrisNol 282d638c11 refactor: Implement PR feedback 2023-09-24 13:46:19 +02:00
Philipp d9ca808efa Mypy does not validate if type: ignore comments are needed. (#137) 2023-09-23 12:44:27 +02:00
TrisNol 5a7472cd3c checkpoint(data-extraction): Adapt load to update exisitng entries in order to keep yearly_results 2023-09-23 12:07:07 +02:00
TrisNol 1e23a8d5a3 refactor(data-extraction): Move date_to_iso function to string_tools 2023-09-23 10:51:54 +02:00
Philipp c5a383e903 Pipline / dependency updates (#145) 2023-09-23 10:49:14 +02:00
TrisNol 77f08cd901 Merge branch 'main' into feature/additional-stammdaten 2023-09-23 10:32:09 +02:00
TrisNol d6223b4192 refactor(data-extraction): Improve variable naming and exception handling 2023-09-23 10:21:26 +02:00
TrisNol 4e25be5466 test(data-extraction): Introduct load.py test and scrape test 2023-09-23 10:07:15 +02:00
Philipp 286636dfa4 Reduced the execution of tests and lint actions on pull requests (#143)
This change will change the pipline to limit duplicat execution of tests
and lint actions in pull requests to save computing time.
2023-09-23 09:22:14 +02:00
Philipp 495cd90d85 Reduced required code coverage to 70% (#140) 2023-09-21 18:09:16 +02:00
TrisNol d7f167a868 ignore types mypy 2023-09-21 18:08:20 +02:00
TrisNol 3a11a92687 test(data-extraction): Ignore mypy args errors 2023-09-21 17:55:20 +02:00
TrisNol 365f74edc1 test(data-extraction): Replace hard-coded seperator with OS specific 2023-09-21 17:47:30 +02:00
TrisNol e6af96ea6d test(data-extraction): Host temporary_dir in local env 2023-09-21 17:25:41 +02:00
TrisNol 535c31fc9f test(data-extraction): Change use of TemporaryDirection 2023-09-21 17:16:25 +02:00
TrisNol 56c2ed55ec test(data-extraction): Delay file creation in test_rename_latest_file to avoid same timestamps 2023-09-21 16:54:23 +02:00
KM-R 487b2f42d1 update data based on selected company (#122)
Added UI elements to select a company and update shown data depending on chosen company



---------

Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
2023-09-19 23:45:10 +02:00
TrisNol 7269e7e6a4 test(data-extraction): Cover transform.py 2023-09-18 20:23:19 +02:00
TrisNol 92ea72249c refactor(data-extraction): Bind company type to an enum 2023-09-17 19:43:22 +02:00
TrisNol d54c1cd17d test(data-extraction): Adapt to extended enum 2023-09-17 19:25:30 +02:00
TrisNol febcd59e39 test(data-extraction): Include first unit tests 2023-09-17 19:20:28 +02:00
Philipp 80f077ee7a Version ups (#117)
Rutine version ups for
- python-depdencies
- pre-commits
- piplines
2023-09-17 13:50:53 +02:00
Philipp 06fef5361d Lightend black in the pipline building (#128)
Pipline should now run now 20 -40s faster.
2023-09-17 13:47:20 +02:00
Philipp 56b6280264 Transfer financials from staging to sql (#129) 2023-09-17 13:45:08 +02:00
TrisNol bfe50ac76d checkpoint(data-ingestion): Move Unternehmensregister code to .py 2023-09-15 17:22:54 +02:00
TrisNol 8be192e1de checkpoint(data-ingestion): Include type in company relations, fix issue in capital for KGs 2023-09-15 15:39:42 +02:00