Commit Graph

738 Commits

Author SHA1 Message Date
7d6bb8b6f5 Optional: Add auto-walrus (#158)
To learn the use of the Walrus opperator this hook integrates it in your
code if it finds a reason for it.
This branch is a suggestion of mine to force the use of the walrus
operaor as an autofix to keep it in mind when programming.
This should not increase the workload for us. It just lets us confront a
new programming tool. It also isn't a rull to be follwed. Just a hook
that looks at your code with an autofix.
2023-09-28 17:13:42 +02:00
1e2ca627ba Meeting notes 2023-09-14 2023-09-28 12:54:50 +02:00
9566276047 Create multi page layout (#147)
Created two pages (home and company), page reloads after company
selection in dropdown or clicking the home button.
2023-09-26 18:38:40 +02:00
5fa7cd230a docs: Adding Draw.io on Solution Arch and timeline (#105) 2023-09-25 20:55:27 +02:00
9f3f867ff6 fix(pipeline): Add snapd and install drawio in pipeline 2023-09-25 20:47:17 +02:00
692c8b15cd Update .github/workflows/documentation.yaml
Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
2023-09-25 20:40:41 +02:00
fa272e6491 Update .github/workflows/documentation.yaml
Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
2023-09-25 20:40:29 +02:00
f54c140d98 Update after rebasing 2023-09-25 20:39:13 +02:00
2f8942288e Update documentations/index.rst
Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
2023-09-25 20:38:04 +02:00
dfb93113ac docs: Show relevant pages of draw.io document 2023-09-25 20:38:00 +02:00
54dd574fb8 Added the ability to include drawio diagrams into the sphinx docs. (#107) 2023-09-25 20:37:59 +02:00
3fad05309f docs: Adding Draw.io on Solution Arch and timeline 2023-09-25 20:37:59 +02:00
ac1d5760d0 Bugfix/yearly results with string as keys (#153)
All entries you found have been updated on prod.
2023-09-25 20:35:23 +02:00
0fdfcc938a Added 2 Seminararbeiten to sphinx (#154)
Added 2 Seminararbeiten to sphinx
2023-09-25 20:30:43 +02:00
9cc0654f56 Delete untagged images (#151)
This change to the pipline deletes untagged / overwritten tags once a
week to keep the memory consumption in the GH registry reasonable.
2023-09-25 20:28:49 +02:00
5e716801c0 Change usage of black to the official black action (#152) 2023-09-25 20:26:02 +02:00
77711d8a2f feat: Add simple wrapper to update particual financial entries 2023-09-25 19:34:10 +02:00
7b5cf16e49 feat: Add simple wrapper to update particual financial entries 2023-09-25 19:33:23 +02:00
2050b49fde fix(data-extraction): Resolve issue in different Bundesanzeiger formats 2023-09-25 18:37:39 +02:00
5bbdf046d2 Ruff fix after merge (#149) 2023-09-24 18:38:05 +02:00
091e67de79 build first set of docker container in pipline and place them in the the github registry (#142)
- added a Dockerfile for the thre containers
- added a workflow step to build and placing the container in the
registry
- added a docker-compose.yaml to use the build images
- added a docker compose to build the images locally and a script for
prebuild steps
2023-09-24 16:32:52 +00:00
5c8d20f4c2 Feature/additional stammdaten (#132)
Feature/additional stammdaten
2023-09-24 15:31:17 +02:00
820fb3e52b Repaired the SQL copy and reduced the log volume a bit (#141)
- Added a cli interface to the SQL copy
- Repaired the SQL copy function
- Added the SQL copy function to the scripts
- Reduced the logging verbosity
2023-09-24 15:11:49 +02:00
81b8752abf Merge branch 'main' into feature/additional-stammdaten 2023-09-24 13:49:02 +02:00
282d638c11 refactor: Implement PR feedback 2023-09-24 13:46:19 +02:00
d9ca808efa Mypy does not validate if type: ignore comments are needed. (#137) 2023-09-23 12:44:27 +02:00
5a7472cd3c checkpoint(data-extraction): Adapt load to update exisitng entries in order to keep yearly_results 2023-09-23 12:07:07 +02:00
1e23a8d5a3 refactor(data-extraction): Move date_to_iso function to string_tools 2023-09-23 10:51:54 +02:00
c5a383e903 Pipline / dependency updates (#145) 2023-09-23 10:49:14 +02:00
77f08cd901 Merge branch 'main' into feature/additional-stammdaten 2023-09-23 10:32:09 +02:00
d6223b4192 refactor(data-extraction): Improve variable naming and exception handling 2023-09-23 10:21:26 +02:00
4e25be5466 test(data-extraction): Introduct load.py test and scrape test 2023-09-23 10:07:15 +02:00
286636dfa4 Reduced the execution of tests and lint actions on pull requests (#143)
This change will change the pipline to limit duplicat execution of tests
and lint actions in pull requests to save computing time.
2023-09-23 09:22:14 +02:00
495cd90d85 Reduced required code coverage to 70% (#140) 2023-09-21 18:09:16 +02:00
d7f167a868 ignore types mypy 2023-09-21 18:08:20 +02:00
3a11a92687 test(data-extraction): Ignore mypy args errors 2023-09-21 17:55:20 +02:00
365f74edc1 test(data-extraction): Replace hard-coded seperator with OS specific 2023-09-21 17:47:30 +02:00
e6af96ea6d test(data-extraction): Host temporary_dir in local env 2023-09-21 17:25:41 +02:00
535c31fc9f test(data-extraction): Change use of TemporaryDirection 2023-09-21 17:16:25 +02:00
56c2ed55ec test(data-extraction): Delay file creation in test_rename_latest_file to avoid same timestamps 2023-09-21 16:54:23 +02:00
487b2f42d1 update data based on selected company (#122)
Added UI elements to select a company and update shown data depending on chosen company



---------

Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
2023-09-19 23:45:10 +02:00
7269e7e6a4 test(data-extraction): Cover transform.py 2023-09-18 20:23:19 +02:00
92ea72249c refactor(data-extraction): Bind company type to an enum 2023-09-17 19:43:22 +02:00
d54c1cd17d test(data-extraction): Adapt to extended enum 2023-09-17 19:25:30 +02:00
febcd59e39 test(data-extraction): Include first unit tests 2023-09-17 19:20:28 +02:00
80f077ee7a Version ups (#117)
Rutine version ups for
- python-depdencies
- pre-commits
- piplines
2023-09-17 13:50:53 +02:00
06fef5361d Lightend black in the pipline building (#128)
Pipline should now run now 20 -40s faster.
2023-09-17 13:47:20 +02:00
56b6280264 Transfer financials from staging to sql (#129) 2023-09-17 13:45:08 +02:00
bfe50ac76d checkpoint(data-ingestion): Move Unternehmensregister code to .py 2023-09-15 17:22:54 +02:00
8be192e1de checkpoint(data-ingestion): Include type in company relations, fix issue in capital for KGs 2023-09-15 15:39:42 +02:00