388 Commits

Author SHA1 Message Date
7d6bb8b6f5
Optional: Add auto-walrus (#158)
To learn the use of the Walrus opperator this hook integrates it in your
code if it finds a reason for it.
This branch is a suggestion of mine to force the use of the walrus
operaor as an autofix to keep it in mind when programming.
This should not increase the workload for us. It just lets us confront a
new programming tool. It also isn't a rull to be follwed. Just a hook
that looks at your code with an autofix.
2023-09-28 17:13:42 +02:00
saschazhu
1e2ca627ba
Meeting notes 2023-09-14 2023-09-28 12:54:50 +02:00
KM-R
9566276047
Create multi page layout (#147)
Created two pages (home and company), page reloads after company
selection in dropdown or clicking the home button.
2023-09-26 18:38:40 +02:00
Tristan Nolde
5fa7cd230a
docs: Adding Draw.io on Solution Arch and timeline (#105) 2023-09-25 20:55:27 +02:00
TrisNol
9f3f867ff6 fix(pipeline): Add snapd and install drawio in pipeline 2023-09-25 20:47:17 +02:00
Tristan Nolde
692c8b15cd
Update .github/workflows/documentation.yaml
Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
2023-09-25 20:40:41 +02:00
Tristan Nolde
fa272e6491
Update .github/workflows/documentation.yaml
Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
2023-09-25 20:40:29 +02:00
f54c140d98
Update after rebasing 2023-09-25 20:39:13 +02:00
Tristan Nolde
2f8942288e
Update documentations/index.rst
Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
2023-09-25 20:38:04 +02:00
TrisNol
dfb93113ac
docs: Show relevant pages of draw.io document 2023-09-25 20:38:00 +02:00
54dd574fb8
Added the ability to include drawio diagrams into the sphinx docs. (#107) 2023-09-25 20:37:59 +02:00
TrisNol
3fad05309f
docs: Adding Draw.io on Solution Arch and timeline 2023-09-25 20:37:59 +02:00
Tristan Nolde
ac1d5760d0
Bugfix/yearly results with string as keys (#153)
All entries you found have been updated on prod.
2023-09-25 20:35:23 +02:00
0fdfcc938a
Added 2 Seminararbeiten to sphinx (#154)
Added 2 Seminararbeiten to sphinx
2023-09-25 20:30:43 +02:00
9cc0654f56
Delete untagged images (#151)
This change to the pipline deletes untagged / overwritten tags once a
week to keep the memory consumption in the GH registry reasonable.
2023-09-25 20:28:49 +02:00
5e716801c0
Change usage of black to the official black action (#152) 2023-09-25 20:26:02 +02:00
TrisNol
77711d8a2f feat: Add simple wrapper to update particual financial entries 2023-09-25 19:34:10 +02:00
TrisNol
7b5cf16e49 feat: Add simple wrapper to update particual financial entries 2023-09-25 19:33:23 +02:00
TrisNol
2050b49fde fix(data-extraction): Resolve issue in different Bundesanzeiger formats 2023-09-25 18:37:39 +02:00
5bbdf046d2
Ruff fix after merge (#149) 2023-09-24 18:38:05 +02:00
091e67de79
build first set of docker container in pipline and place them in the the github registry (#142)
- added a Dockerfile for the thre containers
- added a workflow step to build and placing the container in the
registry
- added a docker-compose.yaml to use the build images
- added a docker compose to build the images locally and a script for
prebuild steps
2023-09-24 16:32:52 +00:00
Tristan Nolde
5c8d20f4c2
Feature/additional stammdaten (#132)
Feature/additional stammdaten
2023-09-24 15:31:17 +02:00
820fb3e52b
Repaired the SQL copy and reduced the log volume a bit (#141)
- Added a cli interface to the SQL copy
- Repaired the SQL copy function
- Added the SQL copy function to the scripts
- Reduced the logging verbosity
2023-09-24 15:11:49 +02:00
TrisNol
81b8752abf Merge branch 'main' into feature/additional-stammdaten 2023-09-24 13:49:02 +02:00
TrisNol
282d638c11 refactor: Implement PR feedback 2023-09-24 13:46:19 +02:00
d9ca808efa
Mypy does not validate if type: ignore comments are needed. (#137) 2023-09-23 12:44:27 +02:00
TrisNol
5a7472cd3c checkpoint(data-extraction): Adapt load to update exisitng entries in order to keep yearly_results 2023-09-23 12:07:07 +02:00
TrisNol
1e23a8d5a3 refactor(data-extraction): Move date_to_iso function to string_tools 2023-09-23 10:51:54 +02:00
c5a383e903
Pipline / dependency updates (#145) 2023-09-23 10:49:14 +02:00
TrisNol
77f08cd901 Merge branch 'main' into feature/additional-stammdaten 2023-09-23 10:32:09 +02:00
TrisNol
d6223b4192 refactor(data-extraction): Improve variable naming and exception handling 2023-09-23 10:21:26 +02:00
TrisNol
4e25be5466 test(data-extraction): Introduct load.py test and scrape test 2023-09-23 10:07:15 +02:00
286636dfa4
Reduced the execution of tests and lint actions on pull requests (#143)
This change will change the pipline to limit duplicat execution of tests
and lint actions in pull requests to save computing time.
2023-09-23 09:22:14 +02:00
495cd90d85
Reduced required code coverage to 70% (#140) 2023-09-21 18:09:16 +02:00
TrisNol
d7f167a868 ignore types mypy 2023-09-21 18:08:20 +02:00
TrisNol
3a11a92687 test(data-extraction): Ignore mypy args errors 2023-09-21 17:55:20 +02:00
TrisNol
365f74edc1 test(data-extraction): Replace hard-coded seperator with OS specific 2023-09-21 17:47:30 +02:00
TrisNol
e6af96ea6d test(data-extraction): Host temporary_dir in local env 2023-09-21 17:25:41 +02:00
TrisNol
535c31fc9f test(data-extraction): Change use of TemporaryDirection 2023-09-21 17:16:25 +02:00
TrisNol
56c2ed55ec test(data-extraction): Delay file creation in test_rename_latest_file to avoid same timestamps 2023-09-21 16:54:23 +02:00
KM-R
487b2f42d1
update data based on selected company (#122)
Added UI elements to select a company and update shown data depending on chosen company



---------

Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
2023-09-19 23:45:10 +02:00
TrisNol
7269e7e6a4 test(data-extraction): Cover transform.py 2023-09-18 20:23:19 +02:00
TrisNol
92ea72249c refactor(data-extraction): Bind company type to an enum 2023-09-17 19:43:22 +02:00
TrisNol
d54c1cd17d test(data-extraction): Adapt to extended enum 2023-09-17 19:25:30 +02:00
TrisNol
febcd59e39 test(data-extraction): Include first unit tests 2023-09-17 19:20:28 +02:00
80f077ee7a
Version ups (#117)
Rutine version ups for
- python-depdencies
- pre-commits
- piplines
2023-09-17 13:50:53 +02:00
06fef5361d
Lightend black in the pipline building (#128)
Pipline should now run now 20 -40s faster.
2023-09-17 13:47:20 +02:00
56b6280264
Transfer financials from staging to sql (#129) 2023-09-17 13:45:08 +02:00
TrisNol
bfe50ac76d checkpoint(data-ingestion): Move Unternehmensregister code to .py 2023-09-15 17:22:54 +02:00
TrisNol
8be192e1de checkpoint(data-ingestion): Include type in company relations, fix issue in capital for KGs 2023-09-15 15:39:42 +02:00