Philipp/aki_prj23_transparenzregister
Philipp/aki_prj23_transparenzregister
1
0
Fork 0
mirror of https://github.com/fhswf/aki_prj23_transparenzregister.git synced 2025-04-24 21:52:34 +02:00
Code Issues Packages Projects Releases Wiki Activity
744 Commits 7 Branches 0 Tags
Commit Graph

744 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Tristan Nolde
f65a377d73
fix(data-extraction): Handle malformed date_of_birth fields (#204) 
fix(data-extraction): Handle malformed date_of_birth fields
 2023-10-09 19:15:37 +02:00
Philipp Horstenkamp
68346aff15
Removed error suppression from sql data transformation. (#205) 2023-10-09 17:58:20 +02:00
TrisNol
84d0139531 fix(data-extraction): Handle malformed date_of_birth fields 2023-10-07 17:01:34 +02:00
Tristan Nolde
7500895982
fix: Add script to fix malformed yearly_result entries (#202) 2023-10-07 12:35:29 +02:00
TrisNol
9cc58ba8be fix: Add script to fix malformed yearly_result entries 2023-10-07 09:11:43 +02:00
Philipp Horstenkamp
63325e7faa
Add constraints to the SQL entities (#186) 2023-10-06 18:48:58 +02:00
Philipp Horstenkamp
ea9c777217
Enabeling data processing in docker container. (#195) 2023-10-06 18:36:29 +02:00
Philipp Horstenkamp
b1ca268a62
SQL fixes after new mongo ingest (#199) 2023-10-06 18:22:19 +02:00
Philipp Horstenkamp
8bb27f5195
Set the DASH_URL_BASE_PATHNAME in the docker container to be used as a default (#192) 
Set the DASH_URL_BASE_PATHNAME in the docker container to be used as a
prefix.

Added a Dash Title
 2023-10-06 18:13:25 +02:00
Tristan Nolde
5137026fab
hotfix(jupiter): Missing port forwarding of mongo container to host (#198) 2023-10-06 18:04:21 +02:00
Tristan Nolde
5e737162a7
Update docker-compose.yml 
Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
 2023-10-06 17:59:14 +02:00
TrisNol
54151c5041 hotfix(jupiter): Missing port forwarding of mongo container to host 2023-10-06 17:30:18 +02:00
Philipp Horstenkamp
ab96c5a01a
Switched two docker container off. 2023-10-05 22:16:45 +02:00
Christian Gawron
d57007e26b changed volumes for data bases 2023-10-05 20:41:47 +02:00
Philipp Horstenkamp
09c36960e3
Add an list of missing relation partners to be searched (#171) 
- [x] Add a new table
- [x] Add a field to the table that can register if the company was
already queried
- [x] Add a field to the table that counts how many times a relation
partner was missing
- [x] Add a function that restets the counter

Also:
- Reworked the get_company function to use the location dict as kwargs
 2023-10-05 19:57:30 +02:00
Philipp Horstenkamp
c6f2c7467c
Rework the transfer of company data to fit the new data in the mongodb (#188) 
This adds the additional company data as proposed to the sql db.

- [x] @TrisNol Is everything included or did I miss a feature. Relations
are in another issue.
- [x] @KM-R New DB features for the Dashbord for your review.
 2023-10-05 19:47:46 +02:00
KM-R
2152704dfc
175 create person page (#178) 
Created person page and updated search bar in the header to search for persons
 2023-10-05 18:00:31 +02:00
Tristan Nolde
bf7c072e87
Fix/company names with quotes (#187) 2023-10-04 20:07:51 +02:00
Philipp Horstenkamp
ea89a64a80
Linter update to ruff==0.0.292 (#191) 2023-10-04 20:04:59 +02:00
Philipp Horstenkamp
41f2c9f995
Executing black over all jupyter notebook (#190) 
Reverting black for the jupyter notebooks gets old. Can we just run
black over all of them?
 2023-10-04 20:03:47 +02:00
TrisNol
38d19a835d refactor: Replace last replace with call of dedicated function 2023-10-04 19:39:50 +02:00
Philipp Horstenkamp
030ad00c7d
Testing speedup with in memory SQLite (#189) 
If no SQLite File is written and deleted testing is MUCH faster.
 2023-10-04 19:36:57 +02:00
TrisNol
c2f1670032 refactor: Implement MyPy feedback 2023-10-03 16:43:23 +02:00
TrisNol
0dfe95652d refactor: Implement MyPy feedback 2023-10-03 16:42:09 +02:00
TrisNol
259259953e refactor: Move quote removal funtion to string utils, adapt to requirements 2023-10-03 16:37:54 +02:00
TrisNol
2a446a9937 checkpoint: Remove quotes from company names in relations 2023-10-03 14:33:46 +02:00
TrisNol
49498ad7c0 checkpoint: Remove quotes from company name 2023-10-03 14:33:45 +02:00
Tristan Nolde
aa6c0efc87
docs: Meeting notes for 2023-09-28 (#164) 
Zum Review
 2023-10-03 14:33:08 +02:00
Tristan Nolde
7e9cff046a
fix(data-extraction): Parse house-number from street field if possibl… (#179) 2023-10-03 14:26:21 +02:00
TrisNol
231513d45d docs: Adding Seminararbeit on Data Extraction 2023-10-03 12:38:17 +02:00
TrisNol
0ea233e610 Merge branch 'meetings/2023-09-28' of github.com:fhswf/aki_prj23_transparenzregister into meetings/2023-09-28 2023-10-03 12:17:57 +02:00
TrisNol
f58b6dfc23 docs: PR feedback implemented 2023-10-03 12:16:21 +02:00
TrisNol
dd55b5184c refactor: Initialiased target docs structure 2023-10-03 12:16:21 +02:00
TrisNol
0d779db1e8 docs: Update meeting notes 2023-10-03 12:16:20 +02:00
Tristan Nolde
1c0b23b85d Update documentations/meeting-notes/Meeting_2023-09-28.md 
Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
 2023-10-03 12:16:20 +02:00
Tristan Nolde
e470316373 Update documentations/meeting-notes/Meeting_2023-09-28.md 
Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
 2023-10-03 12:16:20 +02:00
Tristan Nolde
3eeeaeaba9 Update documentations/meeting-notes/Meeting_2023-09-28.md 
Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
 2023-10-03 12:16:20 +02:00
TrisNol
63644e56ae docs: Meeting notes for 2023-09-28 2023-10-03 12:16:20 +02:00
Philipp Horstenkamp
01b4ce00c1
Spellchecking with PyCharm (#133) 
Co-authored-by: KM-R <129882581+KM-R@users.noreply.github.com>
 2023-10-02 20:47:42 +02:00
Philipp Horstenkamp
d2d4a436f8
Add a cli interface to choose a configuration (#163) 
- [x] add a cli to the webserver to take env variables into account 
- [x] add a cli to the data processing that takes enviromental variable
as a valid source into account
- [x] rework the cli for the reset sql command
- [x] rework the cli for the copying of sql data from one db to another
 2023-10-02 20:31:42 +02:00
Philipp Horstenkamp
2abe12f027
Add a function to convert DM to EUR (#168) 
The function is ment to transform the captial dict into a format that
can be added as a kwarg (**norm_capital(capital_dict) to the company
entities.
This PR only contains the function itself.
 2023-10-02 19:46:17 +02:00
Tristan Nolde
84fb50bad1
Update src/aki_prj23_transparenzregister/utils/data_extraction/unternehmensregister/transform.py 
Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
 2023-10-02 19:23:57 +02:00
TrisNol
56bfc03ac6 docs: PR feedback implemented 2023-10-02 19:17:35 +02:00
TrisNol
2aec7ce115 refactor: Initialiased target docs structure 2023-10-02 19:17:29 +02:00
TrisNol
e94684050b docs: Update meeting notes 2023-10-02 19:16:25 +02:00
Tristan Nolde
469f8bdd41 Update documentations/meeting-notes/Meeting_2023-09-28.md 
Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
 2023-10-02 19:16:25 +02:00
Tristan Nolde
e551c97130 Update documentations/meeting-notes/Meeting_2023-09-28.md 
Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
 2023-10-02 19:16:25 +02:00
Tristan Nolde
71f442fdc7 Update documentations/meeting-notes/Meeting_2023-09-28.md 
Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
 2023-10-02 19:16:25 +02:00
TrisNol
8151a18efb docs: Meeting notes for 2023-09-28 2023-10-02 19:16:24 +02:00
Philipp Horstenkamp
05472cc16a
Added longitude/latitude and positional accuracy to the company data (#180) 2023-10-02 17:18:04 +02:00