172 Commits

Author SHA1 Message Date
TrisNol
b91ecdfe42 test(data-ingestion): Fix myPy complaints regarding tests 2023-09-09 09:57:43 +02:00
TrisNol
2eaa1c5a65 test(utils): Cover added functiosnn in CompanyMongoService 2023-09-08 19:09:27 +02:00
TrisNol
4944372ebc test(date-ingestion): Cover enrich_company_financials 2023-09-08 18:56:10 +02:00
TrisNol
cfb4459a16 checkpoint 2023-09-07 17:46:17 +02:00
ecf94d4b61
Added an import smoke test. 2023-09-06 19:08:44 +02:00
TrisNol
0a374a10f6 test(data-ingestion): Increase coverage on Bundesanzeiger wrapper 2023-09-06 18:11:47 +02:00
TrisNol
f4a4cbc4f2 test(data-ingestion): Test Bundesanzeiger wrapper 2023-09-06 17:48:00 +02:00
TrisNol
d34bb1f3be checkpoint(data-ingestion): Replace print statements with loguru 2023-09-06 17:19:19 +02:00
TrisNol
00a5e9ec25 Merge branch 'main' into feat/fetch-financials 2023-09-06 17:16:48 +02:00
d04255a7a8
Old date corrected in meeting notes fixed (#76)
The date in the meeting nots was from the meeting two weeks before.
2023-09-04 19:49:17 +02:00
17e89da0d8
Repo struktur dokumentieren (#75) 2023-09-04 19:48:14 +02:00
f20823a613
Version updates for pre-commit/poetry/linter (#74)
Just a rutine update to keep ruff up to date and sync.
2023-09-03 17:56:13 +02:00
KM-R
80faf57c77
54 get data from multiple tables postgres (#72)
Create first dash board including header, basic company information and
finance plot

---------

Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
2023-09-03 16:18:19 +02:00
011184b898
Small fixes to the documentation. (#70) 2023-08-31 16:57:50 +02:00
69039706ac
Version updates (#69)
Version ups for poetry and pre-commit to keep them in sync with the
pipline.
2023-08-31 16:57:09 +02:00
TrisNol
b970416641 checkpoint(data-ingestion): Add method to mongo service to fetch companies with yearly results 2023-08-29 18:50:33 +02:00
TrisNol
7a2bc5db2b multi-thread company financial ingestion 2023-08-29 18:38:25 +02:00
TrisNol
ac07bd8e8e improve financial fetch, bind financial KPIs to enum 2023-08-29 17:10:42 +02:00
06e59b8061
Changes to the database (#67)
In this PR are pruposed changed that come up when i started the data
migration.
Plese review them an approve and disaprove.
2023-08-24 17:23:19 +02:00
KM-R
ba30ba2cc5
Viz: Company stats (#64)
First connection to Postgres database and creating dashboard with
dropdown and table

---------

Co-authored-by: Tim <tim.ronneburg@outlook.de>
Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
Co-authored-by: Sebastian <94404394+SeZett@users.noreply.github.com>
2023-08-21 21:30:19 +02:00
82979b1981
Expanded a bit on the installation of the project. 2023-08-20 13:03:06 +02:00
TrisNol
d1c09d51a2 checkpoint: Update Mongo Company entries with yearly_results 2023-08-19 18:06:33 +02:00
TrisNol
6514db2954 checkpoint: Enrich Company entity with yearly results 2023-08-19 15:12:41 +02:00
Sebastian
d48201595f
Create Meeting_2023-08-17.md 2023-08-18 21:17:57 +02:00
TrisNol
e8e354932c feat(data-extraction): Minimal Financial data fetch 2023-08-18 16:44:49 +02:00
TrisNol
1e15656028 refactor: Pull Auditor extraction into Bundesanzeiger utils 2023-08-18 16:21:52 +02:00
TrisNol
f64e0dd96e fix: Install deutschland via HTTPS link 2023-08-18 14:27:32 +02:00
TrisNol
eb0962e1be refactor: Move Auditor dataclass to models 2023-08-18 14:20:34 +02:00
TrisNol
309755383e Install deutschland package 2023-08-18 14:15:05 +02:00
e4a57c9136
Chore/rework workflow (#52)
* Reworked the lint action
* Removed the file change requirement
* Repaired mypy
* Repaired pip-audit
2023-08-17 22:05:12 +02:00
Tim
daa315804e added secrets_prod to gitignore 2023-08-17 21:50:40 +02:00
faca0a0af6
Repaired a mypy option 2023-08-16 22:10:52 +02:00
9c237402be
Excluded ipynb files from json pretty formatter + poetry update (#50)
* Excluded ipynb files from json pretty formatter +  poetry update
* Reworked pip audit
* Relocated dependencies
* Reworked the tests a bit.
* Poetry update
* Excluded lint and test workflows against the target branch
2023-08-16 20:25:15 +02:00
KM-R
1e7e55e649
Visualization first running dashboard (#51)
* added session maker

* Update prebuild psycopg-build2

* added table dash

* Update company_stats_dash

* Repaired a test.

* update connector_test

---------

Co-authored-by: Tim <tim.ronneburg@outlook.de>
Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
2023-08-15 21:30:58 +02:00
KM-R
105aab8122
Rename Erste_Übersicht_Sentiment_Analysis.md to Erste_Uebersicht_Sentiment_Analysis.md 2023-08-15 18:34:26 +02:00
Tristan Nolde
9a25d3ad0f
Merge pull request #49 from fhswf/visualization
fixed sqlAlchemy and db connection
2023-08-14 21:23:57 +02:00
Tim
ea7c955533 fixed sqlAlchemy and db connection
Co-authored-by: Tristan Nolde <TrisNol@users.noreply.github.com>
2023-08-14 20:59:30 +02:00
Tim Ronneburg
7420e744a5
Merge pull request #47 from fhswf/feature/refactor-utils
checkpoint(db): Refactor mongo utils, extract postgres entities from …
2023-08-13 19:18:27 +02:00
67c94cfb7e
Changes sql-alchemy to version 1.4.49 2023-08-13 15:00:29 +02:00
TrisNol
775b360ff7 test: Fix unit test of connector.py 2023-08-11 16:50:22 +02:00
TrisNol
46cdaa625f test: Add Unit test to connector.py 2023-08-11 16:45:05 +02:00
TrisNol
b2b3ab2f04 test: Add test for entities file 2023-08-11 16:35:57 +02:00
TrisNol
e7627aa2b7 refactor: Remove wrong typing from entities 2023-08-11 16:31:58 +02:00
TrisNol
4e7f6bca1d test: Add missing unit tests 2023-08-11 16:29:08 +02:00
TrisNol
86001a19e9 refactor: Add missing type declaration to ORM entities 2023-08-11 15:59:16 +02:00
TrisNol
db2da67ee4 docs: Add reference on how to use secrets.json 2023-08-11 15:55:54 +02:00
TrisNol
1ca1985f57 Merge branch 'main' into feature/refactor-utils 2023-08-11 15:40:33 +02:00
TrisNol
0203de98a7 feat(config): Read connection from secrets.json file 2023-08-11 15:39:08 +02:00
TrisNol
d565770b99 checkpoint(db): Refactor mongo utils, extract postgres entities from Juptyer 2023-08-11 15:12:18 +02:00
50bf7811ef
Div. dev ops updates (#43)
* Pipline rework to limit mypy and balck to src and tests
* Poetry update
* pre-commit update
2023-08-10 19:20:12 +02:00