145 Commits

Author SHA1 Message Date
aea4b450c8
Pre commit update (#35) 2023-07-11 14:23:15 +02:00
TrisNol
ed681d7c47 refactor: Implement linter feedback 2023-07-11 14:20:16 +02:00
1c621f46a7
Added selenium to poetry 2023-07-11 01:59:11 +02:00
TrisNol
4c95550dbf feat(data-extraction): MongoWrapper, DataClasses and services for News and Company data 2023-07-10 18:58:31 +02:00
TrisNol
4c65d37816 Merge main into feature/data-extraction 2023-07-10 17:15:43 +02:00
KM-R
a3ef2e0e9f
Feature/visualisierung (#33)
Add files for presentation
2023-07-06 13:45:24 +02:00
RonnyFlex
7d54b7efd8 Praesentation zur Verflechtungsanalyse hochgeladen 2023-07-03 20:44:10 +02:00
TrisNol
e44385ce3a style: Refactoring imports, adapting MongoConnector to different connection_strings 2023-06-30 20:36:03 +02:00
e29133f509
Never executing jupyter for sphinx (#31) 2023-06-29 17:54:23 +02:00
Sebastian
91cfa28d7f
Feature/datenspeicherung (#30)
* Added Seminararbeit Datenspeicherung
2023-06-29 17:39:38 +02:00
TrisNol
3cd8860312 adding distric court location to export 2023-06-27 19:49:23 +02:00
TrisNol
421b1e8c87 Bundesanzeiger preparation, Handeslblatt RSS feed export 2023-06-27 19:17:54 +02:00
TrisNol
37fb1b1da3 multi-process scraping, transforming unternehmensregister output 2023-06-25 15:58:53 +02:00
a9304201af
(chore): Initilised devops tools (#29)
* Added a first action

* Repaired a typo

* Repaired a typo2

* Repaired a typo2

* Added flake8 action

* Repaired a typo in the flake8 action.

* Added a first bandit action

* Added a first batch

* Added a first batch

* Added a first batch

* Added a first batch

* Added a first batch

* Added the flake8-prebuild as a need to flake8

* Added the flake8-prebuild as a need to flake8

* Added the flake8-prebuild as a need to flake8

* Added the docker socket to the volume.

* Added the flake8-prebuild as a need to flake8

* Removed latest part from container.

* Removed latest part from container.

* Removed latest part from container.

* Reworked flake8

* Reworked flake8

* Reworked flake8

* Reworked flake8

* Reworked flake8

* Reworked flake8

* Reworked flake8

* Reworked flake8

* Reworked flake8

* Reworked flake8

* Reworked flake8

* Reworked flake8

* Reworked flake8 poetry

* Reworked flake8 poetry

* Changed to 64bit

* Some edits to the runner

* Added python setup

* Added python -m to python docker image.

* Added python -m to python docker image.

* Added python -m to python docker image.

* Added python -m to python docker image.

* Added python -m to python docker image.

* Added python -m to python docker image.

* Added ra run linter

* Added ra run linter

* Added ra run linter

* Added ra run linter

* Removed redundant version

* Removed redundant version

* Added isort

* Added isort

* Added isort

* Added poetry install

* Added poetry install

* Added flake8 as lint.

* Added flake8 as lint.

* Added flake8 as lint.

* Added flake8 as lint.

* Added flake8 as lint.

* Added flake8 as lint.

* Added flake8 as lint.

* Uses nodejs and python image

* Added flake8 as lint.

* Added flake8 as lint.

* Added flake8 as lint.

* Added flake8 as lint.

* Removed selfhosted runner

* Removed self hosted runner

* Removed self hosted runner

* Removed self hosted runner

* Added black and flake8 tests

* Removed self hosted runner

* Removed self hosted runner

* Removed unneded actions

* Added a mypy error.

* Removed poetry call before boetry setup

* Removed poetry call before poetry setup

* Added a test to understand the poetry action better

* Added a test to understand the poetry action better

* Added a test to understand the poetry action better

* Added a test to understand the poetry action better

* Added a test to understand the poetry action better

* Added a test to understand the poetry action better

* Added the snook poetry builder

* Reworked the repo a bit

* Removed unneeded poetry installation

* Added the isort action

* Added isort test

* Added ruff

* Added full ruff configuration

* Added full ruff configuration2

* Added full ruff configuration2

* Removed duplicat configurations

* Removed some redundant pre-commit hooks

* Removed unneeded actions.

* Removed unneeded actions.

* Repaired ruff

* Added tests.

* Removed

* Removed

* Removed a missing file

* Removed a missing file

* Removed a missing file

* Removed a missing file

* Removed a missing file

* Added reports as artifacts

* Added reports as artifacts

* Added reports as artifacts

* Removed the unneded poetry test

* Added a license checker.

* Added a license checker.

* Removed some unneeded configuration.

* Removed the import reformatted.

* Added doc generation.

* Added doc generation.

* Added license summary.

* Add

* Add lint

* Switched pip-licenses to poetry.

* Switched pip-licenses to poetry.

* Switched pip-licenses to poetry.

* Remove some more packages.

* Remove some more packages.

* Added a make file

* Added a make file

* Added a make file

* Added a make file

* Added a make file

* Added a make file

* Added a make file

* Added a make file

* Added a make file

* Added a make file

* Added a make file

* Added a make file

* Added a make file

* Added a make file

* Added a make file

* Added version codes to the main package

* Changed the format of the md files

* Presentation first draft

* Version up and added extensions

* Version up and added extensions

* Version up and added extensions

* Removed the venv path from docbuild

* Actions version up

* Actions version up

* Actions version up

* Actions version up

* Actions version up

* Actions version up

* Experiements with sphinx

* Experiments with sphinx

* Experiments with sphinx

* Experiments with sphinx

* Experiments with sphinx

* Experiments with sphinx

* Experiments with sphinx

* Experiments with sphinx

* First draft of the sphinx documentation.

* Added the protocol to the time series.

* Added the protocol to the time series.

* First draft ot a first build pipline

* Added mermaid version support

* Added documentations pull and branch request requirements.

* Added documentations pull and branch request requirements.

* Added documentations pull and branch request requirements.

* Added documentations pull and branch request requirements.

* Tests should now be passing

* Tests should now be passing

* Tests should now be passing

* Tests should now be passing

* Tests should now be passing

* Tests should now be passing

* Tests should now be passing

* Tests should now be passing

* Add safety

* Add safety

* Add safety

* Added the action on pull_request_target

* Added the action on pull_request_target

* Added the action on pull_request_target

* Added a pytest coverage report

* Added a pytest coverage report

* Added a pytest coverage report

* Added a pytest coverage report

* Added a pytest coverage report

* Added a build step

* Added a build step

* Added a build step

* Added a build step

* Changed the lint action to work only on python changes.

* Changed the lint action to work only on python changes.

* Changed the lint action to work only on python changes.

* Added the ability to compile a html report

* Added the ability to compile a html report

* Added the ability to compile a html report

* Added the ability to compile a html report

* Added the ability to compile a html report

* Added the ability to compile a html report

* Added the ability to compile a html report

* Added the ability to compile a html report

* Added the ability to compile a html report

* Added the ability to compile a html report

* Added the ability to compile a html report

* Added the ability to compile a html report

* Added the ability to compile a html report

* Added the ability to compile a html report

* Added the ability to compile a html report

* Coverage

* Finished test and build workflow

* Finished test and build workflow

* Finished test and build workflow

* Finished test and build workflow

* Finished test and build workflow

* Finished test and build workflow

* Finished test and build workflow

* Finished test and build workflow

* Finished test and build workflow

* Finished test and build workflow

* Finished test and build workflow

* Finished test and build workflow

* Finished test and build workflow

* Finished test and build workflow

* Finished test and build workflow

* Finished test and build workflow

* Finished test and build workflow

* Finished test and build workflow

* Finished test and build workflow

* Finished test and build workflow

* Repaired a bug.

* Repaired a bug.

* Repaired a bug.

* Repaired a bug.

* Repaired a bug.

* Added a github branch.ref

* Removed a poetry install

* Docbuild now excludes templates

* Added the seminarpräsentation to the documentation build

* Added the seminarpräsentation to the documentation build

* Added the seminarpräsentation to the documentation build

* dded a few images

* Changed the pre-commit image

* Changed the pre-commit image

* Presentation done

* Never executing jupyter for sphinx

* Never executing jupyter for sphinx

* Never executing jupyter for sphinx

* Never executing jupyter for sphinx

* Never executing jupyter for sphinx
2023-06-23 18:47:04 +02:00
Tristan Nolde
f691cac9e8
Merge pull request #27 from fhswf/feature/meeting-notes-09-06-2023
docs(meeting-notes): Meeting 09.06.2023
2023-06-19 18:10:59 +02:00
TrisNol
c9c7b0cf7a code cleanup, presentation on data extraction 2023-06-19 18:02:34 +02:00
Sebastian
c8d5ff04c8
Added Mock-Up from Miro 2023-06-16 20:51:06 +02:00
TrisNol
6e31bc62bd mongodb wrapper for managing News objects 2023-06-16 18:50:19 +02:00
TrisNol
5b96bb7e3e adding company ID as well as compatible dataclasses 2023-06-16 18:00:11 +02:00
TrisNol
d3d8adabad dockerized mongodb as staging DB 2023-06-15 20:24:39 +02:00
TrisNol
3e737fbac5 first news article data extraction from tagesschau api 2023-06-15 18:04:23 +02:00
TrisNol
058c16b3ff Bulk process Unternehmensregister .xmls 2023-06-11 13:11:44 +02:00
TrisNol
1010b43a5f Extract first stakeholder informationen from Unternehmensregister export 2023-06-09 14:23:56 +02:00
TrisNol
e2ad2d475a Traverse all pages 2023-06-09 13:51:36 +02:00
TrisNol
d69368318f Download Unternehmensregister export via Selenium 2023-06-09 13:01:46 +02:00
TrisNol
8fce1ffc7e docs(meeting-notes): Meeting 09.06.2023 2023-06-09 10:47:56 +02:00
RonnyFlex
64cc1041f7 V1 Verflechtungsanalyse 2023-06-07 15:02:56 +02:00
a9101aef2f
Meeting notes 2023_05_25 (#26)
* New meeting notes
* Some small changes to the other protokolls.
* Spelling error changes
2023-06-05 01:25:46 +02:00
KM-R
e7434af17c
Rename Übersicht to Übersicht.md 2023-06-04 18:11:40 +02:00
KM-R
7ca2923d0a
Upload of networks and pyvis mwe 2023-06-04 17:58:55 +02:00
KM-R
1ccb654187
Create folder Datenvisualisierung 2023-06-04 17:57:57 +02:00
a8d4810337 Added the DGID env variable to the documentation. 2023-06-01 22:58:15 +02:00
928a88ba80
Feature/issue#13 (#25)
* Frist draft of what is planned for the coursework

feature/issue#13

* Some small changes to the draft.
2023-05-29 20:12:36 +02:00
be2ba08b77 Add a new github runner infrastructure 2023-05-27 16:55:25 +02:00
d92561f745 Added a first draft of a github runner 2023-05-27 16:31:37 +02:00
KM-R
77613c4336
Create Abstract_Datenvisualisierung.md (#24) 2023-05-25 17:10:45 +02:00
saschazhu
d6d69560f1
Meeting Notes 2023-05-11 2023-05-25 16:17:31 +02:00
3633594156
Moved contribution rules and format documentation to CONTRIBUTING.md (#19)
* Moved contribution rules and format documentation to CONTRIBUTING.md
2023-05-11 17:16:17 +02:00
KM-R
75f9964152
Meeting notes 2023 05 04 (#21)
* Create images folder in meeting notes

* Upload screenshot of project for meeting notes

* Delete test file

* Create Meeting_2023-05-04.md

* Rename Meeting_30-03-2023.md to Meeting_2023-03-30.md

* Rename Meeting_13-04-2023.md to Meeting_2023-04-13.md
2023-05-11 17:11:59 +02:00
Tristan Nolde
78e5ecb7e4
Add files via upload 2023-05-11 16:09:59 +02:00
TrisNol
e6446ac0ad feat(docs): Abstract on automated data extraction 2023-05-11 16:09:15 +02:00
SeZett
0d19546e65 Added 'Datenspeicherung' 2023-05-11 16:07:41 +02:00
SeZett
ba46532e0a Change on timeseries Notebook: filepath 2023-05-11 15:56:14 +02:00
saschazhu
57eb12d8f7
Add files via upload 2023-05-11 14:52:01 +02:00
RonnyFlex
6d509ee6ed News research + Abstract verflechtungsanalyse V1 2023-05-08 21:01:33 +02:00
1ad1931c7c
Added a folder for the seminar arbeiten. 2023-05-06 10:41:19 +02:00
SeZett
783891557b added ideas to DB scheme 2023-05-04 11:20:37 +02:00
SeZett
abff4831e3 added ideas to DB scheme 2023-05-04 11:19:20 +02:00
KM-R
375d96b0ed
Example for sentiment analysis using VADER
To compare another sentiment analysis library to FINBert, used the same sample texts
2023-05-03 00:06:09 +02:00
KM-R
ae0dc03ae3
Update Erste_Übersicht_Sentiment_Analysis.md 2023-05-02 22:44:54 +02:00