Feature/ner (#103)

NER und Sentiment-Pipeline mit Services zur Datenextraktion.

---------

Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de>
Co-authored-by: TrisNol <tristan.nolde@yahoo.de>
This commit is contained in:
Sebastian
2023-10-16 19:54:24 +02:00
committed by GitHub
parent 99b61e7c2e
commit c680ac9759
28 changed files with 12509 additions and 10 deletions

View File

@@ -0,0 +1,38 @@
```mermaid
flowchart LR
DBConnect["`**Mongo Connect**
- create connection string
- establish connection`"]
DBRead["`**Mongo Read**
- read database
- get fields without attribute 'companies'`"]
NER["`**NERService**
- process news article
- get entities`"]
DBUpdate["`**Mongo Update Documents**
- update processed documents
- add an attribute 'companies'`"]
id1[["`**NERSpacy**
Named Entitiy Recognition with spaCy`"]]
id2[["`**NERCompanyList**
Named Entitiy Recognition by comparing text with list`"]]
id3[["`**NERTransformer**
Named Entitiy Recognition with transformer`"]]
DBConnect-->DBRead-->NER
NER--select service-->id1
NER--select service-->id2
NER--select service-->id3
id1-->DBUpdate
id2-->DBUpdate
id3-->DBUpdate
```