mirror of
https://github.com/fhswf/aki_prj23_transparenzregister.git
synced 2025-04-24 21:42:35 +02:00
c680ac9759
NER und Sentiment-Pipeline mit Services zur Datenextraktion. --------- Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de> Co-authored-by: TrisNol <tristan.nolde@yahoo.de>
39 lines
836 B
Markdown
39 lines
836 B
Markdown
```mermaid
|
|
flowchart LR
|
|
DBConnect["`**Mongo Connect**
|
|
- create connection string
|
|
- establish connection`"]
|
|
|
|
DBRead["`**Mongo Read**
|
|
- read database
|
|
- get fields without attribute 'companies'`"]
|
|
|
|
NER["`**NERService**
|
|
- process news article
|
|
- get entities`"]
|
|
|
|
DBUpdate["`**Mongo Update Documents**
|
|
- update processed documents
|
|
- add an attribute 'companies'`"]
|
|
|
|
id1[["`**NERSpacy**
|
|
Named Entitiy Recognition with spaCy`"]]
|
|
|
|
id2[["`**NERCompanyList**
|
|
Named Entitiy Recognition by comparing text with list`"]]
|
|
|
|
id3[["`**NERTransformer**
|
|
Named Entitiy Recognition with transformer`"]]
|
|
|
|
DBConnect-->DBRead-->NER
|
|
NER--select service-->id1
|
|
NER--select service-->id2
|
|
NER--select service-->id3
|
|
|
|
id1-->DBUpdate
|
|
id2-->DBUpdate
|
|
id3-->DBUpdate
|
|
|
|
|
|
```
|