mirror of
https://github.com/fhswf/aki_prj23_transparenzregister.git
synced 2025-09-14 02:21:19 +02:00
Feature/ner (#103)
NER und Sentiment-Pipeline mit Services zur Datenextraktion. --------- Co-authored-by: Philipp Horstenkamp <philipp@horstenkamp.de> Co-authored-by: TrisNol <tristan.nolde@yahoo.de>
This commit is contained in:
38
Jupyter/NER/NER-Pipeline.md
Normal file
38
Jupyter/NER/NER-Pipeline.md
Normal file
@@ -0,0 +1,38 @@
|
||||
```mermaid
|
||||
flowchart LR
|
||||
DBConnect["`**Mongo Connect**
|
||||
- create connection string
|
||||
- establish connection`"]
|
||||
|
||||
DBRead["`**Mongo Read**
|
||||
- read database
|
||||
- get fields without attribute 'companies'`"]
|
||||
|
||||
NER["`**NERService**
|
||||
- process news article
|
||||
- get entities`"]
|
||||
|
||||
DBUpdate["`**Mongo Update Documents**
|
||||
- update processed documents
|
||||
- add an attribute 'companies'`"]
|
||||
|
||||
id1[["`**NERSpacy**
|
||||
Named Entitiy Recognition with spaCy`"]]
|
||||
|
||||
id2[["`**NERCompanyList**
|
||||
Named Entitiy Recognition by comparing text with list`"]]
|
||||
|
||||
id3[["`**NERTransformer**
|
||||
Named Entitiy Recognition with transformer`"]]
|
||||
|
||||
DBConnect-->DBRead-->NER
|
||||
NER--select service-->id1
|
||||
NER--select service-->id2
|
||||
NER--select service-->id3
|
||||
|
||||
id1-->DBUpdate
|
||||
id2-->DBUpdate
|
||||
id3-->DBUpdate
|
||||
|
||||
|
||||
```
|
Reference in New Issue
Block a user