Created pipeline to run ner sentiment and sql ingest (#314)

Created a dataprocessing pipline that enhances the raw mined data with
Organsiation extractions and sentiment analysis prio to moving the data
to the sql db.
The transfer of matched data is done afterword.

---------

Co-authored-by: SeZett <zeleny.sebastian@fh-swf.de>
This commit is contained in:
PhilippandSeZett authored and GitHub committed 2023-11-11 13:28:12 +00:00
1 parent a6d486209a
commit 066800123d
12 files changed
+206 -132

No files matched your search

+1 -1
View File
@@ -34,7 +34,7 @@ LABEL PART="DATA-TRANSFORMATION"
RUN pip install --find-links=dist aki-prj23-transparenzregister[transformation] --no-cache-dir && \
rm dist/ -R
ENTRYPOINT ["data-transformation", "ENV"]
ENTRYPOINT ["data-processing", "ENV"]
CMD ["--level", "DEBUG"]
FROM base as web-server