Philipp/aki_prj23_transparenzregister
1
0
Fork 0
mirror of https://github.com/fhswf/aki_prj23_transparenzregister.git synced 2026-02-13 22:17:38 +01:00
Code Issues Packages Projects Releases Wiki Activity
685 Commits 7 Branches 0 Tags
26292a9dea1efadfa64d4ae356a8d546ed09a0aa
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Philipp 26292a9dea Made cached ttl configurable (#546) 2024-01-10 20:08:59 +01:00
Philipp f094750853 Removed broken logging (#545) 
Pandas elements can't be logged / log only an object reference
 2024-01-10 20:08:43 +01:00
Philipp 9a6259d732 Fixing the sqllite threadpool (#544) 2024-01-10 20:04:31 +01:00
Philipp 29cb22ac80 Removed auto assignment of maintenance actions. (#541) 2024-01-10 20:00:30 +01:00
Philipp 1a5c9147c5 Added some logging (#550) 2024-01-10 19:58:00 +01:00
Philipp b4bd135fb5 Added some logging 2024-01-10 00:20:42 +01:00
Philipp 4e3b449bd0 Made the cache ttl configurable. 2024-01-09 23:06:17 +01:00
Philipp 6252914b46 Dataframes can't be logged. Therefore the logging line is removed. 2024-01-08 21:02:46 +01:00
Philipp a2497d8ae6 Fixing the local sqlite connection. 2024-01-08 20:55:42 +01:00
Philipp fa9b2b8a5e Removed a debugging line 2024-01-08 19:01:56 +01:00
Philipp 193db130f8 Removed auto assignment of maintenance actions. 2024-01-08 18:59:40 +01:00
Philipp 894c140ba1 Removed plotlyjs logo from plots (#538) 2024-01-08 18:57:51 +01:00
Philipp f8b27fafcc Added a docs section about the Webserver and its Settings (#509) 2024-01-07 17:45:45 +01:00
Philipp bf75e320da Update documentations/Ergebnisse/Abschlussbericht_und_Praesentation/PhHo/04-data-visualisation-container.md 2024-01-07 14:32:44 +01:00
Philipp ff2fd77c5d Added a section about the Webserver and its Settings 2024-01-07 14:32:44 +01:00
Philipp 6f60b0fb6d Moved absa to dev dependencies (#537) 2024-01-07 13:06:13 +00:00
PhilippandTristan Nolde 04bcc3c458 Readme text on how to enable dependabot & actions (#519) 
Added texts and images that show how dependabot and actions should be
updated.

---------

Co-authored-by: Tristan Nolde <tristan.nolde@yahoo.de>
 2024-01-07 12:39:35 +00:00
Philipp 6568b02f3a Removed the edge color extra definition (#532) 2024-01-06 18:29:50 +01:00
Philipp e966bead37 Reformatting contributing.md (#523) 2024-01-05 16:05:48 +01:00
Philipp e8c27d0954 Removed a copy past error (#525) 2024-01-05 10:57:19 +01:00
Philipp 9ea3771f18 A lot of spelling (#512) 2024-01-04 18:01:59 +01:00
Philipp b2e6ada264 Spellchecking and weekly number to meeting note (#522) 
Spellchecking and weekly number to meeting note
 2024-01-04 17:43:34 +01:00
PhilippandTristan Nolde f645e2ec4b Added a section on startup in the README.md (#507) 
Reworked the index.md
- removed commented out text

Minor restructuring of the README.md

---------

Co-authored-by: Tristan Nolde <tristan.nolde@yahoo.de>
 2024-01-03 18:31:01 +01:00
Philipp 6e0247c58c Added docs on FK and PK (#504) 2024-01-03 18:30:35 +01:00
Philipp 797dd165a8 Switched the container default to log level info (#510) 2024-01-03 18:03:24 +01:00
Philipp 25f2dc5939 Added favicon to docs. (#511) 2024-01-03 18:00:15 +01:00
Philipp e79aa65781 Added transparency gpt as logo (#514) 2024-01-03 13:51:56 +01:00
Philipp 259f037dcb Removed an old test marker (#506) 2024-01-02 10:35:12 +00:00
Philipp 734d27393d fix for missing images (#502) 2024-01-02 11:27:11 +01:00
PhilippSebastianTristan Nolde
 		daffcadd11 Seminararbeit DevOps & CI/CD (#486) 
Co-authored-by: Sebastian <94404394+SeZett@users.noreply.github.com>
Co-authored-by: Tristan Nolde <tristan.nolde@yahoo.de>
 2024-01-01 14:26:05 +01:00
Philipp 923d5eec9f Added some -es 2023-12-31 17:21:41 +01:00
Philipp abbf565557 Added a note on when the code is executed and sql-schema versioning. 2023-12-31 17:21:41 +01:00
Philipp 3e0c2d055a Added a todo 2023-12-31 17:21:41 +01:00
Philipp 98d1edc807 Renamed the schema 2023-12-31 17:21:41 +01:00
Philipp 81d5abbf24 Added a Database Generator 2023-12-31 17:21:41 +01:00
Philipp a833439ba7 Added a test-db.drawio diagram 2023-12-31 17:21:41 +01:00
Philipp 27a6bce545 Added a file about the 2023-12-31 17:21:41 +01:00
PhilippandTristan Nolde 7e05792634 Refactored the index.rst (#497) 
Reworked the index.rst as requested in our meeting.
Made drawio background transparent.
Minor tweaks.

---------

Co-authored-by: Tristan Nolde <tristan.nolde@yahoo.de>
 2023-12-31 16:02:57 +01:00
Philipp b7cdfa6fa3 Simplified the index.rst (#492) 
- removed a line of test text
- Limited the automodule Toctree
 2023-12-27 21:07:25 +01:00
Philipp 9777b75409 Short text on how devops developed in the course of the project (#490) 2023-12-27 20:59:10 +01:00
Philipp 8b405c9187 Reworked the documentation action (#477) 2023-12-27 12:59:56 +01:00
Philipp 0a72f0ce69 Removing the ruff version number from the actions (#487) 
This does not need to be maintained manually.
Just use latest!
Latest ist greates!
 2023-12-27 11:32:15 +00:00
Philipp 77dd1ffb27 Spellcheking / formating / weekly counter (#475) 2023-12-27 12:30:12 +01:00
Philipp 6fa0f838ea Updates to everything (#488) 2023-12-27 12:28:46 +01:00
Philipp 2bc477d384 Reconfigureing the dependabot limits (#491) 
Setting the pip lmits to 10 since we idel often with 5 open PRs.
 2023-12-27 12:28:26 +01:00
Philipp 71c929cda8 Renamed some artifacts (#489) 
Renamed some artifacts and other minor tweaks to the test & build
workfow
 2023-12-27 10:59:02 +00:00
Philipp 2235987834 Renamed the artifact to have a sensible name (#485) 2023-12-26 12:17:43 +01:00
Philipp 6ccf2ffd17 Reworked the options creation (#464) 
Fixed the bug
 2023-12-23 21:19:36 +01:00
Philipp 43e66e28f6 Merge pull request #476 
* Removed the git changes since dependabot utterly overflows that and b…
 2023-12-21 21:52:22 +01:00
Philipp e846bba576 Removed some packages and moved some to the dev dependencies. (#467) 2023-12-20 11:10:20 +01:00
Philipp cf1f043291 Downgraded the artifact download in pages (#465) 
V4 artifact download can't download v2 pages artifacts download
 2023-12-17 13:19:59 +01:00
Philipp fd16ed6752 Artifact upgrade v4 (#463) 2023-12-15 16:46:52 +01:00
Philipp d1736db653 Removed the title length limit for news articles (#457) 2023-12-14 17:14:24 +00:00
Philipp 3b6ee329e4 Edit eol for sh files (#456) 2023-12-14 18:08:10 +01:00
Philipp 7dbf674eae Starting the container with tini for more stability (#452) 2023-12-14 17:11:01 +01:00
Philipp 319ca3b8ad Added redirection callbacks to the person and the company page. (#423) 2023-12-04 19:11:22 +01:00
Philipp 5969929f79 Potential fix. (#427) 
I have looked up the error and found an potential fix.
I could not reproduce the error afterwords so it should work.
 2023-11-30 17:22:31 +01:00
Philipp 9c60d01985 Simplifications (#416) 2023-11-30 17:21:19 +01:00
Philipp 6890562a18 Simplified some functions. (#414) 2023-11-26 14:01:12 +00:00
Philipp 0672773551 Ner simplifications (#419) 2023-11-25 16:53:10 +01:00
Philipp 65c41bb20c Added translations to the search que page and the about page. (#407) 2023-11-22 21:48:35 +01:00
Philipp 762d3f9091 Add flask-compress (#409) 
Added flask compression for compressed responsed to limit the download
time of plots.
I switch this on by default. It could also be crontoled via
DASH_COMPRESS as an env variable.
 2023-11-20 21:12:07 +01:00
Philipp 36f2d653b1 Added links (#406) 
Added links into the plot.
When clicking on the plot on the main page a redirect is implemente the
the matching detailpage.
 2023-11-20 20:06:51 +00:00
Philipp cf1c8ea508 Fixed the layout dropdown for the graph. (#393) 2023-11-16 17:43:54 +01:00
Philipp e257799f77 Fixed initial layout of homepage. (#388) 2023-11-16 17:26:02 +01:00
Philipp ce1598c42e Removed double execution of Layouting in 2 and 3d. (#385) 
Prior to layouting the sping layout was allways calculated and later
overwritten. (Double execution)
 2023-11-16 17:25:15 +01:00
PhilippandTristan Nolde 96d216fb74 Added a web-frontend to add companies to the search queue. (#375) 
This webfrontent adds a company to the search que or resets the search
que entry to be searched again.
This will allow for directed growth or an initiallisation.

---------

Co-authored-by: Tristan Nolde <tristan.nolde@yahoo.de>
 2023-11-16 17:24:43 +01:00
PhilippandKM-R 0d4d1324d0 Simplification of layout selection (#384) 
Removed the 2d/3d toggle and added that option into the layout dropdown.

---------

Co-authored-by: KM-R <129882581+KM-R@users.noreply.github.com>
 2023-11-14 21:31:30 +00:00
Philipp e7278c047e Fixed edge thickness (#370) 2023-11-14 19:32:32 +01:00
Philipp 4e63c6e907 Added rounding on Metric table to 6 digits to limit the noise (#386) 
Currently to many digits are shown in the Metrics table. Rounding to 6
digits should be a bit better.
 2023-11-14 17:49:48 +01:00
Philipp 119a3edfca Fixed sql alchemy reset order. (#383) 
There was a problem on the PG variant.
The SQLite variant worked. Now resetting properly also on PG.
 2023-11-14 17:44:24 +01:00
Philipp 7c1fac28fd Fixed tqdm typos. (#382) 2023-11-14 17:42:38 +01:00
Philipp 0c4a2d7a74 Moved transparenzregister url prefix to docker compose. (#380) 2023-11-13 20:08:50 +01:00
Philipp 2da3e6cea0 Removed the unused colorscale legend and other unused code fragements (#371) 2023-11-13 19:28:57 +01:00
Philipp 31221a1055 Fixed spagetti connection by adding breaks. (#366) 2023-11-13 19:27:03 +01:00
Philipp d0677287b6 Added a filter for financial reports. (#372) 
Finanical reports are now filtered before beeing added to the SQL
database to only added knwon keys.
Some matching is also done.
The most importend missing reports are printed to be implemented later
on.
Rapidfuzz could be used.
 2023-11-13 18:52:12 +01:00
Philipp 41bee38bf7 Print the actor in the maintenance action (#377) 2023-11-13 13:07:45 +01:00
Philipp af8a907cf9 Stop table reset of better persistent tables. (#373) 2023-11-12 14:27:44 +01:00
Philipp 19a4460d90 Added a small stability fix. (#374) 
The current code has problems with an empty db.
 2023-11-12 14:14:15 +01:00
Philipp 24c55c68b7 Removed docstring ruins. (#367) 2023-11-12 13:58:00 +01:00
Philipp 905021af14 Experimental caching (#285) 
Added some caching decoraterors to speedup page delivery.
 2023-11-11 14:28:25 +01:00
PhilippandSeZett 066800123d Created pipeline to run ner sentiment and sql ingest (#314) 
Created a dataprocessing pipline that enhances the raw mined data with
Organsiation extractions and sentiment analysis prio to moving the data
to the sql db.
The transfer of matched data is done afterword.

---------

Co-authored-by: SeZett <zeleny.sebastian@fh-swf.de>
 2023-11-11 13:28:12 +00:00
Philipp e5b61bc19c Added multi relation dropdowns to dashbord (#363) 
This change allows for a more complete combination of relation
combinations to be filtered.
 2023-11-11 13:47:46 +01:00
Philipp ad8f5d0fb1 Added github actions automerge for pre-commit updates. (#362) 2023-11-11 13:30:16 +01:00
Philipp 4716eb9fe2 Added a frist rollback function on a pending Rollback error. (#346) 
Possible fix for #341.
Rolls back stuck SQL sessions.
This only helps against the symptomps not the cause.
 2023-11-09 19:48:26 +00:00
Philipp 97fc7f01b5 Added some redirects to home page. (#348) 2023-11-09 19:06:36 +01:00
Philipp 3ce49c9e19 Added requirements.txt to gitignore (#347) 2023-11-09 18:38:42 +01:00
Philipp fe02b0f6c5 Added an error handling when the sql session crashes in process on network connection lost. (#352) 2023-11-09 18:38:04 +01:00
Philipp 12f40af538 Added pagination, sorting and filtering for the table of related persons. (#333) 
Added pagination, sorting and filtering for the table of related
persons.
 2023-11-07 22:19:36 +01:00
Philipp 16b975a0f4 Hide the plotly logo in graph objects (#339) 2023-11-07 22:16:27 +01:00
Philipp 97b05bacf4 Added a custom favicon. (#338) 2023-11-07 22:15:08 +01:00
Philipp aec7414e69 Removed the background color of plotly plot. (#334) 
Removed the background color of the plot to fully use the plotly_white
layout.
 2023-11-07 15:55:50 +01:00
Philipp d79bc0f267 Added poetry install to the pre-commit hooks. (#332) 
Limiting most pre-commit hooks to the pre-commit stage.
 2023-11-06 21:58:33 +01:00
Philipp 4323522b96 Added poetry install to the pre-commit hooks. (#329) 2023-11-06 20:02:29 +01:00
Philipp 2fddc9149a Reduced the number of times the dependabot auto merge is triggered. (#318) 2023-11-03 21:25:55 +01:00
Philipp ad36c68993 Moved the AI tests into the AI folder. (#315) 2023-11-03 13:45:24 +01:00
Philipp a638949644 Added a types package and upgraded poetry. (#313) 2023-11-02 22:13:32 +01:00
Philipp d40746c69b Used black on jupyter. (#312) 2023-11-02 20:52:46 +00:00
Philipp 8d9981d967 Moved AI files in the AI module. (#308) 2023-11-02 20:30:04 +01:00
Philipp 389810c9bc Update and rename dependabot-approve.yaml to dependabot-auto-merge.yaml 2023-11-01 18:21:56 +01:00