Commit Graph
56 Commits
Author SHA1 Message Date
Sebastian Lenzlinger c4a139c6ef Add instructions to wiki.md.
Instructions how to load csv into db manually since script might not work because of access rights restrictions.
2024-01-05 19:09:47 +01:00
Sebastian Lenzlinger 758bfa45f3 SYNC COMMIT 2024-01-05 19:05:09 +01:00
Sebastian Lenzlinger 7ae7d486f1 Fix HeatMap and HeatMapTime. We now generate correct html maps. 2024-01-05 18:14:38 +01:00
Sebastian Lenzlinger 0605036052 SYNC COMMIT 2024-01-05 16:46:35 +01:00
Sebastian Lenzlinger d563a0af0b SYNC COMMIT 2024-01-05 16:43:05 +01:00
Sebastian Lenzlinger 915066f735 Merge remote-tracking branch 'origin/sebl' into sebl 2024-01-05 16:03:21 +01:00
Sebastian Lenzlinger 033e66849e Small refactor of map.py. 2024-01-05 16:02:19 +01:00
Sebastian Lenzlinger 617cd2d1f4 Small refactor of map.py. 2024-01-05 15:45:39 +01:00
Sebastian Lenzlinger 0f73f829aa Fix map.py.
Issue: No datapoints where displayed.
2024-01-05 15:44:00 +01:00
Sebastian Lenzlinger 3c00de0afb Refactor map.py 2024-01-05 14:42:05 +01:00
Sebastian Lenzlinger 685a5cf2d3 Merge remote-tracking branch 'origin/sebl' into sebl 2024-01-05 13:52:41 +01:00
Sebastian Lenzlinger cd6746d0ea Add Heat Map Generation 2024-01-05 13:52:23 +01:00
Sebastian Lenzlinger 40adf8a397 Add Heat Map Generation 2024-01-05 13:52:04 +01:00
Sebastian Lenzlinger 7c58cfc335 Fix 2 Add comments to setup_tables.sql 2024-01-04 18:37:16 +01:00
Sebastian Lenzlinger 200d913fa9 Fix 2 setup_tables.sql 2024-01-04 18:27:41 +01:00
Sebastian Lenzlinger 27c5ca1587 Fix setup_tables.sql 2024-01-04 18:26:36 +01:00
Sebastian Lenzlinger 6af1f734ef SYNC COMMIT 2024-01-04 18:20:55 +01:00
Sebastian Lenzlinger 843ed0a1a3 SYNC COMMIT 2024-01-04 16:18:28 +01:00
Sebastian Lenzlinger 4c5e7e1251 Hot Fix and add tester.ipynb. 2024-01-04 16:03:04 +01:00
Sebastian Lenzlinger 4523b3d8e5 Update .gitignore. 2024-01-04 15:47:54 +01:00
Sebastian Lenzlinger 92e54174cc Add db_connector.py body and beginnings of map.py. As well as config_example.py to use as central source of truth for connection credentials. 2024-01-04 15:47:00 +01:00
Sebastian Lenzlinger 0d9e71618d Update requirements.txt.
Begin Analysis.
2024-01-03 15:50:55 +01:00
Sebastian Lenzlinger 994b9ce7d0 Fix implicit boolean conversion bug for integrate.py when integrating accident data. FIXES: Non empty strings are all converted to true when using bool() constructor, so 'true' and 'false' become True regardelss. 2024-01-03 15:34:50 +01:00
Sebastian Lenzlinger 5b41db5e7e Add logger statements and first plays with accident data in notebook. 2024-01-03 13:49:01 +01:00
Sebastian Lenzlinger b9ee59e4ae Modification to make scripts run on server 2024-01-02 15:53:22 +01:00
Sebastian Lenzlinger 49bb3f4e20 Data Integration Milestone Completed.
Refactored ensuring all relevant dirs exist into separate script.
2023-12-03 23:53:36 +01:00
Sebastian Lenzlinger e9b1d82517 FINAL TOUCH: Add functions to get data from api link.
Refactor bash script into python function to ensure portability.
Add sql queries to create "Contemporaneous" db table.
2023-12-03 22:52:20 +01:00
Sebastian Lenzlinger b79ee792b6 Preliminary: Completed Integration Scripts. Add scripts that load data into a database of choice. Some config is still manual. 2023-12-03 21:40:29 +01:00
Sebastian Lenzlinger fcfb3f028b Intermediate Commit 2023-12-03 20:46:54 +01:00
Sebastian Lenzlinger 45b4f7b998 Merge remote-tracking branch 'origin/dev-explore' into dev-explore
# Conflicts:
#	src/integrate.py
#	src/setup_tables.sql
2023-12-03 19:27:35 +01:00
Sebastian Lenzlinger 39b28a4b65 Merge remote-tracking branch 'origin/dev-explore' into dev-explore
# Conflicts:
#	src/integrate.py
#	src/setup_tables.sql
2023-12-03 19:27:02 +01:00
Sebastian Lenzlinger dcf921292b Merge remote-tracking branch 'origin/dev-explore' into dev-explore
# Conflicts:
#	src/integrate.py
#	src/setup_tables.sql
2023-12-03 17:37:07 +01:00
Sebastian Lenzlinger 90a38b1bb5 Drop duplicates in unified miv csv. 2023-12-03 17:36:29 +01:00
Sebastian Lenzlinger 920f725d74 Drop duplicates in unified miv csv. 2023-12-03 17:05:09 +01:00
Sebastian Lenzlinger c33ca87aaf UNFINNISHED: Script to create csv of integrated and clean datasets. 2023-12-03 16:34:40 +01:00
Sebastian Lenzlinger 1ef7bbe39b Convert MIV coordinate to Int 2023-12-03 13:37:11 +01:00
Sebastian Lenzlinger 94ee3cc3b0 ADD ID to fb. 2023-12-03 13:18:01 +01:00
Sebastian Lenzlinger 65bd9480e7 Load accident file from internet if not present. 2023-12-03 12:35:38 +01:00
Sebastian Lenzlinger 0afab39397 Merge remote-tracking branch 'origin/dev-explore' into dev-explore
# Conflicts:
#	src/data_utils.py
#	src/integrate.py
2023-12-03 12:30:26 +01:00
Sebastian Lenzlinger ca3450a4de Add logger. 2023-12-03 12:30:15 +01:00
Sebastian Lenzlinger e4d0484a23 Add logger. 2023-12-03 12:28:32 +01:00
Sebastian Lenzlinger e73962d8e1 + 2023-12-03 11:48:32 +01:00
Sebastian Lenzlinger cd0bb639ca Merge remote-tracking branch 'origin/dev-explore' into dev-explore 2023-12-03 11:48:19 +01:00
Sebastian Lenzlinger 793b783dd9 + 2023-12-03 11:48:11 +01:00
Sebastian Lenzlinger 983f85b116 Fix requirements.txt 2023-12-03 11:45:00 +01:00
Sebastian Lenzlinger 250e13acba Fix requirements.txt 2023-12-03 11:44:42 +01:00
Sebastian Lenzlinger b6715a0ff1 UNFINNISHED: Commit for Syncing Repos 2023-12-03 01:09:32 +01:00
Sebastian Lenzlinger 101243fae8 Add test notebook for debugging on different machine 2023-12-03 00:28:25 +01:00
Sebastian Lenzlinger e07932a113 UNFINNISHED: Add data integration scripts. 2023-12-02 22:26:13 +01:00
Sebastian Lenzlinger 77bf140efc Add Text File containing relevant datasource urls.
First diary entries written.
Wiki entries on how to setup a python virtual env for the project
2023-12-02 22:10:30 +01:00
Sebastian Lenzlinger 653c3341ce Add Text File containing relevant datasource urls.
First diary entries written.
Wiki entries on how to setup a python virtual env for the project
2023-11-16 18:40:55 +01:00
Sebastian Lenzlinger 8cf5940a4d Add Text File containing relevant datasource urls.
First diary entries written.
Wiki entries on how to setup a python virtual env for the project
2023-11-16 18:04:10 +01:00
Sebastian Lenzlinger 552b49f118 Add Text File containing relevant datasource urls.
First diary entries written.
Wiki entries on how to setup a python virtual env for the project
2023-11-16 17:59:10 +01:00
Sebastian Lenzlinger b47ee9ea1d Add Text File containing relevant datasource urls 2023-11-16 16:49:10 +01:00
Sebastian Lenzlinger b29ce4278c Add Data Exploration Notebook. 2023-11-15 14:04:39 +01:00
Sebastian Lenzlinger 22a72aea6c Add a diary and a wiki document. 2023-11-07 13:46:35 +01:00