New task was created
Develop system to integrate raw data converter scripts
Created on Friday 26 August 2022, 19:26
Back to task list-
ID1011261
-
ProjectMetabolism of Cities Data Hub
-
StatusOpen
-
PriorityMedium
-
TypeProgramming work
-
TagsGeneral data hub improvements
-
Assigned toNo one yet
-
SubscribersPaul Hoekman
Description
When data are being uploaded repeatedly from the same source, and significant reformatting of data is needed in order for our system to read this, then this creates quite a hurdle for a user to update data. It would be very helpful if we allow users to write a script that reformats data, and that this script is automatically being run when data of a specific dataset is being updated.
We might want to make use of e.g. Jupyter notebooks which are quite user-friendly. Or direct python code? Let's see what the best approach would be.