Develop system to integrate raw data converter scripts

Created on Friday 26 August 2022, 19:26

Back to task list
  • ID
    1011261
  • Project
    Metabolism of Cities Data Hub
  • Status
    Open
  • Priority
    Medium
  • Type
    Programming work
  • Tags
    General data hub improvements
  • Assigned to
    Paul Hoekman
  • Subscribers
    Paul Hoekman

You are not logged in

Log In Register

Please join us and let's build things, together!

Description

When data are being uploaded repeatedly from the same source, and significant reformatting of data is needed in order for our system to read this, then this creates quite a hurdle for a user to update data. It would be very helpful if we allow users to write a script that reformats data, and that this script is automatically being run when data of a specific dataset is being updated.

We might want to make use of e.g. Jupyter notebooks which are quite user-friendly. Or direct python code? Let's see what the best approach would be.

Discussion and updates


New task was created


Task was assigned to Paul Hoekman