We are looking to migrate out particle file output to a tabular output using Parquet. This will have the following benefits:
- simplifying the
particlefile.py module as particle positions can now be trivially appended
- simplify analysis of trajectories (since trajectory output isn't fundamentally n-dimensional, storing it in Zarr can be quite confusing for those doing post-processing or analysis)
- easier integration into other trajectory analysis tools
- making it easier to implement other parcels features down the line (e.g., restarting simulations)
Tasks:
Additional things to consider:
Previous attempt: #1399
FYI @oj-tooth
Keen to discuss further if people have ideas on what this should look like.
We are looking to migrate out particle file output to a tabular output using Parquet. This will have the following benefits:
particlefile.pymodule as particle positions can now be trivially appendedTasks:
Additional things to consider:
Previous attempt: #1399
FYI @oj-tooth
Keen to discuss further if people have ideas on what this should look like.