I wanted to use the mcstastox for a big file.
I wanted to load only a small set of the file so that I can debug my workflow first but it's not... possible from this loader right...?
Also I realized in case of loading a huge file, it'll be easier to work with
if we histogram the probabilities and accumulate them chunk by chunk,
so that it doesn't freeze everything in the jupyter notebook for 30 minutes.
i.e. group them by id or histogram them by (x, y) chunk by chunk and accumulate the result and then return it as a DataArray.
May I work on this...? @mads-bertelsen
So that we can add a notebook in the codeshelf using mcstastox.
I wanted to use the mcstastox for a big file.
I wanted to load only a small set of the file so that I can debug my workflow first but it's not... possible from this loader right...?
Also I realized in case of loading a huge file, it'll be easier to work with
if we histogram the probabilities and accumulate them chunk by chunk,
so that it doesn't freeze everything in the jupyter notebook for 30 minutes.
i.e. group them by id or histogram them by (x, y) chunk by chunk and accumulate the result and then return it as a DataArray.
May I work on this...? @mads-bertelsen
So that we can add a notebook in the codeshelf using mcstastox.