the idea of supporting sparse data is really good. again, HDF5 supports this through what is called a chunked dataset (details).

in addition, for current inroads into cloud storage and computing, parallel hdf5 (detials) can be a huge benefit for imaging algorithms that can run in parallel.