Can't open zarr contains which contains any other than the expected files about napari HOT 7 CLOSED

thoughts?

I actually have no memory of supporting multi-arrays at all, that's neat! 😜

I think we can be a little more proactive in the iteration — we should only iterate directories in that list comprehension. So:

for subpath is sorted(os.listdir(path))
if not subpath.startswith('.')
and os.path.isdir(path)
and (os.path.exists(os.path.join(path, '.zarray'))
     or os.path.exists(os.path.join(path, '.zgroup')))

At this point I think wrap path in a pathlib.Path to make that whole thing less of a mouthful, but you get my drift. Basically, only recurse subdirectories and only if they are actually zarr arrays or nested groups.

from napari.

for reference, in zarr-python right now, contains_group and contains_array both do what you would expect for checking if a path denotes a group or array.

Once you have a handle to a group, you can iterate over its sub-groups / sub-arrays with Group.items() (because Group is a MutableMapping, or just sub-arrays with Group.arrays, or just sub-groups with Group.groups.

Note that some of this will change in v3, but not too drastically -- e.g., we might make contains_array / contains_group take a zarr_format keyword argument, since zarr v3 and zarr v2 arrays can co-exist in the same directory.

from napari.

Great well, that should be an easy PR!

@imagejan if you are at all interested in contributing this fix yourself, let us know and we can guide you through it. Otherwise one of the core team will get to it as soon as we can!

from napari.

Is there any reason to not use the zarr-python api for listing groups and arrays here?

In zarr v3, .zarray and .zgroup are gone, and so this code will need to handle the names of the new metadata document (zarr.json). But if instead this code uses zarr-python to abstract over the names of the metadata documents, things are a lot simpler for napari, IMO

from napari.

Is there any reason to not use the zarr-python api for listing groups and arrays here?

ignorance! 😂 Since @imagejan already opened #6857 which is strictly better than the current situation, I suggest we merge that, then iterate. Thanks for the suggestion @d-v-b, that's indeed the right path forward.

from napari.

Thanks for reporting. I agree with the suggested expected behavior.
There's a couple builtins issues, looks like that part of napari needs a closer look.

from napari.

The problem code is here. It tries to read everything in the directory that doesn't start with a .. We should either try..except this and only raise later if the image is empty, or find a better way to identify the arrays than paths that don't start with a .. @jni thoughts?

from napari.