Right now, it's not possible to install array_record on M2 Macs (got here via this repo being a dependency of keras_cv).

Are there any plans to add MacOS support? There's this pull request but I seems to be abandoned.

how to compile the array_record_module.cc file running in the python directory.

Right now the wheels are published as array_record-0.4.0-py310-none-any.whl ; which gets them installed on linux arm64 even though they provide x86 binaries.

This blocks tensorflow-datasets on Python 3.12 from being installed. Is there any way to get the wheels released?

Hi, I am having trouble using this package on Apple Silicon (M2) due to the shared library file array_record_module.so.

Specifically I have the following error on Python 3.9.16 with array-record==0.2.0:

>>> from array_record.python import array_record_module
ImportError: dlopen(/Users/rp.eloff/.pyenv/versions/test-array-record-py39/lib/python3.9/site-packages/array_record/python/array_record_module.so, 0x0002): tried: '/Users/rp.eloff/.pyenv/versions/test-array-record-py39/lib/python3.9/site-packages/array_record/python/array_record_module.so' (not a mach-o file), '/System/Volumes/Preboot/Cryptexes/OS/Users/rp.eloff/.pyenv/versions/test-array-record-py39/lib/python3.9/site-packages/array_record/python/array_record_module.so' (no such file), '/Users/rp.eloff/.pyenv/versions/test-array-record-py39/lib/python3.9/site-packages/array_record/python/array_record_module.so' (not a mach-o file), '/Users/rp.eloff/.pyenv/versions/3.9.16/envs/test-array-record-py39/lib/python3.9/site-packages/array_record/python/array_record_module.so' (not a mach-o file), '/System/Volumes/Preboot/Cryptexes/OS/Users/rp.eloff/.pyenv/versions/3.9.16/envs/test-array-record-py39/lib/python3.9/site-packages/array_record/python/array_record_module.so' (no such file), '/Users/rp.eloff/.pyenv/versions/3.9.16/envs/test-array-record-py39/lib/python3.9/site-packages/array_record/python/array_record_module.so' (not a mach-o file)

I assume this is due to array_record_module.so being built for linux. Would it be possible to support Apple Silicon in the build process?

The main motivation for this is that tfds is dependent on array-record since this commit tensorflow/datasets@f2aa83d.

The complete issue:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/rp.eloff/.pyenv/versions/test-array-record-py39/lib/python3.9/site-packages/tensorflow_datasets/__init__.py", line 43, in <module>
    import tensorflow_datasets.core.logging as _tfds_logging
  File "/Users/rp.eloff/.pyenv/versions/test-array-record-py39/lib/python3.9/site-packages/tensorflow_datasets/core/__init__.py", line 22, in <module>
    from tensorflow_datasets.core import community
  File "/Users/rp.eloff/.pyenv/versions/test-array-record-py39/lib/python3.9/site-packages/tensorflow_datasets/core/community/__init__.py", line 18, in <module>
    from tensorflow_datasets.core.community.huggingface_wrapper import mock_builtin_to_use_gfile
  File "/Users/rp.eloff/.pyenv/versions/test-array-record-py39/lib/python3.9/site-packages/tensorflow_datasets/core/community/huggingface_wrapper.py", line 31, in <module>
    from tensorflow_datasets.core import dataset_builder
  File "/Users/rp.eloff/.pyenv/versions/test-array-record-py39/lib/python3.9/site-packages/tensorflow_datasets/core/dataset_builder.py", line 34, in <module>
    from tensorflow_datasets.core import dataset_info
  File "/Users/rp.eloff/.pyenv/versions/test-array-record-py39/lib/python3.9/site-packages/tensorflow_datasets/core/dataset_info.py", line 47, in <module>
    from tensorflow_datasets.core import file_adapters
  File "/Users/rp.eloff/.pyenv/versions/test-array-record-py39/lib/python3.9/site-packages/tensorflow_datasets/core/file_adapters.py", line 29, in <module>
    from array_record.python import array_record_module
ImportError: dlopen(/Users/rp.eloff/.pyenv/versions/test-array-record-py39/lib/python3.9/site-packages/array_record/python/array_record_module.so, 0x0002): tried: '/Users/rp.eloff/.pyenv/versions/test-array-record-py39/lib/python3.9/site-packages/array_record/python/array_record_module.so' (not a mach-o file), '/System/Volumes/Preboot/Cryptexes/OS/Users/rp.eloff/.pyenv/versions/test-array-record-py39/lib/python3.9/site-packages/array_record/python/array_record_module.so' (no such file), '/Users/rp.eloff/.pyenv/versions/test-array-record-py39/lib/python3.9/site-packages/array_record/python/array_record_module.so' (not a mach-o file), '/Users/rp.eloff/.pyenv/versions/3.9.16/envs/test-array-record-py39/lib/python3.9/site-packages/array_record/python/array_record_module.so' (not a mach-o file), '/System/Volumes/Preboot/Cryptexes/OS/Users/rp.eloff/.pyenv/versions/3.9.16/envs/test-array-record-py39/lib/python3.9/site-packages/array_record/python/array_record_module.so' (no such file), '/Users/rp.eloff/.pyenv/versions/3.9.16/envs/test-array-record-py39/lib/python3.9/site-packages/array_record/python/array_record_module.so' (not a mach-o file)

So I am trying to use the mediapipe-model-maker which needs the tensorflow_datasets package and this package uses this package (array-record) and I am getting this error while running the code:
Traceback (most recent call last):
File "C:\venv\lib\site-packages\mediapipe_model_maker_init_.py", line 17, in
from mediapipe_model_maker.python.vision import image_classifier
File "C:\venv\lib\site-packages\mediapipe_model_maker\python\vision\image_classifier_init_.py", line 16, in
from mediapipe_model_maker.python.vision.image_classifier import dataset
File "C:\venv\lib\site-packages\mediapipe_model_maker\python\vision\image_classifier\dataset.py", line 21, in
import tensorflow_datasets as tfds
File "C:\venv\lib\site-packages\tensorflow_datasets_init_.py", line 43, in
import tensorflow_datasets.core.logging as tfds_logging
File "C:\venv\lib\site-packages\tensorflow_datasets\core_init.py", line 22, in
from tensorflow_datasets.core import community
File "C:\venv\lib\site-packages\tensorflow_datasets\core\community_init_.py", line 18, in
from tensorflow_datasets.core.community.huggingface_wrapper import mock_builtin_to_use_gfile
File "C:\venv\lib\site-packages\tensorflow_datasets\core\community\huggingface_wrapper.py", line 31, in
from tensorflow_datasets.core import dataset_builder
File "C:\venv\lib\site-packages\tensorflow_datasets\core\dataset_builder.py", line 34, in
from tensorflow_datasets.core import dataset_info
File "C:\venv\lib\site-packages\tensorflow_datasets\core\dataset_info.py", line 47, in
from tensorflow_datasets.core import file_adapters
File "C:\venv\lib\site-packages\tensorflow_datasets\core\file_adapters.py", line 29, in
from array_record.python import array_record_module
ImportError: cannot import name 'array_record_module' from 'array_record.python' (C:\venv\lib\site-packages\array_record\python_init_.py)

Hi a support for python 3.11 would be great. Currently, new version of tensorflow_datasets cannot be run with python 3.11 because array_record is not compiled to support that.

Can we have wheels for windows too, please? This is preventing TensorFlow datasets to be installed properly.