The lmtool-fwp's discuss from idsia

lmtool-fwp's Issues

cannot run example with python 3.10 and pytorch1.11 in a virtual environment

I cannot run the provided example. The code depends on a very old version of pytorch (1.4), I had to install 1.11, and tried to run it inside a python virtual environment. This however seems to be preventing the import of the jit compiled module, and I get instead these errors:

     Loading extension module fast_weight_forward... 
Traceback (most recent call last):
  File "<...redacted>/lmtool-fwp/src/train.py", line 18, in <module>
    from model_main import MemTransformerLM
  File "<...redacted>/lmtool-fwp/src/model_main.py", line 19, in <module>
    from utils.cuda_fast_weight_layer import CudaFastWeightLinearTransformerLayer
  File "<...redacted>/lmtool-fwp/src/utils/cuda_fast_weight_layer.py", line 9, in <module>
    from utils.fast_fast_weight import fast_weight_delta
  File "<...redacted>/lmtool-fwp/src/utils/fast_fast_weight/__init__.py", line 17, in <module>
    mod_causal_dot_product_cuda = load(
  File "<...redacted>/lmtool-fwp/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1144, in load
    return _jit_compile(
  File "<...redacted>/lmtool-fwp/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1382, in _jit_compile
    return _import_module_from_library(name, build_directory, is_python_module)
  File "<...redacted>/lmtool-fwp/env/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1776, in _import_module_from_library
    assert isinstance(spec.loader, importlib.abc.Loader)
AttributeError: module 'importlib' has no attribute 'abc'. Did you mean: '_abc'?

Do you have any insight on how to proceed?

Recommend Projects