关于训练时梯度的问题 about vand-april-gan HOT 4 OPEN

你解决了吗？我也遇到了这个问题

from vand-april-gan.

Can you provide more detailed error information, please? I need to pinpoint the location of the error.

from vand-april-gan.

Can you provide more detailed error information, please? I need to pinpoint the location of the error.

Traceback (most recent call last):
File "train.py", line 177, in
train(args)
File "train.py", line 140, in train
loss.backward()
File "C:\Users\yzc.conda\envs\APRIL_GAN\lib\site-packages\torch_tensor.py", line 522, in backward
torch.autograd.backward(
File "C:\Users\yzc.conda\envs\APRIL_GAN\lib\site-packages\torch\autograd_init_.py", line 266, in backward
Variable._execution_engine.run_backward( # Calls into the C++ engine to run the backward pass
RuntimeError: one of the variables needed for gradient computation has been modified by an inplace operation: [torch.cuda.HalfTensor [8, 1369, 768]], which is output 0 of DivBackward0, is at version 2; expected version 1 instead. Hint: enable anomaly detection to find the operation that failed to compute its gradient, with torch.autograd.set_detect_anomaly(True).

my env: windows11, torch 2.2.2+cu121
In my env, I modified line 122 in train.py to the following and then the error disappeared

patch_tokens[layer] = patch_tokens[layer] / patch_tokens[layer].norm(dim=-1, keepdim=True)

from vand-april-gan.

fix it here

from vand-april-gan.