Git Product home page Git Product logo

xmindflow / deformablelka Goto Github PK

View Code? Open in Web Editor NEW
159.0 2.0 12.0 8.12 MB

[WACV 2024] Beyond Self-Attention: Deformable Large Kernel Attention for Medical Image Segmentation

Home Page: https://arxiv.org/abs/2309.00121

Python 81.69% Shell 0.02% Jupyter Notebook 17.03% Batchfile 0.01% C++ 0.20% Cuda 1.06%
2d-segmentation 3d-segmentation deep-learning pancreas segmentation skin-lesion-segmentation synapse transformers

deformablelka's Introduction

xmindflow.github.io

deformablelka's People

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

deformablelka's Issues

OSError: [Errno 22] Invalid argument

Dear author:When I run the train_MaxViT_deform_LKA.py file, it shows OSError: [Errno 22] Invalid argument: '.\model_out\MaxViT_improved_deform_LKA_two_layer\MaxViT_improved_deform_LKA_2024-03-16 12:43:30.810350dice.png'. How can I solve it?

微信截图_20240316170856

RuntimeError: The size of tensor a (71680) must match the size of tensor b (32768) at non-singleton dimension 1

Dear author, When I want to use synapse code to train kipa22 dataset, I meet this problem. But I don't know what's wrong with this. I do not know whether there is a problem with the size format of my data, or the parameters in the code need to be modified? Thanks for your help, may be this is a easy problem, but I don't know how to dealt with it.
I processed the date just use the nnUnet's code, then I copy the processed data to this project's folder.

Traceback (most recent call last):
File "d_lka_former/run/run_training.py", line 211, in
main()
File "d_lka_former/run/run_training.py", line 195, in main
trainer.run_training()
File "/home/javier/Desktop/deformableLKA-main/3D/d_lka_former/training/network_training/d_lka_former_trainer_synapse.py", line 490, in run_training
ret = super().run_training()
File "/home/javier/Desktop/deformableLKA-main/3D/d_lka_former/training/network_training/Trainer_synapse.py", line 321, in run_training
super(Trainer_synapse, self).run_training()
File "/home/javier/Desktop/deformableLKA-main/3D/d_lka_former/training/network_training/network_trainer_synapse.py", line 485, in run_training
l = self.run_iteration(self.tr_gen, True)
File "/home/javier/Desktop/deformableLKA-main/3D/d_lka_former/training/network_training/d_lka_former_trainer_synapse.py", line 295, in run_iteration
output = self.network(data)
File "/home/javier/conda3/envs/d_lka_net_3d/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
return forward_call(*input, **kwargs)
File "/home/javier/Desktop/deformableLKA-main/3D/d_lka_former/network_architecture/synapse/d_lka_former_synapse.py", line 153, in forward
x_output, hidden_states = self.d_lka_former_encoder(x_in)
File "/home/javier/conda3/envs/d_lka_net_3d/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
return forward_call(*input, **kwargs)
File "/home/javier/Desktop/deformableLKA-main/3D/d_lka_former/network_architecture/synapse/model_components.py", line 69, in forward
x, hidden_states = self.forward_features(x)
File "/home/javier/Desktop/deformableLKA-main/3D/d_lka_former/network_architecture/synapse/model_components.py", line 56, in forward_features
x = self.stages0
File "/home/javier/conda3/envs/d_lka_net_3d/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
return forward_call(*input, **kwargs)
File "/home/javier/conda3/envs/d_lka_net_3d/lib/python3.8/site-packages/torch/nn/modules/container.py", line 139, in forward
input = module(input)
File "/home/javier/conda3/envs/d_lka_net_3d/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1130, in _call_impl
return forward_call(*input, **kwargs)
File "/home/javier/Desktop/deformableLKA-main/3D/d_lka_former/network_architecture/synapse/transformerblock.py", line 60, in forward
x = x + self.pos_embed
RuntimeError: The size of tensor a (71680) must match the size of tensor b (32768) at non-singleton dimension 1

i cant visit 3d synpase dataset

because i dont have an identification of the from identity provider 'live.com' does not exist in tenant 'Mohamed Bin Zayed University of Artificial Intelligence' and cannot access the application '00000003-0000-0ff1-ce00-000000000000'(Office 365 SharePoint Online) in that tenant. The account needs to be added as an external user in the tenant first. Sign out and sign in again with a different Azure Active Directory user account. can you change the source? thank u!

About 3D deformable convolution

what is the role of 2D/deformable_LKA/deformable_2dconvolution.py and 2D/deformable_LKA/deformable_3dconvolution.py ?
Are they python implementation of dcn? If that's the case, why you need to use D3D?

Futhermore, as far as I konwn, D3D process THW data, they don't deform at T. I can't see the any modifications to D3D's dcn library.

So how do you deform at three spatial dimension? I mean, D, H, W. Thank you very much.

Regarding the reproduction of ISIC2017 and ISIC2018

Hello author, while reproducing ISIC2018 and ISIC2018, I found a significant difference between the final results and those in your paper. May I ask if you have done any processing on the dataset, or could you upload the dataset you have processed.

maxvit_rmlp_small_rw_224_sw-6ef0ae4f.pth

Hello, while I was training the model, the system reminded me that it couldn't find the file “maxvit_rmlp_small_rw_224_sw-6ef0ae4f.pth”. How can I solve it? thanks ( :

can not find the file

Dear author:
When I run train_MaxViT_deform_LKA.py
the result:FileNotFoundError: [Errno 2] No such file or directory: './pretrained_pth/maxvit/maxvit_rmlp_small_rw_224_sw-6ef0ae4f.pth'

ERROR: Failed building wheel for D3D

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for D3D
ERROR: Could not build wheels for D3D, which is required to install pyproject.toml-based projects

I encounter when i reproduce to test 3d synpase

I find the code finally output 13 classes' results, but in inference_synpase.py, you wanna 8 classes like other papers. i wonder is the final result save in "summary.json"? and when i reproduce the code, i find inference_synpase.py didnt work , as well as write in the text. Then my final result is different from your paper, the result is in the image
图片1

Problem encountered during reproduction

Hello author, I noticed a strange phenomenon while reproducing the results of DAEFormer on the ISIC2018 dataset. After starting training on the preprocessed dataset, I noticed a gradient explosion in the loss value section. May I ask if this is caused by some issues with the code of the processed dataset
5eaf3fa7038d7c9b93bd80146179c78
a6dbd2a6b0df1868f1c716150a08810

can not find ./config_skin.yml

Hello! Thank you for resolving my issue earlier. I now realize that I ran it first but couldn't find the file. Where does it exist? Thank you very much!

Pancreas code loading state_dict for D_LKA_Net error

I followed all the steps you have including downloading the same Python and PyTorch versions for running the pancreas code.

The train_pancreas.py ran well and the weights were saved as intended. However, I am getting an error when running the test_pancreas.py and I cannot seem to fix it.

image (1)
image (2)

Deformable LKA module

Hello, I would like to know where the complete code flow of the Deformable LKA module in Figure 2 in your paper is, but I didn't find it

Cannot find the pre-trained weight file

Hello, your work is excellent, and I'm eager to delve deeper into learning. However, I encountered an issue while running the training code, which indicates that the pre-training weight file is missing.

As shown below:
FileNotFoundError: [Errno 2] No such file or directory: './pretrained_pth/maxvit/maxvit_rmlp_small_rw_224_sw-6ef0ae4f.pth'

I couldn't find this particular pre-training weight file on the code homepage. Would you mind providing it? If possible, here's my email: [email protected].

Differences

what is the differences among DeformConv, DeformConvPack, DeformConvPack_experimental,
DeformConv_d, and DeformConvPack_d?

can not find best_model.pth and best_model.pth.txt

Dear author:
Due to the poor performance of my computer, it is difficult to finish running the train_MaxViT_deform_LKA.py file.
When I run the test.py file it shows that I don't have best_model.pth and best_model.pth.txt
Do I need to run train_MaxViT_deform_LKA.py completely to obtain these two files? Or can these two files be downloaded directly?

processing 12% and then error

When training synapse data in 2D, processing 12% and then error:

Traceback (most recent call last):
File "train_MaxViT_deform_LKA.py", line 134, in
trainer[dataset_name](args, net, args.output_dir)
File "/home/sjh/mydisk/project/deformableLKA/2D/trainer_MaxViT_deform_LKA.py", line 168, in trainer_synapse
image = image_batch[1, 0:1, :, :]
IndexError: index 1 is out of bounds for dimension 0 with size 1

Who can handle this problem?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.