Comments (9)
Hi @sunxin010205 , what is Mamba?
from motion-diffusion-model.
嗨,曼巴是什么?
Mamba: Linear-Time Sequence Modeling with Selective State Spaces,Mamba is a new architecture proposed for the linear complexity of transformer。
When I use mamba instead of transformer encoder, other loss is normal, only loss_q3 cannot be reduced. Do you know what the situation is? Looking forward to your early reply!
from motion-diffusion-model.
I'm not familiar with this one.
What's loss_q3?
from motion-diffusion-model.
Hi! After replacing an eight-layer Transformer encoder with Mamba, the training loss fails to decrease. Could it be that Mamba doesn't perform as effectively as the Transformer in the diffusion model? Looking forward to your response。 Here are my codes.
I tried to replace the transformer layer with other architectures and encountered the same situation as yours, where the loss is around 2.4 and cannot be reduced. May I ask if you have found a solution later on?
from motion-diffusion-model.
Hi! After replacing an eight-layer Transformer encoder with Mamba, the training loss fails to decrease. Could it be that Mamba doesn't perform as effectively as the Transformer in the diffusion model? Looking forward to your response。 Here are my codes.嗨!用Mamba替换八层Transformer编码器后,训练损失未能减少。难道曼巴在扩散模型中的表现不如Transformer有效?期待您的回复。这是我的密码
mamba.txt mdm.txt minimamba.txt loss_log.txtI tried to replace the transformer layer with other architectures and encountered the same situation as yours, where the loss is around 2.4 and cannot be reduced. May I ask if you have found a solution later on?我尝试用其他架构替换Transformer层,遇到了和你一样的情况,损耗在2.4左右,无法降低。我能问一下你后来有没有找到解决办法吗?
Sry, I have not continued this part of the work at present, but my overall loss after replacement is about 0.2. If you can find the problem, could you please tell me the solution? I have some ideas. Perhaps the original encoder layer is not suitable after replacing transformer. You can try other encoder methods.
from motion-diffusion-model.
from motion-diffusion-model.
Thank you for your reply. I am also trying to use Mamba or a combination of Mamba with the transformer to replace the transformer layer. May I ask if you have conducted any experiments combining Mamba with the transformer? 苏紫欣 @.*** 广西师范大学
感谢您的回复。我还尝试使用Mamba或Mamba与Transformer的组合来替换Transformer层。我能问一下你有没有做过将曼巴和Transformer结合的实验吗?
苏紫欣
@.***广西师范大学
…
------------------ 原始邮件 ------------------ 发件人: @.>; 发送时间: 2024年6月18日(星期二) 下午4:48 收件人: @.>; 抄送: @.>; @.>; 主题: Re: [GuyTevet/motion-diffusion-model] replace transformerencoder with mamba (Issue #199) Hi! After replacing an eight-layer Transformer encoder with Mamba, the training loss fails to decrease. Could it be that Mamba doesn't perform as effectively as the Transformer in the diffusion model? Looking forward to your response。 Here are my codes.嗨!用Mamba替换八层Transformer编码器后,训练损失未能减少。难道曼巴在扩散模型中的表现不如Transformer有效?期待您的回复。这是我的密码 mamba.txt mdm.txt minimamba.txt loss_log.txt I tried to replace the transformer layer with other architectures and encountered the same situation as yours, where the loss is around 2.4 and cannot be reduced. May I ask if you have found a solution later on?我尝试用其他架构替换Transformer层,遇到了和你一样的情况,损耗在2.4左右,无法降低。我能问一下你后来有没有找到解决办法吗? Sry, I have not continued this part of the work at present, but my overall loss after replacement is about 0.2. If you can find the problem, could you please tell me the solution? I have some ideas. Perhaps the original encoder layer is not suitable after replacing transformer. You can try other encoder methods. — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.***>
我用过4层mamba+4层transformer,loss也可以正常的降下去,而且效果还可以。我采用的一层mamba和一层transformer交替的结构,然后速度可能会比较快一点,参数量基本相同。
from motion-diffusion-model.
from motion-diffusion-model.
I'm not familiar with this one. What's loss_q3?
The logger output during training looks like this, I can't find the definition of loss_q3 in the code.
| grad_norm | 1.84 |
| loss | 1.37 |
| loss_q0 | 1.33 |
| loss_q1 | 1.21 |
| loss_q2 | 1.11 |
| loss_q3 | 1.82 |
| param_norm | 462 |
| rot_mse | 1.37 |
| rot_mse_q0 | 1.33 |
| rot_mse_q1 | 1.21 |
| rot_mse_q2 | 1.11 |
| rot_mse_q3 | 1.82 |
| samples | 64 |
| step | 0 |
from motion-diffusion-model.
Related Issues (20)
- loss function code HOT 1
- Problem of unconditioned model HOT 1
- questions about Loss Functions and Representation HOT 5
- Question about t2m_mean.py and t2m_std.npy HOT 1
- how to solve the error when run render_mesh HOT 1
- How to generate visualization mesh real time HOT 1
- About diffusion_steps 50 HOT 1
- About Render SMPL mesh HOT 1
- Why different models are used for condition c and time t? HOT 1
- About Frame control HOT 1
- How to import results into blender HOT 1
- Data pre-processing ,Optimisation algorithms for model training HOT 1
- About diffusion_steps 50 training code release HOT 1
- the evaluation of the text-to-motion task HOT 4
- About HumanAct12 Dataset Transformation HOT 3
- Performance on KIT dataset HOT 4
- After using -diffusion_steps 50?? HOT 2
- Generation working on Macbook with Python 3.11, Torch 2.5dev, Numpy 1.26.4 using MPS
- no eval file HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from motion-diffusion-model.