ericguo5513 / tm2t Goto Github PK

I have downloaded the HumanML3D dataset to correct dir, but could not find the 004822.npy file while 012314.npy exists.

Loading t2m_model model: Epoch 031 Total_Iter 11904
  0%|                                                                                                                                    | 0/4384 [00:00<?, ?it/s]
Traceback (most recent call last):
  File "evaluate_t2m_seq2seq.py", line 121, in <module>
    dataset = Motion2TextEvalDataset(opt, mean, std, split_file, w_vectorizer)
  File "C:\GITHERE\TM2T\data\dataset.py", line 532, in __init__
    motion = np.load(pjoin(opt.motion_dir, name + '.npy'))
  File "C:\Users\Bush\anaconda3\envs\TM2T\lib\site-packages\numpy\lib\npyio.py", line 390, in load
    fid = stack.enter_context(open(os_fspath(file), "rb"))
FileNotFoundError: [Errno 2] No such file or directory: './dataset/HumanML3D/new_joint_vecs\\004822.npy'

Hi, Thanks for your awesome work! and how to convert

to

any suggestion? Thank you.

Firstly of all, thank you for sharing such an interesting work!

I have a question on the final evaluation:
When I try the python final_evaluation_m2t.py ,
I met a error message: FileNotFoundError: [Errno 2] No such file or directory: './checkpoints/t2m/Comp_v6_KLD005/opt.txt'
I found the config name Comp_v6_KLD005 in your previous work text-to-motion.
Is there any modification I need to do to make it runable?

When I run "python final_evaluations_m2t.py", the error occurs: FileNotFoundError: [Errno 2] No such file or directory: './glove/our_vab_data.npy'

I will appreciate it if you could help me.
Traceback (most recent call last):
File "evaluate_m2t_transformer.py", line 131, in
dataset = Motion2TextEvalDataset(opt, mean, std, split_file, w_vectorizer)
File "D:\Graduate\my_direction\Text2gesture\code\TM2T-main\data\dataset.py", line 538, in init
with cs.open(pjoin(opt.m_token_dir, name + '.txt'), 'r') as f:
File "D:\ProgramData\anaconda3\envs\tm2t\lib\codecs.py", line 898, in open
file = builtins.open(filename, mode, buffering)
FileNotFoundError: [Errno 2] No such file or directory: './dataset/HumanML3D/VQVAEV3_CB1024_CMT_H1024_NRES3\004822.txt'

Hi, i can't fiind T2M_Seq2Seq_NML1_Ear_SME0_N in kit.zip ,can you help me?

HI, i can't download HumanML3D model when i use TM2T code

Hi, thank you for the great work!
I have a question about the inverse_kinematics_n
I am looking for the Inverse Kinematics (input keypoint, output quaternions) for SMPL model. May I ask if inverse_kinematics_n can be used as a SMPL.IK by setting the t2m_raw_offsets as the the T-pose offset?

When I load a SMPL model with all axis-angle np.zeros(1, 24, 3), I can convert it to quaternions (1,0,0,0).repeat(24), and extract keypoint3D by SMPL.forward() and get the T-pose offset.
Since the inverse_kinematics_n can convert keypoint3D to quaternions, I try set the t2m_raw_offsets as the the T-pose offset, and use it as input pose to caculate:
quat_params = src_skel.inverse_kinematics_np(the T-pose offset, face_joint_indx),
I expected the quat_params would be quaternions (1,0,0,0).repeat(24), but it give me
array([[ 1. , 0. , 0. , 0. ], [ 0.97018707, 0.10117273, 0.02506009, 0.21879934], [ 0.9764908 , 0.08095426, -0.02427085, -0.19830072], [ 0.19227548, 0.97177869, 0.00742641, 0.13645965], [ 0.96733868, -0.09798025, -0.02706633, -0.23221391], [ 0.97394329, -0.06727229, 0.02661659, 0.21494284], [-0.02280826, -0.9866249 , 0.12702832, -0.09957472], [ 0.99863803, 0.03256986, 0.00384251, -0.04057946], [ 0.99891472, 0.01709825, -0.00162746, 0.04329439], [ 0.98927391, 0.13215074, 0.00712388, -0.06183069], [ 0.8467989 , -0.49483883, -0.06065629, 0.18543833], [ 0.84711134, -0.50181162, 0.0676151 , -0.16129398], [ 0.99846792, 0.04506058, 0.00653788, -0.03145744], [ 0.99325216, -0.06699904, 0.02710451, -0.09070143], [ 0.98986506, -0.07060396, -0.02671974, 0.12028421], [ 0.9634037 , 0.26020402, 0.00433816, -0.06426686], [ 0.98609924, 0.02350155, 0.0062857 , -0.1643672 ], [ 0.9903416 , 0.05510591, 0.00776913, 0.12699005], [ 0.99951196, 0.02822196, -0.01334839, 0.00127889], [ 0.99990761, -0.01145354, -0.00515127, 0.00520699], [ 0.99215883, 0.02453573, -0.01576269, 0.12153636], [ 0.99276286, 0.03386558, 0.02881835, -0.11155534], [ 0.99562532, -0.03552062, 0.06299305, -0.05917664], [ 0.99824488, -0.02248499, -0.03899435, 0.03848618]]).

Is there anything I did wrongly?
Thank you!

When I use "evaluate_m2t_transformer.py" to evaluate the pretrained model on KIT dataset, it occurs this error:
No such file or directory: './dataset/KIT-ML/VQVAEV3_CB1024_CMT_H1024_NRES3/02346.txt'
I found that the "texts" folder contains a series of *.txt files, I correct the correpsonding codes about data acquisition in "dataset.py" in Line 538 (opt.m_token_dir -> opt.text_dir), it occurs this error:

When i run the command
python evaluate_t2m_seq2seq.py --name T2M_Seq2Seq_NML1_Ear_SME0_N --num_results 10 --repeat_times 3 --sample --ext sample
The output is

Traceback (most recent call last):
  File "evaluate_t2m_seq2seq.py", line 122, in <module>
    dataset = Motion2TextEvalDataset(opt, mean, std, split_file, w_vectorizer)
  File "/home/student/TM2T/data/dataset.py", line 538, in __init__
    with cs.open(pjoin(opt.m_token_dir, name + '.txt'), 'r') as f:
  File "/home/student/.conda/env/lib/python3.7/codecs.py", line 904, in open
    file = builtins.open(filename, mode, buffering)
FileNotFoundError: [Errno 2] No such file or directory: './dataset/HumanML3D/VQVAEV3_CB1024_CMT_H1024_NRES3/004822.txt' 

I have downloaded the required dataset, but there is no VQVAEV3_CB1024_CMT_H1024_NRES3 file folder in the dataset folder. I have the same problem when I run the commands in Translating motions into langauge (using test set) .What should I do to get the VQVAEV3_CB1024_CMT_H1024_NRES3 file folder？

Hi, thank you very much for sharing this intereting work.
I tried download the data HumanML3D and re-run the whole process.
While the final_evaluation meet error, the qualitative result looks very nice.

Here I want to ask some questions about the training process, which I am not sure if I did it right or not.

train_vq_tokenizer_v3.py

1. I found there is a ema and cmt opinion for quantizer, while some blog says ema is faster, may I ask if ema works better in this task?
2. When I run the train_vq_tokenizer_v3.py, I found that the max_epoch is 300, while it takes me 24 hours for about 50 epoch. If I increased the batch_size , and got a lower val_loss, will that faster the training process without hurt the performance?
3. I found that the break after 'Early Stopping!~' is comment out, is that because we need to try ckpt from longer training?

train_m2t_transformer.py

1. When I run the train_m2t_transformer.py, the val_los stop decrease after 20 mins as shown in the Fig below, is this normal? Or would be appreciated if you could provide us log file for double check... >.<
   

Thank you!