Comments (5)
The TCD-TIMIT dataset website is not managed by me and I am not quite sure who is in charge of it.
If you registered using your academic email address, then you have done your part well.
There is a manual verification step on the admin side that sometimes makes the whole process take more time than a researcher actually requires. I will try to find out who validates the accounts and let them know of the pending requests.
from avsr-tf1.
Ok , I got it. Thank you very much. I am very grateful for your help.
from avsr-tf1.
And I have another problem that if I can't get the TIMIT dataset, how can I preprocess my own dataset to the format of your model input? can u provide me the detail steps?
from avsr-tf1.
I have forwarded your request two days ago and I hope it will get solved timely.
We don't have one fixed model with input restrictions, and the API is quite flexible in allowing you to define the pre-processing steps on your own.
Personally I use the OpenFace toolkit to detect and align the face track in a video, and this is the Python script: extract_faces.py
The AVSR class is designed to take paths to binary datasets in Tensorflow's TFRecord format. We designed a TFRecordWriter class that does this for you, please have a look at its three methods write_labels_records
, write_audio_records
and write_bmp_records
(last one takes the .bmp output of OpenFace), and also at this script for an example.
If by "our model" you refer to the attention-based audio-visual speech alignment strategy presented at the ICMI conference, the essence should be the principle (frame-level alignment while still encoding), not necessarily the precise architecture we used. We know there are many combinations that don't work and several that do, and we're still studying this aspect. I strongly encourage you to try your own "flavours" and datasets, so we could learn more about this task.
from avsr-tf1.
I am closing this issue for the lack of activity, but please feel free to re-open if there is something else I could help with.
from avsr-tf1.
Related Issues (20)
- Inquiry about some parameter selection reason HOT 5
- awgn: out of bounds when sampling noise clip HOT 1
- [AMSGrad] get running error in audio only training HOT 3
- How do I change loss function to CTC?? HOT 2
- [feature] minimum data length for stack log mel feature HOT 2
- visemes and phonemes mapping HOT 1
- How many epochs should i train? HOT 2
- How can i change this av_align model for applying to audio2video?
- What should I do to reproduce the results of the paper? HOT 5
- How can I solve this problem HOT 6
- Inquiry about aus csv generation HOT 2
- What do the folders speaker-dependence and speaker-independence stand for? HOT 2
- How to run this program on multiple GPUs HOT 5
- The tfrecord files HOT 8
- use video-only on LRS2 HOT 1
- The result in noisy environment HOT 6
- KeyError: 'aus' when running run_audiovisual.py HOT 2
- how to pad features and labels to same length in one batch ? HOT 1
- Ask about epochs and learning rate HOT 1
- ask about the results HOT 9
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from avsr-tf1.