Comments (6)
Nice, I am glad it worked.
Was it something wrong with the script itself, or does it need better documentation ?
Feature pre-processing is something that I don't test very often once the .tfrecord files are written.
from avsr-tf1.
There's no problem with scripts, but I think you really need to write a more detailed document.
Or you should comment on the difference between preprocessing lrs2 and tcdtimit in scripts.
from avsr-tf1.
Hi @ThompsonDadada
Could you please provide a full log to see which part of the code raises the error ?
My best guess is that you are missing a file extension.
I will have a busy day tomorrow, and will take a closer look from the day after.
Please also try to run openface directly in the command line on a single video.
Unfortunately this external tool lacks a Python interface to make things easier.
from avsr-tf1.
Hi @georgesterpu
Thank you very much for your reply! You're right. It's really a file extension problem. I added .mp4 to each line in the text you provided, and now it works. Thanks again.
from avsr-tf1.
Sorry, I'm having trouble generating TFRecords. When executing write_records_TCD program, it will report an error. I will post it below:
Traceback (most recent call last):
File "write_records_tcd.py", line 58, in
main()
File "write_records_tcd.py", line 34, in main
test_record_name='/data/cqx/gjw/dataset/LRS2/tfrecords/characters_test_sd.tfrecord',
File "/data/cqx/gjw/git/avsr-tf1-master/avsr/dataset_writer.py", line 47, in write_labels_records
labels = _symbols_to_ints(ground_truth, unit_dict)
File "/data/cqx/gjw/git/avsr-tf1-master/avsr/dataset_writer.py", line 286, in _symbols_to_ints
ints = [unit_dict[symbol] for symbol in symbols]
File "/data/cqx/gjw/git/avsr-tf1-master/avsr/dataset_writer.py", line 286, in
ints = [unit_dict[symbol] for symbol in symbols]
KeyError: '4'
from avsr-tf1.
The default vocabulary in ./avsr/misc/character_list
only includes letters from the English alphabet and two punctuation marks. It seems that your text contains digits as well. You can either:
- update your vocabulary with all the unknown tokens (e.g. digits)
- parse and tokenise the text (e.g. convert numbers to words)
- propose something more clever
Thanks for your feedback on improving documentation. I am currently writing my thesis, but will try to find time for it in the coming weeks.
from avsr-tf1.
Related Issues (20)
- Inquiry about some parameter selection reason HOT 5
- awgn: out of bounds when sampling noise clip HOT 1
- [AMSGrad] get running error in audio only training HOT 3
- How do I change loss function to CTC?? HOT 2
- [feature] minimum data length for stack log mel feature HOT 2
- visemes and phonemes mapping HOT 1
- How many epochs should i train? HOT 2
- How can i change this av_align model for applying to audio2video?
- What should I do to reproduce the results of the paper? HOT 5
- Inquiry about aus csv generation HOT 2
- What do the folders speaker-dependence and speaker-independence stand for? HOT 2
- How to run this program on multiple GPUs HOT 5
- The tfrecord files HOT 8
- use video-only on LRS2 HOT 1
- The result in noisy environment HOT 6
- KeyError: 'aus' when running run_audiovisual.py HOT 2
- how to pad features and labels to same length in one batch ? HOT 1
- Ask about epochs and learning rate HOT 1
- ask about the results HOT 9
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from avsr-tf1.