Comments (5)
I think the problem here is that you are not passing the input_pipeline_dev
argument, which is required. Ideally you should always have a validation set, not just a training set ;)
It's probably a good idea to throw a better error message and to make the development data optional. Will do that.
For now I guess a workaround is to just copy a small subset of your training data and use that as validation data to get around the error. Thanks for reporting.
from seq2seq.
Unfortunately the Tensorflow Experiment
class does not allow you to disable evaluation, so you need to pass an input_pipeline_dev
. I at least updated the code to throw a better error message though.
from seq2seq.
Thanks for your kindly reply! @dennybritz
from seq2seq.
Same problem. Thank you.
from seq2seq.
@dennybritz i am having the same problem but i am using both dev data as well as train set.
config.yml
`model: AttentionSeq2seq
model params:
vocab_source: ${HOME}/nil/beam/seq2seq/tmp/vocab.50k.bpe.32000.en
vocab_target: ${HOME}/nil/beam/seq2seq/tmp/vocab.50k.bpe.32000.hi
input_pipeline_train:
input_pipeline_train:
class: ParallelTextInputPipeline
params:
- source_files: ${HOME}/nil/beam/seq2seq/tmp/test.bpe.32000.en
- target_files: ${HOME}/nil/beam/seq2seq/tmp/test.bpe.32000.hi
input_pipeline_dev:
class: ParallelTextInputPipeline
params:
- source_files: ${HOME}/nil/beam/seq2seq/tmp/IITB.en-hi.bpe.32000.en
- target_files: ${HOME}/nil/beam/seq2seq/tmp/IITB.en-hi.bpe.32000.hi
train_steps: ${HOME}/nil/beam/seq2seq/tmp/train
output_dir: ${HOME}/nil/beam/seq2seq/tmp/model
'
beam.yml
model: AttentionSeq2Seq
model_params:
attention.class: seq2seq.decoders.attention.AttentionLayerBahdanau
attention.params:
num_units: 512
bridge.class: seq2seq.models.bridges.ZeroBridge
embedding.dim: 512
encoder.class: seq2seq.encoders.BidirectionalRNNEncoder
encoder.params:
rnn_cell:
cell_class: GRUCell
cell_params:
num_units: 512
dropout_input_keep_prob: 0.8
dropout_output_keep_prob: 1.0
num_layers: 2
decoder.class: seq2seq.decoders.BeamSearchDecoder
decoder.params:
rnn_cell:
cell_class: GRUCell
cell_params:
num_units: 512
dropout_input_keep_prob: 0.8
dropout_output_keep_prob: 1.0
num_layers: 2
optimizer.name: Adam
optimizer.params:
epsilon: 0.0000008
optimizer.learning_rate: 0.0001
source.max_seq_len: 50
source.reverse: false
target.max_seq_len: 50
training the set: python -m bin.train --config_paths="./example_configs/beam.yml,example_configs/train_seq2seq.yml,./config.yml"
from seq2seq.
Related Issues (20)
- speeding up inference nmt chatbot nlp
- InvalidArgumentError, Found Inf or NaN gradient(global norm). HOT 2
- Invalid argument: No OpKernel was registered to support Op 'PyFunc' HOT 4
- ValueError: Can not provide both every_secs and every_steps
- seq2seq checkpoint restore for transfer learning
- num_units is not a valid argument for BasicLSTMCell class tf 1.14 HOT 3
- KeyErrors when running pipeline test HOT 8
- Fix Google seq2seq Installation Errors
- AttributeError: module 'tensorflow.python.platform.flags' has no attribute '_FlagValues' HOT 4
- Error while executing
- tensorflow.python.framework.errors_impl.NotFoundError : Key not found HOT 2
- Error while making predictions (Testing).
- Deprecate non-standard BLEU scripts
- How to build a character based seq2seq tensorflow model for spell correction?
- Error On Setup HOT 1
- WMT 2016 En-De Download Link is broken HOT 1
- python -m unittest seq2seq.test.pipeline_test -> ModuleNotFoundError: No module named 'seq2seq' HOT 2
- ModuleNotFoundError: No module named 'tensorflow.contrib' HOT 2
- ModuleNotFoundError: No module named 'tensorflow' HOT 1
- Can I decode embedings to sequences using seq2seq? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from seq2seq.