Hierarchical multi-label text classification of the BlurbGenreCollection using capsule networks.
Home Page: https://www.aclweb.org/anthology/P19-2045/
License: Apache License 2.0
when i run the code as your tuturial. i has some problem.can you show me your tensorflow verson of the project
WARNING:
Traceback (most recent call last):
File "main.py", line 400, in <module>
main()
File "main.py", line 299, in main
run()
File "main.py", line 321, in run
model = create_model(dev = True, preload = False)
File "main.py", line 371, in create_model
return model_capsule(dev, preload)
File "main.py", line 258, in model_capsule
args.dense_capsule_dim, args.n_channels, 3, dev)
File "/code/BlurbGenreCollection_Classification/code/networks.py", line 37, in create_model_capsule
input = inputs, use_static = use_static, voc = vocabulary, lang = language, dev = dev)
File "/code/BlurbGenreCollection_Classification/code/networks.py", line 238, in pre_embedding
trainable= trainable)(input)
File "/home/prozx/anaconda3/lib/python3.6/site-packages/keras/engine/base_layer.py", line 430, in __call__
self.set_weights(self._initial_weights)
File "/home/prozx/anaconda3/lib/python3.6/site-packages/keras/engine/base_layer.py", line 1051, in set_weights
'provided weight shape ' + str(w.shape))
ValueError: Layer weight shape (45, 300) not compatible with provided weight shape (100288, 300)
data_helpers.py", line 360, in load_data
X_train, X_dev, X_test, y_train, y_dev, y_test = data
ValueError: not enough values to unpack (expected 6, got 0)
Hi,
I'm trying to run the capsulenet classifier using the command below:
python main.py --mode train_validation --classifier capsule --lang EN --sequence_length 100 --learning_rate 0.001 --learning_decay 1
However, the create_model method throws an exception when constructing the model. The Traceback is as follows
Traceback (most recent call last):
File "main.py", line 400, in <module>
main()
File "main.py", line 299, in main
run()
File "main.py", line 321, in run
model = create_model(dev = True, preload = False)
File "main.py", line 371, in create_model
return model_capsule(dev, preload)
File "main.py", line 258, in model_capsule
args.dense_capsule_dim, args.n_channels, 3, dev)
File "/home/daan_vandennest/git/BlurbGenreCollection_Classification/code/networks.py", line 50, in create_model_capsule
name='digitcaps')(primarycaps)
File "/home/daan_vandennest/miniconda3/envs/capsnet/lib/python3.6/site-packages/keras/engine/base_layer.py", line 451, in __call__
output = self.call(inputs, **kwargs)
File "/home/daan_vandennest/git/BlurbGenreCollection_Classification/code/capsulelayers.py", line 119, in call
b += K.batch_dot(outputs, inputs_hat, [2, 3])
File "/home/daan_vandennest/miniconda3/envs/capsnet/lib/python3.6/site-packages/keras/backend/tensorflow_backend.py", line 1261, in batch_dot
'y.shape[%d] (%d != %d).' % (axes[0], axes[1], d1, d2))
ValueError: Can not do batch_dot on inputs with shapes (None, 131, 131, 2805, 16) and (None, 131, None, 2805, 16) with axes=[2, 3]. x.shape[2] != y.shape[3] (131 != 2805).
I'v made no changes to the code. The only difference is that I'm not using tensorflow-gpu, but plain tensorflow.
Do you have any idea what might be causing this?
For completeness' sake I've added the output of pip freeze below:
absl-py==0.9.0
astor==0.8.1
beautifulsoup4==4.6.0
bleach==1.5.0
blis==0.2.4
boto==2.49.0
boto3==1.12.14
botocore==1.15.14
certifi==2019.11.28
chardet==3.0.4
cycler==0.10.0
cymem==2.0.3
cysignals==1.10.2
Cython==0.29.15
decorator==4.4.2
docutils==0.15.2
en-core-web-sm==2.1.0
future==0.18.2
gast==0.3.3
gensim==3.8.0
GPy==1.9.5
GPyOpt==1.2.5
graphviz==0.8.3
grpcio==1.27.2
h5py==2.8.0
html5lib==0.9999999
idna==2.9
jmespath==0.9.5
Keras==2.2.5
Keras-Applications==1.0.8
Keras-Preprocessing==1.1.0
kiwisolver==1.1.0
Markdown==3.2.1
matplotlib==2.2.2
murmurhash==1.0.2
numpy==1.16.5
pandas==0.23.4
paramz==0.9.4
pathlib==1.0.1
pipenv==2018.11.26
plac==0.9.6
plumbum==1.6.6
preshed==2.0.1
protobuf==3.11.3
pydot==1.2.3
pyfasttext==0.4.5
pyparsing==2.4.6
python-dateutil==2.8.1
pytz==2019.3
PyYAML==5.3
regex==2017.4.5
requests==2.23.0
s3transfer==0.3.3
scikit-learn==0.19.1
scipy==1.1.0
six==1.14.0
smart-open==1.9.0
spacy==2.1.8
spyder==2.3.8
srsly==1.0.2
stop-words==2015.2.23.1
tensorboard==1.7.0
tensorflow==1.7.0
termcolor==1.1.0
thinc==7.0.8
tqdm==4.43.0
treetaggerwrapper==2.2.4
ujson==1.35
urllib3==1.25.8
virtualenv-clone==0.5.3
wasabi==0.6.0
Werkzeug==1.0.0
Soon to be released.
data_loader is unnecessarily complicated. Simplify!
I run your model, but I enounter an error, can you provide this source code:
File "main.py", line 7, in <module> from data_helpers import load_data, extract_hierarchies, remove_genres_not_level File "/home/eric/Documents/Experiments/BlurbGenreCollection_Classification/code/data_helpers.py", line 11, in <module> from comp_questions_loader import CompQ_Loader ModuleNotFoundError: No module named 'comp_questions_loader'
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
Django
The Web framework for perfectionists with deadlines.
Laravel
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft
Open source projects and samples from Microsoft.
Google
Google ❤️ Open Source for everyone.
Alibaba
Alibaba Open Source for everyone
D3
Data-Driven Documents codes.
Tencent
China tencent open source team.