pmorerio / minimal-entropy-correlation-alignment Goto Github PK
View Code? Open in Web Editor NEWCode for the paper "Minimal-Entropy Correlation Alignment for Unsupervised Deep Domain Adaptation", ICLR 2018
License: MIT License
Code for the paper "Minimal-Entropy Correlation Alignment for Unsupervised Deep Domain Adaptation", ICLR 2018
License: MIT License
Hello, @pmorerio
I got another question about the eigenvalue of cov_matrix.
As far as I understood from your paper, cov_representation is positive definite, therefore
taking a logarithm on the eigenvalues makes sense.
However, when I decompose my covariance matrices I got some negative eigenvalues which result in nan
logarithm values.
Is this expected behavior?
If so, coral_loss
can perform as well as log_coral_loss
?
I am afraid that I miss some part of your paper.
Any comments are welcome!!
Best,
Yoo
Hi ! I have re-run your code and got 90% accuracy for both log-d-coral and d-coral. Is there any missing in the code ? I just use following command:
for log-d-coral:
python main.py --mode='train' --method='log-d-coral' --alpha=1. --device='/gpu:0'
python main.py --mode='test' --method='log-d-coral' --alpha=1. --device='/gpu:0'
for d-coral:
python main.py --mode='train' --method='d-coral' --alpha=1. --device='/gpu:0'
python main.py --mode='test' --method='d-coral' --alpha=1. --device='/gpu:0'
Hi @pmorerio ,
I have three questions regarding the log_coral_loss:
It doesn't work with batch size 0 why is there no workaround? Is that part of the method?
Is the cov result supposed to be complex?
Did you try yet to apply this method to latent spaces? Or are you aware of anyone doing it?
Best,
Bjarne
Hello, @pmorerio
Thank you for your nice work!
I got a question about calculating log_coral_loss.
Let say, activation after conv_layer is the size of [20, 256, 200, 176] (N, H, W, C respectively), it is too big to flatten and calculate the covariance matrix.
In this case, what can be a good solution?
(1x1 convolution and 2d_maxpool would work properly...?)
Do you have a similar experience?
Any advice and comments are welcome!
Thank you in advance.
In your paper you mentioned that "The architecture is the very same employed in [Ganin & Lempitsky (2015)] with the only difference that the last fully connected layer (fc2) has only 64 units instead of 2048. Performances are the same, but covariance computation is less onerous. fc2 is in fact the layer where domain adaptation i performed." But in your code I found that (may be I am wrong), fc2 has 128 units. Can you please explain here a little bit more to understand me please?
hidden_size = 128
self.hidden_repr_size = hidden_size
net = slim.fully_connected(net, self.hidden_repr_size, activation_fn=tf.tanh,scope='fc4')
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.