Git Product home page Git Product logo

Comments (4)

jameschapman19 avatar jameschapman19 commented on May 30, 2024 1

Thanks for this! I believe I have just fixed it in latest version 1.7.10. Basically I switched the models to run double precision by default when using the DeepWrapper class (this helps with some stability issues e.g. #39). As you have noticed this wasn't compatible with the MNIST datasets which gave floats.

  • I have now changed DeepWrapper to put things in double before passing to the model.
  • Have also added a test that runs a subset of the tutorial to check it runs

Your comment also raised a different issue which was that the reconstruction loss in the autoencoder was reduce='sum' which is bigger with larger batch size so needs more tuning of learning rate.

  • Have changed this to reduce='mean' which produces much more sensible losses and convergence for DCCAE and SplitAE

from cca_zoo.

jameschapman19 avatar jameschapman19 commented on May 30, 2024 1

I have uploaded a new run of the tutorial which seems to run OK so tentatively closing this but let me know if further issues

from cca_zoo.

jameschapman19 avatar jameschapman19 commented on May 30, 2024

Note - when running the notebook again you may need to run:

!pip install cca-zoo[deep,probabilistic] --upgrade

To get the new version :)

from cca_zoo.

DiegoMac17 avatar DiegoMac17 commented on May 30, 2024

Thank you @jameschapman19 ! That was fast! It is all working great now.
Also thank you for the AE 'reduce' parameter fix, it definitely achieves much more reasonable losses.

from cca_zoo.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.