Git Product home page Git Product logo

christianmontecchiani / cs-330-deep-multi-task-and-meta-learning Goto Github PK

View Code? Open in Web Editor NEW
7.0 1.0 2.0 6.52 MB

Notes and Assignment solutions for Stanford CS330 (Autumn 2023 & 2024) Deep Multi-Task and Meta Learning

License: MIT License

Python 98.90% Shell 1.10%
deep-learning meta-learning multi-task-learning tensorboard cs330 stanford stanford-university deep-meta-learning deep-multi-task

cs-330-deep-multi-task-and-meta-learning's Introduction

Deep Multi-Task Learning and Meta Learning ๐Ÿค–

Stanford CS330-2023

This repo contains homework assignment solutions for the Stanford CS 330 (Deep Multi-Task and Meta Learning) class offered in Autumn 2023. A brief summary of key concepts covered in different assignments is summarized below.

In this assignment, we will implement a multi-task movie recommender system based on the classic Matrix Factorization and Neural Collaborative Filtering algorithms. In particular, we will build a model based on the BellKor solution to the Netflix Grand Prize challenge and extend it to predict both likely user-movie interactions and potential scores. A multi-task neural network architecture is implemented and the effect of parameter sharing and loss weighting on model performance is explored.

The main goal of these exercises is to get familiar with multi-task architectures, the training pipeline, and coding in PyTorch.

Goal of this assignment is to understand meta-learning for few shot classification. Following are the key undertakings:

  • Learn how to process and partition data for meta learning problems, where training is done over a distribution of training tasks
  • Implement and train memory augmented neural networks (MANN), a black-box meta-learner that uses a recurrent neural network [1].
  • Analyze the learning performance for different size problems.
  • Experiment with model parameters and explore how they improve performance. The analysis is performed using Omniglot [2], a dataset with 1623 characters from 50 languages and each character has 20 images.

References

[1] Santoro, A., Bartunov, S., Botvinick, M., Wierstra, D., & Lillicrap, T. (2016, June). Meta-learning with memory-augmented neural networks. In International conference on machine learning (pp. 1842-1850). PMLR.

[2] Lake, B. M., Salakhutdinov, R., & Tenenbaum, J. B. (2015). Human-level concept learning through probabilistic program induction. Science, 350(6266), 1332-1338.

cs-330-deep-multi-task-and-meta-learning's People

Contributors

christianmontecchiani avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar

Forkers

mikhisor rhshriva

cs-330-deep-multi-task-and-meta-learning's Issues

HW 2,3,4

Thank you so much for open-sourcing the solutions! Do you have the solutions for HW 2,3,4 too? I am self-learning this course, really appreciate it!

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.