Git Product home page Git Product logo

fmri_words's Introduction

fmri

Here, we use machine learning techniques to replicate the analysis in a paper about an experiment where subjects brains were scanned with fMRI while they thought of words. We achieve the same accuracy for predicting words from fMRI's as the original paper's model, and further, we can interpret model parameters to replicate their conclusions regarding the human brain. We include our initial attempt using lasso, trained via stochastic gradient descent with exponentially decreasing step sizes, along with our final model, which performs a linear fit to principal components of the data set. Both models predict 218 semantic features to expand the effecetive data set. The model's chosen word is then chosen by manhattan-distance measured distance in the 218 dimensional space of predictions.

"Brain scans were taken of a subject in the process of a word reading task. We want to be able to predict what word the participant is reading based off of the activation patterns in their brain. To do this, we have 218 semantic features for each word in our dictionary (where each feature is a rating from 1-5 answering a question such as "Is it an animal?"). Thus, we can use the fMRI image to predict the semantic features of the word, and then use our dictionary to find our best guess as to which word it is. In this way, we can predict words without ever having seen them in our training set."

link to website for original paper: http://www.cs.cmu.edu/afs/cs/project/theo-73/www/science2008/data.html We used a different model than the authors of the paper but achieved equivalent predictivity, probably limitedby the head motion of the study participants. We performed an eigendecomposition of the training set of brain scans and then used a linear model to fit for predictions for each of the semantic features. for each x datapoint (fmri image) it calculated the predicted semantic features value. It then found the rmse of the predicted semantic features value and each other word in the data set (y_word - x.w) ^ 2. Each word was ranked according to this value.

fmri_words's People

Contributors

stellastyl avatar musiqclab avatar

Stargazers

 avatar

Forkers

edolele

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.