Comments (4)
This is interesting!
from spyx.
Thanks! I'd be happy to include a SpikeGPT/SpikingRWKV block, I just haven't had the chance yet to really dig into the architectures and try implementing it. A numpy or torch implementation of the block would be all I need to translate it into an equivalent JAX module.
from spyx.
In another RWKV/SpikeGPT project the numpy version of RWKV was done but may not including the spiking block. Would you like to discuss this over email?
from spyx.
I'd prefer to discuss things either here or on the Open Neuromorphic discord channel so that way other's could follow along if that works for you!
from spyx.
Related Issues (20)
- Implement interface to NIR HOT 4
- Add SPSN HOT 3
- Write test cases for CI/CD
- Refactor dataloading to not require torchvision. HOT 1
- Improve Documentation
- Add Type Checking via Chex
- Add Phasor layers/network capability HOT 1
- Implement EXODUS algorithm
- Adjust Neuron Models in spyx.nn to store constant betas as hk.params
- Make AEStream example
- Support for latency-based spike coding
- Find way to do dataloading without torchvision HOT 1
- Shuffling utility has returns leading axis zer0 HOT 1
- Investigate Pallas to implement faster neurons? HOT 2
- Add shape checking to Accuracy and Loss functions
- Create optimize utility/quick train and eval loop
- Implement Synthetic Gradients
- AttributeError: module 'spyx.axn' has no attribute 'Axon' HOT 3
- Spyx SHD Paper benchmark needs reviewed
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from spyx.