Comments (6)
dkeeney
commented on June 12, 2024
The Network class serializes using Yaml. everything else uses plain binary
stream writes. It is fast, non-invasive, but not platform independent. I
coded up plain stream serialization for the Network class but I backed it
out. The Yaml is more readable and we need Yaml for parameter processing
anyway.
What are your thoughts?
…On Mon, Aug 6, 2018 at 10:52 PM, breznak ***@***.***> wrote:
Also in https://github.com/chhenning/nupic.core/pull/4/commits
Replace with plain stream writes?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
<#48>, or mute the thread
<https://github.com/notifications/unsubscribe-auth/AFBa_03-ct-W5hq3vxXsWVVuXLt5VqsZks5uOSsXgaJpZM4Vxhqc>
.
from htm.core.
breznak
commented on June 12, 2024
The Yaml is more readable and we need Yaml for parameter processing anyway.
Could you point me to the param handling code? Actually, I'd like to replace all the individual setXX, setXY setters/getters with a {json: "style"} format and a factory. So a config can be saved in separate file and passed to other algorithms (useful for param optimization, etc)
everything else uses plain binary stream writes. It is fast, non-invasive, but not platform independent.
I'd like to ask about your thoughts on capnp? I dislike it for it bloats so much of the codebase, on the other hand, there's already a lot of code written and it works.
from htm.core.
dkeeney
commented on June 12, 2024
The Yaml parameter processing is in src/nupic/engine/YAMLUtils.cpp/hpp.
The parameters are passed to the third argument of Network::addRegion(name,
nodeType, nodeParams). Often this is written in JSON format but since Yaml
is a superset of JSON it can handle both formats.
I looked at replacing it with simple JSON because it would be much simpler
(and we could remove the last dependency) but I think we would break a lot
of people's existing implementations. In the forums people talk about
their setup in ModelParams.yaml. And I think it might also break OPF if we
removed this.
I know OPF relies on the Network API for much of its implementation so I
have tried to be careful to avoid changes that affect the API.
One feature I would like to get rid of is the requirement that all plugins
(subclass of RegionImpl) must implement the functions
getParameterFromBuffer() and setParameterFromBuffer(). These rely on the
IWriteBuffer and IReadBuffer classes which are an attempt to avoid strong
parameter typing. If all plugins implemented the getParameterXXX() and
setParameterXXX() functions those older functions would not be needed. We
can fix all of the existing C++ plugins that still use the old functions
but we would still break Python plugins that still use them.
…On Tue, Aug 7, 2018 at 10:02 AM, breznak ***@***.***> wrote:
The Yaml is more readable and we need Yaml for parameter processing anyway.
Could you point me to the param handling code? Actually, I'd like to
replace all the individual setXX, setXY setters/getters with a {json:
"style"} format and a factory. So a config can be saved in separate file
and passed to other algorithms (useful for param optimization, etc)
everything else uses plain binary stream writes. It is fast, non-invasive,
but not platform independent.
I'd like to ask about your thoughts on capnp? I dislike it for it bloats
so much of the codebase, on the other hand, there's already a lot of code
written and it works.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
<#48 (comment)>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/AFBa_737JBn8s4ocamX9p01u9vr3JVqQks5uOcgJgaJpZM4Vxhqc>
.
from htm.core.
breznak
commented on June 12, 2024
looked at replacing it with simple JSON because it would be much simpler (and we could remove the last dependency) but I think we would break a lot of people's existing implementations. In the forums people talk about their setup in ModelParams.yaml. And I think it might also break OPF if we removed this.
https://codebeautify.org/yaml-to-json-xml-csv
I'd still consider that scenario (shifting from yaml to json), what do you think about asking people for one-time automated conversion of their config?
from htm.core.
dkeeney
commented on June 12, 2024
I will take on removing capnproto. My branch will be "remove_capnproto"
from htm.core.
breznak
commented on June 12, 2024
Awesome, I'm looking forward! Please open a PR even if you have some WIP, so we can review incrementally.
from htm.core.
Related Issues (20)
- Region.setParameters(name, value) not available HOT 1
- "HelloSPTPTest" Fails on a clean installation HOT 2
- No CMAKE_CXX_COMPILER could be found. HOT 1
- ModuleNotFoundError: No module named 'htm.bindings'
- Trouble Submitting Pull Request HOT 1
- Build python module without extra dependencies HOT 3
- htm.corr-nspkg.pth error HOT 1
- Build with Xcode 13.3.x fails with DEPRECATED error HOT 8
- Attempting to build from source (python): import error HOT 2
- Histogram evoked drive color HOT 1
- No module named 'htm.bindings.xxx'
- Getting error when installing by building from source HOT 1
- 'cp950' codec can't decode HOT 1
- Does not work with Python 3.11 HOT 1
- build error in debug mode
- prediction quality using ApicalTiebreakTemporalMemory? HOT 1
- Debian installation attempt fails: ModuleNotFoundError: No module named 'htm.bindings' HOT 6
- Request for monitor mixin examples
- htm.dummy extension HOT 5
- "resetIn" flag on tmRegion doesn't seem to actually work.
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from htm.core.