Regarding nyroglancer, I think it unfortunately does not support the automatic meshing.

The error you list at the top of init takes 3 positional arguments is a recent breakage in sockjs-tornado due to the release of tornado 5.0 just a few days ago.
mrjoes/sockjs-tornado#113

To fix that, you could either downgrade tornado to 4.5.3 via
pip install tornado==4.5.3

or install this version of sockjs tornado from github.

https://github.com/mathben/sockjs-tornado/tree/fix_tornado_5.0_%23113

You can do that with this command:
pip install 'git+git://github.com/mathben/sockjs-tornado@212ba27' --upgrade

from neuroglancer.

from neuroglancer.

The format is identical to the precomputed mesh format, documented here:

https://github.com/google/neuroglancer/tree/master/src/neuroglancer/datasource/precomputed#mesh-representation-of-segmented-object-surfaces

If you write the output to a file, then create the appropriate manifest JSON file for each object, you can view it as a precomputed mesh source.

from neuroglancer.

from neuroglancer.

Can you explain a bit more exactly what you've done and what you observe?

Have you tried running the example file python/examples/example.py ?

If you set neuroglancer.server.debug = True, you will see debug logs from the server, which may provide useful information.

from neuroglancer.

Thank you for your reply.
I carefully followed for the instructions but couldn't make that example to work.
When I run it like this (while I'm in python directory of this repo) python examples/example.py I get something like this:

Traceback (most recent call last):
  File "examples/example.py", line 31, in <module>
    viewer = neuroglancer.Viewer()
  File "/CONDA/neuro/lib/python3.6/site-packages/neuroglancer-1.0.7-py3.6-linux-x86_64.egg/neuroglancer/viewer.py", line 43, in __init__
    server.register_viewer(self)
  File "/CONDA/neuro/lib/python3.6/site-packages/neuroglancer-1.0.7-py3.6-linux-x86_64.egg/neuroglancer/server.py", line 269, in register_viewer
    start()
  File "/CONDA/neuro/lib/python3.6/site-packages/neuroglancer-1.0.7-py3.6-linux-x86_64.egg/neuroglancer/server.py", line 262, in start
    global_server = Server(ioloop=ioloop, **global_server_args)
  File "/CONDA/neuro/lib/python3.6/site-packages/neuroglancer-1.0.7-py3.6-linux-x86_64.egg/neuroglancer/server.py", line 62, in __init__
    SockJSHandler, SOCKET_PATH_REGEX_WITHOUT_GROUP, io_loop=ioloop)
  File "/CONDA/neuro/lib/python3.6/site-packages/sockjs/tornado/router.py", line 111, in __init__
    self.io_loop)
TypeError: __init__() takes 3 positional arguments but 4 were given

The way how I'm testing this right now is part of the nyroglancer.
It works perfectly fine for me (except for the fact that I don't see the mesh being generated when I click on the object).
My raw.bin data is just a grayscale 3D image and I'm using it to overlay segments from segs.bin.
segs.bin has one integer value per voxel (3D pixel) and those values are visually look like a cells from one of your demos.
What I get is ability to browse through the data, but when I click on the object I don't get a mesh.

So I was wondering if I need to do a preprocessing of some sort or convert my data format into something else in order for neuroglancer to pick it up.

P.S. I realize that I'm not using neuroglancer directly here - but it's only because I couldn't make it work even for the examples.

Thanks for your help!

from neuroglancer.

Thank you, @jbms. I installed the patch from git using the command you've provided.
And also was able to run the command with no errors.
But now it dies (or at least looks like it dies) immediately right after I type it.

(neuro) [thoth@host neuroglancer]$ python python/examples/example.py -a 0.0.0.0
http://host:38474/v/fbd8fb5da6fa030ee4f82d24164425f487ce6320/
(neuro) [thoth@host neuroglancer]$ echo $?
0

I enabled debugging as you have suggested earlier - but that changed no behavior.
Thanks in Advance!

from neuroglancer.

Run it with python -i so that python stays running.

from neuroglancer.

Thank you,
Now I'm getting this in the browser:

404: Not Found

from neuroglancer.

Are you sure you are using the right URL? It changes every time.

from neuroglancer.

yes, I double checked it. I also downgraded tornado to make sure that it's not patch failure. Was no help as well.

from neuroglancer.

Unfortunately I'm not sure what the issue is. What I'd recommend is that you install neuroglancer in development mode, by (per instructions in python/README.md) cloning the git repository, and then running:

python setup.py develop
python setup.py bundle_client

Then in python/neuroglancer/server.py, I'd recommend adding print statements to the get method of the StaticPathHandler class so as to be able to get a better idea of what is going on.

from neuroglancer.

Thank you, @jbms.
I did this in server.py:

class StaticPathHandler(BaseRequestHandler):
    def get(self, viewer_token, path):
        print(f"{viewer_token} at {path}")
        print(f"{self.server.token} is server token")
        print(f"{self.server.viewers} are server viewers")
        if viewer_token != self.server.token and viewer_token not in self.server.viewers:
            self.send_error(404)
            return
        try:
            print(f"global={global_static_content_source}")
            data, content_type = global_static_content_source.get(path)
        except ValueError as e:
            self.send_error(404, message=e.args[0])
            return
        self.set_header('Content-type', content_type)
        self.finish(data)

And it produced this during the test:

python -i examples/example.py
http://127.0.0.1:40671/v/2956cea95659d30405f79bae0217b64ca20265be/
>>> 2956cea95659d30405f79bae0217b64ca20265be at 
2c479cad54909b2caf87caed44d4c4117b5d7b3d is server token
<WeakValueDictionary at 0x2ae698f796a0> are server viewers
global=<neuroglancer.static.PkgResourcesContentSource object at 0x2ae698f8b400>
2956cea95659d30405f79bae0217b64ca20265be at styles.css
2c479cad54909b2caf87caed44d4c4117b5d7b3d is server token
<WeakValueDictionary at 0x2ae698f796a0> are server viewers
global=<neuroglancer.static.PkgResourcesContentSource object at 0x2ae698f8b400>
2956cea95659d30405f79bae0217b64ca20265be at main.bundle.js
2c479cad54909b2caf87caed44d4c4117b5d7b3d is server token
<WeakValueDictionary at 0x2ae698f796a0> are server viewers
global=<neuroglancer.static.PkgResourcesContentSource object at 0x2ae698f8b400>

As you can see the viewer is not matching server token. More over if I use server token in place of viewer (added one more print to see the server token) - then everything the same happens.

Please keep helping...
I really want to make it to work - many many people will be amazed by this Google technology!

Thanks in Advance.

from neuroglancer.

It is confusing that requests are coming in for styles.css and main.bundle.js, if you are just getting a 404 error --- since the browser would not know to fetch those paths if it didn't receive the index.html file.

That suggests that StaticPathHandler may not in fact be returning a 404 error --- and you can verify that by adding additional print statements after the data, content_type = ... line, and also in the except handler.

You might try using the Chrome or Firefox developer tools to investigate what network requests are coming through.

from neuroglancer.

Ok.
I've tried chrome now and it kinda works (with lot's of flickering).
I deleted everything and started over. Still flickering.
I don't know if it suppose to be like that. (ignore the green color - it's artifact of gifmaker - but flickering is true).

Thank you for your help!

from neuroglancer.

from neuroglancer.

When I do nyroglancer it works fine.
But I checked the settings of my chrome and got this:

Graphics Feature Status
Canvas: Software only, hardware acceleration unavailable
CheckerImaging: Disabled
Flash: Software only, hardware acceleration unavailable
Flash Stage3D: Software only, hardware acceleration unavailable
Flash Stage3D Baseline profile: Software only, hardware acceleration unavailable
Compositing: Software only, hardware acceleration unavailable
Multiple Raster Threads: Enabled
Native GpuMemoryBuffers: Software only. Hardware acceleration disabled
Rasterization: Software only, hardware acceleration unavailable
Video Decode: Software only, hardware acceleration unavailable
WebGL: Hardware accelerated but at reduced performance
WebGL2: Software only, hardware acceleration unavailable

I'll see how I can fix these hardware rendering issues and will do some of my tests again.

Thanks again!

from neuroglancer.

Thank you for your help.
I installed new version of graphical drivers and went to this tab in chrome chrome://flags/ to override the software rendering settings.
It works!

Finally after all the technical issues (on my side) we can come back to the actual topic of this question.
In the example.py I see 2 arrays:

• a: 4D - (3,z,y,x) - uint8 dataset
• b: 3D - (z,y,x) - uint32 dataset
  I assume that b is used for automatic mesh generation. In my case that will be segs. Thankfully the format and shape is matching.

question

But the format and shape of overlay image a and raw are not matching in my case.
What should I do to my raw (if I need to do anything at all) for it to work as it works for a in example.py (if I understood it correctly)?

from neuroglancer.

from neuroglancer.

Thank you, @jbms
At first it looked not so right - I expected grayscale, though.

Once I asked for the mesh I got some strange behavior.
It looks like there is a lot of noise in my data. Or I interpret it the wrong way?
I just don't understand where it comes from - my raw data or my segs data?
And another thing I noticed is low CPU utilization (top shows only 200% CPU out of 7200% possible - it's skylake node) during mesh generation.
There were also quite a lot of memory utilization, but I assume that it's due to noise...

questions

• Why I don't see nice gray scale background behind the segments as in demos on the page?
  • I assume it's because my format is uint16
  • if so - should I normalize it to uint8 first?
• Do I generate mesh correctly?
  • I double click on the highlighted segment
  • Do I need to do any pre-processing to speed it up?

Thank you very much for going through this with me!

from neuroglancer.

from neuroglancer.

You were completely right.
Once I attributed my data with Image and Segmentation layers - it's all worked!
Not only much more beautiful right now - but also much faster.
I clearly see that it takes a first touch to the global mesh - but then local selected meshes are generated very fast (comparing to before).
So I would say that this issue is no longer an issue!

I might come back very soon with some more questions - but for now - it looks and does exactly what I would expect!

last minor question

One minor thing, though, is that Image layer is not as bright as I would expect - is there any way to control the colormap of it so that more active range of the image would be used?

from neuroglancer.

from neuroglancer.

Order of layers is matters, indeed! Well, that was somewhat unexpected, but reasonable.
Is there any documentation on that shader technique, you've mentioned above?
I also noticed that there are few attributes of segmentation class: 'selected_alpha', 'not_selected_alpha', 'object_alpha' - how do they affect overlay of the image and segments. There is also 'opacity' in image segmentation class... Should I use that one instead?
And I also noticed AnnotationLayer - what is that beast for - does it add hints to the view - so on mouse over I can put some information?

one more last question

(I should stop calling them last :-) )
Is there any way to trigger a mesh generator in advance?
I really want my mesh to be available when I let the user to see the viewer's url.

Thank you very for your help!

from neuroglancer.

See this documentation regarding custom image layer shaders:
https://github.com/google/neuroglancer/blob/master/src/neuroglancer/sliceview/image_layer_rendering.md

The layers are rendering in the order they are listed, and by default blended as: dest_value = old_dest_value * (1 - src_alpha) + src_value * src_alpha

not_selected_alpha and selected_alpha determine the alpha values for the segmentation layer. object_alpha affects the 3-d rendering only.

Yes, the annotationlayer lets you do exactly that --- see the discussion in #78 and this example link: https://goo.gl/vhcUXE

There isn't currently a great way to trigger mesh generation in advance, although you could manually call the get_object_mesh method of LocalVolume.

from neuroglancer.

Thank you for the examples and documentation - will experiment to see how far I can get.

Couldn't figure out how to use get_object_mesh - cannot find the way to get object_id within txn() context.
Would be nice to see an example.

Thank you for very detailed answers!
Hope that somebody else will find this discussion as useful as it was for me!

from neuroglancer.

    vol = neuroglancer.LocalVolume(
            data=b,
            voxel_size=s.voxel_size,
        )
    vol.get_object_mesh(0)
    s.layers.append(
        name='b', layer=neuroglancer.SegmentationLayer(source=vol))

from neuroglancer.

Thank you for this, @jbms.
I have got this error:

Traceback (most recent call last):
  File "example.py", line 85, in <module>
    vol.get_object_mesh(0)
  File "neuroglancer/python/neuroglancer/local_volume.py", line 243, in get_object_mesh
    raise InvalidObjectIdForMesh()
neuroglancer.local_volume.InvalidObjectIdForMesh

Is there any alternative to this?
May be an additional flag to the SegmentationLayer which would force mesh generation... But I don't know how to implement it...

from neuroglancer.

from neuroglancer.

I put a try/except and it indeed worked! Thanks!

To do the simplification as well, you would need to call
get_object_mesh for every object id.

Don't follow this point... And even if I would understand what you meant - I still don't know where get the list of objects from...

from neuroglancer.

I think this is related enough to include in this thread -- but if not I can create a new issue.

Is there a way to export the mesh that neuroglancer python creates and then load it in from a static URL? I've been unsuccessful in determining what the output of get_object_mesh is (raw byte string)?

from neuroglancer.

Thank you, @jbms for your help!
How to remove visualization of orthogonal 3D planes?
The reason I need it is that I can browse through my data in 3 other windows but would like to see 3D generated object clearly in my 3D view without panels going into my sight.
May be I can set transparency for the panels or somehow disable them in 3D view?

from neuroglancer.