Git Product home page Git Product logo

unet-segmentation's Introduction

Unet-Segmentation

This is the source of the U-Net Segmentation plugin for Fiji. You can obtain the latest stable version directly from the Fiji updater via update site "U-Net Segmentation".

For more details check our project page. Binary releases are available on our Fiji update site

The plugin requires connection to a Linux workstation (can be the local computer) running a special variant of caffe (caffe_unet).

U-Net Segmentation backend caffe_unet (binaries, source, docker)

Obtain the U-Net segmentation backend (caffe_unet) binaries and corresponding caffe source patch from the project page. Please also check our caffe-unet-docker repository.

Build from source

We recommend to use Linux for building from source, in theory building on Windows should work, but it is not tested.

Prerequisites:

ij.jar, jsch.jar and jhdf5.jar should be already included in an of-the-shelf Fiji installation. You can obtain protobuf-java from the U-Net update site.

General build instructions

Clone this repository, create a separate build directory, and run cmake using the cloned directory as source folder and the build directory as destination folder. Choose your Fiji plugins folder as install prefix.

Example:

  • Fiji is installed in /home/user/Fiji.app
  • You installed the protobuf compiler using your package management system (e.g. on debian-based systems using apt-get install protobuf-compiler)
  • You cloned this repository to /home/user/Unet-Segmentation

Then the following block should build and install the Unet-Segmentation plugin into Fiji. The API documentation can be found in /home/user/Unet-Segmentation/build/javadoc/doc/.

mkdir -p /home/user/Unet-Segmentation/build
cd /home/user/Unet-Segmentation/build
cmake -DCMAKE_INSTALL_PREFIX=/home/user/Fiji.app/plugins -DFIJI_BIN=/home/user/Fiji.app/ImageJ-linux64  ..
make install

unet-segmentation's People

Contributors

ctrueden avatar thorstenfalk avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

unet-segmentation's Issues

Memory leak?

I'm running a FIJI macro on a dedicated Ubuntu machine that has a 2 step Unet segmentation. It all works on single images but when I run a macro on a folder, every 7-8 image I get the error below. Running garbage collection doesn't help - only quiting and relaunching Fiji - I've reproduced this behavior 5 times now on different sets of images.

Please let me know if there's anything I can do to help identify the error or allow it to run across a whole folder without restarting the run each time.

(Fiji Is Just) ImageJ 2.0.0-rc-69/1.52n; Java 1.8.0_172 [64-bit]; Linux 4.15.0-47-generic; 15317MB of 30000MB (51%)

java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedMethodAccessor102.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at ij.macro.Functions.call(Functions.java:4363)
at ij.macro.Functions.getStringFunction(Functions.java:274)
at ij.macro.Interpreter.getStringTerm(Interpreter.java:1407)
at ij.macro.Interpreter.getString(Interpreter.java:1385)
at ij.macro.Interpreter.doStatement(Interpreter.java:324)
at ij.macro.Interpreter.doBlock(Interpreter.java:666)
at ij.macro.Interpreter.runUserFunction(Interpreter.java:365)
at ij.macro.Interpreter.doStatement(Interpreter.java:276)
at ij.macro.Interpreter.doIf(Interpreter.java:1044)
at ij.macro.Interpreter.doStatement(Interpreter.java:291)
at ij.macro.Interpreter.doBlock(Interpreter.java:666)
at ij.macro.Interpreter.doStatement(Interpreter.java:315)
at ij.macro.Interpreter.doFor(Interpreter.java:588)
at ij.macro.Interpreter.doStatement(Interpreter.java:297)
at ij.macro.Interpreter.doBlock(Interpreter.java:666)
at ij.macro.Interpreter.runUserFunction(Interpreter.java:365)
at ij.macro.Interpreter.doStatement(Interpreter.java:276)
at ij.macro.Interpreter.doStatements(Interpreter.java:256)
at ij.macro.Interpreter.run(Interpreter.java:152)
at ij.macro.Interpreter.run(Interpreter.java:91)
at ij.macro.Interpreter.run(Interpreter.java:102)
at ij.plugin.Macro_Runner.runMacro(Macro_Runner.java:161)
at ij.IJ.runMacro(IJ.java:148)
at ij.IJ.runMacro(IJ.java:137)
at net.imagej.legacy.IJ1Helper$3.call(IJ1Helper.java:1107)
at net.imagej.legacy.IJ1Helper$3.call(IJ1Helper.java:1103)
at net.imagej.legacy.IJ1Helper.runMacroFriendly(IJ1Helper.java:1054)
at net.imagej.legacy.IJ1Helper.runMacro(IJ1Helper.java:1103)
at net.imagej.legacy.plugin.IJ1MacroEngine.eval(IJ1MacroEngine.java:147)
at org.scijava.script.ScriptModule.run(ScriptModule.java:160)
at org.scijava.module.ModuleRunner.run(ModuleRunner.java:168)
at org.scijava.module.ModuleRunner.call(ModuleRunner.java:127)
at org.scijava.module.ModuleRunner.call(ModuleRunner.java:66)
at org.scijava.thread.DefaultThreadService$3.call(DefaultThreadService.java:238)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.RuntimeException: Macro canceled
at ij.Macro.abort(Macro.java:76)
at ij.IJ.error(IJ.java:691)
at de.unifreiburg.unet.SegmentationJob.run(SegmentationJob.java:737)
at de.unifreiburg.unet.SegmentationJob.processHyperStack(SegmentationJob.java:620)

Question: Optimizer, choice of learning rate

Hey,

I am currently experimenting with training a detection U-Net from scratch, and have tried different settings for the learning rate. I saw in the solver_prototxt information in the *modeldef.h5 files generated by the finetuning, that the default optimizer is Adam, with parameters as follows:

 base_lr:       0.00001
 momentum:      0.9
 momentum2:     0.999
 lr_policy:     "fixed"

Now, I have a couple of questions to that:

-Is it correct that learning rate set with the ImageJ plugin overwrites the base_lr=10^-5 setting?
-Do I understand Adam correctly that it adjusts the learning rate per parameter, and the learning rate set in the plugin is just like an upper bound to the optimization stepsize? Or does the lr_policy="fixed" imply that the effective stepsize is constant despite the optimzer being Adam?
-Is there any best practice to set or tune the learning rate for U-Nets? Does it e.g. make sense to train from scratch for few iterations with high learning rate, then finetune with smaller learning rate? (I would assume that Adam takes care of this implicitly)

Two more general, related questions:

-I saw in your paper that you trained one of your from-scratch models with SGD and learning rate decay. To implement that with the plugin, is it sufficient to change the solver_prototxt attribute of the *_modeldef.h5 file accordingly?
-I also saw in your paper description of the training procedure that you trained Adam with 'fixed schedule' - what is meant by that? That the base_lr is not changed?

I'd be grateful for any hint! Thanks in advance,
Jan.

Question: Many channel learning

I'm not sure if this is a question better posed here or on image.sc so please just let me know if I should post it there instead.

So I have 3 color ISH tissue images with cells labeled (fairly brightly) in either, red, green, or blue. After finetuning the 2D cellnet with increasing number of data, it sometimes does a very good job, but sometimes seems to miss some obvious cells. The detection plateaus at about 60% and throwing another 10k epochs and set of images doesn't seem to improve it much.

I made a script to add some texture channels for each channel in the hopes of improving what the Unet can learn from. Basically added a Laplacian of Gaussian, Gaussian Gradient Magnitude, and Difference of Gaussian per channel, thus making the final image 4x3=12channel (RGB intensity + three texture channels per intensity channel) but the Unet doesn't seem to be terribly impressed with it.

When I attempted to finetune the original 2D Unet, it seemed to have quite poor performance even after 20k epochs (Tile ~700px, 1E-4, interval of 20) - basically it didn't seem to be learning anything. I then tried to finetune my already finetune 2D cellnet for the detecting the 3 cell types but it appears stuck at "splitting color channels (7% progress) for almost a day now.

Does the Unet plugin support so many channels? Is there any better way to add additional information like texture that works better than what I'm trying?

Segmenting Bacteria in Dense Populations

Greetings,
I am trying to apply the U-net algorithm to 2D images of bacteria. The goal is to segment and count bacteria in a dense population. Here is a representative image. This is Acinetobacter Baylyi with a fluorescent DNA stain in green. the pixel width is about 65 nm. The length of such a bacteria is around 1 micron.
BF with GFP S4-6
Do you think this is feasible?

To start however, I made low density pictures and annotated them for the U-net to train on.
Brightfield with GFP S3-2-C1
When I tell the standard model to segment this kind of images it is not too bad. However, when I finetune with the above shown training data the result of the segmentation after is usually just a black screen. I suspect that my annotations are wrongly interpreted by the algorithm. As info: I have named all 50 ROIs 'cell' and then made an overlay.
Is my annotation the problem or is it something else? If somebody has an idea how I can improve my training data, e.g. less clumbed up bacteria, different or no staining, different annotations, or bigger bacteria. I would be grateful.
Here is a list of which settings I have tried: lower learning rate, 100 k and 1 k iterations, annotation via multipoints, zoomed in images, different element sizes, pictures without staining, pictures with only the fluorescent channel, the 'Labels are Classes' box checked and unchecked, and different tile shapes.
All with the same result a black screen. Below is a figure of what the Loss over Iterations plot of the finetuning usually looks like.
Loss over Iterations_1000 failed learning

Another issue I have encountered is the re-scaling of the images before segmenting and finetuning. My pictures have a pixel width of about 65 nm. I have changed the properties of the image accordingly. When I segment the first thing the algorithm does is re-scale it to 0.5 by 0.5 microns. As a result it blurs the image to an almost unusable point. Below is the re-scaled version of the second image.
Brightfield with GFP S3-2-C1 - 32-Bit - rescaled (xy) - normalized
I can work around this by setting the pixel width to 0.5 by 0.5 microns. However while finetuning, I will have to set the pixel width and the element size both to 0.5 by 0.5. At this point I am not sure if the algorithm then looks for elements which are one pixel in width. Does it do that? What is this re-scaling about and good for?

I am thankful for any answer to one of my many questions.

Best,
Reto

PS @ Thorsten: I managed to install U-net on a different computer running ubuntu 19.04.

Model output is empty

Hi,

I am new with U-net and not so good with linux. We asked our university IT guys to set up a U-net server in our Lab and they installed Ubunutu 18.04, with CUDA 10 and cuDNN 7.

I downloaded the caffemodels and the sample data from your website: https://lmb.informatik.uni-freiburg.de/lmbsoft/unet/#installation-backend-fromsource

I followed the tutorial video for segmentation and added our U-net server (I'm using Fiji on a Windows 10 laptop) and all the corresponding caffemodel and weights. The plugin seems to communicate well with the server but the model output an empty normalized image (all pixels are Zeros) and an empty segmentation image. I used the BF-microspores image for that.

Here is what the log window in Fiji shows:

Establishing SSH connection for 'uppersat@uppersatpc1:22' $ sftp "C:\Users\tala\AppData\Local\Temp\unet-1d2151f8-4485-433f-8ad0-87d8d0ebdc766776308919625221650.tmp" "uppersat@uppersatpc1:22:/home/uppersat/caffemodels/unet-1d2151f8-4485-433f-8ad0-87d8d0ebdc766776308919625221650.tmp" uppersat@uppersatpc1 $ rm "/home/uppersat/caffemodels/unet-1d2151f8-4485-433f-8ad0-87d8d0ebdc766776308919625221650.tmp" uppersat@uppersatpc1$ /data/u-net/bin/caffe uppersat@uppersatpc1$ /data/u-net/bin/caffe_unet $ sftp "C:\Users\tala\Downloads\2d_cell_net_v0_model\2d_cell_net_v0.modeldef.h5" "uppersat@uppersatpc1:22:/home/uppersat/caffemodels/unet-1d2151f8-4485-433f-8ad0-87d8d0ebdc76.modeldef.h5" uppersat@uppersatpc1$ caffe_unet check_model_and_weights_h5 -model "caffemodels/unet-1d2151f8-4485-433f-8ad0-87d8d0ebdc76.modeldef.h5" -weights "2d_cell_net_v0.caffemodel.h5" -n_channels 1 -gpu 0 Rescaling Hyperstack (xy) from (0.5319140448180135, 0.5319140448180135) to (0.5, 0.5) t = 1: scale = Infinity, offset = -0.0 Caffe blobs saved to 'C:\Users\tala\AppData\Local\Temp\unet-1d2151f8-4485-433f-8ad0-87d8d0ebdc768842665550246266494.h5' $ sftp "C:\Users\tala\AppData\Local\Temp\unet-1d2151f8-4485-433f-8ad0-87d8d0ebdc768842665550246266494.h5" "uppersat@uppersatpc1:22:/home/uppersat/caffemodels/unet-1d2151f8-4485-433f-8ad0-87d8d0ebdc76.h5" caffe_unet tiled_predict -infileH5 caffemodels/unet-1d2151f8-4485-433f-8ad0-87d8d0ebdc76.h5 -outfileH5 caffemodels/unet-1d2151f8-4485-433f-8ad0-87d8d0ebdc76.h5 -model caffemodels/unet-1d2151f8-4485-433f-8ad0-87d8d0ebdc76.modeldef.h5 -weights 2d_cell_net_v0.caffemodel.h5 -iterations 0 -gpu_mem_available_MB 8000 -gpu 0 $ sftp "uppersat@uppersatpc1:22:/home/uppersat/caffemodels/unet-1d2151f8-4485-433f-8ad0-87d8d0ebdc76.h5" "C:\Users\tala\AppData\Local\Temp\unet-1d2151f8-4485-433f-8ad0-87d8d0ebdc768842665550246266494.h5" uppersat@uppersatpc1 $ rm "/home/uppersat/caffemodels/unet-1d2151f8-4485-433f-8ad0-87d8d0ebdc76.modeldef.h5" uppersat@uppersatpc1 $ rm "/home/uppersat/caffemodels/unet-1d2151f8-4485-433f-8ad0-87d8d0ebdc76.h5" Removing C:\Users\tala\AppData\Local\Temp\unet-1d2151f8-4485-433f-8ad0-87d8d0ebdc768842665550246266494.h5 U-Net job finished

I don't see any errors and would like to know what might be the cause for a blank output.

Also If a try finetunning the model with the erytrocytes images my training curves are weird compared to the tutorial video:

image

And if I try to use the retrained model I get and empty output again.

Macro Execution ignores model

Hi,
I'm not sure when this change took place, but with the current version of the plugin, it appears to ignore the parameters of executing the job from macro and just uses the model/weights selected in the dialog box. Even if e.g. the last GUI job was a detection job, if you execute a segmentation job with specifying the parameters - it still executes the job with the settings from the last GUI job.

I even tried re-recording the commands in case syntax changed but the behavior remains.

To elaborate:
I have a ModelA and WeightsA selected in GUI as the last job I did (doesn't matter if it was segmentation or detection)
I execute a macro asking for segmentation with ModelB and WeightsB
Result: it executes segmentation with ModelA and WeightsA

This is on Ubuntu Fiji 1.52o running the "latest" Unet according to the update site - I haven't yet tested if it's the same on windows.

How can I train datasets like PASCAL VOC without fiji?

Hi there!

I just wanna train datasets for segmentation using only caffe. (without fiji)
But, I can't understand attributes of blobs like HDF5 training file.
When I use fji to do 'U-Net -> Utilities -> Creat Blobs', then I can make HDF5 file which contains data, labels, weights, weights2, DATA_TYPES, conversionParameters.
I'm trying to write some scripts to make that HDF5 file using python but I'm not sure I can do that...
Is there way to do that without GUI?

Regards,
Jim

Finetuning uses a lot of client RAM; validation slows down over time

Hey all,

I am using the ImageJ plugin to finetune the available 2D network to my own segmentation problem.

I ran a finetuning for 10k iterations with relatively small tiles (188x396 tiles of 1024x1024-images with 0.541 microns/pixel resolution) overnight, using a remote GPU. Here is the exact settings I used:

2dnet_v0_ft_segmentation_dataset_8_preproc_0_tiles_188x396_LR_-6__iter_10k_settings

Next morning, I noticed that the training got "stuck" near iteration 1200. It seemed that the validation slowed down the training a lot: a single validation took on the order of 30 minutes, the 20 iterations in between only a few seconds. This was 16 hours after I started the training, and in that time, roughly 60 validations had been computed.
Assuming that preprocessing and the training validations alone don't take much time, that gives an expected validation duration of ca. 15min. The validations that I observed took about twice as long, so I suspected that the validation time somehow increased over the training course.
At the same time, I noticed that the RAM of my client PC was almost exclusively used by ImageJ (no other programs were active at the same time), which surprised me, because I thought most of the processing was done at the remote host with GPUs.

At that point, I aborted training, here's the training loss/validation time course:

_earlystop_metrics

In order to reproduce this issue, I ran a finetuning with almost the same images/setting, except that I used slightly larger tiles (396x220) and fewer validations to speed up the preprocessing etc. Exact settings:

test_RAM_usage3_settings

I monitored the RAM usage of ImageJ during the whole preprocessing and finetuning (using the Monitor Memory function under "Plugins/Utilities"), and the global CPU/RAM use of the client PC (using my gnome system monitor). My ImageJ memory is limited to 4.5 GB (under Edit/Options/Memory&Threads).

I noted that during preprocessing, ImageJ RAM usage was below 200MB at all times. When finetuning started, ImageJ RAM usage slowly grew over the first 1k iterations to a peak usage of 3.8 GB. When it hit the limit, the used memory somehow "reset" back to a few hundred MB, and then irregularly changed between 300 and 2000 MB. At the same time, global RAM display (starting at ~2GB) went up until 6GB during the first 1k iterations, and did not reset when the ImageJ internal RAM display "reset".

I then (manually) timed the validations, noting that they took increasingly longer (each validation timed took about 1sec longer than the validation before). The training iterations between two validations seemed to always take the same time.

I tried to use the ImageJ garbage collection (clicking on the status bar is supposed to release unused memory to the OS) to speed up the validations again. Clicking repeatedly led to a visible release of RAM, but that was instantly filled up again:

test_RAM_usage3_part1_gh

A single click had a much smaller effect on RAM:

test_RAM_usage3_part2_gh

With respect to reducing the validation duration, using multiple garbage collections worked to a certain degree: I observed a decrease of the validation duration from >30sec to ca. 20sec, but after a while of staying at 20sec/validation, the validation durations started to increase again. I tried this several times (using the garbage collection and then timing the validations), with similar results.

This seemed to fit the observation from my first case (increasingly slow validations), although the increase was not as exponential as I expected, and also shows some connection to the (for me: unexpectedly) strong use of client PC RAM.

My final questions are:
Do you think that this RAM issue is related to why my validations were so slow in the first place? If so, is there a way to integrate regular garbage collection into the UNET routine, or do some other thing to improve memory-handling?

Thanks in advance for all kinds of suggestions and reading this potentially over-detailed post ;)
Cheers,
Jan

EDIT:
In case that is of relevance, I also include:

Training course plots for the finetuning session during which I timed the validations and monitored the RAM usage:

test_RAM_usage3_metrics

RAM usage after finetuning was over:
test_RAM_usage3_after_gh

logfile:

Establishing SSH connection for 'jlause@localhost:8888'
$ sftp "/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da43367320197613465157.tmp" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da43367320197613465157.tmp"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da43367320197613465157.tmp"
jlause@localhost$ caffe_unet
Setting caffe_unet binary path to caffe_unet
Searching for caffe
jlause@localhost$ caffe
$ sftp "/home/jan/unet/caffemodels/2d_cell_net_v0.modeldef.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4.modeldef.h5"
jlause@localhost$ caffe_unet check_model_and_weights_h5 -model "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4.modeldef.h5" -weights "/gpfs01/berens/user/jlause/unet/caffemodels/2d_cell_net_v0.caffemodel.h5" -n_channels 1 -gpu all
t = 1: scale = 0.004310345, offset = -1.0
Caffe blobs saved to '/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4874480592713993178.h5'
$ sftp "/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4874480592713993178.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_train_0.h5"
t = 1: scale = 0.003968254, offset = -3.0
Caffe blobs saved to '/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4874480592713993178.h5'
$ sftp "/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4874480592713993178.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_train_1.h5"
t = 1: scale = 0.003937008, offset = -1.0
Caffe blobs saved to '/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4874480592713993178.h5'
$ sftp "/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4874480592713993178.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_train_2.h5"
t = 1: scale = 0.003921569, offset = -0.0
Caffe blobs saved to '/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4874480592713993178.h5'
$ sftp "/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4874480592713993178.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_train_3.h5"
Rescaling Hyperstack (xy) from (1.0, 1.0) to (0.5411255411255411, 0.5411255411255411)
t = 1: scale = 0.003921569, offset = -0.0
Rescaling IntBlob (1024,1024) with element size (1.0,1.0) to element size (0.5411255411255411,0.5411255411255411). New shape: (1892,1892)
Rescaling IntBlob (1024,1024) with element size (1.0,1.0) to element size (0.5411255411255411,0.5411255411255411). New shape: (1892,1892)
Caffe blobs saved to '/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4874480592713993178.h5'
$ sftp "/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4874480592713993178.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_train_4.h5"
t = 1: scale = 0.003921569, offset = -0.0
  tiling = 29x5
  nTiles = 145
$ sftp "/tmp/unet-5387939510992264211.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_0.h5"
$ sftp "/tmp/unet-8591135739089553150.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_1.h5"
$ sftp "/tmp/unet-8806742242741778632.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_2.h5"
$ sftp "/tmp/unet-8366725207263488560.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_3.h5"
$ sftp "/tmp/unet-1946763803660850257.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_4.h5"
$ sftp "/tmp/unet-7806440870826550305.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_5.h5"
$ sftp "/tmp/unet-7134146928483958440.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_6.h5"
$ sftp "/tmp/unet-8513109742971283698.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_7.h5"
$ sftp "/tmp/unet-4356171677631801023.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_8.h5"
$ sftp "/tmp/unet-2115524499617258184.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_9.h5"
$ sftp "/tmp/unet-6554963247515528681.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_10.h5"
$ sftp "/tmp/unet-7958642577088432017.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_11.h5"
$ sftp "/tmp/unet-7596627300800775416.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_12.h5"
$ sftp "/tmp/unet-7795662447579621757.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_13.h5"
$ sftp "/tmp/unet-1229242775828524394.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_14.h5"
$ sftp "/tmp/unet-4070816394182483321.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_15.h5"
$ sftp "/tmp/unet-5974613572401871820.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_16.h5"
$ sftp "/tmp/unet-5012107460445373874.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_17.h5"
$ sftp "/tmp/unet-1873208052756501108.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_18.h5"
$ sftp "/tmp/unet-6858721651339551052.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_19.h5"
$ sftp "/tmp/unet-8089652205409557005.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_20.h5"
$ sftp "/tmp/unet-5725426706108049953.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_21.h5"
$ sftp "/tmp/unet-7608736555302676740.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_22.h5"
$ sftp "/tmp/unet-4982690984373670164.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_23.h5"
$ sftp "/tmp/unet-86984389182684390.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_24.h5"
$ sftp "/tmp/unet-8066443981935560157.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_25.h5"
$ sftp "/tmp/unet-1770662725243244531.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_26.h5"
$ sftp "/tmp/unet-8958511571195205228.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_27.h5"
$ sftp "/tmp/unet-5980995913340060114.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_28.h5"
$ sftp "/tmp/unet-68419975348299284.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_29.h5"
$ sftp "/tmp/unet-6075110541042681249.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_30.h5"
$ sftp "/tmp/unet-7194968751161790104.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_31.h5"
$ sftp "/tmp/unet-4210257040092106702.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_32.h5"
$ sftp "/tmp/unet-6199343513652704161.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_33.h5"
$ sftp "/tmp/unet-836086232751771529.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_34.h5"
$ sftp "/tmp/unet-3828017726264670407.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_35.h5"
$ sftp "/tmp/unet-7845887863190552851.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_36.h5"
$ sftp "/tmp/unet-2832524476003047382.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_37.h5"
$ sftp "/tmp/unet-1840672047434077788.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_38.h5"
$ sftp "/tmp/unet-4014303859261042307.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_39.h5"
$ sftp "/tmp/unet-8116931262423464516.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_40.h5"
$ sftp "/tmp/unet-8037798238754365474.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_41.h5"
$ sftp "/tmp/unet-5124787291998211204.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_42.h5"
$ sftp "/tmp/unet-641146882808319450.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_43.h5"
$ sftp "/tmp/unet-642295062858391572.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_44.h5"
$ sftp "/tmp/unet-5387041193070417010.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_45.h5"
$ sftp "/tmp/unet-6659440853094300464.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_46.h5"
$ sftp "/tmp/unet-7696367105397481594.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_47.h5"
$ sftp "/tmp/unet-293038438841336272.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_48.h5"
$ sftp "/tmp/unet-1588629178800279702.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_49.h5"
$ sftp "/tmp/unet-4169276897488964543.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_50.h5"
$ sftp "/tmp/unet-773556640976172685.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_51.h5"
$ sftp "/tmp/unet-4035698830916795251.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_52.h5"
$ sftp "/tmp/unet-8150621356345097262.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_53.h5"
$ sftp "/tmp/unet-5983622946762386513.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_54.h5"
$ sftp "/tmp/unet-4432106429103330911.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_55.h5"
$ sftp "/tmp/unet-1639923198854482905.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_56.h5"
$ sftp "/tmp/unet-7481894413399954138.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_57.h5"
$ sftp "/tmp/unet-283941786984664460.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_58.h5"
$ sftp "/tmp/unet-733282710395592505.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_59.h5"
$ sftp "/tmp/unet-204694904087133417.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_60.h5"
$ sftp "/tmp/unet-6624600254260968697.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_61.h5"
$ sftp "/tmp/unet-6026002405050985156.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_62.h5"
$ sftp "/tmp/unet-692040428958177357.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_63.h5"
$ sftp "/tmp/unet-7838223118086939193.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_64.h5"
$ sftp "/tmp/unet-5293607745162842094.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_65.h5"
$ sftp "/tmp/unet-4215943816915668816.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_66.h5"
$ sftp "/tmp/unet-7647646060099423469.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_67.h5"
$ sftp "/tmp/unet-280566656756102855.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_68.h5"
$ sftp "/tmp/unet-7085297328934366690.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_69.h5"
$ sftp "/tmp/unet-6247194254009318433.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_70.h5"
$ sftp "/tmp/unet-7523996542116386158.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_71.h5"
$ sftp "/tmp/unet-341418945222463918.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_72.h5"
$ sftp "/tmp/unet-4964922863416197466.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_73.h5"
$ sftp "/tmp/unet-5531220205954050574.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_74.h5"
$ sftp "/tmp/unet-7801845241821795232.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_75.h5"
$ sftp "/tmp/unet-6057375970842618511.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_76.h5"
$ sftp "/tmp/unet-7746812756919883794.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_77.h5"
$ sftp "/tmp/unet-1985209088400247310.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_78.h5"
$ sftp "/tmp/unet-2067852636358726369.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_79.h5"
$ sftp "/tmp/unet-2478245220859908202.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_80.h5"
$ sftp "/tmp/unet-4581300370282789034.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_81.h5"
$ sftp "/tmp/unet-4659684296577540002.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_82.h5"
$ sftp "/tmp/unet-6900649995884365592.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_83.h5"
$ sftp "/tmp/unet-3586301529478212538.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_84.h5"
$ sftp "/tmp/unet-5250500836356533551.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_85.h5"
$ sftp "/tmp/unet-6495302120719668678.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_86.h5"
$ sftp "/tmp/unet-156317646978945000.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_87.h5"
$ sftp "/tmp/unet-7520654010198437620.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_88.h5"
$ sftp "/tmp/unet-12497491367357789.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_89.h5"
$ sftp "/tmp/unet-8505305319907189680.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_90.h5"
$ sftp "/tmp/unet-7907835158995015294.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_91.h5"
$ sftp "/tmp/unet-5045312248328090716.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_92.h5"
$ sftp "/tmp/unet-4746897568897586824.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_93.h5"
$ sftp "/tmp/unet-1050409133323525736.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_94.h5"
$ sftp "/tmp/unet-836692674466411227.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_95.h5"
$ sftp "/tmp/unet-6705943626366946223.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_96.h5"
$ sftp "/tmp/unet-1139938941232899395.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_97.h5"
$ sftp "/tmp/unet-9182710107144098599.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_98.h5"
$ sftp "/tmp/unet-4888067200592247896.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_99.h5"
$ sftp "/tmp/unet-7334339055171858057.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_100.h5"
$ sftp "/tmp/unet-976160864782450305.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_101.h5"
$ sftp "/tmp/unet-8710923410422600017.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_102.h5"
$ sftp "/tmp/unet-2483664883773330622.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_103.h5"
$ sftp "/tmp/unet-8032221919799439384.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_104.h5"
$ sftp "/tmp/unet-7849523849339351088.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_105.h5"
$ sftp "/tmp/unet-6436638984753336724.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_106.h5"
$ sftp "/tmp/unet-7546159608820094868.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_107.h5"
$ sftp "/tmp/unet-7278815199498383517.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_108.h5"
$ sftp "/tmp/unet-1350985919285689558.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_109.h5"
$ sftp "/tmp/unet-3917394184972152779.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_110.h5"
$ sftp "/tmp/unet-3570644306345847213.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_111.h5"
$ sftp "/tmp/unet-849264144567609019.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_112.h5"
$ sftp "/tmp/unet-5229474986784201134.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_113.h5"
$ sftp "/tmp/unet-8087892508332110027.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_114.h5"
$ sftp "/tmp/unet-4224140053199840173.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_115.h5"
$ sftp "/tmp/unet-2892160254184233568.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_116.h5"
$ sftp "/tmp/unet-5507077445973746179.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_117.h5"
$ sftp "/tmp/unet-6739530348207500923.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_118.h5"
$ sftp "/tmp/unet-4901838998787252140.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_119.h5"
$ sftp "/tmp/unet-5737655600896751849.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_120.h5"
$ sftp "/tmp/unet-1547471633533784941.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_121.h5"
$ sftp "/tmp/unet-2761260349792892403.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_122.h5"
$ sftp "/tmp/unet-8241973524132098062.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_123.h5"
$ sftp "/tmp/unet-6222435695524647946.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_124.h5"
$ sftp "/tmp/unet-3350220926167593561.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_125.h5"
$ sftp "/tmp/unet-1815865713260270136.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_126.h5"
$ sftp "/tmp/unet-833465268609889853.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_127.h5"
$ sftp "/tmp/unet-7296789308578871834.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_128.h5"
$ sftp "/tmp/unet-7895278476948913538.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_129.h5"
$ sftp "/tmp/unet-8295648460487964838.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_130.h5"
$ sftp "/tmp/unet-416661836181474632.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_131.h5"
$ sftp "/tmp/unet-3358819363420194161.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_132.h5"
$ sftp "/tmp/unet-4657636416493475238.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_133.h5"
$ sftp "/tmp/unet-6860613118486520566.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_134.h5"
$ sftp "/tmp/unet-852426724938700598.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_135.h5"
$ sftp "/tmp/unet-7985732418181024100.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_136.h5"
$ sftp "/tmp/unet-4673027388237540936.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_137.h5"
$ sftp "/tmp/unet-930519142862424697.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_138.h5"
$ sftp "/tmp/unet-6109412088145705045.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_139.h5"
$ sftp "/tmp/unet-6408488650813175337.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_140.h5"
$ sftp "/tmp/unet-5846860351898195409.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_141.h5"
$ sftp "/tmp/unet-2465767961486617762.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_142.h5"
$ sftp "/tmp/unet-5723498006682142824.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_143.h5"
$ sftp "/tmp/unet-3873320238338554856.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_144.h5"
t = 1: scale = 0.0047393367, offset = -1.0
  tiling = 29x5
  nTiles = 145
$ sftp "/tmp/unet-4906226389031519427.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_0.h5"
$ sftp "/tmp/unet-5714798486390339360.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_1.h5"
$ sftp "/tmp/unet-4870170144944071685.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_2.h5"
$ sftp "/tmp/unet-5331692642127674643.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_3.h5"
$ sftp "/tmp/unet-2600684872342283447.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_4.h5"
$ sftp "/tmp/unet-3763529999680523377.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_5.h5"
$ sftp "/tmp/unet-3130804910904183027.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_6.h5"
$ sftp "/tmp/unet-1495943865741236772.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_7.h5"
$ sftp "/tmp/unet-4411664547800206602.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_8.h5"
$ sftp "/tmp/unet-2947440904329056185.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_9.h5"
$ sftp "/tmp/unet-3028175184634557771.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_10.h5"
$ sftp "/tmp/unet-450985896463587629.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_11.h5"
$ sftp "/tmp/unet-7609888176250209449.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_12.h5"
$ sftp "/tmp/unet-8898455798911259717.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_13.h5"
$ sftp "/tmp/unet-1503804619612904680.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_14.h5"
$ sftp "/tmp/unet-3336272595156574332.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_15.h5"
$ sftp "/tmp/unet-1527827692722255273.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_16.h5"
$ sftp "/tmp/unet-7436960035953508442.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_17.h5"
$ sftp "/tmp/unet-5571333411668001295.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_18.h5"
$ sftp "/tmp/unet-1464316997113894632.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_19.h5"
$ sftp "/tmp/unet-1888314123698464818.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_20.h5"
$ sftp "/tmp/unet-732275291587227844.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_21.h5"
$ sftp "/tmp/unet-595263958771590190.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_22.h5"
$ sftp "/tmp/unet-1517643509846426106.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_23.h5"
$ sftp "/tmp/unet-7077977013059047581.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_24.h5"
$ sftp "/tmp/unet-4066588104302363496.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_25.h5"
$ sftp "/tmp/unet-1025244261053643530.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_26.h5"
$ sftp "/tmp/unet-6549973518498035314.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_27.h5"
$ sftp "/tmp/unet-9005991206564027266.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_28.h5"
$ sftp "/tmp/unet-8623785620200863327.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_29.h5"
$ sftp "/tmp/unet-6533706421615831978.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_30.h5"
$ sftp "/tmp/unet-737412412962838748.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_31.h5"
$ sftp "/tmp/unet-6150684385036097603.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_32.h5"
$ sftp "/tmp/unet-3812611111897171648.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_33.h5"
$ sftp "/tmp/unet-5997433311280912957.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_34.h5"
$ sftp "/tmp/unet-2827893708841253683.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_35.h5"
$ sftp "/tmp/unet-6419179104422072140.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_36.h5"
$ sftp "/tmp/unet-1073595629801482910.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_37.h5"
$ sftp "/tmp/unet-3081876829319470985.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_38.h5"
$ sftp "/tmp/unet-845582710219157715.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_39.h5"
$ sftp "/tmp/unet-8379806331805635078.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_40.h5"
$ sftp "/tmp/unet-1232568181735485218.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_41.h5"
$ sftp "/tmp/unet-5787957255828323555.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_42.h5"
$ sftp "/tmp/unet-1352514289035891058.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_43.h5"
$ sftp "/tmp/unet-2149755508915227051.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_44.h5"
$ sftp "/tmp/unet-6743546201598829641.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_45.h5"
$ sftp "/tmp/unet-7956055126119433467.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_46.h5"
$ sftp "/tmp/unet-7366501544222229283.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_47.h5"
$ sftp "/tmp/unet-4309724966012127208.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_48.h5"
$ sftp "/tmp/unet-2911098749375249587.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_49.h5"
$ sftp "/tmp/unet-2248982560852481622.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_50.h5"
$ sftp "/tmp/unet-4837581370725200224.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_51.h5"
$ sftp "/tmp/unet-5728772197332262020.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_52.h5"
$ sftp "/tmp/unet-3333171497858331877.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_53.h5"
$ sftp "/tmp/unet-7372666530215876658.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_54.h5"
$ sftp "/tmp/unet-6740918914968042077.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_55.h5"
$ sftp "/tmp/unet-5277878153263929064.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_56.h5"
$ sftp "/tmp/unet-3216312043669436291.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_57.h5"
$ sftp "/tmp/unet-8297589227746518407.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_58.h5"
$ sftp "/tmp/unet-5685990515911537752.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_59.h5"
$ sftp "/tmp/unet-8669796677859972858.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_60.h5"
$ sftp "/tmp/unet-8650364314178820694.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_61.h5"
$ sftp "/tmp/unet-2162966543180221770.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_62.h5"
$ sftp "/tmp/unet-5376085515543252786.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_63.h5"
$ sftp "/tmp/unet-2557580926369237440.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_64.h5"
$ sftp "/tmp/unet-2132939970402713793.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_65.h5"
$ sftp "/tmp/unet-2410519892956807552.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_66.h5"
$ sftp "/tmp/unet-6486126231172563179.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_67.h5"
$ sftp "/tmp/unet-5996453120545788543.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_68.h5"
$ sftp "/tmp/unet-5695634476488179019.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_69.h5"
$ sftp "/tmp/unet-7865494250158565121.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_70.h5"
$ sftp "/tmp/unet-7859500611620018185.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_71.h5"
$ sftp "/tmp/unet-534150576839833641.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_72.h5"
$ sftp "/tmp/unet-3173193275900100261.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_73.h5"
$ sftp "/tmp/unet-7927604394316391416.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_74.h5"
$ sftp "/tmp/unet-9003440452883651218.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_75.h5"
$ sftp "/tmp/unet-9151032022971336251.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_76.h5"
$ sftp "/tmp/unet-18848458679976695.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_77.h5"
$ sftp "/tmp/unet-5173063483833540693.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_78.h5"
$ sftp "/tmp/unet-1061415860769352769.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_79.h5"
$ sftp "/tmp/unet-3901643332558633384.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_80.h5"
$ sftp "/tmp/unet-662286780693520856.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_81.h5"
$ sftp "/tmp/unet-3392476233709300411.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_82.h5"
$ sftp "/tmp/unet-2348632691280719013.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_83.h5"
$ sftp "/tmp/unet-491640909842090631.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_84.h5"
$ sftp "/tmp/unet-6084422573132566954.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_85.h5"
$ sftp "/tmp/unet-239041136219900026.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_86.h5"
$ sftp "/tmp/unet-4574892769111815171.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_87.h5"
$ sftp "/tmp/unet-6921761291442215266.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_88.h5"
$ sftp "/tmp/unet-3335948249430697087.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_89.h5"
$ sftp "/tmp/unet-175978630347283211.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_90.h5"
$ sftp "/tmp/unet-8588811657014651700.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_91.h5"
$ sftp "/tmp/unet-2138912549245792246.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_92.h5"
$ sftp "/tmp/unet-3889679616115140918.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_93.h5"
$ sftp "/tmp/unet-2521561628521131650.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_94.h5"
$ sftp "/tmp/unet-7799688693692255824.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_95.h5"
$ sftp "/tmp/unet-3342016442328278453.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_96.h5"
$ sftp "/tmp/unet-826011443753147618.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_97.h5"
$ sftp "/tmp/unet-8854467844838379962.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_98.h5"
$ sftp "/tmp/unet-3997039576994969512.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_99.h5"
$ sftp "/tmp/unet-5523542749994871410.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_100.h5"
$ sftp "/tmp/unet-686830971712638063.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_101.h5"
$ sftp "/tmp/unet-1763843545547183092.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_102.h5"
$ sftp "/tmp/unet-5890914863045960061.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_103.h5"
$ sftp "/tmp/unet-3793036175748499198.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_104.h5"
$ sftp "/tmp/unet-3286769501083634192.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_105.h5"
$ sftp "/tmp/unet-9064422019023678827.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_106.h5"
$ sftp "/tmp/unet-8279364324794941792.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_107.h5"
$ sftp "/tmp/unet-4530804225286789617.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_108.h5"
$ sftp "/tmp/unet-1072295059866489903.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_109.h5"
$ sftp "/tmp/unet-5786933067947469290.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_110.h5"
$ sftp "/tmp/unet-3270972657258523700.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_111.h5"
$ sftp "/tmp/unet-8226836805422678609.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_112.h5"
$ sftp "/tmp/unet-2305505741287346988.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_113.h5"
$ sftp "/tmp/unet-8252638643101473636.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_114.h5"
$ sftp "/tmp/unet-4132183036696918850.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_115.h5"
$ sftp "/tmp/unet-6743066821111235809.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_116.h5"
$ sftp "/tmp/unet-5602627795188039565.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_117.h5"
$ sftp "/tmp/unet-6935428991871079181.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_118.h5"
$ sftp "/tmp/unet-3021420433593133613.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_119.h5"
$ sftp "/tmp/unet-8702639603690296658.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_120.h5"
$ sftp "/tmp/unet-4542712786702687292.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_121.h5"
$ sftp "/tmp/unet-5931195001546435715.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_122.h5"
$ sftp "/tmp/unet-7578720719301528588.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_123.h5"
$ sftp "/tmp/unet-405112361672094376.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_124.h5"
$ sftp "/tmp/unet-1792674865007235997.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_125.h5"
$ sftp "/tmp/unet-6780157222518110684.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_126.h5"
$ sftp "/tmp/unet-4269511005941070578.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_127.h5"
$ sftp "/tmp/unet-1068373990224816873.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_128.h5"
$ sftp "/tmp/unet-6216843409556800092.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_129.h5"
$ sftp "/tmp/unet-6753596953579034837.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_130.h5"
$ sftp "/tmp/unet-8364757040364941132.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_131.h5"
$ sftp "/tmp/unet-8538842955890100890.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_132.h5"
$ sftp "/tmp/unet-620416232810175878.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_133.h5"
$ sftp "/tmp/unet-6526932558449066036.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_134.h5"
$ sftp "/tmp/unet-6265404788553268523.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_135.h5"
$ sftp "/tmp/unet-3459308673141781288.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_136.h5"
$ sftp "/tmp/unet-8440385345444431866.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_137.h5"
$ sftp "/tmp/unet-5350330322037178328.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_138.h5"
$ sftp "/tmp/unet-8799599475680600336.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_139.h5"
$ sftp "/tmp/unet-5773164935841218488.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_140.h5"
$ sftp "/tmp/unet-1219173373551803645.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_141.h5"
$ sftp "/tmp/unet-3469731975942700642.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_142.h5"
$ sftp "/tmp/unet-7643431027577029815.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_143.h5"
$ sftp "/tmp/unet-6800711595837485026.h5" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_144.h5"
$ sftp "/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da48803352612071615208-trainfilelist.txt" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4-trainfilelist.txt"
$ sftp "/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da46886407304290027279-validfilelist.txt" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4-validfilelist.txt"
$ sftp "/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da42599936632870271204-model.prototxt" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4-model.prototxt"
$ sftp "/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da47543288804660436531-solver.prototxt" "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4-solver.prototxt"
caffe train -solver /gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4-solver.prototxt -weights /gpfs01/berens/user/jlause/unet/caffemodels/2d_cell_net_v0.caffemodel.h5 -gpu all -sigint_effect stop 
$ sftp "jlause@localhost:8888:/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4-snapshot_iter_5000.caffemodel.h5" "/home/jan/CIN/berens/data/data/immunoanalysis/Model_Unet_ManualTraining/dataset8/ft_segmentation/2dnet_v0_test_RAM_usage3_weights.caffemodel.h5"
Could not rename weightsfile to /home/jan/CIN/berens/data/data/immunoanalysis/Model_Unet_ManualTraining/dataset8/ft_segmentation/2dnet_v0_test_RAM_usage3_weights.caffemodel.h5
The trained model can be found at /gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4-snapshot_iter_5000.caffemodel.h5
2: No such file
Finetuned weights have been saved to /gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4-snapshot_iter_5000.caffemodel.h5 on the remote host.
Finetuning finished
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4.modeldef.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_train_0.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_train_1.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_train_2.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_train_3.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_train_4.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_0.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_1.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_2.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_3.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_4.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_5.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_6.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_7.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_8.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_9.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_10.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_11.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_12.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_13.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_14.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_15.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_16.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_17.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_18.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_19.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_20.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_21.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_22.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_23.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_24.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_25.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_26.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_27.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_28.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_29.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_30.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_31.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_32.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_33.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_34.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_35.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_36.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_37.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_38.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_39.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_40.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_41.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_42.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_43.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_44.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_45.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_46.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_47.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_48.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_49.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_50.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_51.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_52.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_53.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_54.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_55.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_56.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_57.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_58.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_59.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_60.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_61.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_62.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_63.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_64.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_65.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_66.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_67.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_68.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_69.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_70.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_71.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_72.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_73.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_74.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_75.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_76.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_77.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_78.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_79.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_80.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_81.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_82.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_83.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_84.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_85.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_86.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_87.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_88.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_89.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_90.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_91.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_92.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_93.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_94.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_95.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_96.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_97.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_98.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_99.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_100.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_101.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_102.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_103.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_104.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_105.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_106.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_107.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_108.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_109.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_110.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_111.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_112.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_113.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_114.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_115.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_116.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_117.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_118.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_119.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_120.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_121.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_122.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_123.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_124.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_125.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_126.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_127.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_128.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_129.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_130.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_131.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_132.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_133.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_134.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_135.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_136.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_137.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_138.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_139.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_140.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_141.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_142.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_143.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_0_144.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_0.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_1.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_2.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_3.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_4.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_5.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_6.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_7.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_8.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_9.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_10.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_11.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_12.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_13.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_14.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_15.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_16.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_17.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_18.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_19.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_20.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_21.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_22.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_23.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_24.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_25.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_26.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_27.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_28.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_29.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_30.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_31.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_32.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_33.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_34.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_35.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_36.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_37.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_38.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_39.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_40.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_41.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_42.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_43.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_44.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_45.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_46.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_47.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_48.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_49.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_50.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_51.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_52.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_53.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_54.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_55.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_56.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_57.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_58.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_59.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_60.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_61.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_62.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_63.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_64.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_65.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_66.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_67.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_68.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_69.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_70.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_71.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_72.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_73.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_74.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_75.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_76.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_77.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_78.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_79.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_80.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_81.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_82.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_83.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_84.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_85.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_86.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_87.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_88.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_89.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_90.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_91.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_92.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_93.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_94.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_95.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_96.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_97.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_98.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_99.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_100.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_101.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_102.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_103.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_104.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_105.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_106.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_107.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_108.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_109.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_110.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_111.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_112.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_113.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_114.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_115.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_116.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_117.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_118.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_119.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_120.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_121.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_122.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_123.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_124.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_125.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_126.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_127.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_128.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_129.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_130.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_131.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_132.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_133.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_134.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_135.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_136.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_137.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_138.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_139.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_140.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_141.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_142.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_143.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4_valid_1_144.h5"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4-trainfilelist.txt"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4-validfilelist.txt"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4-model.prototxt"
jlause@localhost $ rm "/gpfs01/berens/user/jlause/unet/tmp/unet-d4ff796d-f176-46d5-99ab-55efd7456da4-solver.prototxt"
U-Net job finished

Make "Create Caffe Blob" job macro-aware

Currently this job takes the current ImagePlus, and creates a set of new ImagePlus objects containing data, labels, weights and sample pdf. Although this is nice for debugging, it is of no practical use.

Instead it should write out the created blobs to an hdf5 file that can be used for training a model offline. This functionality must be scriptable. A small macro that processes whole folders that way and writes corresponding blobs to selected output folders, and then creates a small script to start the training would be great!

"de.unifreiburg.unet.DetectionJob.processHyperStack" does not work uising ImageJ Macro

Thank you very much for developing the really great software.

I am trying to run "detection" using ".ijm" (ImageJ Macro), however,
call("de.unifreiburg.unet.DetectionJob.processHyperStack", ....)
dose not work even though call("de.unifreiburg.unet.SegmentationJob.processHyperStack", ....) perfectly works.

Can we use "de.unifreiburg.unet.DetectionJob" as ImageJ Macro or it's not supported yet?

The error message is as follows:
(Fiji Is Just) ImageJ 2.0.0-rc-69/1.52i; Java 1.8.0_172 [64-bit]; Mac OS X 10.14; 573MB of 8395MB (6%)

java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at ij.macro.Functions.call(Functions.java:4379)
at ij.macro.Functions.getStringFunction(Functions.java:274)
at ij.macro.Interpreter.getStringTerm(Interpreter.java:1366)
at ij.macro.Interpreter.getString(Interpreter.java:1344)
at ij.macro.Interpreter.doStatement(Interpreter.java:304)
at ij.macro.Interpreter.doStatements(Interpreter.java:236)
at ij.macro.Interpreter.run(Interpreter.java:119)
at ij.macro.Interpreter.run(Interpreter.java:90)
at ij.macro.Interpreter.run(Interpreter.java:101)
at ij.plugin.Macro_Runner.runMacro(Macro_Runner.java:161)
at ij.IJ.runMacro(IJ.java:147)
at ij.IJ.runMacro(IJ.java:136)
at net.imagej.legacy.IJ1Helper$3.call(IJ1Helper.java:1107)
at net.imagej.legacy.IJ1Helper$3.call(IJ1Helper.java:1103)
at net.imagej.legacy.IJ1Helper.runMacroFriendly(IJ1Helper.java:1054)
at net.imagej.legacy.IJ1Helper.runMacro(IJ1Helper.java:1103)
at net.imagej.legacy.plugin.IJ1MacroEngine.eval(IJ1MacroEngine.java:147)
at org.scijava.script.ScriptModule.run(ScriptModule.java:160)
at org.scijava.module.ModuleRunner.run(ModuleRunner.java:168)
at org.scijava.module.ModuleRunner.call(ModuleRunner.java:127)
at org.scijava.module.ModuleRunner.call(ModuleRunner.java:66)
at org.scijava.thread.DefaultThreadService$3.call(DefaultThreadService.java:238)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ArrayIndexOutOfBoundsException: 1
at de.unifreiburg.unet.DetectionJob.processHyperStack(DetectionJob.java:131)
... 30 more

Image tagging and Online model

Hey,
First thanks for your awesome plugin!
Some background: I'm trying to create a detection model for bone cells, in order to create an automated tool for cell counting. It will shorten the time period of biomedical researchers in this field.
I have 3 questions. It is my first machine learning task, so those questions are quite basics :)

  1. I have a set of annotated images: an image file (PNG) and Json file containing the coordinates of each class. Do you know how can I create easily based on this data tagged image (containing overlay layer) without doing manual work?
  2. Can I create an online model, a model which keeps on learning based on feedback? If the answer is yes, is there a friendly user interface for giving feedback to the model? Do I have to run the model manually once I get feedback, or can it be done automatically?
  3. Can I download the model and use it as an input for model written in python?

Thanks!
Shahar

FIJI plugin with AWS

Hi,
I installed the Fiji plugin and want to use an AWS server to run the plug. I have a few questions:

  1. Does the AWS server need a preinstalled Caffe library?
  2. I have tried connecting an AMI in the plugin using the remote host option, but it can not establish the connection. Could you explain this procedure in more details?
    Thank you,
    Aashrith

Input/Output error: java.io.IOException: Error during segmentation:exit status -1

Amozon EC2 Ubuntu Server 16.04 LTS (HVM)
CPU
tile shape 500x500

Input/Output error: java.io.IOException: Error during segmentation:exit status -1
unknown caffe error

Log before error:
I0420 13:50:03.208966 7217 net.cpp:814] Ignoring source layer def_data-data2
I0420 13:50:03.209018 7217 net.cpp:814] Ignoring source layer def_label-crop
I0420 13:50:03.209081 7217 net.cpp:814] Ignoring source layer def_weight-crop
I0420 13:50:03.209127 7217 net.cpp:814] Ignoring source layer dropout_d3c
I0420 13:50:03.209172 7217 net.cpp:814] Ignoring source layer dropout_d4c
I0420 13:50:03.209226 7217 net.cpp:814] Ignoring source layer loaddata
I0420 13:50:03.209272 7217 net.cpp:814] Ignoring source layer loss
I0420 13:50:03.209573 7217 net.cpp:814] Ignoring source layer reshape_data
I0420 13:50:03.209621 7217 net.cpp:814] Ignoring source layer reshape_labels
I0420 13:50:03.209668 7217 net.cpp:814] Ignoring source layer reshape_weights
I0420 13:50:03.209715 7217 net.cpp:814] Ignoring source layer reshape_weights2
I0420 13:50:03.214604 7217 tiled_predict.cpp:656] ----> tile (0,0)
F0420 13:50:03.564906 7217 syncedmem.hpp:33] Check failed: *ptr host allocation of size 1065369600 failed
*** Check failure stack trace: ***
@ 0x7f6e343885cd google::LogMessage::Fail()
@ 0x7f6e3438a433 google::LogMessage::SendToLog()
@ 0x7f6e3438815b google::LogMessage::Flush()
@ 0x7f6e3438ae1e google::LogMessageFatal::~LogMessageFatal()
@ 0x7f6e34adb183 caffe::SyncedMemory::mutable_cpu_data()
@ 0x7f6e34ab5982 caffe::Blob<>::mutable_cpu_data()
@ 0x7f6e348eb298 caffe::BaseConvolutionLayer<>::forward_cpu_gemm()
@ 0x7f6e3491fc46 caffe::ConvolutionLayer<>::Forward_cpu()
@ 0x7f6e34ae5d53 caffe::Net<>::ForwardFromTo()
@ 0x7f6e34ae5f56 caffe::Net<>::Forward()
@ 0x7f6e34aa8c50 caffe::TiledPredict<>()
@ 0x408e6f tiled_predict()
@ 0x4076a0 main
@ 0x7f6e329b7830 __libc_start_main
@ 0x407ef9 _start
@ (nil) (unknown)

what is wrong? Can you help me ?

Model/weight check failed

Dear Thorsten, here I still have some issue in running the example.

Using the following setting:
image
Error:
$ /home/daveb/unet-seg/bin/caffe_unet
$ /home/daveb/unet-seg/bin/caffe_unet
$ caffe_unet check_model_and_weights_h5 -model /home/daveb/Downloads/caffemodels/2d_cell_net_v0.modeldef.h5 -weights /home/daveb/Downloads/2d_cell_net_v0.caffemodel.h5 -n_channels 1 -gpu 0
Model/Weight check failed:
See log for further details
U-Net job aborted

Any idea how to solve this? Any other log file saved to track the issue? Thanks.

Installation and OS details:
Build from source (using instructions from readme); local machine; Ubuntu 18.04 LTS, CUDA 9.0 CuDNN 7

tutorial on training?

Hi,
First, great work on the Nature methods paper.
I tried Unet on caffe when it first came out.

But I wonder how easy is it to prepare training data (with reference data) to further train Unet or finetune in the current imageJ?

Do you have a tutorial for this?

thank you

Error messages from caffe calls too general

It would be nice if at least frequently reoccurring errors the user can fix by changing parameters would produce less cryptic error messages, ideally with suggestions on what to change.

3D U-net segmentation

Hi,
Thanks for the cool tool! For my dataset, I got very nice 2D segmentation based on Unet plugin, now I am using the U-net Plugin to do the 3D segmentation. But it always failed.

Q1: No matter how I set the parameters and the annotations, I never got IoU and F1 curve.

Untitled-github0

And I used your example pre-trained 3D model "3d_cell_net_v1_models", finetuned on it. The result still looked strange.
Untitled-github3

My 3D data is anisotropic. The input patch size is 802 * 802 * 100 (1 channel), resolution(x,y) is 1.02μm/px, and resolution(z) is 5μm/px.
As the supplementary information of the paper on Nature Methods mentioned, I annotated on selected slices in the stack (Once I tested the Roi set from 1st, 25th, 49th, 75th and 99th slice, the others are ignore. I also tested the Roi set just for the top, the central, the bottom and others ignore...whatever I did the annotations, the results were always unsatisfied as I showed at beginning.) For sure, the setting of Roi names and class name also followed as the paper.
In "create a new model" and "finetune", I used the similar parameters as I used in 2D segmentation, which the values had good performance. Just for test, 2 stacks for train, and 1 stack for validation.

how should I correctly build and train my 3D model?

Q2: The usage of "Extract Mask Annotations". Could you give me a clue to use it?

Thanks a lot in advance!

caffe_unet was not found

I setup on own server (using pre-built binaries)
when I test: start a new shell and execute "caffe",it's fine;
but when I execute"ssh localhost caffe",there's a error:

"zsh:1: command not found: caffe"

and when I use ImageJ according to your teaching video setp by step,something is wrong:

"caffe_unet was not found".

B47A67E92D224B3B82D6318A55FDA3D3

85034084D4444BDF9304D0AD0F63F4DC

How to change normalization strategy and weight map in fine tuning?

Hi,
Because the features of my images are diverse, so I am trying to subtract the mean and divide by sd of each image. How can I realize it in fine tuning?
For my images, foreground/background is about 0.003. To decrease the weight of background, what is the best value for Vbal? And how can I change it?
Thank you very much!

Macro call does not properly respect Windows paths

call('de.unifreiburg.unet.SegmentationJob.processHyperStack', 'modelFilename=C:\Users\username\Desktop\xxx\xxx.modeldef.h5,weightsFilename=xxx.caffemodel.h5,Tile shape (px):=724x516,gpuId=GPU 0,useRemoteHost=true,hostname=lmbunet.informatik.uni-freiburg.de,port=2222,username=unetuser,processFolder=,average=none,keepOriginal=true,outputScores=false,outputSoftmaxScores=false');

failed with log output

(Fiji Is Just) ImageJ 2.0.0-rc-68/1.52i; Java 1.8.0_66 [64-bit]; Windows 10 10.0; 1083MB of 6024MB (17%)

java.lang.reflect.InvocationTargetException

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:497)

at ij.macro.Functions.call(Functions.java:4379)

at ij.macro.Functions.getStringFunction(Functions.java:274)

at ij.macro.Interpreter.getStringTerm(Interpreter.java:1366)

at ij.macro.Interpreter.getString(Interpreter.java:1344)

at ij.macro.Interpreter.doStatement(Interpreter.java:304)

at ij.macro.Interpreter.doStatements(Interpreter.java:236)

at ij.macro.Interpreter.run(Interpreter.java:119)

at ij.macro.Interpreter.run(Interpreter.java:90)

at ij.macro.Interpreter.run(Interpreter.java:101)

at ij.plugin.Macro_Runner.runMacro(Macro_Runner.java:161)

at ij.IJ.runMacro(IJ.java:147)

at ij.IJ.runMacro(IJ.java:136)

at net.imagej.legacy.IJ1Helper$3.call(IJ1Helper.java:1098)

at net.imagej.legacy.IJ1Helper$3.call(IJ1Helper.java:1094)

at net.imagej.legacy.IJ1Helper.runMacroFriendly(IJ1Helper.java:1045)

at net.imagej.legacy.IJ1Helper.runMacro(IJ1Helper.java:1094)

at net.imagej.legacy.plugin.IJ1MacroEngine.eval(IJ1MacroEngine.java:137)

at org.scijava.script.ScriptModule.run(ScriptModule.java:160)

at org.scijava.module.ModuleRunner.run(ModuleRunner.java:168)

at org.scijava.module.ModuleRunner.call(ModuleRunner.java:127)

at org.scijava.module.ModuleRunner.call(ModuleRunner.java:66)

at org.scijava.thread.DefaultThreadService$3.call(DefaultThreadService.java:238)

at java.util.concurrent.FutureTask.run(FutureTask.java:266)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: ncsa.hdf.hdf5lib.exceptions.HDF5FileNotFoundException: Path does not exit.
(C:\Fiji\UsersusernameDesktop xxx xx.modeldef.h5)

at ch.systemsx.cisd.hdf5.HDF5BaseReader.openFile(HDF5BaseReader.java:194)

at ch.systemsx.cisd.hdf5.HDF5BaseReader.(HDF5BaseReader.java:147)

at ch.systemsx.cisd.hdf5.HDF5BaseReader.(HDF5BaseReader.java:126)

at ch.systemsx.cisd.hdf5.HDF5ReaderConfigurator.reader(HDF5ReaderConfigurator.java:86)

at de.unifreiburg.unet.ModelDefinition._load(ModelDefinition.java:304)

at de.unifreiburg.unet.ModelDefinition.load(ModelDefinition.java:809)

at de.unifreiburg.unet.SegmentationJob.processHyperStack(SegmentationJob.java:604)

... 30 more

null pointer exception in checkParameters() of SegmentationJob

Issue detail: When runs segmentation job using BF example dataset and pretrained model provided by the paper, exception occurs:

Exception in thread "Thread-5" java.lang.NullPointerException
at de.unifreiburg.unet.SegmentationJob.checkParameters(SegmentationJob.java:390)
at de.unifreiburg.unet.SegmentationJob.getParameters(SegmentationJob.java:438)
at de.unifreiburg.unet.SegmentationJob.run(SegmentationJob.java:661)

log file indicates:

$ /home/daveb/unet-seg/bin/caffe_unet
$ /home/daveb/unet-seg/bin/caffe_unet
$ caffe_unet check_model_and_weights_h5 -model /home/daveb/Downloads/caffemodels/2d_cell_net_v0.modeldef.h5 -weights /home/daveb/Downloads/2d_cell_net_v0.caffemodel.h5 -n_channels 1 -gpu 0

Installation and OS details:

Build from source (using instructions from project website);

No backend used (running caffe_unet in terminal correctly shows usage information)

Ubuntu 18.04 LTS, CUDA 9.0 CuDNN 7

java.lang.NoSuchMethodError

I recently tried to finetune a model, but run into following error, when starting the finetune process:

Exception in thread "Thread-10" java.lang.NoSuchMethodError: de.unifreiburg.unet.ProgressMonitor.taskProgressMax()F
at de.unifreiburg.unet.FinetuneWithRoisJob.run(FinetuneWithRoisJob.java:291)

I trief with a fresh Fiji-Download from http://fiji.sc ; deleted the IJ_Prefs.txt file; and a clean install of the U-Net Plugin via the "Manage update sites". Tried it on 2 different machines (Win 8.1/10), but still the same error. Backend server is running Ubuntu 16.04 LTS with the "caffe_unet_package_16.04_gpu_cuDNN.zip" prebuild binary. Segmentation workes fine.

Also when pressing the "from Image" button for element size a similar error occurs:

Exception in thread "AWT-EventQueue-0" java.lang.NoSuchMethodError: de.unifreiburg.unet.Tools.getElementSizeUmFromCalibration(Lij/measure/Calibration;I)[D
at de.unifreiburg.unet.FinetuneWithRoisJob$1.actionPerformed(FinetuneWithRoisJob.java:166)

Any idea how to fix it?
Thank you very much!

grafik

Script: U-Net integration into python pipeline.

Hey all,

I currently have my image processing pipeline for cell detection in python and I've been looking for ways to integrate your UNET implementation into it. More specifically, I have a datajoint pipeline which holds images and ground truth outlines/center locations, then trains models based on that, makes predictions for all models&images and finally computes quality metrics. Now I want to try to add your model to it.

Thus, I'm looking for a GUI-free way to start and control finetuning/segementation/detection jobs from a python environment. Is there a "command line-like" level that I could access?

As far as I understood from a brief look through your code, you prepare the model definition and input files in a certain way (creating blobs / h5files within the Java part of the code), and then submit these to the respective caffe functions, which then return results to the Java plugin.

I'm not sure if this is correct and where in that sequence it would be wise to start with a python integration (or if that is a bad idea to begin with, and implementing UNET myself is easier). If you have any thoughts on this or if you could point me to some documentation of your Java/caffe interface, I'd be very grateful!

Cheers,
Jan.

Post Unet update - local execution broken - caffe_unet not found

I updated the unet plugin on the local installation of fiji on my ubuntu server to address the bug where command line execution ignored the model/weights parameters. Unfortunately the new version results in segmentation not running at all. Remote execution from a windows machine with the old plugin still woks fine - I've yet to update it to test if it breaks it too.

Following the update, running a segmentation job from the GUI plugin results in "Caffe_unet was not found, please specify your caffe_unet binary" message. This is not the library issue as the command caffe_unet executes both remotely via SSH, and locally via terminal. When I execute it locally I can't get it to work but if connect to caffe_unet via SSH - the segmentation job executes fine.

I've tried restarting and deleting IJ_prefs in ~/.imagej/ - no joy.

Executing the segmentation job via a macro results in a more informative error:
Caffe blobs saved to '/home/administrator/cellnet/unet-9f09797f-9c1b-482f-8e8e-48520e2613ce.h5'
caffe_unet tiled_predict -infileH5 /home/administrator/cellnet/unet-9f09797f-9c1b-482f-8e8e-48520e2613ce.h5 -outfileH5 /home/administrator/cellnet/unet-9f09797f-9c1b-482f-8e8e-48520e2613ce.h5 -model /home/administrator/Desktop/CPbolek/UNET/caffemodels/OE4chanDAPI1_23JUN19.modeldef.h5 -weights /home/administrator/cellnet/caffemodels/OE4chanDAPI1_23JUN19.caffemodel.h5 -iterations 0 -tile_size 1188x1188 -gpu 1
caffe_unet: symbol lookup error: caffe_unet: undefined symbol: _ZN5caffe3NetIfE21CopyTrainedLayersFromERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE

Low loss but still getting poor segmentation

I am fine-tuning a model to detect neural stem cells. The cell shape is not very consistent from picture to picture and the cells will often go out of focus. The loss and intersection over union are both pretty good (.15 and .7 respectively) but the segmentation is very poor (under .1). When I try to segment using the trained model it either picks up on nothing or partially recognizes a few cells. I am confused why the performance is so good on the other two metrics and yet it still fails to segment. Do you have any suggestions for how I can get better segmentation results? Thanks!

Finetuning can't find 'train', aborts

Dear all,

I moved to GPU for finetuning, using the following setup:

Server: CUDA 10.0, cuDNN 7, Ubuntu 18, running within a docker container into which I ssh
Client: Ubuntu 16

I use the binaries provided at https://lmb.informatik.uni-freiburg.de/resources/opensource/unet/caffe_unet_package_18.04_gpu_cuda10_cudnn7.tar.gz

Segmentation and Detection work fine with this setup. However, finetuning does not even start, aborting with the following error:
image
The log output:
image
I use the following settings:
image

Thanks in advance for any hint what I might be doing wrong. If you need more details to reproduce, let me know!
Cheers, Jan.

caffe_unet not found on ImageJ

Hi All,

I was trying to install and test u-net segmentation on some of our biological images. I have ubuntu 16.04 running on VirtualBox, with both frontend and backend running on the same machine. I followed the instructions on the project page to install u-net from pre-built binaries, except that I did not install CUDA as my virtual machine has no gpu, so I was testing with just my cpu. After setting up the environment with the following lines:
export UNET_PATH="$/home/username/u-net"
export PATH="$PATH:$/home/username/u-net/bin"
export LD_LIBRARY_PATH="$LD_LIBRARY_PATH:$/home/username/u-net/lib:/home/username/u-net/extlib"

I tested it by simply typing caffe on the terminal and I got the following:

bash: /home/username/u-net/bin/caffe: cannot execute binary file: Exer format error

I also checked the Shell by using:

echo $SHELL

and I got:

/bin/bash

I ran U-net Segmentation on ImageJ and the error "caffe_unet was not found" came out. As I saw the same question raised by Christian on another thread (#17), I opened imageJ from the shell using the following lines suggested by Christian (Thank you Christian):

cd /home/username/Fiji.app
./ImageJ-linux32

(my username is username)

But I still ran into the same problem.

I'm sorry if that seems a stupid question, as I had very little experience in programming/ubuntu, I would really appreciate it if anyone can help.

Thank you!

Brian

Train and Test 3D images in ImageJ(Fiji) using U-Net Plugin

Dear all,

Hi, I am Jihoon and learning about U-Net nowadays.
I want to train and test 3D image data using 3D U-Net Plugin in ImageJ(Fiji).
Is it possible to do it?
Also, if anybody knows how to do it, can you write the procedure?
Thank you.

Finetuning ERROR: unknown command line flag

Dear all,

I just installed U-net on my local computer, running Ubuntu 16.04, nvidia-driver 410, CUDA 10, cuDNN v7, etc. I installed from the pre-compiled binaries.
Segmentation using the provided models work as intended.
However starting the Finetuning function gives the following errors:
screenshot from 2019-02-09 19-01-43

As far as I can understand, caffe_unet does not includes the flags siging_effect nor solver, while caffe does:
caffe in Terminal:
screenshot from 2019-02-09 19-04-05

caffe_unet in Terminal:
screenshot from 2019-02-09 19-05-25

Any idea on how to solve this?

Thank you very much

caffe_unet was not found

Hi,

I am trying to run your U-Net plugin on our Linux server (Devuan GNU/Linux 2.0 , CUDA 9.2.88 and no CuDNN) and downloaded and installed the file caffe_unet_package_16.04_gpu_cuda9.tar.gz. When running caffe or caffe_unet on my commandline, everything seems to be fine.

When trying to run the U-Net Job Manager and start a segmentation I get the following error message (up until then I was following your tutorial video)
u-net_fiji_error

The caffe_unet binary file is however correctly located under /home/user/u-net/bin/.

Any idea what the problem might be?

Question: How to generate weight file when training from scratch?

Hey all,

I want to train the model architecture you provide as pre-trained "base model" from scratch. Thus, I used the plugin function under U-Net/Utilities/Create new model which created a new modeldef.h5 file, but no randomly initialized weight file as far as I can see.

What is the way to go here? How can I start a training without a weight file? Or does the plugin offer a way to generate the initial weights so I can use the finetuning functions to train from scratch? Or do I have to interface with the command line tools somehow?

Happy for any hint, thanks in advance!

Jan.

Handle out of memory and invalid device ordinal errors without Job abort

Job fail due to selection of a non-existent GPU is caught during parameter check, and thus can be handled by the user, however the frequently re-occurring out of memory error is caught too late, so the whole pre-processing pipeline is run before finally the user gets informed that not enough memory is available with non-graceful job abort... This is not very nice user experience and should be changed. Ideally the user could change GPU selection or tile shape upon this error.

What to put WeightsFilename in "de.unifreiburg.unet.DetectionJob.processHyperStack" ?

In the tutorial video, it seems a caffemodel is specified in WeightsFilename for detection, however, when I specify a caffemodel in WeightsFilename with "de.unifreiburg.unet.DetectionJob.processHyperStack" it does not work. But, using ".modeldef.h5", it is fine.

Is there any problems if I put ".modeldef.h5" in WeightsFilename with "de.unifreiburg.unet.DetectionJob.processHyperStack"?

Thank you.

Finetuning with validation does not work (tutorial settings)

Hey all,

I am currently testing your ImageJ plugin, following the tutorials.

My setup is Ubuntu 16.04, no CUDA/GPU. I used the pre-build caffe package for CPU (caffe_unet_package_16.04_cpu.zip from https://lmb.informatik.uni-freiburg.de/resources/opensource/unet/).

When I try to follow your finetuning tutorial with the following settings:

image

I get the following caffee-error, that seems to be related to the IoU-measure computed during validation:

image

Full logfile:

Log_tutorial.txt

The following tasks work as expected:
-Segmentation
-Detection
-Finetuning without validation (I terminated after a few iterations, but did not get the error described above)

I hope this helps to improve the software.
If you need more information, let me know!
Best, Jan.

Issue with caffe_unet library path

So I am trying to install the U-net server according to the following tutorials
https://lmb.informatik.uni-freiburg.de/resources/opensource/unet/#installation-backend-onsite
https://github.com/lmb-freiburg/Unet-Segmentation/wiki/Installation

on Ubuntu. When I run Fiji from the terminal I get a caffe_unet was not found error if I do not select use remote host or a cannot connect to localhost one when I do. I believe I have a library path error because when I try to run caffe from the terminal I get

caffe: error while loading shared libraries: libcudart.so.10.0: cannot open shared object file: No such file or directory

Here is the top of my .bashrc
image

and here are my settings in Fiji.
image

Can anyone see what I am doing wrong?

Fiji Train - Caffe_unet train or caffe train

When starting finetuning in different Fiji instances on the same computer I get the error
ERROR Unknown command line flag 'sigint_effect'
ERROR Unknown command line flag 'solver'

it seems that some instance of my Fiji issue the train command as "caffe train -solver...." where as others issue "caffe_unet train -solver...." (this one doesn't work)

I'm using different instances of Fiji as it seems when starting a train, all the images that are loaded have to be used as train or validate (it would be nice if it was possible to remove images without having to close them from Fiji but I suppose this is a feature request)

Is this a version issue where the old unet plugin used "caffe_unet train" and the new one uses "caffe train" ?

"cat: tmp" No such file or directory" Error

Hi everyone,

I'm currently trying to install and use Unet for some cell quantification. I decided to go with AWS option, however I'm having some troubles passing by this step:
" echo "export PATH=$PATH:/home/ubuntu/caffe_unet_package_16.04_gpu_no_cuDNN/bin" | cat - tmp > ~/.bashrc"
I get an error saying: "cat: tmp" No such file or directory"

Could you please help with this?
Thank you in advance.
Best.

hungarian_algorithm.cpp:84] Check failed: value >= 0 (-nan vs. 0) All matrix elements have to be non-negative.

Hi! I'm trying to train a 3d model from scratch using a 332 resolution without normalization. My system is Ubuntu 18.04 with CuDNN 7.6 and Cuda 10.0.
For the hardware part:
2x GTX970 4gb (I used only the GPU1)
I7 4790K
16gb of RAM
I get the error below after a few thousand iterations if I have validation images (in local). the time before error seems to link to the size of the validation images and frequency of the validation steps but not completely sure... I tried to do it remotely with 3 small images to see if it would be better but if I put 1 image in the validation it gives me the same message directly at the starts.

Here are the message and log from a remote test

Capture
Log.txt

I0728 11:44:18.950510 4121 softmax_loss_layer.cu:93] SoftmaxWithLoss warning: sum of pixel wise loss weights is zero!
I0728 11:44:18.950646 4121 iou_layer.cu:89] IoU - Per class intersection: 0
I0728 11:44:18.950652 4121 iou_layer.cu:91] IoU - Per class union: 0
I0728 11:44:18.951164 4121 f1_layer.cpp:387] F1_detection - Per class true positive count: 0
I0728 11:44:18.951170 4121 f1_layer.cpp:389] F1_detection - Per class prediction count: 0
I0728 11:44:18.951174 4121 f1_layer.cpp:391] F1_detection - Per class object count: 0
I0728 11:44:18.951588 4121 f1_layer.cpp:387] F1_segmentation - Per class true positive count: 0
I0728 11:44:18.951593 4121 f1_layer.cpp:389] F1_segmentation - Per class prediction count: 0
I0728 11:44:18.951596 4121 f1_layer.cpp:391] F1_segmentation - Per class object count: 0
I0728 11:44:19.146605 4121 iou_layer.cu:89] IoU - Per class intersection: 5
I0728 11:44:19.146618 4121 iou_layer.cu:91] IoU - Per class union: 3586
F0728 11:44:19.147724 4121 hungarian_algorithm.cpp:84] Check failed: value >= 0 (-nan vs. 0) All matrix elements have to be non-negative.
*** Check failure stack trace: ***
@ 0x7f06c6bd30cd google::LogMessage::Fail()
@ 0x7f06c6bd4f33 google::LogMessage::SendToLog()
@ 0x7f06c6bd2c28 google::LogMessage::Flush()
@ 0x7f06c6bd5999 google::LogMessageFatal::~LogMessageFatal()
@ 0x7f06c7334f60 HungarianAlgorithm::assignmentoptimal()
@ 0x7f06c733544a HungarianAlgorithm::Solve()
@ 0x7f06c722fa27 caffe::F1Layer<>::Forward_cpu()
@ 0x7f06c72e4ee7 caffe::Net<>::ForwardFromTo()
@ 0x7f06c72e51f7 caffe::Net<>::Forward()
@ 0x7f06c7302290 caffe::Solver<>::Test()
@ 0x7f06c7302a07 caffe::Solver<>::TestAll()
@ 0x7f06c7304c2b caffe::Solver<>::Step()
@ 0x7f06c7304e2d caffe::Solver<>::Solve()
@ 0x556a11596384 train()
@ 0x556a1159205a main
@ 0x7f06c595eb97 __libc_start_main
@ 0x556a11592a5a _start

In the end, I can work with it locally but I always need to do only 3000-5000 iterations each session which is not ideal. I hope that I just configured something wrong and that there is a simple fix because the first results are encouraging. Thank you for this great work!

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.