Hi, I follow instruction doc Nydus Setup for Containerd Env

Hi，Thank you <a class="user-mention notranslate" data-hovercard-type="user" data-hover

<a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/us

Thank you <a class="user-mention notranslate" data-hovercard-type="user" data-hovercar

nydusd is trying to connect to your local registry with url: <div class="snippet-c

Nydus with containerd running Pod failed,about dragonflyoss/nydus

Comments (10)

changweige commented on June 29, 2024

Hi,
I noticed that you set nydus-snapshotter's root directory fixed at /var/lib/containerd/io.containerd.snapshotter.v1.nydus where it stores metadata into its own boltdb. Can your take a try to remove that directory entirely? I doubt that inconsistency sit between containerd and snapshotter. Moreover, please ensure only one containerd daemon is running in your local node.

From the error log, it's not nydusd's turn to come to the stage.

from nydus.

Apokleos commented on June 29, 2024

Hi,
I noticed that you set nydus-snapshotter's root directory fixed at /var/lib/containerd/io.containerd.snapshotter.v1.nydus where it stores metadata into its own boltdb. Can your take a try to remove that directory entirely? I doubt that inconsistency sit between containerd and snapshotter. Moreover, please ensure only one containerd daemon is running in your local node.

From the error log, it's not nydusd's turn to come to the stage.

Thank you @changweige.

I have only one containerd on my node,

# ps -ef |grep containerd
root      439709       1  0 Jan20 ?        00:00:09 /usr/local/bin/containerd-shim-runc-v2 -namespace k8s.io -id a30900b882bc9730998b5cbeb1b909b72ab60028f7206cdfcd35aeffbd070308 -address /run/containerd/containerd.sock
root      496723       1  0 Jan20 ?        00:00:09 /usr/local/bin/containerd-shim-runc-v2 -namespace k8s.io -id 0e7e948f1a27394df3d2184f86ecaf5293454c29bcabad3af93ae06ff80df6fa -address /run/containerd/containerd.sock
root      535983       1  0 Jan20 ?        00:00:08 /usr/local/bin/containerd-shim-runc-v2 -namespace k8s.io -id 63825db915be9fabf6e313956009f74f7d95646a36d7d4f417b334dee7493f70 -address /run/containerd/containerd.sock
root      714546       1  0 07:14 ?        00:00:01 /usr/local/bin/containerd
root      714597       1  0 07:14 ?        00:00:00 /usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
root      714744       1  0 07:14 ?        00:00:00 /usr/local/bin/containerd-shim-runc-v2 -namespace moby -id 19ae9be42e0836bac8c45028ac15c9f468d13595a8414c4a1fffb2450b5a7c2e -address /run/containerd/containerd.sock
root      715381  677880  0 07:15 pts/2    00:00:00 containerd-nydus-grpc --nydusd-path nydusd --config-path /etc/nydusd-config.json --shared-daemon --log-level debug --root /var/lib/containerd/io.containerd.snapshotter.v1.nydus --address /run/containerd/containerd-nydus-grpc.sock

Andf I have tried to remove the /var/lib/containerd/io.containerd.snapshotter.v1.nydus even the /etc/containerd, but in vain, having the same errors

from nydus.

Apokleos commented on June 29, 2024

Hi,
I noticed that you set nydus-snapshotter's root directory fixed at /var/lib/containerd/io.containerd.snapshotter.v1.nydus where it stores metadata into its own boltdb. Can your take a try to remove that directory entirely? I doubt that inconsistency sit between containerd and snapshotter. Moreover, please ensure only one containerd daemon is running in your local node.
From the error log, it's not nydusd's turn to come to the stage.

Thank you @changweige.

I have only one containerd on my node,
# ps -ef |grep containerd
root      439709       1  0 Jan20 ?        00:00:09 /usr/local/bin/containerd-shim-runc-v2 -namespace k8s.io -id a30900b882bc9730998b5cbeb1b909b72ab60028f7206cdfcd35aeffbd070308 -address /run/containerd/containerd.sock
root      496723       1  0 Jan20 ?        00:00:09 /usr/local/bin/containerd-shim-runc-v2 -namespace k8s.io -id 0e7e948f1a27394df3d2184f86ecaf5293454c29bcabad3af93ae06ff80df6fa -address /run/containerd/containerd.sock
root      535983       1  0 Jan20 ?        00:00:08 /usr/local/bin/containerd-shim-runc-v2 -namespace k8s.io -id 63825db915be9fabf6e313956009f74f7d95646a36d7d4f417b334dee7493f70 -address /run/containerd/containerd.sock
root      714546       1  0 07:14 ?        00:00:01 /usr/local/bin/containerd
root      714597       1  0 07:14 ?        00:00:00 /usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock
root      714744       1  0 07:14 ?        00:00:00 /usr/local/bin/containerd-shim-runc-v2 -namespace moby -id 19ae9be42e0836bac8c45028ac15c9f468d13595a8414c4a1fffb2450b5a7c2e -address /run/containerd/containerd.sock
root      715381  677880  0 07:15 pts/2    00:00:00 containerd-nydus-grpc --nydusd-path nydusd --config-path /etc/nydusd-config.json --shared-daemon --log-level debug --root /var/lib/containerd/io.containerd.snapshotter.v1.nydus --address /run/containerd/containerd-nydus-grpc.sock
Andf I have tried to remove the /var/lib/containerd/io.containerd.snapshotter.v1.nydus even the /etc/containerd, but in vain, having the same errors

I make a mistake with my containerd/config.toml. I have corrected containerd-test to containerd in config.toml and kill all of containerd-shim-runc-v2* processes.
But when I do crictl run container-config.yaml pod-config.yaml another error occurs,as below

FATA[0002] running container: creating container failed: rpc error: code = Unknown desc = failed to create containerd container: failed to mount daemon l0JTKuDlToWhljpjLV-0fQ: failed to shared mount: failed to mount: stat /var/lib/containerd/io.containerd.snapshotter.v1.nydus/socket/shared_daemon/api.sock: no such file or directory: unknown

and grpc nydusd error

...
{"level":"info","msg":"remote snapshot mountpoint /var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/5/fs, labels map[containerd.io/snapshot.ref:sha256:3ca68d5c588367ad261529f36e28a2f93db1c4cb51d145489ab3169c2f858ac1 containerd.io/snapshot/cri.image-layers:sha256:e857494af608a036bfb38c986762c0da00f4eaad5548ac81b1b798b7de5cd1b2 containerd.io/snapshot/cri.image-ref:localhost:5000/busybox-nydus3:latest containerd.io/snapshot/cri.layer-digest:sha256:e857494af608a036bfb38c986762c0da00f4eaad5548ac81b1b798b7de5cd1b2 containerd.io/snapshot/cri.manifest-digest:sha256:578411f32cb78afee79c1236a9baf7796ea31777bbe6a4b19601a15a8b174f08 containerd.io/snapshot/nydus-bootstrap:true]","time":"2021-01-21T07:30:43.415721284Z"}
{"level":"error","msg":"failed to mount /5/fs, failed to shared mount: failed to mount: stat /var/lib/containerd/io.containerd.snapshotter.v1.nydus/socket/shared_daemon/api.sock: no such file or directory","time":"2021-01-21T07:30:43.847345486Z"}
{"level":"info","msg":"umount remote snapshot, mountpoint /5/fs","time":"2021-01-21T07:30:43.848213895Z"}

from nydus.

changweige commented on June 29, 2024

Aha.
failed to shared mount means snapshotter commands nydusd to mount a Rafs backend via HTTP API. But right now, the API is not compatible because we have to switch to another forked crate (micro-http) first, which is undergoing. Please refer to #45 . You can still run container by removing flag --shared-daemon out from snapshotter command line. We will fix the API compatibility problem soon.

from nydus.

Apokleos commented on June 29, 2024

Hi，Thank you @bergwolf @changweige
I have removed the flag --shared-daemon, the original error msgs disappear. But I have another boring error msg as below:
1. crictl run ...

# crictl run container-config.yaml pod-config.yaml
FATA[0032] running container: creating container failed: rpc error: code = Unknown desc = failed to create containerd container: mount callback failed on /var/lib/containerd/tmpmounts/containerd-mount306396156: read /var/lib/containerd/tmpmounts/containerd-mount306396156/etc/passwd: input/output error

2. nydusd error msg

containerd-nydus-grpc --nydusd-path nydusd --config-path /etc/nydusd-config.json --log-level debug --root /var/lib/containerd/io.containerd.snapshotter.v1.nydus --address /run/containerd/containerd-nydus-grpc.sock
{"key":"k8s.io/1/extract-611401271-_6y5 sha256:ba0dae6243cc9fa2890df40a625721fdbea5c94ca6da897acdd814d710149770","level":"info","msg":"prepare key k8s.io/1/extract-611401271-_6y5 sha256:ba0dae6243cc9fa2890df40a625721fdbea5c94ca6da897acdd814d710149770 parent  labels","parent":"","time":"2021-01-25T07:02:33.700892835Z"}
{"level":"info","msg":"image ref k8s.gcr.io/pause:3.2 digest sha256:c74f8866df097496217c9f15efe8f8d3db05d19d678a02d01cc7eaed520bb136","time":"2021-01-25T07:02:33.701074703Z"}
{"level":"info","msg":"get size 296534","time":"2021-01-25T07:02:40.672415165Z"}
{"level":"info","msg":"get blob duration 6971","time":"2021-01-25T07:02:40.672591451Z"}
{"key":"k8s.io/3/97a2a6d0e4cda3bafe622153b84fd4d7b5ac52a4f1a20348754014a920cac9f6","level":"info","msg":"prepare key k8s.io/3/97a2a6d0e4cda3bafe622153b84fd4d7b5ac52a4f1a20348754014a920cac9f6 parent k8s.io/2/sha256:ba0dae6243cc9fa2890df40a625721fdbea5c94ca6da897acdd814d710149770 labels","parent":"k8s.io/2/sha256:ba0dae6243cc9fa2890df40a625721fdbea5c94ca6da897acdd814d710149770","time":"2021-01-25T07:02:54.722671474Z"}
{"key":"k8s.io/3/97a2a6d0e4cda3bafe622153b84fd4d7b5ac52a4f1a20348754014a920cac9f6","level":"info","msg":"prepare for container layer k8s.io/3/97a2a6d0e4cda3bafe622153b84fd4d7b5ac52a4f1a20348754014a920cac9f6","parent":"k8s.io/2/sha256:ba0dae6243cc9fa2890df40a625721fdbea5c94ca6da897acdd814d710149770","time":"2021-01-25T07:02:54.722793659Z"}
{"level":"info","msg":"id 2 is data layer, continue to check parent layer","time":"2021-01-25T07:02:54.722899385Z"}
{"level":"info","msg":"id 1 is data layer, continue to check parent layer","time":"2021-01-25T07:02:54.722968670Z"}
{"level":"info","msg":"id 2 is data layer, continue to check parent layer","time":"2021-01-25T07:02:54.723021942Z"}
{"level":"info","msg":"id 1 is data layer, continue to check parent layer","time":"2021-01-25T07:02:54.723076883Z"}
{"level":"info","msg":"mount options [workdir=/var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/2/work upperdir=/var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/2/fs lowerdir=/var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/1/fs]","time":"2021-01-25T07:02:54.723139900Z"}
{"level":"info","msg":"id 2 is data layer, continue to check parent layer","time":"2021-01-25T07:02:54.801093685Z"}
{"level":"info","msg":"id 1 is data layer, continue to check parent layer","time":"2021-01-25T07:02:54.801275176Z"}
{"level":"info","msg":"id 2 is data layer, continue to check parent layer","time":"2021-01-25T07:02:54.801378785Z"}
{"level":"info","msg":"id 1 is data layer, continue to check parent layer","time":"2021-01-25T07:02:54.801461634Z"}
{"level":"info","msg":"mount options [workdir=/var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/2/work upperdir=/var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/2/fs lowerdir=/var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/1/fs]","time":"2021-01-25T07:02:54.801620533Z"}
{"key":"k8s.io/4/extract-557357497-NVyb sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f","level":"info","msg":"prepare key k8s.io/4/extract-557357497-NVyb sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f parent  labels","parent":"","time":"2021-01-25T07:02:55.605752177Z"}
{"key":"k8s.io/4/extract-557357497-NVyb sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f","level":"info","msg":"nydus data layer, skip download and unpack k8s.io/4/extract-557357497-NVyb sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f","parent":"","time":"2021-01-25T07:02:55.605870277Z"}
{"key":"k8s.io/5/extract-765837698-fNhg sha256:3ca68d5c588367ad261529f36e28a2f93db1c4cb51d145489ab3169c2f858ac1","level":"info","msg":"prepare key k8s.io/5/extract-765837698-fNhg sha256:3ca68d5c588367ad261529f36e28a2f93db1c4cb51d145489ab3169c2f858ac1 parent sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f labels","parent":"sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f","time":"2021-01-25T07:02:55.872761984Z"}
{"level":"info","msg":"image ref localhost:5000/busybox-nydus:latest digest sha256:e857494af608a036bfb38c986762c0da00f4eaad5548ac81b1b798b7de5cd1b2","time":"2021-01-25T07:02:55.872933539Z"}
{"level":"info","msg":"get size 6340","time":"2021-01-25T07:02:55.890113440Z"}
{"level":"info","msg":"get blob duration 17","time":"2021-01-25T07:02:55.890182455Z"}
{"level":"info","msg":"mount options [workdir=/var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/4/work upperdir=/var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/4/fs lowerdir=/var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/3/fs]","time":"2021-01-25T07:02:55.894971316Z"}
{"key":"k8s.io/7/285465b70018fdb2afa8c06bf96dd16cc100b54fc1e9d963116d1c685f949456","level":"info","msg":"prepare key k8s.io/7/285465b70018fdb2afa8c06bf96dd16cc100b54fc1e9d963116d1c685f949456 parent k8s.io/6/sha256:3ca68d5c588367ad261529f36e28a2f93db1c4cb51d145489ab3169c2f858ac1 labels","parent":"k8s.io/6/sha256:3ca68d5c588367ad261529f36e28a2f93db1c4cb51d145489ab3169c2f858ac1","time":"2021-01-25T07:02:56.924545653Z"}
{"key":"k8s.io/7/285465b70018fdb2afa8c06bf96dd16cc100b54fc1e9d963116d1c685f949456","level":"info","msg":"prepare for container layer k8s.io/7/285465b70018fdb2afa8c06bf96dd16cc100b54fc1e9d963116d1c685f949456","parent":"k8s.io/6/sha256:3ca68d5c588367ad261529f36e28a2f93db1c4cb51d145489ab3169c2f858ac1","time":"2021-01-25T07:02:56.924666087Z"}
{"level":"info","msg":"id 5 is data layer, continue to check parent layer","time":"2021-01-25T07:02:56.924763491Z"}
{"key":"k8s.io/7/285465b70018fdb2afa8c06bf96dd16cc100b54fc1e9d963116d1c685f949456","level":"info","msg":"found nydus meta layer id 4, parpare remote snapshot","parent":"k8s.io/6/sha256:3ca68d5c588367ad261529f36e28a2f93db1c4cb51d145489ab3169c2f858ac1","time":"2021-01-25T07:02:56.924944815Z"}
{"level":"info","msg":"remote snapshot mountpoint /var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/4/fs, labels map[containerd.io/snapshot.ref:sha256:3ca68d5c588367ad261529f36e28a2f93db1c4cb51d145489ab3169c2f858ac1 containerd.io/snapshot/cri.image-layers:sha256:e857494af608a036bfb38c986762c0da00f4eaad5548ac81b1b798b7de5cd1b2 containerd.io/snapshot/cri.image-ref:localhost:5000/busybox-nydus:latest containerd.io/snapshot/cri.layer-digest:sha256:e857494af608a036bfb38c986762c0da00f4eaad5548ac81b1b798b7de5cd1b2 containerd.io/snapshot/cri.manifest-digest:sha256:578411f32cb78afee79c1236a9baf7796ea31777bbe6a4b19601a15a8b174f08 containerd.io/snapshot/nydus-bootstrap:true]","time":"2021-01-25T07:02:56.925033024Z"}
{"level":"info","msg":"mount options [workdir=/var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/5/work upperdir=/var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/5/fs lowerdir=/var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/4/fs:/var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/3/fs]","time":"2021-01-25T07:02:56.927389670Z"}
{"level":"info","msg":"id 5 is data layer, continue to check parent layer","time":"2021-01-25T07:02:56.969396956Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:56+00:00 - INFO - rafs superblock features: COMPRESS_LZ4_BLOCK DIGESTER_BLAKE3 EXPLICIT_UID_GID ","time":"2021-01-25T07:02:56.976662432Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:56+00:00 - INFO - backend config: CommonConfig { proxy: ProxyConfig { url: \"\", ping_url: \"\", fallback: false, check_interval: 5 }, timeout: 5, connect_timeout: 5, force_upload: false, retry_limit: 0 }","time":"2021-01-25T07:02:56.977330175Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - INFO - rafs imported","time":"2021-01-25T07:02:57.020377237Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - INFO - rafs mounted: mode=direct digest_validate=false iostats_files=true","time":"2021-01-25T07:02:57.020442512Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - INFO - vfs mounted","time":"2021-01-25T07:02:57.021109680Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - INFO - Prefetch thread exits.","time":"2021-01-25T07:02:57.021767312Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - INFO - Prefetch thread exits.","time":"2021-01-25T07:02:57.022410251Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - INFO - Prefetch thread exits.","time":"2021-01-25T07:02:57.022989799Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - INFO - api server running at /var/lib/containerd/io.containerd.snapshotter.v1.nydus/socket/D3XRZtk5TK6HcUPWxzt1Cg/api.sock","time":"2021-01-25T07:02:57.023740622Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - INFO - http server started","time":"2021-01-25T07:02:57.024095071Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - INFO - mount source nydusfs dest /var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/4/fs with fstype fuse opts default_permissions,allow_other,fd=15,rootmode=40000,user_id=0,group_id=0 fd 15","time":"2021-01-25T07:02:57.251271882Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - INFO - starting fuse daemon","time":"2021-01-25T07:02:57.251924971Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - INFO - FUSE INIT major 7 minor 27","time":"2021-01-25T07:02:57.254973365Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":" in_opts: ASYNC_READ | POSIX_LOCKS | ATOMIC_O_TRUNC | EXPORT_SUPPORT | BIG_WRITES | DONT_MASK | SPLICE_WRITE | SPLICE_MOVE | SPLICE_READ | FLOCK_LOCKS | HAS_IOCTL_DIR | AUTO_INVAL_DATA | DO_READDIRPLUS | READDIRPLUS_AUTO | ASYNC_DIO | WRITEBACK_CACHE | ZERO_MESSAGE_OPEN | PARALLEL_DIROPS | HANDLE_KILLPRIV | POSIX_ACL | ABORT_ERROR","time":"2021-01-25T07:02:57.255032148Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"out_opts: ASYNC_READ | ATOMIC_O_TRUNC | BIG_WRITES | HAS_IOCTL_DIR | AUTO_INVAL_DATA | DO_READDIRPLUS | READDIRPLUS_AUTO | ASYNC_DIO | WRITEBACK_CACHE | ZERO_MESSAGE_OPEN | PARALLEL_DIROPS","time":"2021-01-25T07:02:57.255065284Z"}
{"level":"info","msg":"daemon D3XRZtk5TK6HcUPWxzt1Cg snapshotID 4 info {nydusd 0.1.0 Running}","time":"2021-01-25T07:02:57.402122101Z"}
{"level":"info","msg":"mount options [workdir=/var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/5/work upperdir=/var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/5/fs lowerdir=/var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/4/fs]","time":"2021-01-25T07:02:57.402265521Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - ERROR - Error:","time":"2021-01-25T07:02:57.441545017Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\t\"\u003c!DOCTYPE html PUBLIC \\\"-//W3C//DTD HTML 4.01//EN\\\" \\\"http://www.w3.org/TR/html4/strict.dtd\\\"\u003e\\n\u003chtml\u003e\u003chead\u003e\\n\u003cmeta http-equiv=\\\"Content-Type\\\" CONTENT=\\\"text/html; charset=utf-8\\\"\u003e\\n\u003ctitle\u003eERROR: The requested URL could not be retrieved\u003c/title\u003e\\n\u003cstyle type=\\\"text/css\\\"\u003e\u003c!-- \\n /*\\n Stylesheet for Squid Error pages\\n Adapted from design by Free CSS Templates\\n http://www.freecsstemplates.org\\n Released for free under a Creative Commons Attribution 2.5 License\\n*/\\n\\n/* Page basics */\\n* {\\n\\tfont-family: verdana, sans-serif;\\n}\\n\\nhtml body {\\n\\tmargin: 0;\\n\\tpadding: 0;\\n\\tbackground: #efefef;\\n\\tfont-size: 12px;\\n\\tcolor: #1e1e1e;\\n}\\n\\n/* Page displayed title area */\\n#titles {\\n\\tmargin-left: 15px;\\n\\tpadding: 10px;\\n\\tpadding-left: 100px;\\n\\tbackground: url(\\'http://www.squid-cache.org/Artwork/SN.png\\') no-repeat left;\\n}\\n\\n/* initial title */\\n#titles h1 {\\n\\tcolor: #000000;\\n}\\n#titles h2 {\\n\\tcolor: #000000;\\n}\\n\\n/* special event: FTP success page titles */\\n#titles ftpsuccess {\\n\\tbackground-color:#00ff00;\\n\\twidth:100%;\\n}\\n\\n/* Page displayed body content area */\\n#content {\\n\\tpadding: 10px;\\n\\tbackground: #ffffff;\\n}\\n\\n/* General text */\\np {\\n}\\n\\n/* error brief description */\\n#error p {\\n}\\n\\n/* some data which may have caused the problem */\\n#data {\\n}\\n\\n/* the error message received from the system or other software */\\n#sysmsg {\\n}\\n\\npre {\\n    font-family:sans-serif;\\n}\\n\\n/* special event: FTP / Gopher directory listing */\\n#dirmsg {\\n    font-family: courier;\\n    color: black;\\n    font-size: 10pt;\\n}\\n#dirlisting {\\n    margin-left: 2%;\\n    margin-right: 2%;\\n}\\n#dirlisting tr.entry td.icon,td.filename,td.size,td.date {\\n    border-bottom: groove;\\n}\\n#dirlisting td.size {\\n    width: 50px;\\n    text-align: right;\\n    padding-right: 5px;\\n}\\n\\n/* horizontal lines */\\nhr {\\n\\tmargin: 0;\\n}\\n\\n/* page displayed footer area */\\n#footer {\\n\\tfont-size: 9px;\\n\\tpadding-left: 10px;\\n}\\n\\n\\nbody\\n:lang(fa) { direction: rtl; font-size: 100%; font-family: Tahoma, Roya, sans-serif; float: right; }\\n:lang(he) { direction: rtl; float: right; }\\n --\u003e\u003c/style\u003e\\n\u003c/head\u003e\u003cbody\u003e\\n\u003cdiv id=\\\"titles\\\"\u003e\\n\u003ch1\u003eERROR\u003c/h1\u003e\\n\u003ch2\u003eThe requested URL could not be retrieved\u003c/h2\u003e\\n\u003c/div\u003e\\n\u003chr\u003e\\n\\n\u003cdiv id=\\\"content\\\"\u003e\\n\u003cp\u003eThe following error was encountered while trying to retrieve the URL: \u003ca href=\\\"http://localhost:5000/v2/busybox-nydus/blobs/sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f\\\"\u003ehttp://localhost:5000/v2/busybox-nydus/blobs/sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f\u003c/a\u003e\u003c/p\u003e\\n\\n\u003cblockquote id=\\\"error\\\"\u003e\\n\u003cp\u003e\u003cb\u003eConnection to 127.0.0.1 failed.\u003c/b\u003e\u003c/p\u003e\\n\u003c/blockquote\u003e\\n\\n\u003cp id=\\\"sysmsg\\\"\u003eThe system returned: \u003ci\u003e(111) Connection refused\u003c/i\u003e\u003c/p\u003e\\n\\n\u003cp\u003eThe remote host or network may be down. Please try the request again.\u003c/p\u003e\\n\\n\u003cp\u003eYour cache administrator is \u003ca href=\\\"mailto:root?subject=CacheErrorInfo%20-%20ERR_CONNECT_FAIL\u0026amp;body=CacheHost%3A%20ip-172-31-29-60%0D%0AErrPage%3A%20ERR_CONNECT_FAIL%0D%0AErr%3A%20(111)%20Connection%20refused%0D%0ATimeStamp%3A%20Mon,%2025%20Jan%202021%2007%3A02%3A34%20GMT%0D%0A%0D%0AClientIP%3A%2061.130.6.2%0D%0AServerIP%3A%20127.0.0.1%0D%0A%0D%0AHTTP%20Request%3A%0D%0AGET%20%2Fv2%2Fbusybox-nydus%2Fblobs%2Fsha256%3A804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f%20HTTP%2F1.1%0ARange%3A%20bytes%3D142-431%0D%0AContent-Length%3A%200%0D%0AAccept%3A%20*%2F*%0D%0AHost%3A%20localhost%3A5000%0D%0A%0D%0A%0D%0A\\\"\u003eroot\u003c/a\u003e.\u003c/p\u003e\\n\\n\u003cbr\u003e\\n\u003c/div\u003e\\n\\n\u003chr\u003e\\n\u003cdiv id=\\\"footer\\\"\u003e\\n\u003cp\u003eGenerated Mon, 25 Jan 2021 07:02:34 GMT by ip-172-31-29-60 (squid/3.1.10)\u003c/p\u003e\\n\u003c!-- ERR_CONNECT_FAIL --\u003e\\n\u003c/div\u003e\\n\u003c/body\u003e\u003c/html\u003e\\n\"","time":"2021-01-25T07:02:57.442246867Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tat rafs/src/storage/backend/request.rs:106","time":"2021-01-25T07:02:57.442437254Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tnote: enable `RUST_BACKTRACE=1` env to display a backtrace","time":"2021-01-25T07:02:57.442477414Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - ERROR - Error:","time":"2021-01-25T07:02:57.442548436Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\t\"Read from backend failed: Input/output error (os error 5)\"","time":"2021-01-25T07:02:57.442571380Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tat rafs/src/storage/backend/mod.rs:103","time":"2021-01-25T07:02:57.442595632Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tnote: enable `RUST_BACKTRACE=1` env to display a backtrace","time":"2021-01-25T07:02:57.442618203Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - INFO - Prefetch thread exits.","time":"2021-01-25T07:02:57.442643210Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - ERROR - Error:","time":"2021-01-25T07:02:57.491152134Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\t\"\u003c!DOCTYPE html PUBLIC \\\"-//W3C//DTD HTML 4.01//EN\\\" \\\"http://www.w3.org/TR/html4/strict.dtd\\\"\u003e\\n\u003chtml\u003e\u003chead\u003e\\n\u003cmeta http-equiv=\\\"Content-Type\\\" CONTENT=\\\"text/html; charset=utf-8\\\"\u003e\\n\u003ctitle\u003eERROR: The requested URL could not be retrieved\u003c/title\u003e\\n\u003cstyle type=\\\"text/css\\\"\u003e\u003c!-- \\n /*\\n Stylesheet for Squid Error pages\\n Adapted from design by Free CSS Templates\\n http://www.freecsstemplates.org\\n Released for free under a Creative Commons Attribution 2.5 License\\n*/\\n\\n/* Page basics */\\n* {\\n\\tfont-family: verdana, sans-serif;\\n}\\n\\nhtml body {\\n\\tmargin: 0;\\n\\tpadding: 0;\\n\\tbackground: #efefef;\\n\\tfont-size: 12px;\\n\\tcolor: #1e1e1e;\\n}\\n\\n/* Page displayed title area */\\n#titles {\\n\\tmargin-left: 15px;\\n\\tpadding: 10px;\\n\\tpadding-left: 100px;\\n\\tbackground: url(\\'http://www.squid-cache.org/Artwork/SN.png\\') no-repeat left;\\n}\\n\\n/* initial title */\\n#titles h1 {\\n\\tcolor: #000000;\\n}\\n#titles h2 {\\n\\tcolor: #000000;\\n}\\n\\n/* special event: FTP success page titles */\\n#titles ftpsuccess {\\n\\tbackground-color:#00ff00;\\n\\twidth:100%;\\n}\\n\\n/* Page displayed body content area */\\n#content {\\n\\tpadding: 10px;\\n\\tbackground: #ffffff;\\n}\\n\\n/* General text */\\np {\\n}\\n\\n/* error brief description */\\n#error p {\\n}\\n\\n/* some data which may have caused the problem */\\n#data {\\n}\\n\\n/* the error message received from the system or other software */\\n#sysmsg {\\n}\\n\\npre {\\n    font-family:sans-serif;\\n}\\n\\n/* special event: FTP / Gopher directory listing */\\n#dirmsg {\\n    font-family: courier;\\n    color: black;\\n    font-size: 10pt;\\n}\\n#dirlisting {\\n    margin-left: 2%;\\n    margin-right: 2%;\\n}\\n#dirlisting tr.entry td.icon,td.filename,td.size,td.date {\\n    border-bottom: groove;\\n}\\n#dirlisting td.size {\\n    width: 50px;\\n    text-align: right;\\n    padding-right: 5px;\\n}\\n\\n/* horizontal lines */\\nhr {\\n\\tmargin: 0;\\n}\\n\\n/* page displayed footer area */\\n#footer {\\n\\tfont-size: 9px;\\n\\tpadding-left: 10px;\\n}\\n\\n\\nbody\\n:lang(fa) { direction: rtl; font-size: 100%; font-family: Tahoma, Roya, sans-serif; float: right; }\\n:lang(he) { direction: rtl; float: right; }\\n --\u003e\u003c/style\u003e\\n\u003c/head\u003e\u003cbody\u003e\\n\u003cdiv id=\\\"titles\\\"\u003e\\n\u003ch1\u003eERROR\u003c/h1\u003e\\n\u003ch2\u003eThe requested URL could not be retrieved\u003c/h2\u003e\\n\u003c/div\u003e\\n\u003chr\u003e\\n\\n\u003cdiv id=\\\"content\\\"\u003e\\n\u003cp\u003eThe following error was encountered while trying to retrieve the URL: \u003ca href=\\\"http://localhost:5000/v2/busybox-nydus/blobs/sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f\\\"\u003ehttp://localhost:5000/v2/busybox-nydus/blobs/sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f\u003c/a\u003e\u003c/p\u003e\\n\\n\u003cblockquote id=\\\"error\\\"\u003e\\n\u003cp\u003e\u003cb\u003eConnection to 127.0.0.1 failed.\u003c/b\u003e\u003c/p\u003e\\n\u003c/blockquote\u003e\\n\\n\u003cp id=\\\"sysmsg\\\"\u003eThe system returned: \u003ci\u003e(111) Connection refused\u003c/i\u003e\u003c/p\u003e\\n\\n\u003cp\u003eThe remote host or network may be down. Please try the request again.\u003c/p\u003e\\n\\n\u003cp\u003eYour cache administrator is \u003ca href=\\\"mailto:root?subject=CacheErrorInfo%20-%20ERR_CONNECT_FAIL\u0026amp;body=CacheHost%3A%20ip-172-31-29-60%0D%0AErrPage%3A%20ERR_CONNECT_FAIL%0D%0AErr%3A%20(111)%20Connection%20refused%0D%0ATimeStamp%3A%20Mon,%2025%20Jan%202021%2007%3A02%3A34%20GMT%0D%0A%0D%0AClientIP%3A%2061.130.6.2%0D%0AServerIP%3A%20127.0.0.1%0D%0A%0D%0AHTTP%20Request%3A%0D%0AGET%20%2Fv2%2Fbusybox-nydus%2Fblobs%2Fsha256%3A804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f%20HTTP%2F1.1%0ARange%3A%20bytes%3D432-673%0D%0AContent-Length%3A%200%0D%0AAccept%3A%20*%2F*%0D%0AHost%3A%20localhost%3A5000%0D%0A%0D%0A%0D%0A\\\"\u003eroot\u003c/a\u003e.\u003c/p\u003e\\n\\n\u003cbr\u003e\\n\u003c/div\u003e\\n\\n\u003chr\u003e\\n\u003cdiv id=\\\"footer\\\"\u003e\\n\u003cp\u003eGenerated Mon, 25 Jan 2021 07:02:34 GMT by ip-172-31-29-60 (squid/3.1.10)\u003c/p\u003e\\n\u003c!-- ERR_CONNECT_FAIL --\u003e\\n\u003c/div\u003e\\n\u003c/body\u003e\u003c/html\u003e\\n\"","time":"2021-01-25T07:02:57.491941340Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tat rafs/src/storage/backend/request.rs:106","time":"2021-01-25T07:02:57.492097644Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tnote: enable `RUST_BACKTRACE=1` env to display a backtrace","time":"2021-01-25T07:02:57.492122536Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - ERROR - Error:","time":"2021-01-25T07:02:57.492144743Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\t\"Read from backend failed: Input/output error (os error 5)\"","time":"2021-01-25T07:02:57.492167223Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tat rafs/src/storage/backend/mod.rs:103","time":"2021-01-25T07:02:57.492188229Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tnote: enable `RUST_BACKTRACE=1` env to display a backtrace","time":"2021-01-25T07:02:57.492209261Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - INFO - Prefetch thread exits.","time":"2021-01-25T07:02:57.492233066Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - ERROR - Error:","time":"2021-01-25T07:02:57.507354511Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\t\"\u003c!DOCTYPE html PUBLIC \\\"-//W3C//DTD HTML 4.01//EN\\\" \\\"http://www.w3.org/TR/html4/strict.dtd\\\"\u003e\\n\u003chtml\u003e\u003chead\u003e\\n\u003cmeta http-equiv=\\\"Content-Type\\\" CONTENT=\\\"text/html; charset=utf-8\\\"\u003e\\n\u003ctitle\u003eERROR: The requested URL could not be retrieved\u003c/title\u003e\\n\u003cstyle type=\\\"text/css\\\"\u003e\u003c!-- \\n /*\\n Stylesheet for Squid Error pages\\n Adapted from design by Free CSS Templates\\n http://www.freecsstemplates.org\\n Released for free under a Creative Commons Attribution 2.5 License\\n*/\\n\\n/* Page basics */\\n* {\\n\\tfont-family: verdana, sans-serif;\\n}\\n\\nhtml body {\\n\\tmargin: 0;\\n\\tpadding: 0;\\n\\tbackground: #efefef;\\n\\tfont-size: 12px;\\n\\tcolor: #1e1e1e;\\n}\\n\\n/* Page displayed title area */\\n#titles {\\n\\tmargin-left: 15px;\\n\\tpadding: 10px;\\n\\tpadding-left: 100px;\\n\\tbackground: url(\\'http://www.squid-cache.org/Artwork/SN.png\\') no-repeat left;\\n}\\n\\n/* initial title */\\n#titles h1 {\\n\\tcolor: #000000;\\n}\\n#titles h2 {\\n\\tcolor: #000000;\\n}\\n\\n/* special event: FTP success page titles */\\n#titles ftpsuccess {\\n\\tbackground-color:#00ff00;\\n\\twidth:100%;\\n}\\n\\n/* Page displayed body content area */\\n#content {\\n\\tpadding: 10px;\\n\\tbackground: #ffffff;\\n}\\n\\n/* General text */\\np {\\n}\\n\\n/* error brief description */\\n#error p {\\n}\\n\\n/* some data which may have caused the problem */\\n#data {\\n}\\n\\n/* the error message received from the system or other software */\\n#sysmsg {\\n}\\n\\npre {\\n    font-family:sans-serif;\\n}\\n\\n/* special event: FTP / Gopher directory listing */\\n#dirmsg {\\n    font-family: courier;\\n    color: black;\\n    font-size: 10pt;\\n}\\n#dirlisting {\\n    margin-left: 2%;\\n    margin-right: 2%;\\n}\\n#dirlisting tr.entry td.icon,td.filename,td.size,td.date {\\n    border-bottom: groove;\\n}\\n#dirlisting td.size {\\n    width: 50px;\\n    text-align: right;\\n    padding-right: 5px;\\n}\\n\\n/* horizontal lines */\\nhr {\\n\\tmargin: 0;\\n}\\n\\n/* page displayed footer area */\\n#footer {\\n\\tfont-size: 9px;\\n\\tpadding-left: 10px;\\n}\\n\\n\\nbody\\n:lang(fa) { direction: rtl; font-size: 100%; font-family: Tahoma, Roya, sans-serif; float: right; }\\n:lang(he) { direction: rtl; float: right; }\\n --\u003e\u003c/style\u003e\\n\u003c/head\u003e\u003cbody\u003e\\n\u003cdiv id=\\\"titles\\\"\u003e\\n\u003ch1\u003eERROR\u003c/h1\u003e\\n\u003ch2\u003eThe requested URL could not be retrieved\u003c/h2\u003e\\n\u003c/div\u003e\\n\u003chr\u003e\\n\\n\u003cdiv id=\\\"content\\\"\u003e\\n\u003cp\u003eThe following error was encountered while trying to retrieve the URL: \u003ca href=\\\"http://localhost:5000/v2/busybox-nydus/blobs/sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f\\\"\u003ehttp://localhost:5000/v2/busybox-nydus/blobs/sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f\u003c/a\u003e\u003c/p\u003e\\n\\n\u003cblockquote id=\\\"error\\\"\u003e\\n\u003cp\u003e\u003cb\u003eConnection to 127.0.0.1 failed.\u003c/b\u003e\u003c/p\u003e\\n\u003c/blockquote\u003e\\n\\n\u003cp id=\\\"sysmsg\\\"\u003eThe system returned: \u003ci\u003e(111) Connection refused\u003c/i\u003e\u003c/p\u003e\\n\\n\u003cp\u003eThe remote host or network may be down. Please try the request again.\u003c/p\u003e\\n\\n\u003cp\u003eYour cache administrator is \u003ca href=\\\"mailto:root?subject=CacheErrorInfo%20-%20ERR_CONNECT_FAIL\u0026amp;body=CacheHost%3A%20ip-172-31-29-60%0D%0AErrPage%3A%20ERR_CONNECT_FAIL%0D%0AErr%3A%20(111)%20Connection%20refused%0D%0ATimeStamp%3A%20Mon,%2025%20Jan%202021%2007%3A02%3A34%20GMT%0D%0A%0D%0AClientIP%3A%2061.130.6.2%0D%0AServerIP%3A%20127.0.0.1%0D%0A%0D%0AHTTP%20Request%3A%0D%0AGET%20%2Fv2%2Fbusybox-nydus%2Fblobs%2Fsha256%3A804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f%20HTTP%2F1.1%0ARange%3A%20bytes%3D47735-928815%0D%0AContent-Length%3A%200%0D%0AAccept%3A%20*%2F*%0D%0AHost%3A%20localhost%3A5000%0D%0A%0D%0A%0D%0A\\\"\u003eroot\u003c/a\u003e.\u003c/p\u003e\\n\\n\u003cbr\u003e\\n\u003c/div\u003e\\n\\n\u003chr\u003e\\n\u003cdiv id=\\\"footer\\\"\u003e\\n\u003cp\u003eGenerated Mon, 25 Jan 2021 07:02:34 GMT by ip-172-31-29-60 (squid/3.1.10)\u003c/p\u003e\\n\u003c!-- ERR_CONNECT_FAIL --\u003e\\n\u003c/div\u003e\\n\u003c/body\u003e\u003c/html\u003e\\n\"","time":"2021-01-25T07:02:57.507941200Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tat rafs/src/storage/backend/request.rs:106","time":"2021-01-25T07:02:57.508081761Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tnote: enable `RUST_BACKTRACE=1` env to display a backtrace","time":"2021-01-25T07:02:57.508113364Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - ERROR - Error:","time":"2021-01-25T07:02:57.508135661Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\t\"Read from backend failed: Input/output error (os error 5)\"","time":"2021-01-25T07:02:57.508158922Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tat rafs/src/storage/backend/mod.rs:103","time":"2021-01-25T07:02:57.508180396Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tnote: enable `RUST_BACKTRACE=1` env to display a backtrace","time":"2021-01-25T07:02:57.508205302Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - INFO - Prefetch thread exits.","time":"2021-01-25T07:02:57.508229755Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - ERROR - Error:","time":"2021-01-25T07:02:57.731391387Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\t\"\u003c!DOCTYPE html PUBLIC \\\"-//W3C//DTD HTML 4.01//EN\\\" \\\"http://www.w3.org/TR/html4/strict.dtd\\\"\u003e\\n\u003chtml\u003e\u003chead\u003e\\n\u003cmeta http-equiv=\\\"Content-Type\\\" CONTENT=\\\"text/html; charset=utf-8\\\"\u003e\\n\u003ctitle\u003eERROR: The requested URL could not be retrieved\u003c/title\u003e\\n\u003cstyle type=\\\"text/css\\\"\u003e\u003c!-- \\n /*\\n Stylesheet for Squid Error pages\\n Adapted from design by Free CSS Templates\\n http://www.freecsstemplates.org\\n Released for free under a Creative Commons Attribution 2.5 License\\n*/\\n\\n/* Page basics */\\n* {\\n\\tfont-family: verdana, sans-serif;\\n}\\n\\nhtml body {\\n\\tmargin: 0;\\n\\tpadding: 0;\\n\\tbackground: #efefef;\\n\\tfont-size: 12px;\\n\\tcolor: #1e1e1e;\\n}\\n\\n/* Page displayed title area */\\n#titles {\\n\\tmargin-left: 15px;\\n\\tpadding: 10px;\\n\\tpadding-left: 100px;\\n\\tbackground: url(\\'http://www.squid-cache.org/Artwork/SN.png\\') no-repeat left;\\n}\\n\\n/* initial title */\\n#titles h1 {\\n\\tcolor: #000000;\\n}\\n#titles h2 {\\n\\tcolor: #000000;\\n}\\n\\n/* special event: FTP success page titles */\\n#titles ftpsuccess {\\n\\tbackground-color:#00ff00;\\n\\twidth:100%;\\n}\\n\\n/* Page displayed body content area */\\n#content {\\n\\tpadding: 10px;\\n\\tbackground: #ffffff;\\n}\\n\\n/* General text */\\np {\\n}\\n\\n/* error brief description */\\n#error p {\\n}\\n\\n/* some data which may have caused the problem */\\n#data {\\n}\\n\\n/* the error message received from the system or other software */\\n#sysmsg {\\n}\\n\\npre {\\n    font-family:sans-serif;\\n}\\n\\n/* special event: FTP / Gopher directory listing */\\n#dirmsg {\\n    font-family: courier;\\n    color: black;\\n    font-size: 10pt;\\n}\\n#dirlisting {\\n    margin-left: 2%;\\n    margin-right: 2%;\\n}\\n#dirlisting tr.entry td.icon,td.filename,td.size,td.date {\\n    border-bottom: groove;\\n}\\n#dirlisting td.size {\\n    width: 50px;\\n    text-align: right;\\n    padding-right: 5px;\\n}\\n\\n/* horizontal lines */\\nhr {\\n\\tmargin: 0;\\n}\\n\\n/* page displayed footer area */\\n#footer {\\n\\tfont-size: 9px;\\n\\tpadding-left: 10px;\\n}\\n\\n\\nbody\\n:lang(fa) { direction: rtl; font-size: 100%; font-family: Tahoma, Roya, sans-serif; float: right; }\\n:lang(he) { direction: rtl; float: right; }\\n --\u003e\u003c/style\u003e\\n\u003c/head\u003e\u003cbody\u003e\\n\u003cdiv id=\\\"titles\\\"\u003e\\n\u003ch1\u003eERROR\u003c/h1\u003e\\n\u003ch2\u003eThe requested URL could not be retrieved\u003c/h2\u003e\\n\u003c/div\u003e\\n\u003chr\u003e\\n\\n\u003cdiv id=\\\"content\\\"\u003e\\n\u003cp\u003eThe following error was encountered while trying to retrieve the URL: \u003ca href=\\\"http://localhost:5000/v2/busybox-nydus/blobs/sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f\\\"\u003ehttp://localhost:5000/v2/busybox-nydus/blobs/sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f\u003c/a\u003e\u003c/p\u003e\\n\\n\u003cblockquote id=\\\"error\\\"\u003e\\n\u003cp\u003e\u003cb\u003eConnection to 127.0.0.1 failed.\u003c/b\u003e\u003c/p\u003e\\n\u003c/blockquote\u003e\\n\\n\u003cp id=\\\"sysmsg\\\"\u003eThe system returned: \u003ci\u003e(111) Connection refused\u003c/i\u003e\u003c/p\u003e\\n\\n\u003cp\u003eThe remote host or network may be down. Please try the request again.\u003c/p\u003e\\n\\n\u003cp\u003eYour cache administrator is \u003ca href=\\\"mailto:root?subject=CacheErrorInfo%20-%20ERR_CONNECT_FAIL\u0026amp;body=CacheHost%3A%20ip-172-31-29-60%0D%0AErrPage%3A%20ERR_CONNECT_FAIL%0D%0AErr%3A%20(111)%20Connection%20refused%0D%0ATimeStamp%3A%20Mon,%2025%20Jan%202021%2007%3A02%3A34%20GMT%0D%0A%0D%0AClientIP%3A%2061.130.6.2%0D%0AServerIP%3A%20127.0.0.1%0D%0A%0D%0AHTTP%20Request%3A%0D%0AGET%20%2Fv2%2Fbusybox-nydus%2Fblobs%2Fsha256%3A804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f%20HTTP%2F1.1%0ARange%3A%20bytes%3D674-47734%0D%0AContent-Length%3A%200%0D%0AAccept%3A%20*%2F*%0D%0AHost%3A%20localhost%3A5000%0D%0A%0D%0A%0D%0A\\\"\u003eroot\u003c/a\u003e.\u003c/p\u003e\\n\\n\u003cbr\u003e\\n\u003c/div\u003e\\n\\n\u003chr\u003e\\n\u003cdiv id=\\\"footer\\\"\u003e\\n\u003cp\u003eGenerated Mon, 25 Jan 2021 07:02:34 GMT by ip-172-31-29-60 (squid/3.1.10)\u003c/p\u003e\\n\u003c!-- ERR_CONNECT_FAIL --\u003e\\n\u003c/div\u003e\\n\u003c/body\u003e\u003c/html\u003e\\n\"","time":"2021-01-25T07:02:57.732146625Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tat rafs/src/storage/backend/request.rs:106","time":"2021-01-25T07:02:57.732352417Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tnote: enable `RUST_BACKTRACE=1` env to display a backtrace","time":"2021-01-25T07:02:57.732387252Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - ERROR - Error:","time":"2021-01-25T07:02:57.732442654Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\t\"Read from backend failed: Input/output error (os error 5)\"","time":"2021-01-25T07:02:57.732463920Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tat rafs/src/storage/backend/mod.rs:103","time":"2021-01-25T07:02:57.732483800Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tnote: enable `RUST_BACKTRACE=1` env to display a backtrace","time":"2021-01-25T07:02:57.732521710Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - INFO - Prefetch thread exits.","time":"2021-01-25T07:02:57.732545034Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - ERROR - Error:","time":"2021-01-25T07:02:57.743229654Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\t\"\u003c!DOCTYPE html PUBLIC \\\"-//W3C//DTD HTML 4.01//EN\\\" \\\"http://www.w3.org/TR/html4/strict.dtd\\\"\u003e\\n\u003chtml\u003e\u003chead\u003e\\n\u003cmeta http-equiv=\\\"Content-Type\\\" CONTENT=\\\"text/html; charset=utf-8\\\"\u003e\\n\u003ctitle\u003eERROR: The requested URL could not be retrieved\u003c/title\u003e\\n\u003cstyle type=\\\"text/css\\\"\u003e\u003c!-- \\n /*\\n Stylesheet for Squid Error pages\\n Adapted from design by Free CSS Templates\\n http://www.freecsstemplates.org\\n Released for free under a Creative Commons Attribution 2.5 License\\n*/\\n\\n/* Page basics */\\n* {\\n\\tfont-family: verdana, sans-serif;\\n}\\n\\nhtml body {\\n\\tmargin: 0;\\n\\tpadding: 0;\\n\\tbackground: #efefef;\\n\\tfont-size: 12px;\\n\\tcolor: #1e1e1e;\\n}\\n\\n/* Page displayed title area */\\n#titles {\\n\\tmargin-left: 15px;\\n\\tpadding: 10px;\\n\\tpadding-left: 100px;\\n\\tbackground: url(\\'http://www.squid-cache.org/Artwork/SN.png\\') no-repeat left;\\n}\\n\\n/* initial title */\\n#titles h1 {\\n\\tcolor: #000000;\\n}\\n#titles h2 {\\n\\tcolor: #000000;\\n}\\n\\n/* special event: FTP success page titles */\\n#titles ftpsuccess {\\n\\tbackground-color:#00ff00;\\n\\twidth:100%;\\n}\\n\\n/* Page displayed body content area */\\n#content {\\n\\tpadding: 10px;\\n\\tbackground: #ffffff;\\n}\\n\\n/* General text */\\np {\\n}\\n\\n/* error brief description */\\n#error p {\\n}\\n\\n/* some data which may have caused the problem */\\n#data {\\n}\\n\\n/* the error message received from the system or other software */\\n#sysmsg {\\n}\\n\\npre {\\n    font-family:sans-serif;\\n}\\n\\n/* special event: FTP / Gopher directory listing */\\n#dirmsg {\\n    font-family: courier;\\n    color: black;\\n    font-size: 10pt;\\n}\\n#dirlisting {\\n    margin-left: 2%;\\n    margin-right: 2%;\\n}\\n#dirlisting tr.entry td.icon,td.filename,td.size,td.date {\\n    border-bottom: groove;\\n}\\n#dirlisting td.size {\\n    width: 50px;\\n    text-align: right;\\n    padding-right: 5px;\\n}\\n\\n/* horizontal lines */\\nhr {\\n\\tmargin: 0;\\n}\\n\\n/* page displayed footer area */\\n#footer {\\n\\tfont-size: 9px;\\n\\tpadding-left: 10px;\\n}\\n\\n\\nbody\\n:lang(fa) { direction: rtl; font-size: 100%; font-family: Tahoma, Roya, sans-serif; float: right; }\\n:lang(he) { direction: rtl; float: right; }\\n --\u003e\u003c/style\u003e\\n\u003c/head\u003e\u003cbody\u003e\\n\u003cdiv id=\\\"titles\\\"\u003e\\n\u003ch1\u003eERROR\u003c/h1\u003e\\n\u003ch2\u003eThe requested URL could not be retrieved\u003c/h2\u003e\\n\u003c/div\u003e\\n\u003chr\u003e\\n\\n\u003cdiv id=\\\"content\\\"\u003e\\n\u003cp\u003eThe following error was encountered while trying to retrieve the URL: \u003ca href=\\\"http://localhost:5000/v2/busybox-nydus/blobs/sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f\\\"\u003ehttp://localhost:5000/v2/busybox-nydus/blobs/sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f\u003c/a\u003e\u003c/p\u003e\\n\\n\u003cblockquote id=\\\"error\\\"\u003e\\n\u003cp\u003e\u003cb\u003eConnection to 127.0.0.1 failed.\u003c/b\u003e\u003c/p\u003e\\n\u003c/blockquote\u003e\\n\\n\u003cp id=\\\"sysmsg\\\"\u003eThe system returned: \u003ci\u003e(111) Connection refused\u003c/i\u003e\u003c/p\u003e\\n\\n\u003cp\u003eThe remote host or network may be down. Please try the request again.\u003c/p\u003e\\n\\n\u003cp\u003eYour cache administrator is \u003ca href=\\\"mailto:root?subject=CacheErrorInfo%20-%20ERR_CONNECT_FAIL\u0026amp;body=CacheHost%3A%20ip-172-31-29-60%0D%0AErrPage%3A%20ERR_CONNECT_FAIL%0D%0AErr%3A%20(111)%20Connection%20refused%0D%0ATimeStamp%3A%20Mon,%2025%20Jan%202021%2007%3A02%3A34%20GMT%0D%0A%0D%0AClientIP%3A%2061.130.6.2%0D%0AServerIP%3A%20127.0.0.1%0D%0A%0D%0AHTTP%20Request%3A%0D%0AGET%20%2Fv2%2Fbusybox-nydus%2Fblobs%2Fsha256%3A804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f%20HTTP%2F1.1%0ARange%3A%20bytes%3D57-141%0D%0AContent-Length%3A%200%0D%0AAccept%3A%20*%2F*%0D%0AHost%3A%20localhost%3A5000%0D%0A%0D%0A%0D%0A\\\"\u003eroot\u003c/a\u003e.\u003c/p\u003e\\n\\n\u003cbr\u003e\\n\u003c/div\u003e\\n\\n\u003chr\u003e\\n\u003cdiv id=\\\"footer\\\"\u003e\\n\u003cp\u003eGenerated Mon, 25 Jan 2021 07:02:34 GMT by ip-172-31-29-60 (squid/3.1.10)\u003c/p\u003e\\n\u003c!-- ERR_CONNECT_FAIL --\u003e\\n\u003c/div\u003e\\n\u003c/body\u003e\u003c/html\u003e\\n\"","time":"2021-01-25T07:02:57.743965147Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tat rafs/src/storage/backend/request.rs:106","time":"2021-01-25T07:02:57.744191042Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tnote: enable `RUST_BACKTRACE=1` env to display a backtrace","time":"2021-01-25T07:02:57.744234243Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - ERROR - Error:","time":"2021-01-25T07:02:57.744258869Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\t\"Read from backend failed: Input/output error (os error 5)\"","time":"2021-01-25T07:02:57.744281957Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tat rafs/src/storage/backend/mod.rs:103","time":"2021-01-25T07:02:57.744304851Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tnote: enable `RUST_BACKTRACE=1` env to display a backtrace","time":"2021-01-25T07:02:57.744325900Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:57+00:00 - INFO - Prefetch thread exits.","time":"2021-01-25T07:02:57.744351170Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:58+00:00 - ERROR - Error:","time":"2021-01-25T07:02:58.134654776Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\t\"\u003c!DOCTYPE html PUBLIC \\\"-//W3C//DTD HTML 4.01//EN\\\" \\\"http://www.w3.org/TR/html4/strict.dtd\\\"\u003e\\n\u003chtml\u003e\u003chead\u003e\\n\u003cmeta http-equiv=\\\"Content-Type\\\" CONTENT=\\\"text/html; charset=utf-8\\\"\u003e\\n\u003ctitle\u003eERROR: The requested URL could not be retrieved\u003c/title\u003e\\n\u003cstyle type=\\\"text/css\\\"\u003e\u003c!-- \\n /*\\n Stylesheet for Squid Error pages\\n Adapted from design by Free CSS Templates\\n http://www.freecsstemplates.org\\n Released for free under a Creative Commons Attribution 2.5 License\\n*/\\n\\n/* Page basics */\\n* {\\n\\tfont-family: verdana, sans-serif;\\n}\\n\\nhtml body {\\n\\tmargin: 0;\\n\\tpadding: 0;\\n\\tbackground: #efefef;\\n\\tfont-size: 12px;\\n\\tcolor: #1e1e1e;\\n}\\n\\n/* Page displayed title area */\\n#titles {\\n\\tmargin-left: 15px;\\n\\tpadding: 10px;\\n\\tpadding-left: 100px;\\n\\tbackground: url(\\'http://www.squid-cache.org/Artwork/SN.png\\') no-repeat left;\\n}\\n\\n/* initial title */\\n#titles h1 {\\n\\tcolor: #000000;\\n}\\n#titles h2 {\\n\\tcolor: #000000;\\n}\\n\\n/* special event: FTP success page titles */\\n#titles ftpsuccess {\\n\\tbackground-color:#00ff00;\\n\\twidth:100%;\\n}\\n\\n/* Page displayed body content area */\\n#content {\\n\\tpadding: 10px;\\n\\tbackground: #ffffff;\\n}\\n\\n/* General text */\\np {\\n}\\n\\n/* error brief description */\\n#error p {\\n}\\n\\n/* some data which may have caused the problem */\\n#data {\\n}\\n\\n/* the error message received from the system or other software */\\n#sysmsg {\\n}\\n\\npre {\\n    font-family:sans-serif;\\n}\\n\\n/* special event: FTP / Gopher directory listing */\\n#dirmsg {\\n    font-family: courier;\\n    color: black;\\n    font-size: 10pt;\\n}\\n#dirlisting {\\n    margin-left: 2%;\\n    margin-right: 2%;\\n}\\n#dirlisting tr.entry td.icon,td.filename,td.size,td.date {\\n    border-bottom: groove;\\n}\\n#dirlisting td.size {\\n    width: 50px;\\n    text-align: right;\\n    padding-right: 5px;\\n}\\n\\n/* horizontal lines */\\nhr {\\n\\tmargin: 0;\\n}\\n\\n/* page displayed footer area */\\n#footer {\\n\\tfont-size: 9px;\\n\\tpadding-left: 10px;\\n}\\n\\n\\nbody\\n:lang(fa) { direction: rtl; font-size: 100%; font-family: Tahoma, Roya, sans-serif; float: right; }\\n:lang(he) { direction: rtl; float: right; }\\n --\u003e\u003c/style\u003e\\n\u003c/head\u003e\u003cbody\u003e\\n\u003cdiv id=\\\"titles\\\"\u003e\\n\u003ch1\u003eERROR\u003c/h1\u003e\\n\u003ch2\u003eThe requested URL could not be retrieved\u003c/h2\u003e\\n\u003c/div\u003e\\n\u003chr\u003e\\n\\n\u003cdiv id=\\\"content\\\"\u003e\\n\u003cp\u003eThe following error was encountered while trying to retrieve the URL: \u003ca href=\\\"http://localhost:5000/v2/busybox-nydus/blobs/sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f\\\"\u003ehttp://localhost:5000/v2/busybox-nydus/blobs/sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f\u003c/a\u003e\u003c/p\u003e\\n\\n\u003cblockquote id=\\\"error\\\"\u003e\\n\u003cp\u003e\u003cb\u003eConnection to 127.0.0.1 failed.\u003c/b\u003e\u003c/p\u003e\\n\u003c/blockquote\u003e\\n\\n\u003cp id=\\\"sysmsg\\\"\u003eThe system returned: \u003ci\u003e(111) Connection refused\u003c/i\u003e\u003c/p\u003e\\n\\n\u003cp\u003eThe remote host or network may be down. Please try the request again.\u003c/p\u003e\\n\\n\u003cp\u003eYour cache administrator is \u003ca href=\\\"mailto:root?subject=CacheErrorInfo%20-%20ERR_CONNECT_FAIL\u0026amp;body=CacheHost%3A%20ip-172-31-29-60%0D%0AErrPage%3A%20ERR_CONNECT_FAIL%0D%0AErr%3A%20(111)%20Connection%20refused%0D%0ATimeStamp%3A%20Mon,%2025%20Jan%202021%2007%3A02%3A34%20GMT%0D%0A%0D%0AClientIP%3A%2061.130.6.2%0D%0AServerIP%3A%20127.0.0.1%0D%0A%0D%0AHTTP%20Request%3A%0D%0AGET%20%2Fv2%2Fbusybox-nydus%2Fblobs%2Fsha256%3A804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f%20HTTP%2F1.1%0ARange%3A%20bytes%3D928816-988058%0D%0AContent-Length%3A%200%0D%0AAccept%3A%20*%2F*%0D%0AHost%3A%20localhost%3A5000%0D%0A%0D%0A%0D%0A\\\"\u003eroot\u003c/a\u003e.\u003c/p\u003e\\n\\n\u003cbr\u003e\\n\u003c/div\u003e\\n\\n\u003chr\u003e\\n\u003cdiv id=\\\"footer\\\"\u003e\\n\u003cp\u003eGenerated Mon, 25 Jan 2021 07:02:34 GMT by ip-172-31-29-60 (squid/3.1.10)\u003c/p\u003e\\n\u003c!-- ERR_CONNECT_FAIL --\u003e\\n\u003c/div\u003e\\n\u003c/body\u003e\u003c/html\u003e\\n\"","time":"2021-01-25T07:02:58.134777433Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tat rafs/src/storage/backend/request.rs:106","time":"2021-01-25T07:02:58.134961769Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tnote: enable `RUST_BACKTRACE=1` env to display a backtrace","time":"2021-01-25T07:02:58.134988436Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:58+00:00 - ERROR - Error:","time":"2021-01-25T07:02:58.135027158Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\t\"Read from backend failed: Input/output error (os error 5)\"","time":"2021-01-25T07:02:58.135051863Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tat rafs/src/storage/backend/mod.rs:103","time":"2021-01-25T07:02:58.135075583Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tnote: enable `RUST_BACKTRACE=1` env to display a backtrace","time":"2021-01-25T07:02:58.135110023Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:58+00:00 - INFO - Prefetch thread exits.","time":"2021-01-25T07:02:58.135131492Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:58+00:00 - ERROR - Error:","time":"2021-01-25T07:02:58.472935492Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\t\"\u003c!DOCTYPE html PUBLIC \\\"-//W3C//DTD HTML 4.01//EN\\\" \\\"http://www.w3.org/TR/html4/strict.dtd\\\"\u003e\\n\u003chtml\u003e\u003chead\u003e\\n\u003cmeta http-equiv=\\\"Content-Type\\\" CONTENT=\\\"text/html; charset=utf-8\\\"\u003e\\n\u003ctitle\u003eERROR: The requested URL could not be retrieved\u003c/title\u003e\\n\u003cstyle type=\\\"text/css\\\"\u003e\u003c!-- \\n /*\\n Stylesheet for Squid Error pages\\n Adapted from design by Free CSS Templates\\n http://www.freecsstemplates.org\\n Released for free under a Creative Commons Attribution 2.5 License\\n*/\\n\\n/* Page basics */\\n* {\\n\\tfont-family: verdana, sans-serif;\\n}\\n\\nhtml body {\\n\\tmargin: 0;\\n\\tpadding: 0;\\n\\tbackground: #efefef;\\n\\tfont-size: 12px;\\n\\tcolor: #1e1e1e;\\n}\\n\\n/* Page displayed title area */\\n#titles {\\n\\tmargin-left: 15px;\\n\\tpadding: 10px;\\n\\tpadding-left: 100px;\\n\\tbackground: url(\\'http://www.squid-cache.org/Artwork/SN.png\\') no-repeat left;\\n}\\n\\n/* initial title */\\n#titles h1 {\\n\\tcolor: #000000;\\n}\\n#titles h2 {\\n\\tcolor: #000000;\\n}\\n\\n/* special event: FTP success page titles */\\n#titles ftpsuccess {\\n\\tbackground-color:#00ff00;\\n\\twidth:100%;\\n}\\n\\n/* Page displayed body content area */\\n#content {\\n\\tpadding: 10px;\\n\\tbackground: #ffffff;\\n}\\n\\n/* General text */\\np {\\n}\\n\\n/* error brief description */\\n#error p {\\n}\\n\\n/* some data which may have caused the problem */\\n#data {\\n}\\n\\n/* the error message received from the system or other software */\\n#sysmsg {\\n}\\n\\npre {\\n    font-family:sans-serif;\\n}\\n\\n/* special event: FTP / Gopher directory listing */\\n#dirmsg {\\n    font-family: courier;\\n    color: black;\\n    font-size: 10pt;\\n}\\n#dirlisting {\\n    margin-left: 2%;\\n    margin-right: 2%;\\n}\\n#dirlisting tr.entry td.icon,td.filename,td.size,td.date {\\n    border-bottom: groove;\\n}\\n#dirlisting td.size {\\n    width: 50px;\\n    text-align: right;\\n    padding-right: 5px;\\n}\\n\\n/* horizontal lines */\\nhr {\\n\\tmargin: 0;\\n}\\n\\n/* page displayed footer area */\\n#footer {\\n\\tfont-size: 9px;\\n\\tpadding-left: 10px;\\n}\\n\\n\\nbody\\n:lang(fa) { direction: rtl; font-size: 100%; font-family: Tahoma, Roya, sans-serif; float: right; }\\n:lang(he) { direction: rtl; float: right; }\\n --\u003e\u003c/style\u003e\\n\u003c/head\u003e\u003cbody\u003e\\n\u003cdiv id=\\\"titles\\\"\u003e\\n\u003ch1\u003eERROR\u003c/h1\u003e\\n\u003ch2\u003eThe requested URL could not be retrieved\u003c/h2\u003e\\n\u003c/div\u003e\\n\u003chr\u003e\\n\\n\u003cdiv id=\\\"content\\\"\u003e\\n\u003cp\u003eThe following error was encountered while trying to retrieve the URL: \u003ca href=\\\"http://localhost:5000/v2/busybox-nydus/blobs/sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f\\\"\u003ehttp://localhost:5000/v2/busybox-nydus/blobs/sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f\u003c/a\u003e\u003c/p\u003e\\n\\n\u003cblockquote id=\\\"error\\\"\u003e\\n\u003cp\u003e\u003cb\u003eConnection to 127.0.0.1 failed.\u003c/b\u003e\u003c/p\u003e\\n\u003c/blockquote\u003e\\n\\n\u003cp id=\\\"sysmsg\\\"\u003eThe system returned: \u003ci\u003e(111) Connection refused\u003c/i\u003e\u003c/p\u003e\\n\\n\u003cp\u003eThe remote host or network may be down. Please try the request again.\u003c/p\u003e\\n\\n\u003cp\u003eYour cache administrator is \u003ca href=\\\"mailto:root?subject=CacheErrorInfo%20-%20ERR_CONNECT_FAIL\u0026amp;body=CacheHost%3A%20ip-172-31-29-60%0D%0AErrPage%3A%20ERR_CONNECT_FAIL%0D%0AErr%3A%20(111)%20Connection%20refused%0D%0ATimeStamp%3A%20Mon,%2025%20Jan%202021%2007%3A02%3A34%20GMT%0D%0A%0D%0AClientIP%3A%2061.130.6.2%0D%0AServerIP%3A%20127.0.0.1%0D%0A%0D%0AHTTP%20Request%3A%0D%0AGET%20%2Fv2%2Fbusybox-nydus%2Fblobs%2Fsha256%3A804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f%20HTTP%2F1.1%0ARange%3A%20bytes%3D432-673%0D%0AContent-Length%3A%200%0D%0AAccept%3A%20*%2F*%0D%0AHost%3A%20localhost%3A5000%0D%0A%0D%0A%0D%0A\\\"\u003eroot\u003c/a\u003e.\u003c/p\u003e\\n\\n\u003cbr\u003e\\n\u003c/div\u003e\\n\\n\u003chr\u003e\\n\u003cdiv id=\\\"footer\\\"\u003e\\n\u003cp\u003eGenerated Mon, 25 Jan 2021 07:02:34 GMT by ip-172-31-29-60 (squid/3.1.10)\u003c/p\u003e\\n\u003c!-- ERR_CONNECT_FAIL --\u003e\\n\u003c/div\u003e\\n\u003c/body\u003e\u003c/html\u003e\\n\"","time":"2021-01-25T07:02:58.473659355Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tat rafs/src/storage/backend/request.rs:106","time":"2021-01-25T07:02:58.473835787Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tnote: enable `RUST_BACKTRACE=1` env to display a backtrace","time":"2021-01-25T07:02:58.473895921Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:58+00:00 - ERROR - Error:","time":"2021-01-25T07:02:58.473922743Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\t\"Read from backend failed: Input/output error (os error 5)\"","time":"2021-01-25T07:02:58.473965308Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tat rafs/src/storage/backend/mod.rs:103","time":"2021-01-25T07:02:58.473988835Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tnote: enable `RUST_BACKTRACE=1` env to display a backtrace","time":"2021-01-25T07:02:58.474011008Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:58+00:00 - ERROR - Error:","time":"2021-01-25T07:02:58.668725291Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\t\"\u003c!DOCTYPE html PUBLIC \\\"-//W3C//DTD HTML 4.01//EN\\\" \\\"http://www.w3.org/TR/html4/strict.dtd\\\"\u003e\\n\u003chtml\u003e\u003chead\u003e\\n\u003cmeta http-equiv=\\\"Content-Type\\\" CONTENT=\\\"text/html; charset=utf-8\\\"\u003e\\n\u003ctitle\u003eERROR: The requested URL could not be retrieved\u003c/title\u003e\\n\u003cstyle type=\\\"text/css\\\"\u003e\u003c!-- \\n /*\\n Stylesheet for Squid Error pages\\n Adapted from design by Free CSS Templates\\n http://www.freecsstemplates.org\\n Released for free under a Creative Commons Attribution 2.5 License\\n*/\\n\\n/* Page basics */\\n* {\\n\\tfont-family: verdana, sans-serif;\\n}\\n\\nhtml body {\\n\\tmargin: 0;\\n\\tpadding: 0;\\n\\tbackground: #efefef;\\n\\tfont-size: 12px;\\n\\tcolor: #1e1e1e;\\n}\\n\\n/* Page displayed title area */\\n#titles {\\n\\tmargin-left: 15px;\\n\\tpadding: 10px;\\n\\tpadding-left: 100px;\\n\\tbackground: url(\\'http://www.squid-cache.org/Artwork/SN.png\\') no-repeat left;\\n}\\n\\n/* initial title */\\n#titles h1 {\\n\\tcolor: #000000;\\n}\\n#titles h2 {\\n\\tcolor: #000000;\\n}\\n\\n/* special event: FTP success page titles */\\n#titles ftpsuccess {\\n\\tbackground-color:#00ff00;\\n\\twidth:100%;\\n}\\n\\n/* Page displayed body content area */\\n#content {\\n\\tpadding: 10px;\\n\\tbackground: #ffffff;\\n}\\n\\n/* General text */\\np {\\n}\\n\\n/* error brief description */\\n#error p {\\n}\\n\\n/* some data which may have caused the problem */\\n#data {\\n}\\n\\n/* the error message received from the system or other software */\\n#sysmsg {\\n}\\n\\npre {\\n    font-family:sans-serif;\\n}\\n\\n/* special event: FTP / Gopher directory listing */\\n#dirmsg {\\n    font-family: courier;\\n    color: black;\\n    font-size: 10pt;\\n}\\n#dirlisting {\\n    margin-left: 2%;\\n    margin-right: 2%;\\n}\\n#dirlisting tr.entry td.icon,td.filename,td.size,td.date {\\n    border-bottom: groove;\\n}\\n#dirlisting td.size {\\n    width: 50px;\\n    text-align: right;\\n    padding-right: 5px;\\n}\\n\\n/* horizontal lines */\\nhr {\\n\\tmargin: 0;\\n}\\n\\n/* page displayed footer area */\\n#footer {\\n\\tfont-size: 9px;\\n\\tpadding-left: 10px;\\n}\\n\\n\\nbody\\n:lang(fa) { direction: rtl; font-size: 100%; font-family: Tahoma, Roya, sans-serif; float: right; }\\n:lang(he) { direction: rtl; float: right; }\\n --\u003e\u003c/style\u003e\\n\u003c/head\u003e\u003cbody\u003e\\n\u003cdiv id=\\\"titles\\\"\u003e\\n\u003ch1\u003eERROR\u003c/h1\u003e\\n\u003ch2\u003eThe requested URL could not be retrieved\u003c/h2\u003e\\n\u003c/div\u003e\\n\u003chr\u003e\\n\\n\u003cdiv id=\\\"content\\\"\u003e\\n\u003cp\u003eThe following error was encountered while trying to retrieve the URL: \u003ca href=\\\"http://localhost:5000/v2/busybox-nydus/blobs/sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f\\\"\u003ehttp://localhost:5000/v2/busybox-nydus/blobs/sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f\u003c/a\u003e\u003c/p\u003e\\n\\n\u003cblockquote id=\\\"error\\\"\u003e\\n\u003cp\u003e\u003cb\u003eConnection to 127.0.0.1 failed.\u003c/b\u003e\u003c/p\u003e\\n\u003c/blockquote\u003e\\n\\n\u003cp id=\\\"sysmsg\\\"\u003eThe system returned: \u003ci\u003e(111) Connection refused\u003c/i\u003e\u003c/p\u003e\\n\\n\u003cp\u003eThe remote host or network may be down. Please try the request again.\u003c/p\u003e\\n\\n\u003cp\u003eYour cache administrator is \u003ca href=\\\"mailto:root?subject=CacheErrorInfo%20-%20ERR_CONNECT_FAIL\u0026amp;body=CacheHost%3A%20ip-172-31-29-60%0D%0AErrPage%3A%20ERR_CONNECT_FAIL%0D%0AErr%3A%20(111)%20Connection%20refused%0D%0ATimeStamp%3A%20Mon,%2025%20Jan%202021%2007%3A02%3A35%20GMT%0D%0A%0D%0AClientIP%3A%2061.130.6.2%0D%0AServerIP%3A%20127.0.0.1%0D%0A%0D%0AHTTP%20Request%3A%0D%0AGET%20%2Fv2%2Fbusybox-nydus%2Fblobs%2Fsha256%3A804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f%20HTTP%2F1.0%0ARange%3A%20bytes%3D432-673%0D%0AContent-Length%3A%200%0D%0AAccept%3A%20*%2F*%0D%0AHost%3A%20localhost%3A5000%0D%0AConnection%3A%20keep-alive%0D%0A%0D%0A%0D%0A\\\"\u003eroot\u003c/a\u003e.\u003c/p\u003e\\n\\n\u003cbr\u003e\\n\u003c/div\u003e\\n\\n\u003chr\u003e\\n\u003cdiv id=\\\"footer\\\"\u003e\\n\u003cp\u003eGenerated Mon, 25 Jan 2021 07:02:35 GMT by ip-172-31-29-60 (squid/3.1.10)\u003c/p\u003e\\n\u003c!-- ERR_CONNECT_FAIL --\u003e\\n\u003c/div\u003e\\n\u003c/body\u003e\u003c/html\u003e\\n\"","time":"2021-01-25T07:02:58.669452152Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tat rafs/src/storage/backend/request.rs:106","time":"2021-01-25T07:02:58.669656139Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tnote: enable `RUST_BACKTRACE=1` env to display a backtrace","time":"2021-01-25T07:02:58.669711842Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:58+00:00 - ERROR - Error:","time":"2021-01-25T07:02:58.669733831Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\t\"Read from backend failed: Input/output error (os error 5)\"","time":"2021-01-25T07:02:58.669752750Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tat rafs/src/storage/backend/mod.rs:103","time":"2021-01-25T07:02:58.669774281Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tnote: enable `RUST_BACKTRACE=1` env to display a backtrace","time":"2021-01-25T07:02:58.669804300Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:59+00:00 - ERROR - Error:","time":"2021-01-25T07:02:59.278319499Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\t\"\u003c!DOCTYPE html PUBLIC \\\"-//W3C//DTD HTML 4.01//EN\\\" \\\"http://www.w3.org/TR/html4/strict.dtd\\\"\u003e\\n\u003chtml\u003e\u003chead\u003e\\n\u003cmeta http-equiv=\\\"Content-Type\\\" CONTENT=\\\"text/html; charset=utf-8\\\"\u003e\\n\u003ctitle\u003eERROR: The requested URL could not be retrieved\u003c/title\u003e\\n\u003cstyle type=\\\"text/css\\\"\u003e\u003c!-- \\n /*\\n Stylesheet for Squid Error pages\\n Adapted from design by Free CSS Templates\\n http://www.freecsstemplates.org\\n Released for free under a Creative Commons Attribution 2.5 License\\n*/\\n\\n/* Page basics */\\n* {\\n\\tfont-family: verdana, sans-serif;\\n}\\n\\nhtml body {\\n\\tmargin: 0;\\n\\tpadding: 0;\\n\\tbackground: #efefef;\\n\\tfont-size: 12px;\\n\\tcolor: #1e1e1e;\\n}\\n\\n/* Page displayed title area */\\n#titles {\\n\\tmargin-left: 15px;\\n\\tpadding: 10px;\\n\\tpadding-left: 100px;\\n\\tbackground: url(\\'http://www.squid-cache.org/Artwork/SN.png\\') no-repeat left;\\n}\\n\\n/* initial title */\\n#titles h1 {\\n\\tcolor: #000000;\\n}\\n#titles h2 {\\n\\tcolor: #000000;\\n}\\n\\n/* special event: FTP success page titles */\\n#titles ftpsuccess {\\n\\tbackground-color:#00ff00;\\n\\twidth:100%;\\n}\\n\\n/* Page displayed body content area */\\n#content {\\n\\tpadding: 10px;\\n\\tbackground: #ffffff;\\n}\\n\\n/* General text */\\np {\\n}\\n\\n/* error brief description */\\n#error p {\\n}\\n\\n/* some data which may have caused the problem */\\n#data {\\n}\\n\\n/* the error message received from the system or other software */\\n#sysmsg {\\n}\\n\\npre {\\n    font-family:sans-serif;\\n}\\n\\n/* special event: FTP / Gopher directory listing */\\n#dirmsg {\\n    font-family: courier;\\n    color: black;\\n    font-size: 10pt;\\n}\\n#dirlisting {\\n    margin-left: 2%;\\n    margin-right: 2%;\\n}\\n#dirlisting tr.entry td.icon,td.filename,td.size,td.date {\\n    border-bottom: groove;\\n}\\n#dirlisting td.size {\\n    width: 50px;\\n    text-align: right;\\n    padding-right: 5px;\\n}\\n\\n/* horizontal lines */\\nhr {\\n\\tmargin: 0;\\n}\\n\\n/* page displayed footer area */\\n#footer {\\n\\tfont-size: 9px;\\n\\tpadding-left: 10px;\\n}\\n\\n\\nbody\\n:lang(fa) { direction: rtl; font-size: 100%; font-family: Tahoma, Roya, sans-serif; float: right; }\\n:lang(he) { direction: rtl; float: right; }\\n --\u003e\u003c/style\u003e\\n\u003c/head\u003e\u003cbody\u003e\\n\u003cdiv id=\\\"titles\\\"\u003e\\n\u003ch1\u003eERROR\u003c/h1\u003e\\n\u003ch2\u003eThe requested URL could not be retrieved\u003c/h2\u003e\\n\u003c/div\u003e\\n\u003chr\u003e\\n\\n\u003cdiv id=\\\"content\\\"\u003e\\n\u003cp\u003eThe following error was encountered while trying to retrieve the URL: \u003ca href=\\\"http://localhost:5000/v2/busybox-nydus/blobs/sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f\\\"\u003ehttp://localhost:5000/v2/busybox-nydus/blobs/sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f\u003c/a\u003e\u003c/p\u003e\\n\\n\u003cblockquote id=\\\"error\\\"\u003e\\n\u003cp\u003e\u003cb\u003eConnection to 127.0.0.1 failed.\u003c/b\u003e\u003c/p\u003e\\n\u003c/blockquote\u003e\\n\\n\u003cp id=\\\"sysmsg\\\"\u003eThe system returned: \u003ci\u003e(111) Connection refused\u003c/i\u003e\u003c/p\u003e\\n\\n\u003cp\u003eThe remote host or network may be down. Please try the request again.\u003c/p\u003e\\n\\n\u003cp\u003eYour cache administrator is \u003ca href=\\\"mailto:root?subject=CacheErrorInfo%20-%20ERR_CONNECT_FAIL\u0026amp;body=CacheHost%3A%20ip-172-31-29-60%0D%0AErrPage%3A%20ERR_CONNECT_FAIL%0D%0AErr%3A%20(111)%20Connection%20refused%0D%0ATimeStamp%3A%20Mon,%2025%20Jan%202021%2007%3A02%3A35%20GMT%0D%0A%0D%0AClientIP%3A%2061.130.6.2%0D%0AServerIP%3A%20127.0.0.1%0D%0A%0D%0AHTTP%20Request%3A%0D%0AGET%20%2Fv2%2Fbusybox-nydus%2Fblobs%2Fsha256%3A804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f%20HTTP%2F1.1%0ARange%3A%20bytes%3D0-56%0D%0AContent-Length%3A%200%0D%0AAccept%3A%20*%2F*%0D%0AHost%3A%20localhost%3A5000%0D%0A%0D%0A%0D%0A\\\"\u003eroot\u003c/a\u003e.\u003c/p\u003e\\n\\n\u003cbr\u003e\\n\u003c/div\u003e\\n\\n\u003chr\u003e\\n\u003cdiv id=\\\"footer\\\"\u003e\\n\u003cp\u003eGenerated Mon, 25 Jan 2021 07:02:35 GMT by ip-172-31-29-60 (squid/3.1.10)\u003c/p\u003e\\n\u003c!-- ERR_CONNECT_FAIL --\u003e\\n\u003c/div\u003e\\n\u003c/body\u003e\u003c/html\u003e\\n\"","time":"2021-01-25T07:02:59.278810722Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tat rafs/src/storage/backend/request.rs:106","time":"2021-01-25T07:02:59.279013018Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tnote: enable `RUST_BACKTRACE=1` env to display a backtrace","time":"2021-01-25T07:02:59.279066958Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:59+00:00 - ERROR - Error:","time":"2021-01-25T07:02:59.279091597Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\t\"Read from backend failed: Input/output error (os error 5)\"","time":"2021-01-25T07:02:59.279113310Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tat rafs/src/storage/backend/mod.rs:103","time":"2021-01-25T07:02:59.279135403Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"\tnote: enable `RUST_BACKTRACE=1` env to display a backtrace","time":"2021-01-25T07:02:59.279157356Z"}
{"daemon":"D3XRZtk5TK6HcUPWxzt1Cg","level":"debug","msg":"2021-01-25T07:02:59+00:00 - INFO - Prefetch thread exits.","time":"2021-01-25T07:02:59.279182067Z"}
{"level":"info","msg":"cleanup: dirs=[/var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/5]","time":"2021-01-25T07:03:41.538121652Z"}
{"dir":"/var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/5","level":"info","msg":"cleanupSnapshotDirectory /var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/5","time":"2021-01-25T07:03:41.538213993Z"}
{"dir":"/var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/5","error":"failed to get daemon by snapshotID (5)","level":"error","msg":"failed to unmount","time":"2021-01-25T07:03:41.538256691Z"}
{"level":"info","msg":"umount nydus daemon of id 5, mountpoint /var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/5","time":"2021-01-25T07:03:41.538333497Z"}
{"dir":"/var/lib/containerd/io.containerd.snapshotter.v1.nydus/snapshots/5","error":"failed to get daemon by snapshotID (5)","level":"error","msg":"failed to unmount","time":"2021-01-25T07:03:41.538367891Z"}

3. want to know
nydus with containerd or docker if there some Pre-requisites, such as host fs type?

from nydus.

bergwolf commented on June 29, 2024

@Apokleos please share a bit more info about your environment, namingly:

what is the container image you are trying to run?
what is the image registry you are running against?
what does your nydusd config file look like?
are you behind a proxy?

from nydus.

Apokleos commented on June 29, 2024

Thank you @bergwolf

@Apokleos please share a bit more info about your environment, namingly:

what is the container image you are trying to run?
busybox:latest

what is the image registry you are running against?
local registry: http://localhost:5000
registry image: registry:2.7.1

what does your nydusd config file look like?

{
  "device": {
    "backend": {
      "type": "registry",
      "config": {
        "scheme": "http",
        "timeout": 5,
        "connect_timeout": 5,
        "retry_limit": 0
      }
    },
    "cache": {
      "type": "blobcache",
      "config": {
        "work_dir": "cache"
      }
    }
  },
  "mode": "direct",
  "digest_validate": false,
  "iostats_files": true,
  "enable_xattr": false,
  "fs_prefetch": {
    "enable": true,
    "threads_count": 10
  }
}

are you behind a proxy?
No(actually, I set no_proxy=localhost,127.0.0.1, and after unset, the same error. )

from nydus.

bergwolf commented on June 29, 2024

nydusd is trying to connect to your local registry with url:

http://localhost:5000/v2/busybox-nydus/blobs/sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f

and failed with

Connection to 127.0.0.1 failed. The system returned: (111) Connection refused

and looking further, it looks like there is a squid server in the middle:

Generated Mon, 25 Jan 2021 07:02:34 GMT by ip-172-31-29-60 (squid/3.1.10)

Could you retry without squid?

from nydus.

Apokleos commented on June 29, 2024

nydusd is trying to connect to your local registry with url:
http://localhost:5000/v2/busybox-nydus/blobs/sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f
and failed with
Connection to 127.0.0.1 failed. The system returned: (111) Connection refused
and looking further, it looks like there is a squid server in the middle:
Generated Mon, 25 Jan 2021 07:02:34 GMT by ip-172-31-29-60 (squid/3.1.10)
Could you retry without squid?
I don't know why the squid server ip-172-31-29-60 is here, maybe the VM contains some other agent service. In order to eliminate the impact, I have unset all of proxy and other services which can be stopped.

Thanks Bro Tao@bergwolf for patient answer.

I have solved it, images can be converted ok and containers is running.

from nydus.

caoJiang7 commented on June 29, 2024

nydusd is trying to connect to your local registry with url:
http://localhost:5000/v2/busybox-nydus/blobs/sha256:804a73bece6273840b99dc73842ffec9e07e5532b2cf9117ab49f8655cf1268f
and failed with
Connection to 127.0.0.1 failed. The system returned: (111) Connection refused
and looking further, it looks like there is a squid server in the middle:
Generated Mon, 25 Jan 2021 07:02:34 GMT by ip-172-31-29-60 (squid/3.1.10)
Could you retry without squid?
I don't know why the squid server ip-172-31-29-60 is here, maybe the VM contains some other agent service. In order to eliminate the impact, I have unset all of proxy and other services which can be stopped.
Thanks Bro Tao@bergwolf for patient answer.

I have solved it, images can be converted ok and containers is running.

@Apokleos I have the same problem, can you provide a solution，thanks

from nydus.

Nydus with containerd running Pod failed about nydus HOT 10 CLOSED

Comments (10)

Related Issues (20)

Recommend Projects

React

Vue.js

Typescript

TensorFlow

Django

Laravel

D3

Recommend Topics

javascript

web

server

Machine learning

Visualization

Game

Recommend Org

Facebook

Microsoft

Google

Alibaba

D3

Tencent