zfsonlinux / pkg-zfs Goto Github PK
View Code? Open in Web Editor NEWNative ZFS packaging for Debian and Ubuntu
Home Page: https://launchpad.net/~zfs-native/+archive/daily
Native ZFS packaging for Debian and Ubuntu
Home Page: https://launchpad.net/~zfs-native/+archive/daily
The ZFS run-part for grub fails to generate a working kernel command line when the boot device is separate from the root zpool. The error message is:
Begin: Importing ZFS root pool rpool ... done.
Command: zpool import -f -N rpool
Message: cannot import 'rpool': no such pool available.
Notice how the first line contradicts the third line.
Kludge the problem by putting this in the /etc/default/grub
file and running update-grub
:
GRUB_CMDLINE_LINUX="rpool=tank bootfs=tank/ROOT/ubuntu"
Check the upstream grub-2.00 release for a fix.
Using the 12.04.1 live cd. with these instructions:
https://github.com/dajhorn/pkg-zfs/wiki/HOWTO-install-Ubuntu-to-a-Native-ZFS-Root-Filesystem
part 1.2
yesterday , while, daily was at .79:
apt-get install debootstrap ubuntu-zfs
failed on the zfs part , saying zfs could not determine the spl version.
What did work yesterday was doing an install of spl-dkms manually then an install zfs-dkms , then ubuntu-zfs over that.
Today when at .80 , doing the install zfs-dkms it fails saying it's not able to determine zpl version as well.
So installation using those instructions is broken starting today.
not related and not asking for any help on this, I haven't been able to get a system to boot yet. everything in the instructions installs and seems to work fine up until the moment one has to reboot. I tried making grub stay on longer thinking i may have mieed it , but alas no grub to be seen. The system goes past post , reads a bit of the ssd then i see the lights flash on all hdd's , then the screen stays black. numlock still works.
I'm trying to figure out what the issue could be. Today I will do the whole install again but with /stable instead of /daily. I will go scavenge for a 12.04 cd as well instead of a 12.04.1 .
I was wondering if a .56 was available on ppa so I have everything at the same version of when the install instructions were made.
I am thinking the issue is grub related though...
step 5/6 seems to rely on grub-pc : http://i.imgur.com/6l46b.png
while troubleshooting seems to rely on zfs-grub from ppa:zfs-native/grub : http://i.imgur.com/Na93W.png
I am assuming grub-pc is a newer patched version and the troubleshooting part is a paste from older instructions?
Thnx in advance for any reply .
Coreutils pre-depends on libselinux1, and /bin/mount
is linked to /lib/x86_64-linux-gnu/libselinux.so.1
.
Although /sbin/mount.zfs
can be selinux aware, the PPA binary is currently missing that linkage:
$ ldd /sbin/mount.zfs
linux-vdso.so.1 => (0x00007fffb15ff000)
libspl.so.1 => /lib/libspl.so.1 (0x00007f757e30c000)
libzfs.so.1 => /lib/libzfs.so.1 (0x00007f757e0d6000)
libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f757deb8000)
libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f757db19000)
librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007f757d911000)
/lib64/ld-linux-x86-64.so.2 (0x00007f757e537000)
libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f757d68c000)
libefi.so.1 => /lib/libefi.so.1 (0x00007f757d486000)
libnvpair.so.1 => /lib/libnvpair.so.1 (0x00007f757d277000)
libshare.so.1 => /lib/libshare.so.1 (0x00007f757d070000)
libuutil.so.1 => /lib/libuutil.so.1 (0x00007f757ce66000)
libzpool.so.1 => /lib/libzpool.so.1 (0x00007f757cba4000)
libavl.so.1 => /lib/libavl.so.1 (0x00007f757c9a0000)
libuuid.so.1 => /lib/x86_64-linux-gnu/libuuid.so.1 (0x00007f757c79b000)
libz.so.1 => /lib/x86_64-linux-gnu/libz.so.1 (0x00007f757c583000)
libunicode.so.1 => /lib/libunicode.so.1 (0x00007f757c332000)
Hi Darik,
i have a few grub-related issues. In all cases i encountered these problems on a fresh
install via amd64 live-cd to an empty disk.
Following this howto, i never ever got grub-pc installed. Not on 11.04, nor on 11.10. In step 5.6 when executing
# apt-get install --no-install-recommends linux-image linux-image-generic linux-headers-generic
i get
The following extra packages will be installed:
linux-firmware linux-headers-3.0.0-12 linux-headers-3.0.0-12-generic linux-image-3.0.0-12-generic wireless-crda
Suggested packages:
fdutils linux-doc-3.0.0 linux-source-3.0.0 linux-tools
Recommended packages:
grub-pc grub-efi-amd64 grub-efi-ia32 grub lilo
The following NEW packages will be installed:
linux-firmware linux-headers-3.0.0-12 linux-headers-3.0.0-12-generic linux-headers-generic linux-image linux-image-3.0.0-12-generic linux-image-generic wireless-crda
0 upgraded, 8 newly installed, 0 to remove and 0 not upgraded.
You see, grub-pc is recommended but ignored due to the switch.
In step 6.1 grub-probe is succesful but /boot/grub is missing and also grub-install and update-grub
# grub-probe /
zfs
# ls /boot/grub/zfs*
ls: cannot access /boot/grub/zfs*: No such file or directory
# which update-grub
# which grub-install
#
# dpkg -l | grep grub
ii grub-common 1.99-12ubuntu5+zfs1~oneiric1 GRand Unified Bootloader (common files)
/etc/grub.d/10_linux: 68: xUNKNOWN (0x2fc12fc1): not found
apt-get install grub-pc resolves the problem regarding /boot/grub and the missing tools
# grub-probe /
zfs
# ls /boot/grub/zfs*
/boot/grub/zfsinfo.mod /boot/grub/zfs.mod
# which update-grub
/usr/sbin/update-grub
# which grub-install
/usr/sbin/grub-install
#
but it throws an error message
Creating config file /etc/default/grub with new version
Installation finished. No error reported.
Generating grub.cfg ...
[: 68: missing ]
/etc/grub.d/10_linux: 68: xUNKNOWN (0x2fc12fc1): not found
Found linux image: /boot/vmlinuz-3.0.0-12-generic
Found initrd image: /boot/initrd.img-3.0.0-12-generic
done
error: cannot find a GRUB drive for /dev/disk/by-id/ata-WDC_...CAWFxxxxxxx. Check your device.map.
For the first time (i did numerous installations previous with 11.04 using /dev/sda) i used /dev/data/by-id/ addressing
schema. /dev/disk/by-id/ has two entries for every disk/partition: an ata-* and a scsi-*. First, inspired by the howto, i used
the scsi variant which worked until step 6.5
# grub-install /dev/disk/by-id/scsi-SATA_WDC_WD2500AAJS-_WD-WCAWFxxxxxxx
/usr/sbin/grub-probe: error: cannot find a GRUB drive for /dev/disk/by-id/scsi-SATA_WDC_WD2500AAJS-_WD-WCAWFxxxxxxx. Check your device.map.
I found that /boot/grub/device.map didnt exist and tried to fix this
# cat /boot/grub/device.map
cat: /boot/grub/device.map: No such file or directory
# grub-mkdevicemap --no-floppy
# cat /boot/grub/device.map
(hd0) /dev/disk/by-id/ata-WDC_WD2500AAJS-00V4A0_WD-WCAWFxxxxxxx
Since grub-mkdevicemap only added the ata variant, i started over by erasing the hd and rebooting from live-cd
using this id. I encountered all 3 issues.
# grub-install /dev/disk/by-id/ata-WDC_WD2500AAJS-00V4A0_WD-WCAWFxxxxxxx
/usr/sbin/grub-probe: error: cannot find a GRUB drive for /dev/disk/by-id/ata-WDC_WD2500AAJS-00V4A0_WD-WCAWFxxxxxxx. Check your device.map.
#
# cat /boot/grub/device.map
(hd0) /dev/disk/by-id/ata-WDC_WD2500AAJS-00V4A0_WD-WCAWFxxxxxxx
BUT (!!!!)
# grub-install /dev/sda
Installation finished. No error reported.
After rebooting, the system is fully functional.
Best regards
Thomas
Following the wiki directions, I've tried to set up an rpool. The grub install pieces appear to be broken ATM because Precise has updated to a later version, which means that apt will pick up that version even though the PPA is the preferred source. Thus I get the following error:
Reading package lists...
Building dependency tree...
Reading state information...
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:
The following packages have unmet dependencies.
grub-common:i386 : Depends: libdevmapper1.02.1:i386 (>= 2:1.02.36) but it is not going to be installed
Depends: gettext-base:i386 but it is not going to be installed
E: Unable to correct problems, you have held broken packages.
The subsequent attempt at zfs-initramfs install breaks because it can't replace the zfs-grub alias because the dependencies can't be solved.
Hello ,
Would you mind specifying where swap should be put when following the instructions here :
https://github.com/dajhorn/pkg-zfs/wiki/HOWTO-install-Ubuntu-to-a-Native-ZFS-Root-Filesystem
I've been using zfs in various systems for a bit now , and when reading up on things memory , and specifically needing a lot of it , always creeps up in discussions. The moment one needs swap space is when memory is somewhat scarce , is it recommended to have zfs handle it at that point?
Can I put swap on the rpool or should I partition some extra space for it ?
Related but not really an issue as such , merely a question/observation..
From those instructions , that seem to be based on using a single drive , where at some point you mention ""you can use a mirror as well" , it seems that /boot is not mirrored . I assume that using mdadm and putting grub on both disks is allowed?
My initial plan was to use 2 usb sticks in software raid 1 to stick /boot on , then have root on 3 drives in raidz1 . Having read up on root pools in general mirroring is the only possible way to go for it. So , having given up on raidz1 I am now wondering if using a mirrored root pool but still using the usb drives for /boot is still possible? or does using a rpool on linux require it to be on the same drives ?
Also , can I add the third drive to the mirror pool for extra redundancy?
ie : zpool attach rpool XXX YYY
And end up with something like this :
NAME STATE READ WRITE CKSUM
rpool ONLINE 0 0 0
mirror ONLINE 0 0 0
DR1 ONLINE 0 0 0
DR2 ONLINE 0 0 0
DR3 ONLINE 0 0 0
Or are there inherent limitations to root pools beyond not being able to use raidz ?
I have read up on several sites on the subject but most seem to be copying each other and merely list the limitation without going into any detail.
Thank you for any reply.
Phoenixxl.
Upon running dpkg-buildpackage on Squeeze, I get this error:
dpkg-checkbuilddeps: Unmet build dependencies: dkms (>> 2.1.1.2-5ubuntu1)
Moreover, zfs-initramfs seems to depend on zfs-grub, which
a) is not built at all (doesn't seem to exist, actually)
b) is unreasonable, since initramfs and GRUB are completely independent, and one could, for example, use LILO or require ZFS in initramfs despite booting from ext2.
The above problems make pkg-zfs unusable on Debian at the moment.
The lintian
in Ubuntu 12.04 is returning new DEP5 conformance warnings for the source package:
W: zfs-linux source: missing-license-paragraph-in-dep5-copyright gpl-2 (paragraph at line 145)
W: zfs-linux source: missing-license-paragraph-in-dep5-copyright gpl-2+ (paragraph at line 1170)
W: zfs-linux source: missing-license-paragraph-in-dep5-copyright cddl-1.0 (paragraph at line 1166)
And errors for the binary packages:
E: libzfs-dev: copyright-should-refer-to-common-license-file-for-gpl
E: libuutil1: copyright-should-refer-to-common-license-file-for-gpl
E: libzpool1: copyright-should-refer-to-common-license-file-for-gpl
E: libnvpair1: copyright-should-refer-to-common-license-file-for-gpl
E: zfs-initramfs: copyright-should-refer-to-common-license-file-for-gpl
E: zfs-dkms: copyright-should-refer-to-common-license-file-for-gpl
E: zfsutils: copyright-should-refer-to-common-license-file-for-gpl
E: libzfs1: copyright-should-refer-to-common-license-file-for-gpl
The change in openzfs/zfs#509 reduces number of shlibdep warnings from several hundred to less than one hundred.
Ideally, pkg-zfs would be completely lintian clean, but this warning seems to be a deficiency in the analysis tool. The actual package dependency is correctly generated.
dh_shlibdeps
dpkg-shlibdeps: warning: symbol xdr_control used by debian/libnvpair1/lib/libnvpair.so.1.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol pthread_setspecific used by debian/libuutil1/lib/libuutil.so.1.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol getexecname used by debian/libuutil1/lib/libuutil.so.1.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol pthread_key_create used by debian/libuutil1/lib/libuutil.so.1.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol pthread_atfork used by debian/libuutil1/lib/libuutil.so.1.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol gethrtime used by debian/libuutil1/lib/libuutil.so.1.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol strlcpy used by debian/libuutil1/lib/libuutil.so.1.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol pthread_getspecific used by debian/libuutil1/lib/libuutil.so.1.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol zfs_iter_root used by debian/libuutil1/lib/libuutil.so.0.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol libzfs_init used by debian/libuutil1/lib/libuutil.so.0.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol zfs_iter_filesystems used by debian/libuutil1/lib/libuutil.so.0.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol zfs_get_type used by debian/libuutil1/lib/libuutil.so.0.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol zfs_prop_get used by debian/libuutil1/lib/libuutil.so.0.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol libzfs_print_on_error used by debian/libuutil1/lib/libuutil.so.0.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol libzfs_fini used by debian/libuutil1/lib/libuutil.so.0.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol zfs_get_name used by debian/libuutil1/lib/libuutil.so.0.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol libzfs_run_process used by debian/libuutil1/lib/libuutil.so.0.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol zfs_is_mounted used by debian/libuutil1/lib/libuutil.so.0.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: 2 other similar warnings have been skipped (use -v to see them all).
dpkg-shlibdeps: warning: symbol nv_alloc_init used by debian/libzpool1/lib/libzpool.so.1.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol nvlist_size used by debian/libzpool1/lib/libzpool.so.1.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol nvlist_dup used by debian/libzpool1/lib/libzpool.so.1.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol nv_fixed_ops used by debian/libzpool1/lib/libzpool.so.1.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol nvlist_add_byte_array used by debian/libzpool1/lib/libzpool.so.1.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol nvlist_add_boolean used by debian/libzpool1/lib/libzpool.so.1.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol nvlist_add_int64 used by debian/libzpool1/lib/libzpool.so.1.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol nvlist_add_nvlist_array used by debian/libzpool1/lib/libzpool.so.1.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol nvlist_add_int8 used by debian/libzpool1/lib/libzpool.so.1.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: symbol nvlist_add_string used by debian/libzpool1/lib/libzpool.so.1.0.0 found in none of the libraries.
dpkg-shlibdeps: warning: 41 other similar warnings have been skipped (use -v to see them all).
Hi,
I just setup a completely fresh install of ubuntu 11.04 server but got the following errors, seems to be a problem with a spl devel package, but what do i need to install to fix this?
Thanks,
Mark
root@pluto:/etc# apt-get install debootstrap ubuntu-zfs
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following extra packages will be installed:
binutils cpp cpp-4.5 dkms fakeroot gcc gcc-4.5 libavl0 libc-dev-bin libc6-dev libcloog-ppl0 libefi0 libelfg0 libgmpxx4ldbl libgomp1 libmpc2 libmpfr4 libnvpair0 libppl-c2 libppl7 libspl0
libunicode0 libuutil0 libzfs0 libzpool0 linux-libc-dev make manpages-dev spl spl-dkms zfs-dkms zfsutils
Suggested packages:
binutils-doc cpp-doc gcc-4.5-locales gcc-multilib autoconf automake1.9 libtool flex bison gdb gcc-doc gcc-4.5-multilib libmudflap0-4.5-dev gcc-4.5-doc libgcc1-dbg libgomp1-dbg libmudflap0-dbg
binutils-gold glibc-doc make-doc zfs-initramfs
The following NEW packages will be installed
binutils cpp cpp-4.5 debootstrap dkms fakeroot gcc gcc-4.5 libavl0 libc-dev-bin libc6-dev libcloog-ppl0 libefi0 libelfg0 libgmpxx4ldbl libgomp1 libmpc2 libmpfr4 libnvpair0 libppl-c2 libppl7
libspl0 libunicode0 libuutil0 libzfs0 libzpool0 linux-libc-dev make manpages-dev spl spl-dkms ubuntu-zfs zfs-dkms zfsutils
0 upgraded, 34 newly installed, 0 to remove and 0 not upgraded.
Need to get 25.0 MB of archives.
After this operation, 78.6 MB of additional disk space will be used.
Do you want to continue [Y/n]? y
Get:1 http://gb.archive.ubuntu.com/ubuntu/ natty/main libgomp1 amd64 4.5.2-8ubuntu4 [25.4 kB]
Get:2 http://ppa.launchpad.net/dajhorn/zfs/ubuntu/ natty/main dkms all 2.1.1.2-5ubuntu1.1natty [71.9 kB]natty1 [430 kB]
Get:3 http://gb.archive.ubuntu.com/ubuntu/ natty/main libgmpxx4ldbl amd64 2:4.3.2+dfsg-1ubuntu3 [10.4 kB]
Get:4 http://gb.archive.ubuntu.com/ubuntu/ natty/main libppl7 amd64 0.10.2-10ubuntu1 [357 kB]
Get:5 http://ppa.launchpad.net/dajhorn/zfs/ubuntu/ natty/main spl-dkms all 0.6.0.21-0ubuntu1
Get:6 http://ppa.launchpad.net/dajhorn/zfs/ubuntu/ natty/main zfs-dkms amd64 0.6.0.21-0ubuntu1natty1 [1,814 kB]natty1 [17.3 kB]
Get:7 http://gb.archive.ubuntu.com/ubuntu/ natty/main libppl-c2 amd64 0.10.2-10ubuntu1 [1,203 kB]
Get:8 http://ppa.launchpad.net/dajhorn/zfs/ubuntu/ natty/main spl amd64 0.6.0.21-0ubuntu1
Get:9 http://ppa.launchpad.net/dajhorn/zfs/ubuntu/ natty/main libavl0 amd64 0.6.0.21-0ubuntu1natty1 [19.9 kB]natty1 [25.4 kB]
Get:10 http://ppa.launchpad.net/dajhorn/zfs/ubuntu/ natty/main libefi0 amd64 0.6.0.21-0ubuntu1
Get:11 http://ppa.launchpad.net/dajhorn/zfs/ubuntu/ natty/main libnvpair0 amd64 0.6.0.21-0ubuntu1natty1 [38.3 kB]natty1 [23.8 kB]
Get:12 http://ppa.launchpad.net/dajhorn/zfs/ubuntu/ natty/main libspl0 amd64 0.6.0.21-0ubuntu1
Get:13 http://ppa.launchpad.net/dajhorn/zfs/ubuntu/ natty/main libunicode0 amd64 0.6.0.21-0ubuntu1natty1 [57.6 kB]natty1 [31.2 kB]
Get:14 http://ppa.launchpad.net/dajhorn/zfs/ubuntu/ natty/main libuutil0 amd64 0.6.0.21-0ubuntu1
Get:15 http://ppa.launchpad.net/dajhorn/zfs/ubuntu/ natty/main libzpool0 amd64 0.6.0.21-0ubuntu1natty1 [366 kB]natty1 [115 kB]
Get:16 http://ppa.launchpad.net/dajhorn/zfs/ubuntu/ natty/main libzfs0 amd64 0.6.0.21-0ubuntu1
Get:17 http://ppa.launchpad.net/dajhorn/zfs/ubuntu/ natty/main zfsutils amd64 0.6.0.21-0ubuntu1natty1 [271 kB]natty [1,678 B]
Get:18 http://ppa.launchpad.net/dajhorn/zfs/ubuntu/ natty/main ubuntu-zfs amd64 4
Get:19 http://gb.archive.ubuntu.com/ubuntu/ natty/main libcloog-ppl0 amd64 0.15.9-2 [62.0 kB]
Get:20 http://gb.archive.ubuntu.com/ubuntu/ natty/main libelfg0 amd64 0.8.13-1 [57.8 kB]
Get:21 http://gb.archive.ubuntu.com/ubuntu/ natty/main libmpfr4 amd64 3.0.0-7 [188 kB]
Get:22 http://gb.archive.ubuntu.com/ubuntu/ natty/main libmpc2 amd64 0.9-1 [39.7 kB]
Get:23 http://gb.archive.ubuntu.com/ubuntu/ natty/main cpp-4.5 amd64 4.5.2-8ubuntu4 [4,603 kB]
Get:24 http://gb.archive.ubuntu.com/ubuntu/ natty/main cpp amd64 4:4.5.2-1ubuntu3 [28.0 kB]
Get:25 http://gb.archive.ubuntu.com/ubuntu/ natty-updates/main binutils amd64 2.21.0.20110327-2ubuntu3 [2,524 kB]
Get:26 http://gb.archive.ubuntu.com/ubuntu/ natty/main gcc-4.5 amd64 4.5.2-8ubuntu4 [7,203 kB]
Get:27 http://gb.archive.ubuntu.com/ubuntu/ natty/main gcc amd64 4:4.5.2-1ubuntu3 [5,062 B]
Get:28 http://gb.archive.ubuntu.com/ubuntu/ natty/main make amd64 3.81-8ubuntu1 [119 kB]
Get:29 http://gb.archive.ubuntu.com/ubuntu/ natty/main fakeroot amd64 1.14.4-1ubuntu1 [101 kB]
Get:30 http://gb.archive.ubuntu.com/ubuntu/ natty/main libc-dev-bin amd64 2.13-0ubuntu13 [89.3 kB]
Get:31 http://gb.archive.ubuntu.com/ubuntu/ natty/main linux-libc-dev amd64 2.6.38-8.42 [792 kB]
Get:32 http://gb.archive.ubuntu.com/ubuntu/ natty/main libc6-dev amd64 2.13-0ubuntu13 [2,630 kB]
Get:33 http://gb.archive.ubuntu.com/ubuntu/ natty/main manpages-dev all 3.27-1ubuntu2 [1,627 kB]
Get:34 http://gb.archive.ubuntu.com/ubuntu/ natty/main debootstrap all 1.0.29ubuntu1 [35.2 kB]
Fetched 25.0 MB in 38s (651 kB/s)
Extract templates from packages: 100%
Selecting previously deselected package libgomp1.
(Reading database ... 48981 files and directories currently installed.)
Unpacking libgomp1 (from .../libgomp1_4.5.2-8ubuntu4_amd64.deb) ...
Selecting previously deselected package libgmpxx4ldbl.
Unpacking libgmpxx4ldbl (from .../libgmpxx4ldbl_2%3a4.3.2+dfsg-1ubuntu3_amd64.deb) ...
Selecting previously deselected package libppl7.
Unpacking libppl7 (from .../libppl7_0.10.2-10ubuntu1_amd64.deb) ...
Selecting previously deselected package libppl-c2.
Unpacking libppl-c2 (from .../libppl-c2_0.10.2-10ubuntu1_amd64.deb) ...
Selecting previously deselected package libcloog-ppl0.
Unpacking libcloog-ppl0 (from .../libcloog-ppl0_0.15.9-2_amd64.deb) ...
Selecting previously deselected package libelfg0.
Unpacking libelfg0 (from .../libelfg0_0.8.13-1_amd64.deb) ...
Selecting previously deselected package libmpfr4.
Unpacking libmpfr4 (from .../libmpfr4_3.0.0-7_amd64.deb) ...
Selecting previously deselected package libmpc2.
Unpacking libmpc2 (from .../libmpc2_0.9-1_amd64.deb) ...
Selecting previously deselected package cpp-4.5.
Unpacking cpp-4.5 (from .../cpp-4.5_4.5.2-8ubuntu4_amd64.deb) ...
Selecting previously deselected package cpp.
Unpacking cpp (from .../cpp_4%3a4.5.2-1ubuntu3_amd64.deb) ...
Selecting previously deselected package binutils.
Unpacking binutils (from .../binutils_2.21.0.20110327-2ubuntu3_amd64.deb) ...
Selecting previously deselected package gcc-4.5.
Unpacking gcc-4.5 (from .../gcc-4.5_4.5.2-8ubuntu4_amd64.deb) ...
Selecting previously deselected package gcc.
Unpacking gcc (from .../gcc_4%3a4.5.2-1ubuntu3_amd64.deb) ...
Selecting previously deselected package make.
Unpacking make (from .../make_3.81-8ubuntu1_amd64.deb) ...
Selecting previously deselected package dkms.
Unpacking dkms (from .../dkms_2.1.1.2-5ubuntu1.1natty_all.deb) ...natty1_all.deb) ...
Selecting previously deselected package spl-dkms.
Unpacking spl-dkms (from .../spl-dkms_0.6.0.21-0ubuntu1
Processing triggers for man-db ...
Setting up libgmpxx4ldbl (2:4.3.2+dfsg-1ubuntu3) ...
Setting up libppl7 (0.10.2-10ubuntu1) ...
Setting up libppl-c2 (0.10.2-10ubuntu1) ...
Setting up libcloog-ppl0 (0.15.9-2) ...
Setting up libelfg0 (0.8.13-1) ...
Setting up libmpfr4 (3.0.0-7) ...
Setting up libmpc2 (0.9-1) ...
Setting up cpp-4.5 (4.5.2-8ubuntu4) ...
Setting up cpp (4:4.5.2-1ubuntu3) ...
Setting up binutils (2.21.0.20110327-2ubuntu3) ...
Setting up libgomp1 (4.5.2-8ubuntu4) ...
Setting up gcc-4.5 (4.5.2-8ubuntu4) ...
Setting up gcc (4:4.5.2-1ubuntu3) ...
Setting up make (3.81-8ubuntu1) ...
Setting up dkms (2.1.1.2-5ubuntu1.1natty) ...natty1) ...
Setting up spl-dkms (0.6.0.21-0ubuntu1
Loading new spl-0.6.0.21 DKMS files...
First Installation: checking all kernels...
Building only for 2.6.38-8-server
Building initial module for 2.6.38-8-server
configure: error: in /var/lib/dkms/spl/0.6.0.21/build': configure: error: C compiler cannot create executables See
config.log' for more details.
Error! Bad return status for module build on kernel: 2.6.38-8-server (x86_64)
Consult the make.log in the build directory
/var/lib/dkms/spl/0.6.0.21/build/ for more information.
Processing triggers for libc-bin ...
ldconfig deferred processing now taking place
Selecting previously deselected package zfs-dkms.
(Reading database ... 49545 files and directories currently installed.)
Unpacking zfs-dkms (from .../zfs-dkms_0.6.0.21-0ubuntu1natty1_amd64.deb) ...natty1_amd64.deb) ...
Selecting previously deselected package fakeroot.
Unpacking fakeroot (from .../fakeroot_1.14.4-1ubuntu1_amd64.deb) ...
Selecting previously deselected package libc-dev-bin.
Unpacking libc-dev-bin (from .../libc-dev-bin_2.13-0ubuntu13_amd64.deb) ...
Selecting previously deselected package linux-libc-dev.
Unpacking linux-libc-dev (from .../linux-libc-dev_2.6.38-8.42_amd64.deb) ...
Selecting previously deselected package libc6-dev.
Unpacking libc6-dev (from .../libc6-dev_2.13-0ubuntu13_amd64.deb) ...
Selecting previously deselected package manpages-dev.
Unpacking manpages-dev (from .../manpages-dev_3.27-1ubuntu2_all.deb) ...
Selecting previously deselected package spl.
Unpacking spl (from .../spl_0.6.0.21-0ubuntu1
Selecting previously deselected package libavl0.
Unpacking libavl0 (from .../libavl0_0.6.0.21-0ubuntu1natty1_amd64.deb) ...natty1_amd64.deb) ...
Selecting previously deselected package libefi0.
Unpacking libefi0 (from .../libefi0_0.6.0.21-0ubuntu1
Selecting previously deselected package libnvpair0.
Unpacking libnvpair0 (from .../libnvpair0_0.6.0.21-0ubuntu1natty1_amd64.deb) ...natty1_amd64.deb) ...
Selecting previously deselected package libspl0.
Unpacking libspl0 (from .../libspl0_0.6.0.21-0ubuntu1
Selecting previously deselected package libunicode0.
Unpacking libunicode0 (from .../libunicode0_0.6.0.21-0ubuntu1natty1_amd64.deb) ...natty1_amd64.deb) ...
Selecting previously deselected package libuutil0.
Unpacking libuutil0 (from .../libuutil0_0.6.0.21-0ubuntu1
Selecting previously deselected package libzpool0.
Unpacking libzpool0 (from .../libzpool0_0.6.0.21-0ubuntu1natty1_amd64.deb) ...natty1_amd64.deb) ...
Selecting previously deselected package libzfs0.
Unpacking libzfs0 (from .../libzfs0_0.6.0.21-0ubuntu1
Selecting previously deselected package zfsutils.
Unpacking zfsutils (from .../zfsutils_0.6.0.21-0ubuntu1natty1_amd64.deb) ...natty_amd64.deb) ...
Selecting previously deselected package ubuntu-zfs.
Unpacking ubuntu-zfs (from .../ubuntu-zfs_4
Selecting previously deselected package debootstrap.
Unpacking debootstrap (from .../debootstrap_1.0.29ubuntu1_all.deb) ...
Processing triggers for man-db ...
Processing triggers for ureadahead ...
Setting up zfs-dkms (0.6.0.21-0ubuntu1~natty1) ...
Loading new zfs-0.6.0.21 DKMS files...
First Installation: checking all kernels...
Building only for 2.6.38-8-server
Building initial module for 2.6.38-8-server
configure: error:
*** Please make sure the spl devel package for your distribution
*** is installed then try again. If that fails you can specify the
*** location of the spl source with the '--with-spl=PATH' option.
Error! Bad return status for module build on kernel: 2.6.38-8-server (x86_64)
Consult the make.log in the build directory
/var/lib/dkms/zfs/0.6.0.21/build/ for more information.
Setting up fakeroot (1.14.4-1ubuntu1) ...
update-alternatives: using /usr/bin/fakeroot-sysv to provide /usr/bin/fakeroot (fakeroot) in auto mode.
Setting up libc-dev-bin (2.13-0ubuntu13) ...
Setting up linux-libc-dev (2.6.38-8.42) ...
Setting up libc6-dev (2.13-0ubuntu13) ...
Setting up manpages-dev (3.27-1ubuntu2) ...
Setting up spl (0.6.0.21-0ubuntu1natty1) ...natty1) ...
Setting up libavl0 (0.6.0.21-0ubuntu1
Setting up libefi0 (0.6.0.21-0ubuntu1natty1) ...natty1) ...
Setting up libnvpair0 (0.6.0.21-0ubuntu1
Setting up libspl0 (0.6.0.21-0ubuntu1natty1) ...natty1) ...
Setting up libunicode0 (0.6.0.21-0ubuntu1
Setting up libuutil0 (0.6.0.21-0ubuntu1natty1) ...natty1) ...
Setting up libzpool0 (0.6.0.21-0ubuntu1
Setting up libzfs0 (0.6.0.21-0ubuntu1natty1) ...natty1) ...
Setting up zfsutils (0.6.0.21-0ubuntu1
Setting up ubuntu-zfs (4~natty) ...
Setting up debootstrap (1.0.29ubuntu1) ...
Processing triggers for libc-bin ...
ldconfig deferred processing now taking place
I run Ubuntu 12.04 Live CD, apt-get installed and modprobed zfs. Imported a pool, and mounted a zfs to /mnt.
# grub-probe /mnt
grub-probe: error: cannot find a device for /mnt (is /dev mounted?).
# grub-probe -d /dev/sda2
zfs
How to make grub-probe working?
Call /usr/share/update-notifier/notify-reboot-required
in the postinst script to advise the system that kernel module upgrades are activated by a reboot.
The mountall utility is not in the regular initrd manifest for Ubuntu, and it is not used to start a native ZFS root filesystem.
Depending on mountall unnecessarily prevents zfs-initramfs from being installed on vanilla Debian systems.
Hi
I have been having a problem with getting zfs to work on my server.
If i try to mount a drive i get the following message: "Failed to load ZFS module stack.
Load the module manually by running 'insmod /zfs.ko' as root."
Found in another thread that i should try modprobe zfs and that gives me the following error: "FATAL: Module zfs not found." i don't know what is wrong or what my next step should be any help is appreciated
A single release branch is currently used to build for all Debian and Ubuntu release series.
However, Debian has an unofficial policy that the debian/changelog file only mention versions that are generally released. This means that log entries should be folded together for distro, which cramps using a shared debian/changelog with daily builds.
It follows that automatic git-dch
snapshot versioning should be used. This enhancement depends on dajhorn/pkg-zfs#45.
Debian is also including systemd in Wheezy, which means that Ubuntu will diverge further and should eventually be separately branched.
Hi Darik,
reading through your Wiki for booting from ZFS with Ubuntu, im missing a hint on how to create a boot device consisting of multiple vdevs ( e.g. mirror or raidz), as it would be common practice on servers to put a boot environment to at least a Raid1 vdev.
Is there a chance to add such configuration to your wiki? Or is it not possible to boot from such a configuration?
Thanks!
The standard debconf template for DKMS modules removes old modules during package upgrades.
The option to keep old versions is especially important for systems that have a native ZFS root filesystem because DKMS removals cause initrd updates, which makes old kernels unbootable.
If GRUB is locally upgraded or fails to link libzfs, then this happens during the grub-mkconfig
run:
# grub-probe /
error: unknown filesystem
This causes the /etc/grub.d/10_linux
run-part to drop the boot=zfs
kernel parameter, which should be an immediate failure.
spl-dkms should depend on lsb-release since it is used in PRE_BUILD, otherwise module won't load with unknown symbols like descibed here: https://github.com/behlendorf/zfs/issues/82
When following the instructions at...
https://github.com/dajhorn/pkg-zfs/wiki/HOWTO-install-Ubuntu-to-a-Native-ZFS-Root-Filesystem
...when we get to the point where we run this in the chroot...
apt-get install ubuntu-zfs zfs-initramfs
...it fails with this output...
Reading package lists... Done
Building dependency tree
Reading state information... Done
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:
The following packages have unmet dependencies:
zfs-initramfs : Depends: zfs-grub
E: Unable to correct problems, you have held broken packages.
...if we try to do zfs-grub instead, we get this...
apt-get install zfs-grub
Reading package lists... Done
Building dependency tree
Reading state information... Done
Note, selecting 'grub-common' instead of 'zfs-grub'
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:
The following packages have unmet dependencies:
grub-common : Depends: libzfs1 (>= 0.6.0.47) but it is not going to be installed
Recommends: os-prober (>= 1.33) but it is not going to be installed
E: Unable to correct problems, you have held broken packages.
...please note that this problem does not exist in the /daily packages at the moment, but it's breaking the stable packages, which means you need to use the bleeding edge to get set up in the first place.
--ryan.
(EDIT: markdown cleanup.)
Hi,
I do not have access to the ZoL bug system, so I thought I should bring this little bug to your attention:
file: /usr/share/initramfs-tools/scripts/zfs
line 92: ZFS_STDERR=$(zfs set -o mountpoint=/ "$ZFS_BOOTFS" 2>&1)
should be
92 ZFS_STDERR=$(zfs set mountpoint=/ "$ZFS_BOOTFS" 2>&1)
ie. just remove the "-o".
This would also be a good place to do a
91.5 ZFS_STDERR=$(zfs set canmount=noauto "$ZFS_BOOTFS" 2>&1)
The "canmount=noauto" should be set on all zfs root filesystems (important if there is more than one), but I haven't seen this mentioned in any of the HowTo's related to ZoL root filesystems.
Cheers.
During a kernel package upgrade, if DKMS tries to compile zfs-linux before spl-linux, then this happens:
Examining /etc/kernel/postinst.d.
run-parts: executing /etc/kernel/postinst.d/dkms 3.2.0-23-generic /boot/vmlinuz-3.2.0-23-generic
configure: error:
*** Cannot determine the version of the spl source.
*** Please prepare the spl source before running this script
Error! Bad return status for module build on kernel: 3.2.0-23-generic (x86_64)
Consult /var/lib/dkms/zfs/0.6.0.58/build/make.log for more information.
This error is spurious because DKMS eventually retries zfs-linux after spl-linux is ready and the installation succeeds. Squelching the error message is likely the best near-term solution for this incarnation of the SPL dependency bug.
Potential far-term solutions are bundling spl-linux into zfs-linux or adding the notion of dependencies to DKMS.
First, let me say that I am new to Linux and this might just be a series of failed skill checks on my part.
This is probably the third maybe fourth fresh install Turnkey Linux's FileServer (http://www.turnkeylinux.org/fileserver) followed by a install of ZFS.
The PPA did not seem to work for me I ended up with the same issues as https://github.com/dajhorn/pkg-zfs/issues/6 but the official instructions referenced by Zodling only let to more errors
For my last attempt I tried a combination of the install instructions from the following..
http://www.howtoforge.com/native-zfs-on-ubuntu
http://zfsonlinux.org/spl-building-deb.html
http://zfsonlinux.org/zfs-building-deb.html
I performed the following:
--Build system
Clean install
setup network
pull system updates
--grab prereqs
apt-get install build-essential gawk zlib1g-dev uuid-dev
apt-get install build-essential gawk alien fakeroot linux-headers-$(uname -r) ( I know it overlaps)
cd /usr/src
--Build and install SPL
wget http://github.com/downloads/zfsonlinux/spl/spl-0.5.2.tar.gz
tar -xvzf spl-0.5.2.tar.gz
cd spl-0.5.2
./configure (no errors)
make (no errors)
make install (no errors)
--Build and install ZFS
wget http://github.com/downloads/zfsonlinux/zfs/zfs-0.5.2.tar.gz
tar -xvzf zfs-0.5.2.tar.gz
cp zfs-0.5.2
./configure (no errors)
make (no errors)
make install (no errors)
--Check installation
modprobe splat
splat -a
modprobe zfs
lsmod |grep zfs
it all looked good to me.....
ran zfs and zpool received the following error
zfs: error while loading shared libraries: libspl.so.0: cannot open shared object file: No such file or directory
So I executed: export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/lib
then ran a zpool import to import a single disk pool. No errors
ZFS did not mount the vol. I was not able to use legacy mounting or manually mounting it. I receive no errors when I unmounted then mounted it again. So I decided to reboot thinking that maybe zfs needed a clean startup.
Upon rebooting, I received the error for cannot open shared object file... so I followed (http://www.cyberciti.biz/faq/set-environment-variable-linux/) to make the change permanent then rebooted.
Upon rebooting I no longer have a colored terminal (putty) (no big deal to me but I'd like to fix it) and now I receive the following errors.
root@fileserver:/# zfs import
Failed to load ZFS module stack.
Load the module manually by running 'insmod /zfs.ko' as root.
root@fileserver:/# modprobe splat
FATAL: Could not load /lib/modules/2.6.32-37-generic/modules.dep: No such file or directory
root@fileserver:/# modprobe zfs
FATAL: Could not load /lib/modules/2.6.32-37-generic/modules.dep: No such file or directory
Now, yes, I fundamentally get and understand that the files are missing..... but why did it work just fine the first time before I rebooted? Sure, maybe the installation process loaded everything thus skipping these checks.
So returning to (https://github.com/dajhorn/pkg-zfs/issues/6#issuecomment-1590302).. I decided to run
root@fileserver:/# dkms status
-bash: dkms: command not found
After installing it...
root@fileserver:/# dkms status
root@fileserver:/#
If you would not mind pointing me in the right direction that would be awesome. I'm kinda lost on this. Thanks
Use the update-alternatives
dpkg facility to allow the ZFS fuse driver and the ZFS native driver to be installed at the same time.
ubuntu server 11.04
clean install
after installing from the ppa i get an error like this when "zpool list"
Failed to load ZFS module stack.
Load the module manually by running 'insmod /zfs.ko' as root.
then i do/get this
sudo insmod /var/lib/dkms/zfs/0.6.0.25.rc5/$(uname -r)/x86_64/module/zfs.ko
insmod: error inserting '/var/lib/dkms/zfs/0.6.0.25.rc5/2.6.38-8-server/x86_64/module/zfs.ko': -1 Unknown symbol in module
PS: sorry about my bad english
Rob ✆ [email protected] writes to zfs-discuss:
I checked and made sure that /etc/default/zfs was set to
ZFS_MOUNT = "yes"
my system reboots but does not run zfs-mount on boot.
what I did to resolve the issue was
#update-rc.d zfs-mount defaults
rebooted and the system is fine.
perhaps this is not being done during the install of the package?
it could also just be a pebkac or id10t error
Thanks again
The original thread is:
http://groups.google.com/a/zfsonlinux.org/group/zfs-discuss/browse_thread/thread/1fbb37eea91e8e96/71ad2c44ab646efa
If /tmp
is a ZFS filesystem with properties canmount=on
and mountpoint=/
, then the system will crash during start with this error messsage:
[ 4.509505] mountall[224]: segfault at 7fff9885fff8 ip 00007fec710d324b sp 0007fff98860000 error 6 in mountall[7fec710cc000+17000]
Two ways to mitigate the problem are:
/lib/init/fstab
file./etc/fstab
file.The output of mountall --debug
is:
plymouth_connect: Failed to connect to Plymouth: Connection refused
parse_filesystems: reading filesystems
parse_filesystems: sysfs (nodev)
parse_filesystems: rootfs (nodev)
parse_filesystems: bdev (nodev)
parse_filesystems: proc (nodev)
parse_filesystems: cgroup (nodev)
parse_filesystems: cpuset (nodev)
parse_filesystems: tmpfs (nodev)
parse_filesystems: devtmpfs (nodev)
parse_filesystems: debugfs (nodev)
parse_filesystems: securityfs (nodev)
parse_filesystems: sockfs (nodev)
parse_filesystems: pipefs (nodev)
parse_filesystems: anon_inodefs (nodev)
parse_filesystems: devpts (nodev)
parse_filesystems: ext3
parse_filesystems: ext2
parse_filesystems: ext4
parse_filesystems: ramfs (nodev)
parse_filesystems: hugetlbfs (nodev)
parse_filesystems: ecryptfs (nodev)
parse_filesystems: fuse (nodev)
parse_filesystems: fuseblk
parse_filesystems: fusectl (nodev)
parse_filesystems: pstore (nodev)
parse_filesystems: mqueue (nodev)
parse_filesystems: zfs (nodev)
parse_fstab: updating from /lib/init/fstab
update_mount: /: / /dev/root rootfs defaults check
update_mount: /proc: /proc none proc nodev,noexec,nosuid
update_mount: /proc/sys/fs/binfmt_misc: /proc/sys/fs/binfmt_misc none binfmt_misc nodev,noexec,nosuid,optional
update_mount: /sys: /sys none sysfs nodev,noexec,nosuid
update_mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections none fusectl optional
update_mount: /sys/kernel/debug: /sys/kernel/debug none debugfs optional
update_mount: /sys/kernel/security: /sys/kernel/security none securityfs optional
update_mount: /spu: /spu none spufs gid=spu,optional
update_mount: /dev: /dev none devtmpfs,tmpfs mode=0755
update_mount: /dev/pts: /dev/pts none devpts noexec,nosuid,gid=tty,mode=0620
update_mount: /tmp: /tmp none none defaults
update_mount: /run: /run none tmpfs noexec,nosuid,size=10%,mode=0755
update_mount: /run/lock: /run/lock none tmpfs nodev,noexec,nosuid,size=5242880
update_mount: /run/shm: /run/shm none tmpfs nosuid,nodev
update_mount: /lib/init/rw: /lib/init/rw none tmpfs mode=0755,nosuid,optional
parse_fstab: updating from /etc/fstab
update_mount: /proc: /proc proc proc nodev,noexec,nosuid
update_mount: /: / UUID=50b3fd7f-62cc-428c-ba16-f7f69dc5df06 ext4 errors=remount-ro check
update_mount: UUID=b926f154-7f79-4fa0-ba2b-f87b5739b0fb: none UUID=b926f154-7f79-4fa0-ba2b-f87b5739b0fb swap sw
parse_zfs_list: parsing ZFS list
update_mount: /tmp: /tmp zdata/tmp zfs zfsutil
parse_mountinfo_file: updating mounts
update_mount: /sys: /sys sysfs sysfs nodev,noexec,nosuid
update_mount: /proc: /proc proc proc nodev,noexec,nosuid
update_mount: /dev: /dev udev devtmpfs mode=0755
update_mount: /dev/pts: /dev/pts devpts devpts noexec,nosuid,gid=tty,mode=0620
update_mount: /run: /run tmpfs tmpfs noexec,nosuid,size=10%,mode=0755
update_mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections fusectl fusectl optional
update_mount: /: / /dev/disk/by-uuid/50b3fd7f-62cc-428c-ba16-f7f69dc5df06 ext4 errors=remount-ro check
update_mount: /sys/kernel/debug: /sys/kernel/debug none debugfs optional
update_mount: /sys/kernel/security: /sys/kernel/security none securityfs optional
update_mount: /run/lock: /run/lock none tmpfs nodev,noexec,nosuid,size=5242880
update_mount: /run/shm: /run/shm none tmpfs nosuid,nodev
mount_policy: /proc/sys/fs/binfmt_misc: dropping unknown filesystem
mount_policy: /spu: dropping unknown filesystem
tag_mount: / is root filesystem
mount_policy: /proc can be mounted while root readonly
mount_policy: /sys can be mounted while root readonly
mount_policy: /sys/fs/fuse/connections parent is /sys
mount_policy: /sys/kernel/debug parent is /sys
mount_policy: /sys/kernel/security parent is /sys
mount_policy: /dev can be mounted while root readonly
mount_policy: /dev/pts parent is /dev
mount_policy: /tmp parent is /tmp
mount_policy: /run can be mounted while root readonly
mount_policy: /run/lock parent is /run
mount_policy: /run/shm parent is /run
mount_policy: /lib/init/rw can be mounted while root readonly
mount_policy: /tmp parent is /tmp
mount_policy: /tmp prior fstab entry UUID=b926f154-7f79-4fa0-ba2b-f87b5739b0fb
/ is local
/proc is virtual
/sys is virtual
/sys/fs/fuse/connections is virtual
/sys/kernel/debug is virtual
/sys/kernel/security is virtual
/dev is virtual
/dev/pts is virtual
/tmp is virtual
/run is virtual
/run/lock is virtual
/run/shm is virtual
/lib/init/rw is virtual
UUID=b926f154-7f79-4fa0-ba2b-f87b5739b0fb is swap
/tmp is virtual
mounted: /
plymouth_connect: Failed to connect to Plymouth: Connection refused
run_mount: mtab /
spawn: mount -f -t ext4 -o errors=remount-ro /dev/disk/by-uuid/50b3fd7f-62cc-428c-ba16-f7f69dc5df06 /
spawn: mount / [1531]
mount / [1531] exited normally
run_mount: mtab /proc
spawn: mount -f -t proc -o nodev,noexec,nosuid proc /proc
spawn: mount /proc [1532]
mount /proc [1532] exited normally
run_mount: mtab /sys
spawn: mount -f -t sysfs -o nodev,noexec,nosuid sysfs /sys
spawn: mount /sys [1533]
mount /sys [1533] exited normally
run_mount: mtab /sys/fs/fuse/connections
spawn: mount -f -t fusectl -o fusectl /sys/fs/fuse/connections
spawn: mount /sys/fs/fuse/connections [1534]
mount /sys/fs/fuse/connections [1534] exited normally
run_mount: mtab /sys/kernel/debug
spawn: mount -f -t debugfs -o none /sys/kernel/debug
spawn: mount /sys/kernel/debug [1535]
mount /sys/kernel/debug [1535] exited normally
run_mount: mtab /sys/kernel/security
spawn: mount -f -t securityfs -o none /sys/kernel/security
spawn: mount /sys/kernel/security [1536]
mount /sys/kernel/security [1536] exited normally
run_mount: mtab /dev
spawn: mount -f -t devtmpfs -o mode=0755 udev /dev
spawn: mount /dev [1537]
mount /dev [1537] exited normally
run_mount: mtab /dev/pts
spawn: mount -f -t devpts -o noexec,nosuid,gid=tty,mode=0620 devpts /dev/pts
spawn: mount /dev/pts [1538]
mount /dev/pts [1538] exited normally
run_mount: mtab /run
spawn: mount -f -t tmpfs -o noexec,nosuid,size=10%,mode=0755 tmpfs /run
spawn: mount /run [1539]
mount /run [1539] exited normally
run_mount: mtab /run/lock
spawn: mount -f -t tmpfs -o nodev,noexec,nosuid,size=5242880 none /run/lock
spawn: mount /run/lock [1540]
mount /run/lock [1540] exited normally
run_mount: mtab /run/shm
spawn: mount -f -t tmpfs -o nosuid,nodev none /run/shm
spawn: mount /run/shm [1541]
mount /run/shm [1541] exited normally
local 1/1 remote 0/0 virtual 0/13 swap 0/1
fsck_update: updating check priorities
plymouth_connect: Failed to connect to Plymouth: Connection refused
mounted: /proc
plymouth_connect: Failed to connect to Plymouth: Connection refused
local 1/1 remote 0/0 virtual 1/13 swap 0/1
fsck_update: updating check priorities
plymouth_connect: Failed to connect to Plymouth: Connection refused
mounted: /sys
plymouth_connect: Failed to connect to Plymouth: Connection refused
local 1/1 remote 0/0 virtual 2/13 swap 0/1
fsck_update: updating check priorities
plymouth_connect: Failed to connect to Plymouth: Connection refused
mounted: /sys/fs/fuse/connections
plymouth_connect: Failed to connect to Plymouth: Connection refused
local 1/1 remote 0/0 virtual 3/13 swap 0/1
fsck_update: updating check priorities
plymouth_connect: Failed to connect to Plymouth: Connection refused
mounted: /sys/kernel/debug
plymouth_connect: Failed to connect to Plymouth: Connection refused
local 1/1 remote 0/0 virtual 4/13 swap 0/1
fsck_update: updating check priorities
plymouth_connect: Failed to connect to Plymouth: Connection refused
mounted: /sys/kernel/security
plymouth_connect: Failed to connect to Plymouth: Connection refused
local 1/1 remote 0/0 virtual 5/13 swap 0/1
fsck_update: updating check priorities
plymouth_connect: Failed to connect to Plymouth: Connection refused
mounted: /dev
plymouth_connect: Failed to connect to Plymouth: Connection refused
local 1/1 remote 0/0 virtual 6/13 swap 0/1
fsck_update: updating check priorities
plymouth_connect: Failed to connect to Plymouth: Connection refused
mounted: /dev/pts
plymouth_connect: Failed to connect to Plymouth: Connection refused
local 1/1 remote 0/0 virtual 7/13 swap 0/1
fsck_update: updating check priorities
plymouth_connect: Failed to connect to Plymouth: Connection refused
mounted: /run
plymouth_connect: Failed to connect to Plymouth: Connection refused
local 1/1 remote 0/0 virtual 8/13 swap 0/1
fsck_update: updating check priorities
plymouth_connect: Failed to connect to Plymouth: Connection refused
mounted: /run/lock
plymouth_connect: Failed to connect to Plymouth: Connection refused
local 1/1 remote 0/0 virtual 9/13 swap 0/1
fsck_update: updating check priorities
plymouth_connect: Failed to connect to Plymouth: Connection refused
mounted: /run/shm
plymouth_connect: Failed to connect to Plymouth: Connection refused
local 1/1 remote 0/0 virtual 10/13 swap 0/1
fsck_update: updating check priorities
plymouth_connect: Failed to connect to Plymouth: Connection refused
control_server_open: Mountall0_1.Server started at address: unix:abstract=/com/ubuntu/mountall/server/
try_mount: /tmp waiting for /tmp
try_mount: /lib/init/rw symlink to /run
try_mount: considering /lib/init/rw mounted, as a symlink to /run
mounted: /lib/init/rw
plymouth_connect: Failed to connect to Plymouth: Connection refused
local 1/1 remote 0/0 virtual 11/13 swap 0/1
fsck_update: updating check priorities
plymouth_connect: Failed to connect to Plymouth: Connection refused
try_mount: UUID=b926f154-7f79-4fa0-ba2b-f87b5739b0fb waiting for device
try_mount: /tmp waiting for /tmp
try_mount: /tmp waiting for /tmp
try_mount: UUID=b926f154-7f79-4fa0-ba2b-f87b5739b0fb waiting for device
try_mount: /tmp waiting for /tmp
udev_catchup: catching up
try_udev_device: block /dev/sda1 50b3fd7f-62cc-428c-ba16-f7f69dc5df06 (null)
try_udev_device: / by link /dev/disk/by-uuid/50b3fd7f-62cc-428c-ba16-f7f69dc5df06
run_fsck: /: mounted filesystem
run_mount: /: already mounted
try_udev_device: block /dev/sda5 b926f154-7f79-4fa0-ba2b-f87b5739b0fb (null)
try_udev_device: UUID=b926f154-7f79-4fa0-ba2b-f87b5739b0fb by uuid
update_mount: /dev/disk/by-uuid/b926f154-7f79-4fa0-ba2b-f87b5739b0fb: none /dev/disk/by-uuid/b926f154-7f79-4fa0-ba2b-f87b5739b0fb swap sw
run_fsck: /dev/disk/by-uuid/b926f154-7f79-4fa0-ba2b-f87b5739b0fb: no check required
activating /dev/disk/by-uuid/b926f154-7f79-4fa0-ba2b-f87b5739b0fb
spawn: swapon /dev/disk/by-uuid/b926f154-7f79-4fa0-ba2b-f87b5739b0fb
swapon: /dev/disk/by-uuid/b926f154-7f79-4fa0-ba2b-f87b5739b0fb: swapon failed: Device or resource busy
mountall: swapon /dev/disk/by-uuid/b926f154-7f79-4fa0-ba2b-f87b5739b0fb [1552] terminated with status 255
mountall: Problem activating swap: /dev/disk/by-uuid/b926f154-7f79-4fa0-ba2b-f87b5739b0fb
https://groups.google.com/a/zfsonlinux.org/group/zfs-discuss/msg/38036f246f989602
From: Augie Schwer
Date: Mon, 18 Jun 2012 14:49:43 -0700
Local: Mon, Jun 18 2012 4:49 pm
Subject: Latest ZFS update for Ubuntu may break sudo.
I didn't see any discussion here about the topic, so I thought I would
briefly share the problem and the fix in-case anyone else runs into
the same trouble I did.
Installing the 0.6.0.56-0ubuntu1~lucid1 version of the ZFS packages
this morning on my Ubuntu 10.04.4 work station resulted in something
similar to this person's experience:
http://askubuntu.com/questions/152108/installing-zfs-changed-my-sudoe...
Where I was unable to use sudo. The solution that worked for me was to
run the following:
pkexec chmod 440 /etc/sudoers.d/zfs
--
Augie Schwer - [email protected] - http://schwer.us
The Ubuntu variants I've been using lately all come with ZFS support built in, but more importantly, in the case of using a separate boot partition to start the system up, there's every reason you'd want to install the initramfs scripts and hooks but not the ZFS-versions of grub that are in the PPA.
As it stands, the zfs-initramfs in stable and daily is a broken package, whereas it should probably just standalone so people can get the hooks installed (since whether grub can bootstrap off a ZFS partition to read the initramfs is an almost entirely separate issue).
Solaris provides a beadm
utility for managing system snapshots in the tank/ROOT/
hierarchy. Linux would benefit from having a similar facility.
Automatically hook package managers like apt
and yum
too.
While installing the packages for the first time onto a 12.04 box:
Setting up spl-dkms (0.6.0.71-0ubuntu1~precise1) ...
Loading new spl-0.6.0.71 DKMS files...
First Installation: checking all kernels...
Building only for 3.2.0-29-generic
Building initial module for 3.2.0-29-generic
configure: error: *** Unable to build an empty module.
Error! Bad return status for module build on kernel: 3.2.0-29-generic (x86_64)
Consult /var/lib/dkms/spl/0.6.0.71/build/make.log for more information.
where the make.log contains:
DKMS make.log for spl-0.6.0.71 for kernel 3.2.0-29-generic (x86_64)
Tue Aug 21 10:43:24 PDT 2012
make: *** No targets specified and no makefile found. Stop.
The initial apt-get also failed to install the zfs-dkms package because of the dependency:
Setting up zfs-dkms (0.6.0.71-0ubuntu1~precise1) ...
Loading new zfs-0.6.0.71 DKMS files...
First Installation: checking all kernels...
Building only for 3.2.0-29-generic
Building initial module for 3.2.0-29-generic
configure: error:
*** Cannot determine the version of the spl source.
*** ZFS depends on the SPL kernel module, which is not yet ready.
*** DKMS should retry zfs-dkms momentarily after building spl-dkms.
*** If this error message persists, or if you are running DKMS manually,
*** then run 'apt-get install --reinstall spl-dkms' and try again.
Error! Bad return status for module build on kernel: 3.2.0-29-generic (x86_64)
Consult /var/lib/dkms/zfs/0.6.0.71/build/make.log for more information.
which resembles issue #30. I am able to manually build and install spl by going to /var/lib/dkms/spl/0.6.0.71/build/, but when I tried the same with the zfs module it advised against it:
*** ZFS should not be manually built in the DKMS source tree.
*** Remove all ZFS packages before compiling the ZoL sources.
*** Running "make install" breaks ZFS packages.
Reattempting via 'apt-get install --reinstall spl-dkms' produces the same error.
Not sure if this is the proper place to report issues on the grub packages...
As per openzfs/zfs#348, there is a fix for this issue, but it doesn't appear to have made it into a package or the PPA yet.
The META file contains a version number that is baked into the kernel module and appears in the dmesg. Most users report bugs using this information.
The META file should be automatically updated at build time to have the same version as the debian/changelog. Doing this will better facilitate git-dch
versioning and help to recognize local builds.
Apport is triggered if zfs-dkms is retried because spl-dkms is not ready. If a desktop environment is running, then the user is incorrectly notified that zfs-dkms crashed.
Blacklist the zfs-dkms package such that apport ignores it.
Note, however, that no report is sent upstream:
*** Problem in zfs-dkms
The problem cannot be reported:
This is not an official Ubuntu package. Please remove any third party package and try again.
I followed your instructions but instead of natty I debootstrapped oneiric. I get:
root@ubuntu:/# apt-add-repository ppa:zfs-native/stable
You are about to add the following PPA to your system:
ZFS Stable Releases for Ubuntu
Traceback (most recent call last):
File "/usr/bin/apt-add-repository", line 80, in <module>
print " %s" % (ppa_info["description"] or "")
UnicodeEncodeError: 'ascii' codec can't encode characters in position 522-523: ordinal not in range(128)
To install it without any error I had to:
apt-add-repository ppa:zfs-native/stable --yes
You could include it in the tutorial.
We;ve noticed an issue with mountall where at boottime files placed in the root directory vanish.
The boot time troubles are a result of zfs not mounting the parent folder if there are subdirectories present - the error you get is cannot mount /tank: directory is not empty. These directories are usually the result of child fs's one has created.
e.g.
$zpool create tank ....
$ cd /tank;
$ zpool create tank/fs1
$ zpool create tank/fs2
(the above creates 2 directories fs1 and fs2 within /tank)
$ touch /tank/testfile
(creates a file call testfile)
when you reboot and use the ubuntu-zfs package -
tanks/fs1 and tank/fs2 get mounted correctly however testfile vanishes because /tank/ does not get mounted like normal.
doing a
$ zfs umount /tank/fs1
$ rm -rf /tank/fs1
$ zfs umount /tank/fs2
$ rm -rf /tank/fs2
$ zfs mount -a
results in the file system being restored as you would expect i.e. testfile appear in the root dir and fs1 and fs2 appear as normal.
When booting with the ZFS enabled initramfs, my HDD's on a Marvell chipset don't come online fast enough for legacy style mounting during mountall.conf upstart job.
Consequently, mountall complains about not being able to see the dataset on my zpool.
In order to work around / fix this issue, it's suggested to wait for udev to finish recognizing all the HDD's while the local script is running inside the initramfs. Below is the recommended solution:
[ "$quiet" != "y" ] && log_begin_msg "Running /scripts/local-premount"
run_scripts /scripts/local-premount
[ "$quiet" != "y" ] && log_end_msg
# added to simulate the zfs script
wait_for_udev
...
...
Primary motivation for me on this is better dependency control, in particular I'd like start on starting libvirt-bin
as I have VMs that depend on NFS shares exported by the host (I could do this via Upstart overrides, rather than modifying the installed init conf). Happy to provide a patch if it would be considered.
As for zfs-mount, I'm not even sure that should be included on Ubuntu since we use mountall, so it only provides for confusion.
Create ZoL ports of these Debian kFreeBSD packages:
The /etc/kernel/header_postinst.d/dkms
run-part always tries to recompile ZFS before SPL, which causes this configure error:
*** Please make sure the spl devel package for your distribution
*** is installed then try again. If that fails you can specify the
*** location of the spl source with the '--with-spl=PATH' option.
This error is incorrect because most people will try to install spl-dev afterwards, and also spurious because DKMS will successfully retry the zfs-dkms package after spl-dkms is ready.
In the few cases where ZFS legitimately fails to compile, doing this usually resolves the problem:
# apt-get install --reinstall spl-dkms
# apt-get install --reinstall zfs-dkms
The proper solution here is to enhance DKMS to recognize module dependencies, or to combine the SPL and ZFS sources.
Resolve these lintian errors:
E: zfs-dkms: shell-script-fails-syntax-check usr/src/zfs-0.6.0.43/cmd/sas_switch_id/sas_switch_id
E: zfs-dkms: shell-script-fails-syntax-check usr/src/zfs-0.6.0.43/cmd/zpool_layout/zpool_layout
W: zfs-dkms: unusual-interpreter usr/src/zfs-0.6.0.43/etc/init.d/zfs.gentoo.in #!/sbin/runscript
Resolve these lintian errors:
E: libzfs-dev: non-empty-dependency_libs-in-la-file lib/libavl.la
E: libzfs-dev: non-empty-dependency_libs-in-la-file lib/libefi.la
E: libzfs-dev: non-empty-dependency_libs-in-la-file lib/libnvpair.la
E: libzfs-dev: non-empty-dependency_libs-in-la-file lib/libshare.la
E: libzfs-dev: non-empty-dependency_libs-in-la-file lib/libspl.la
E: libzfs-dev: non-empty-dependency_libs-in-la-file lib/libunicode.la
E: libzfs-dev: non-empty-dependency_libs-in-la-file lib/libuutil.la
E: libzfs-dev: non-empty-dependency_libs-in-la-file lib/libzfs.la
E: libzfs-dev: non-empty-dependency_libs-in-la-file lib/libzpool.la
After booting no ZFS filesystems are mounted.
System is a clean Ubuntu 12.04.1 x64, 10xWD Red 3TB in RaidZ2 of which 8 disks on an IBM M1015 HBA controller card in IT mode.
The mountall FAQ did not solve the issue.
(https://github.com/dajhorn/pkg-zfs/wiki/Ubuntu-ZFS-mountall-FAQ-and-troubleshooting)
Full issue description + logs here (halfway down the page):
openzfs/zfs#769
(sorry, but I'm just finding my way around these issue trackers and was sent here. If needed i'll repost the full description and logs here)
Thank you.
Resolve these lintian errors:
E: libspl1: helper-templates-in-copyright
E: libnvpair1: helper-templates-in-copyright
E: libzavl1: helper-templates-in-copyright
E: zfs-dracut: helper-templates-in-copyright
E: zfs-dkms: helper-templates-in-copyright
E: libuutil1: helper-templates-in-copyright
E: libunicode1: helper-templates-in-copyright
E: libshare1: helper-templates-in-copyright
E: zfs-initramfs: helper-templates-in-copyright
E: libzfs1: helper-templates-in-copyright
E: zfsutils: helper-templates-in-copyright
E: libzpool1: helper-templates-in-copyright
E: libzfs-dev: helper-templates-in-copyright
E: libefi1: helper-templates-in-copyright
Hello ,
Would you mind specifying where swap should be put when following the instructions here :
https://github.com/dajhorn/pkg-zfs/wiki/HOWTO-install-Ubuntu-to-a-Native-ZFS-Root-Filesystem
I've been using zfs in various systems for a bit now , and when reading up on things memory , and specifically needing a lot of it , always creeps up in discussions. The moment one needs swap space is when memory is somewhat scarce , is it recommended to have zfs handle it at that point?
Can I put swap on the rpool or should I partition some extra space for it ?
Related but not really an issue as such , merely a question/observation..
From those instructions , that seem to be based on using a single drive , where at some point you mention ""you can use a mirror as well" , it seems that /boot is not mirrored . I assume that using mdadm and putting grub on both disks is allowed?
My initial plan was to use 2 usb sticks in software raid 1 to stick /boot on , then have root on 3 drives in raidz1 . Having read up on root pools in general mirroring is the only possible way to go for it. So , having given up on raidz1 I am now wondering if using a mirrored root pool but still using the usb drives for /boot is still possible? or does using a rpool on linux require it to be on the same drives ?
Also , can I add the third drive to the mirror pool for extra redundancy?
ie : zpool attach rpool XXX YYY
And end up with something like this :
NAME STATE READ WRITE CKSUM
rpool ONLINE 0 0 0
mirror ONLINE 0 0 0
DR1 ONLINE 0 0 0
DR2 ONLINE 0 0 0
DR3 ONLINE 0 0 0
Or are there inherent limitations to root pools beyond not being able to use raidz ?
I have read up on several sites on the subject but most seem to be copying each other and merely list the limitation without going into any detail.
Thank you for any reply.
Phoenixxl.
Hi,
1st thanks for all your hard work truly appreciate it!!
I upgraded zfs through the ppa on Ubuntu 11.04 and it gave me this error. Seems to be superficial since it still installs and works but I'm not sure.
Loading new zfs-0.6.0.17 DKMS files...
Building only for 2.6.38-8-server
Building initial module for 2.6.38-8-server
config.status: error: cannot find input file: scripts/Makefile.in
Done.
Thought you'd like to know.
—Mike
I'm using a KVM virtual machine for testing ZFS. The virtual machine sees its virtual disks as SCSI drives. For whatever reason, they don't show up in the Linux until 2-6 seconds too late for the initramfs. So my boot fails.
The zdb
utility requires pthreads for some functions, but the necessary library is not automatically added to the initrd because it is not detected as a dependency. Using zdb
before the regular system starts can result in this kind of error message:
(initramfs) zdb -b tank
libgcc_s.so.1 must be installed for pthread_cancel to work
Explicitly add pthreads to the boot manifest.
Lintian is reporting these errors for the init scripts:
E: zfsutils: init.d-script-missing-dependency-on-remote_fs etc/init.d/zfs-mount: required-start
E: zfsutils: init.d-script-missing-dependency-on-remote_fs etc/init.d/zfs-mount: required-stop
E: zfsutils: init.d-script-missing-dependency-on-remote_fs etc/init.d/zfs-share: required-start
E: zfsutils: init.d-script-missing-dependency-on-remote_fs etc/init.d/zfs-share: required-stop
At first glance, this seems like a false report because ZFS is a _fs
provider itself that does not depend on any remote filesystem. Perhaps the error is caused by having /usr
in the PATH
. See:
http://lintian.debian.org/tags/init.d-script-missing-dependency-on-remote_fs.html
About 8 months ago my Ubuntu 11.04 system running native ZFS started displaying this error message.
(snip from a dmesg when I booted the system today)
.
.
[ 5.154614] SPL: Loaded module v0.6.0.76-rc10
[ 5.154998] zunicode: module license 'CDDL' taints kernel.
[ 5.155041] Disabling lock debugging due to kernel taint
[ 10.536384] ZFS: Loaded module v0.6.0.76-rc10, ZFS pool version 28, ZFS filesystem version 5
[ 10.541113] SPL: using hostid 0x007f0100
[ 11.150051] SPLError: 763:0:(spl-err.c:67:vcmn_err()) WARNING: ZFS replay transaction error 5, dataset delta/ROOT/natty-1, seq 0x4634, txtype 9
.
.
I lived with it at the time. It wasn't more than an annoyance, and I thought it was because I had been playing with a ZIL device (closest thing that matched the issue was a ZIL bug introduced and then fixed). Sometimes my system would display the message and boot, but more recently, it would drop to initramfs prompt after throwing an error:
(hand-written from the initramfs shell)
.
.
Begin: Setting mountpount=/ on ZFS file system delta/ROOT/natty-1 ... done
Begin: Mounting ZFS filesystem delta/ROOT/natty-1 ...
BUG: unable to handle kernel NULL pointer dereference at (null)
IP: [] mutex_lock +0x21/0x50
PGD:11b1c6067 PUD 122e06067 PMD0
Oops: 0002 [#1] SMP
last sysfs file: /sys/devices/virtual/bdi/zfs-1/uevent
CPU1
Modules linked in: zfs(P) zcommon(P) znvpair(P) zavl(P) zunicode(P) spl zlibdeflate {... there are a bunch of modules - list truncated}
Pid: 752, comn:exe Tainted:P 2.6.38-15-generic #64-Ubuntu /DG41RQ
RIP: 0010 [] [] mutex lock +0x21/0x50
RSP: 0018:ffff88011b1e3888 EFLAGS: 0001 0246
At this point I would hard-power off the system, turn it back on, and it usually (75%) booted. Lately, it would take two, three, four times of power cycling...
Booting off LiveCD and doing a zpool scrub always came up with no errors. The drives were mirrored so I felt confident that the bits were good - just at bootup it was not happy. I did not need to reinstall the modules or other libs. I kept up-to-date with the zfs/daily updates, but the issue always remained.
I recently bought an SSD and did a clean install of Ubuntu 12.04 on a new SSD device. Things went fairly well following the native ZFS install guide (I'll make another ticket later about some things I ran into with the installation). I had some graphics-related driver issues and had to hard-reset the system.
Now when I boot this 12.04 install, I see:
.
.
[ 1.978494] ZFS: Loaded module v0.6.0.71-rc10, ZFS pool version 28, ZFS filesystem version 5
[ 2.188731] SPL: using hostid 0x007f0101
[ 2.443662] SPLError: 602:0:(spl-err.c:67:vcmn_err()) WARNING: ZFS replay transaction error 5, dataset omega/ROOT/precise, seq 0x2, txtype 9
.
.
The boot continues and the OS starts. I scrub the zpool (was not booted off the LiveCD though) - no errors detected.
I don't want to go through the disk issues again! I'm not mirrored on the new drive yet. I do have the other two disks attached so I can import in the old zpool (manually).
There may be two issues going on, but I'm not sure if there is a direct relation between them:
I've given you a bunch of symptoms but no backing data. What do you need from me to help chase this down?
-E
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.