DEV Community

Juho
Juho

Posted on

Faster zfs snapshot transfers

Speeding up zfs snapshot xfer b/w machines. The gist is to just parallelize the up/download to the max.

On the source machine

zfs snapshot tank/data@snappy
zfs -v send tank/data@snappy >/data_snappy.zfsend
split -d -b500M /data_snappy.zfsend /data/zsnaps/snappy/data_snappy.zfsend_part_
gsutil -m rsync /data/zsnaps/snappy/data_snappy.zfsend_part_ $GS_BUCKET/data_snappy
Enter fullscreen mode Exit fullscreen mode

On the destination machine

gsutil -m rsync $GS_BUCKET/data_snappy /data/zsnaps/snappy
cat /data/zsnaps/snappy/* | pv | zfs receive tank/data
Enter fullscreen mode Exit fullscreen mode

Top comments (0)