-----============= acceptance-small: sanity-pcc ============----- Thu Oct 23 14:44:36 EDT 2025
mgs: Rocky Linux release 8.10 (Green Obsidian)
MGS_OS_ID_LIKE=rhel centos fedora rocky
MGS_OS_VERSION_ID=8.10
MGS_OS_ID=rocky
MGS_OS_VERSION_CODE=134873088
mds1: Rocky Linux release 8.10 (Green Obsidian)
MDS1_OS_VERSION_ID=8.10
MDS1_OS_VERSION_CODE=134873088
MDS1_OS_ID_LIKE=rhel centos fedora rocky
MDS1_OS_ID=rocky
ost1: Rocky Linux release 8.10 (Green Obsidian)
OST1_OS_VERSION_CODE=134873088
OST1_OS_ID_LIKE=rhel centos fedora rocky
OST1_OS_VERSION_ID=8.10
OST1_OS_ID=rocky
client: Rocky Linux release 8.10 (Green Obsidian)
CLIENT_OS_ID=rocky
CLIENT_OS_VERSION_CODE=134873088
CLIENT_OS_VERSION_ID=8.10
CLIENT_OS_ID_LIKE=rhel centos fedora rocky
=== sanity-pcc: start setup 14:44:48 (1761245088) ===
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Mount client oleg624-client.virtnet: mount -t lustre -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
oleg624-client.virtnet: executing check_config_client /mnt/lustre
oleg624-client.virtnet: Checking config lustre mounted on /mnt/lustre
Checking servers environments
Checking clients oleg624-client.virtnet environments
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff927e83f3c800.idle_timeout=debug
osc.lustre-OST0000-osc-ffff927e88d0e000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927e83f3c800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927e88d0e000.idle_timeout=debug
disable quota as required
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
=== sanity-pcc: finish setup 14:45:10 (1761245110) ===
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [true]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d0_runas_test/f7559]
nobody:x:65534:
oleg624-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanity-pcc.*ex': No such file or directory
excepting tests: 33
Killing existing copytools on oleg624-client.virtnet
pkill: pidfile not valid
Try `pkill --help' for more information.
Set HSM on and start
Set sanity-hsm HSM policy

== sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 14:45:37 (1761245137)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.152428 s, 344 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d1a.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/5120049152/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 0df681a5-2224-4256-a48c-504f34109d99
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f1a.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=0df681a5-2224-4256-a48c-504f34109d99 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d1a.sanity-pcc/d1a.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
using SAVE_PROJECT_SUPPORTED=0
1+0 records in
1+0 records out
7654321 bytes (7.7 MB, 7.3 MiB) copied, 0.0957367 s, 80.0 MB/s
Restore testing...
Attach and detach testing
Start to detach the /mnt/lustre/d1a.sanity-pcc/f1a.sanity-pcc
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d1a.sanity-pcc is idle now
PASS 1a (12s)

== sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 14:45:50 (1761245150)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0993171 s, 528 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d1b.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: ad41ef0b-c6db-4d7c-9dd5-d1350e6a379f
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f1b.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=ad41ef0b-c6db-4d7c-9dd5-d1350e6a379f (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d1b.sanity-pcc/d1b.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
using SAVE_PROJECT_SUPPORTED=0
1+0 records in
1+0 records out
7654321 bytes (7.7 MB, 7.3 MiB) copied, 0.102787 s, 74.5 MB/s
Restore testing...
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Attach and detach testing
Start to detach the /mnt/lustre/d1b.sanity-pcc/f1b.sanity-pcc
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d1b.sanity-pcc is idle now
PASS 1b (16s)

== sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 14:46:06 (1761245166)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg624-client.virtnet /mnt/lustre (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre opts:
Stopping clients: oleg624-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg624-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg624-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg624-server'
oleg624-server: oleg624-server.virtnet: executing load_modules_local
oleg624-server: Loading modules from /home/green/git/lustre-release/lustre
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
oleg624-server: detected 4 online CPUs by sysfs
oleg624-server: MODOPTS_LIBCFS=
oleg624-server: Force libcfs to create 2 CPU partitions
Setup mgs, mdt, osts
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-MDT0000
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0000
Start ost2: mount -t lustre -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff927e8526d800.idle_timeout=debug
osc.lustre-OST0000-osc-ffff927ea03b9800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927e8526d800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927ea03b9800.idle_timeout=debug
disable quota as required
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.196703 s, 267 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d1c.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 7ae84051-5e99-49cf-aae4-8ec60b9e349f
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f1c.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=7ae84051-5e99-49cf-aae4-8ec60b9e349f (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
1+0 records in
1+0 records out
7654321 bytes (7.7 MB, 7.3 MiB) copied, 1.05031 s, 7.3 MB/s
 sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 
  Trace dump:
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7318:error()
  = /home/green/git/lustre-release/lustre/tests/sanity-pcc.sh:92:check_file_size()
  = /home/green/git/lustre-release/lustre/tests/sanity-pcc.sh:102:check_lpcc_sizes()
  = /home/green/git/lustre-release/lustre/tests/sanity-pcc.sh:357:lpcc_rw_test()
  = /home/green/git/lustre-release/lustre/tests/sanity-pcc.sh:426:test_1c()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_one()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7757:run_one_logged()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7572:run_test()
  = /home/green/git/lustre-release/lustre/tests/sanity-pcc.sh:428:main()
Dumping lctl log to /tmp/testlogs//sanity-pcc.test_1c.*.1761245245.log
Cleanup PCC backend on /mnt/lustre
rsync: chown "/tmp/testlogs/.sanity-pcc.test_1c.debug_log.oleg624-server.1761245245.log.rSK2iC" failed: Operation not permitted (1)
rsync: chown "/tmp/testlogs/.sanity-pcc.test_1c.dmesg.oleg624-server.1761245245.log.GHc4V4" failed: Operation not permitted (1)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3]
/mnt/pcc.d1c.sanity-pcc is idle now
FAIL 1c (83s)

== sanity-pcc test 1d: Test Project ID with remote access ========================================================== 14:47:35 (1761245255)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg624-client.virtnet /mnt/lustre (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre opts:
Stopping clients: oleg624-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg624-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg624-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg624-server'
oleg624-server: oleg624-server.virtnet: executing load_modules_local
oleg624-server: Loading modules from /home/green/git/lustre-release/lustre
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
oleg624-server: detected 4 online CPUs by sysfs
oleg624-server: MODOPTS_LIBCFS=
oleg624-server: Force libcfs to create 2 CPU partitions
Setup mgs, mdt, osts
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-MDT0000
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0000
Start ost2: mount -t lustre -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff927e88d09800.idle_timeout=debug
osc.lustre-OST0000-osc-ffff927e9879c000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927e88d09800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927e9879c000.idle_timeout=debug
disable quota as required
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.188031 s, 279 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d1d.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: e75cb011-6e3d-4820-bf55-5c8dc8c8dd6f
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f1d.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=e75cb011-6e3d-4820-bf55-5c8dc8c8dd6f (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
1+0 records in
1+0 records out
7654321 bytes (7.7 MB, 7.3 MiB) copied, 0.641789 s, 11.9 MB/s
 sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 
  Trace dump:
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7318:error()
  = /home/green/git/lustre-release/lustre/tests/sanity-pcc.sh:92:check_file_size()
  = /home/green/git/lustre-release/lustre/tests/sanity-pcc.sh:102:check_lpcc_sizes()
  = /home/green/git/lustre-release/lustre/tests/sanity-pcc.sh:357:lpcc_rw_test()
  = /home/green/git/lustre-release/lustre/tests/sanity-pcc.sh:431:test_1d()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7694:run_one()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7757:run_one_logged()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7572:run_test()
  = /home/green/git/lustre-release/lustre/tests/sanity-pcc.sh:433:main()
Dumping lctl log to /tmp/testlogs//sanity-pcc.test_1d.*.1761245334.log
Cleanup PCC backend on /mnt/lustre
lsof: WARNING: can't stat() nfs4 file system /var/lib/stateless/state
      Output information may be incomplete.
rsync: chown "/tmp/testlogs/.sanity-pcc.test_1d.debug_log.oleg624-server.1761245334.log.drBpf7" failed: Operation not permitted (1)
rsync: chown "/tmp/testlogs/.sanity-pcc.test_1d.dmesg.oleg624-server.1761245334.log.mnlJ1g" failed: Operation not permitted (1)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1668) [generator=3.1.3]
/mnt/pcc.d1d.sanity-pcc is idle now
FAIL 1d (110s)

== sanity-pcc test 1e: Test RW-PCC with non-root user ==== 14:49:30 (1761245370)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-pcc.test_1e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
pcc:
  -
    pccpath: /tmp/arc1/sanity-pcc.test_1e/
    hsmtool: posix_v2
    rwid: 2
    roid: 0
    flags: 90
    autocache: projid={100}
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d1e.sanity-pcc/f1e.sanity-pcc] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0176869 s, 57.9 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-w] [-i] [2] [/mnt/lustre/d1e.sanity-pcc/f1e.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d1e.sanity-pcc/f1e.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00590748 s, 173 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/tests/truncate] [/mnt/lustre/d1e.sanity-pcc/f1e.sanity-pcc] [256]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/tests/truncate] [/mnt/lustre/d1e.sanity-pcc/f1e.sanity-pcc] [2048]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d1e.sanity-pcc/f1e.sanity-pcc] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0045529 s, 225 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [-k] [/mnt/lustre/d1e.sanity-pcc/f1e.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/tmp/arc1/sanity-pcc.test_1e//13a4/0x2000013a1:0x5:0x0]
touch: cannot touch '/tmp/arc1/sanity-pcc.test_1e//13a4/0x2000013a1:0x5:0x0': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/tmp/arc1/sanity-pcc.test_1e//13a4/0x2000013a1:0x5:0x0] [of=/dev/null] [bs=1024] [count=1]
dd: failed to open '/tmp/arc1/sanity-pcc.test_1e//13a4/0x2000013a1:0x5:0x0': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/tmp/arc1/sanity-pcc.test_1e//13a4/0x2000013a1:0x5:0x0] [bs=1024] [count=1]
dd: failed to open '/tmp/arc1/sanity-pcc.test_1e//13a4/0x2000013a1:0x5:0x0': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-w] [-i] [2] [/mnt/lustre/d1e.sanity-pcc/f1e.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/d1e.sanity-pcc/f1e.sanity-pcc]
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Cleanup PCC backend on /mnt/lustre
PASS 1e (11s)

== sanity-pcc test 1f: Test auto RW-PCC cache with non-root user ========================================================== 14:49:41 (1761245381)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg624-client.virtnet /mnt/lustre (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre opts:
Stopping clients: oleg624-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg624-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg624-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg624-server'
oleg624-server: oleg624-server.virtnet: executing load_modules_local
oleg624-server: Loading modules from /home/green/git/lustre-release/lustre
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
oleg624-server: detected 4 online CPUs by sysfs
oleg624-server: MODOPTS_LIBCFS=
oleg624-server: Force libcfs to create 2 CPU partitions
Setup mgs, mdt, osts
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-MDT0000
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0000
Start ost2: mount -t lustre -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff927e84cc7000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff927e87fa8800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927e84cc7000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927e87fa8800.idle_timeout=debug
disable quota as required
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.133667 s, 392 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d1f.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 7149f766-465e-461f-80e5-c0c3301ff89e
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f1f.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=7149f766-465e-461f-80e5-c0c3301ff89e (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d1f.sanity-pcc/d1f.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d1f.sanity-pcc/f1f.sanity-pcc] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00587678 s, 174 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d1f.sanity-pcc/f1f.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0074868 s, 137 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/tests/truncate] [/mnt/lustre/d1f.sanity-pcc/f1f.sanity-pcc] [256]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/tests/truncate] [/mnt/lustre/d1f.sanity-pcc/f1f.sanity-pcc] [2048]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d1f.sanity-pcc/f1f.sanity-pcc] [bs=256] [count=1]
1+0 records in
1+0 records out
256 bytes copied, 0.00623049 s, 41.1 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/pcc.d1f.sanity-pcc/d1f.sanity-pcc/1b73/0x200001b71:0x2:0x0]
touch: cannot touch '/mnt/pcc.d1f.sanity-pcc/d1f.sanity-pcc/1b73/0x200001b71:0x2:0x0': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/pcc.d1f.sanity-pcc/d1f.sanity-pcc/1b73/0x200001b71:0x2:0x0] [of=/dev/null] [bs=1024] [count=1]
dd: failed to open '/mnt/pcc.d1f.sanity-pcc/d1f.sanity-pcc/1b73/0x200001b71:0x2:0x0': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/pcc.d1f.sanity-pcc/d1f.sanity-pcc/1b73/0x200001b71:0x2:0x0] [bs=1024] [count=1]
dd: failed to open '/mnt/pcc.d1f.sanity-pcc/d1f.sanity-pcc/1b73/0x200001b71:0x2:0x0': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/d1f.sanity-pcc/f1f.sanity-pcc]
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d1f.sanity-pcc is idle now
PASS 1f (91s)

== sanity-pcc test 1g: General permission test for RW-PCC ========================================================== 14:51:12 (1761245472)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111127 s, 472 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d1g.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 4e0beec6-1b01-44cb-a14a-a93e92b2aabe
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f1g.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=4e0beec6-1b01-44cb-a14a-a93e92b2aabe (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d1g.sanity-pcc/d1g.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.022052 s, 46.4 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/f1g.sanity-pcc] [bs=1024] [count=1]
dd: failed to open '/mnt/lustre/f1g.sanity-pcc': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/f1g.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
dd: failed to open '/mnt/lustre/f1g.sanity-pcc': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/f1g.sanity-pcc] [bs=1024] [count=1]
dd: failed to open '/mnt/lustre/f1g.sanity-pcc': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/f1g.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
dd: failed to open '/mnt/lustre/f1g.sanity-pcc': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/f1g.sanity-pcc] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0116187 s, 88.1 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/f1g.sanity-pcc]
detach: cannot detach '/mnt/lustre/f1g.sanity-pcc' from PCC: Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/f1g.sanity-pcc]
Waiting 200s for 'SUCCEED'
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/f1g.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0152856 s, 67.0 kB/s
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d1g.sanity-pcc is idle now
PASS 1g (13s)

== sanity-pcc test 2a: Test multi open when creating ===== 14:51:25 (1761245485)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg624-client.virtnet /mnt/lustre (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre opts:
Stopping clients: oleg624-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg624-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg624-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg624-server'
oleg624-server: oleg624-server.virtnet: executing load_modules_local
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
oleg624-server: Loading modules from /home/green/git/lustre-release/lustre
oleg624-server: detected 4 online CPUs by sysfs
oleg624-server: MODOPTS_LIBCFS=
oleg624-server: Force libcfs to create 2 CPU partitions
Setup mgs, mdt, osts
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-MDT0000
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0000
Start ost2: mount -t lustre -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff927e85272000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff927e85308000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927e85272000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927e85308000.idle_timeout=debug
disable quota as required
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.3686 s, 142 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d2a.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 89e8c160-a4d8-4600-9e46-e4619c1bd8a1
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f2a.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=89e8c160-a4d8-4600-9e46-e4619c1bd8a1 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d2a.sanity-pcc/d2a.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
multiop /mnt/lustre/d2a.sanity-pcc/multiop vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.24619
client oleg624-client.virtnet multiop_bg started multiop_pid=24629
---------- 1 root root 14 Oct 23 14:53 /mnt/pcc.d2a.sanity-pcc/d2a.sanity-pcc/2343/0x200002341:0x2:0x0
Stopping multiop_pid=24629 (kill 24629 on oleg624-client.virtnet)
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d2a.sanity-pcc is idle now
PASS 2a (108s)

== sanity-pcc test 2b: Test multi remote open when creating ========================================================== 14:53:13 (1761245593)

 SKIP: sanity-pcc test_2b Need 2 or more clients, have 1
SKIP 2b (3s)

== sanity-pcc test 2c: Test multi open on different mount points when creating ========================================================== 14:53:16 (1761245596)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg624-client.virtnet /mnt/lustre (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre opts:
Stopping clients: oleg624-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg624-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg624-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg624-server'
oleg624-server: oleg624-server.virtnet: executing load_modules_local
oleg624-server: Loading modules from /home/green/git/lustre-release/lustre
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
oleg624-server: detected 4 online CPUs by sysfs
oleg624-server: MODOPTS_LIBCFS=
oleg624-server: Force libcfs to create 2 CPU partitions
Setup mgs, mdt, osts
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-MDT0000
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0000
Start ost2: mount -t lustre -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff927e873cd000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff927ea04db000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927e873cd000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927ea04db000.idle_timeout=debug
disable quota as required
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.166929 s, 314 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d2c.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 0dd8b94f-8555-4858-a112-8bdea8ec83e0
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f2c.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=0dd8b94f-8555-4858-a112-8bdea8ec83e0 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d2c.sanity-pcc/d2c.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
multiop /mnt/lustre/d2c.sanity-pcc/f2c.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.27752
client oleg624-client.virtnet multiop_bg started multiop_pid=27762
Stopping multiop_pid=27762 (kill 27762 on oleg624-client.virtnet)
multiopen_dataCleanup PCC backend on /mnt/lustre
/mnt/pcc.d2c.sanity-pcc is idle now
PASS 2c (89s)

== sanity-pcc test 3a: Repeat attach/detach operations === 14:54:46 (1761245686)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-pcc.test_3a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0223376 s, 45.8 kB/s
Start to RW-PCC attach/detach the file: /mnt/lustre/d3a.sanity-pcc/f3a.sanity-pcc
Repeat to RW-PCC attach/detach the same file: /mnt/lustre/d3a.sanity-pcc/f3a.sanity-pcc
Start to RO-PCC attach/detach the file: /mnt/lustre/d3a.sanity-pcc/f3a.sanity-pcc
Repeat to RO-PCC attach/detach the same file: /mnt/lustre/d3a.sanity-pcc/f3a.sanity-pcc
Cleanup PCC backend on /mnt/lustre
PASS 3a (7s)

== sanity-pcc test 3b: Repeat attach/detach operations on multiple clients ========================================================== 14:54:53 (1761245693)

 SKIP: sanity-pcc test_3b Need 3 or more clients, have 1
SKIP 3b (3s)

== sanity-pcc test 4: Auto cache test for mmap =========== 14:54:56 (1761245696)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg624-client.virtnet /mnt/lustre (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre opts:
Stopping clients: oleg624-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg624-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg624-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg624-server'
oleg624-server: oleg624-server.virtnet: executing load_modules_local
oleg624-server: Loading modules from /home/green/git/lustre-release/lustre
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
oleg624-server: detected 4 online CPUs by sysfs
oleg624-server: MODOPTS_LIBCFS=
oleg624-server: Force libcfs to create 2 CPU partitions
Setup mgs, mdt, osts
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-MDT0000
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0000
Start ost2: mount -t lustre -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff927e87fa8000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff927e9801c800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927e87fa8000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927e9801c800.idle_timeout=debug
disable quota as required
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0915999 s, 572 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d4.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 783aa68c-9b61-4e55-a4c7-2c757839f155
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f4.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=783aa68c-9b61-4e55-a4c7-2c757839f155 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d4.sanity-pcc/d4.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
mmap test1: basic mmap operation (PASS, 0.051603s)
mmap test2: MAP_PRIVATE not write back (PASS, 0.031713s)
mmap test3: concurrent mmap ops on two nodes (PASS, 2.0333s)
mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 4.1055s)
mmap test5: read/write file to/from the buffer which mmapped to just this file (PASS, 0.045119s)
mmap test6: check mmap write/read content on two nodes (PASS, 0.51985s)
mmap test7: file i/o with an unmapped buffer (SKIPPED, 0s)
mmap test8: SIGBUS for beyond file size (SKIPPED, 0s)
mmap test9: SIGBUS for negative file offset (SKIPPED, 0s)
mmap test10: multi-thread mmap access (PASS, 0.16046s)
mmap test11: multi-thread shared mmap (PASS, 0.16843s)
mmap test10: mtime not change for readonly mmap access (PASS, 1.0243s)
ldlm.namespaces.lustre-MDT0000-mdc-ffff927e87fa8000.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff927e9801c800.lru_size=clear
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d4.sanity-pcc is idle now
PASS 4 (114s)

== sanity-pcc test 5: Mmap & cat a RW-PCC cached file ==== 14:56:50 (1761245810)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.283184 s, 185 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d5.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: a0c477a2-9c25-4843-af1c-1089e54c2e8b
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f5.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=a0c477a2-9c25-4843-af1c-1089e54c2e8b (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d5.sanity-pcc/d5.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d5.sanity-pcc is idle now
PASS 5 (9s)

== sanity-pcc test 6: Test mmap write on RW-PCC ========== 14:56:59 (1761245819)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103728 s, 505 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d6.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/5120016384/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 90c68012-21c9-4a1f-8dbf-f0e9f3987637
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f6.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=90c68012-21c9-4a1f-8dbf-f0e9f3987637 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d6.sanity-pcc/d6.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d6.sanity-pcc is idle now
PASS 6 (11s)

== sanity-pcc test 7a: Fake file detached between fault() and page_mkwrite() for RW-PCC ========================================================== 14:57:10 (1761245830)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146945 s, 357 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d7a.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: abd8db22-0ff7-4538-8867-2a5dd9fc68c2
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f7a.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=abd8db22-0ff7-4538-8867-2a5dd9fc68c2 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d7a.sanity-pcc/d7a.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
fail_loc=0x1412
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d7a.sanity-pcc is idle now
PASS 7a (9s)

== sanity-pcc test 7b: Test the race with concurrent mkwrite and detach ========================================================== 14:57:20 (1761245840)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.1683 s, 312 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d7b.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: d1a215ff-b12c-4091-8b43-57ae3e6e70f4
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f7b.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=d1a215ff-b12c-4091-8b43-57ae3e6e70f4 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d7b.sanity-pcc/d7b.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
fail_loc=0x1413
fail_val=20
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d7b.sanity-pcc is idle now
PASS 7b (51s)

== sanity-pcc test 8: Test fake -ENOSPC tolerance for RW-PCC ========================================================== 14:58:12 (1761245892)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.231255 s, 227 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d8.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: cf4852d7-bf88-4a97-84cc-663466f8c1a5
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f8.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=cf4852d7-bf88-4a97-84cc-663466f8c1a5 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d8.sanity-pcc/d8.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
fail_loc=0x1411
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d8.sanity-pcc is idle now
PASS 8 (11s)

== sanity-pcc test 9: Test -ENOSPC tolerance on loop PCC device for RW-PCC ========================================================== 14:58:22 (1761245902)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.168907 s, 310 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.9a: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 51e62b5f-7aa7-47b6-97ec-7709dc6912ad
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f9.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=51e62b5f-7aa7-47b6-97ec-7709dc6912ad (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.9a/d9.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.9a/d9.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 0
    flags: 9e
    autocache: projid={100}
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 3.46087 s, 18.2 MB/s
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.9a is idle now
PASS 9 (12s)

== sanity-pcc test 10a: Test RW-PCC with user quota on loop PCC device ========================================================== 14:58:34 (1761245914)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0899246 s, 583 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d10a.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 3686df8b-aa94-4b8c-a66f-89803ca68132
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f10a.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=3686df8b-aa94-4b8c-a66f-89803ca68132 (extents) (64bit) (large files) (huge files)
*** Report for user quotas on device /dev/loop0
Block grace time: 7days; Inode grace time: 7days
                        Space limits                File limits
User            used    soft    hard  grace    used  soft  hard  grace
----------------------------------------------------------------------
root      --     13K      0K      0K              2     0     0       
sanityusr --      0K      0K  20480K              0     0     0       

Statistics:
Total blocks: 7
Data blocks: 1
Entries: 2
Used average: 2.000000

Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d10a.sanity-pcc/d10a.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d10a.sanity-pcc/d10a.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 0
    flags: 9e
    autocache: projid={100}
15+0 records in
15+0 records out
15728640 bytes (16 MB, 15 MiB) copied, 0.376899 s, 41.7 MB/s
15+0 records in
15+0 records out
15728640 bytes (16 MB, 15 MiB) copied, 0.23103 s, 68.1 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-i] [2] [-w] [/mnt/lustre/d10a.sanity-pcc/uquotaA]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-i] [2] [-w] [/mnt/lustre/d10a.sanity-pcc/uquotaB]
lfs pcc pcc: cannot get UNLOCK lease, ext 10 for [0x2000032e1:0x26:0x0]: Disk quota exceeded (122)
lfs pcc pcc: cannot attach with ID: 2: Disk quota exceeded (122)
attach: cannot attach '/mnt/lustre/d10a.sanity-pcc/uquotaB' to PCC with attach ID '2': Disk quota exceeded
Test -EDQUOT error tolerance for RW-PCC
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d10a.sanity-pcc/uquotaA] [bs=1M] [count=30]
30+0 records in
30+0 records out
31457280 bytes (31 MB, 30 MiB) copied, 1.2269 s, 25.6 MB/s
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d10a.sanity-pcc is idle now
PASS 10a (11s)

== sanity-pcc test 10b: Test RW-PCC with group quota on loop PCC device ========================================================== 14:58:45 (1761245925)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.157368 s, 333 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d10b.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: cd1a1cb5-fce8-404b-92c6-a8950e92b5f4
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f10b.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=cd1a1cb5-fce8-404b-92c6-a8950e92b5f4 (extents) (64bit) (large files) (huge files)
*** Report for group quotas on device /dev/loop0
Block grace time: 7days; Inode grace time: 7days
                        Space limits                File limits
Group           used    soft    hard  grace    used  soft  hard  grace
----------------------------------------------------------------------
root      --     13K      0K      0K              2     0     0       
sanityusr --      0K      0K  20480K              0     0     0       

Statistics:
Total blocks: 7
Data blocks: 1
Entries: 2
Used average: 2.000000

Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d10b.sanity-pcc/d10b.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d10b.sanity-pcc/d10b.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 0
    flags: 9e
    autocache: projid={100}
15+0 records in
15+0 records out
15728640 bytes (16 MB, 15 MiB) copied, 0.290767 s, 54.1 MB/s
15+0 records in
15+0 records out
15728640 bytes (16 MB, 15 MiB) copied, 0.304436 s, 51.7 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-i] [2] [-w] [/mnt/lustre/d10b.sanity-pcc/gquotaA]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-i] [2] [-w] [/mnt/lustre/d10b.sanity-pcc/gquotaB]
lfs pcc pcc: cannot get UNLOCK lease, ext 10 for [0x2000032e1:0x2b:0x0]: Disk quota exceeded (122)
lfs pcc pcc: cannot attach with ID: 2: Disk quota exceeded (122)
attach: cannot attach '/mnt/lustre/d10b.sanity-pcc/gquotaB' to PCC with attach ID '2': Disk quota exceeded
Test -EDQUOT error tolerance for RW-PCC
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d10b.sanity-pcc/gquotaA] [bs=1M] [count=30]
30+0 records in
30+0 records out
31457280 bytes (31 MB, 30 MiB) copied, 1.65227 s, 19.0 MB/s
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d10b.sanity-pcc is idle now
PASS 10b (11s)

== sanity-pcc test 10c: Test RO-PCC with user quota on loop PCC device ========================================================== 14:58:56 (1761245936)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.17732 s, 296 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d10c.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: a59caa7f-d2d6-40db-83b4-be7608a2932e
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f10c.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=a59caa7f-d2d6-40db-83b4-be7608a2932e (extents) (64bit) (large files) (huge files)
*** Report for user quotas on device /dev/loop0
Block grace time: 7days; Inode grace time: 7days
                        Space limits                File limits
User            used    soft    hard  grace    used  soft  hard  grace
----------------------------------------------------------------------
root      --     13K      0K      0K              2     0     0       
sanityusr --      0K      0K  20480K              0     0     0       

Statistics:
Total blocks: 7
Data blocks: 1
Entries: 2
Used average: 2.000000

Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d10c.sanity-pcc/d10c.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d10c.sanity-pcc/d10c.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 2
    flags: ae
    autocache: projid={100}
15+0 records in
15+0 records out
15728640 bytes (16 MB, 15 MiB) copied, 0.331285 s, 47.5 MB/s
15+0 records in
15+0 records out
15728640 bytes (16 MB, 15 MiB) copied, 0.369185 s, 42.6 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-i] [2] [/mnt/lustre/d10c.sanity-pcc/uquotaA]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-i] [2] [/mnt/lustre/d10c.sanity-pcc/uquotaB]
lfs pcc pcc: cannot attach the file to PCC with ID 2 failed: Disk quota exceeded (122)
attach: cannot attach '/mnt/lustre/d10c.sanity-pcc/uquotaB' to PCC with attach ID '2': Disk quota exceeded
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d10c.sanity-pcc is idle now
PASS 10c (10s)

== sanity-pcc test 10d: Test RO-PCC with group quota on loop PCC device ========================================================== 14:59:06 (1761245946)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.131408 s, 399 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d10d.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: f0e2459d-ec17-46a3-8b5a-840c3050a864
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f10d.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=f0e2459d-ec17-46a3-8b5a-840c3050a864 (extents) (64bit) (large files) (huge files)
*** Report for group quotas on device /dev/loop0
Block grace time: 7days; Inode grace time: 7days
                        Space limits                File limits
Group           used    soft    hard  grace    used  soft  hard  grace
----------------------------------------------------------------------
root      --     13K      0K      0K              2     0     0       
sanityusr --      0K      0K  20480K              0     0     0       

Statistics:
Total blocks: 7
Data blocks: 1
Entries: 2
Used average: 2.000000

Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d10d.sanity-pcc/d10d.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d10d.sanity-pcc/d10d.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 2
    flags: ae
    autocache: projid={100}
15+0 records in
15+0 records out
15728640 bytes (16 MB, 15 MiB) copied, 0.398495 s, 39.5 MB/s
15+0 records in
15+0 records out
15728640 bytes (16 MB, 15 MiB) copied, 0.440062 s, 35.7 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-i] [2] [/mnt/lustre/d10d.sanity-pcc/gquotaA]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-i] [2] [/mnt/lustre/d10d.sanity-pcc/gquotaB]
lfs pcc pcc: cannot attach the file to PCC with ID 2 failed: Disk quota exceeded (122)
attach: cannot attach '/mnt/lustre/d10d.sanity-pcc/gquotaB' to PCC with attach ID '2': Disk quota exceeded
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d10d.sanity-pcc is idle now
PASS 10d (10s)

== sanity-pcc test 10e: Tolerate -EDQUOT failure when auto PCC-RO attach with user quota ========================================================== 14:59:16 (1761245956)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.168903 s, 310 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d10e.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: b3d5da07-4a80-44fd-a8aa-3d53b82dfbe7
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f10e.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=b3d5da07-4a80-44fd-a8aa-3d53b82dfbe7 (extents) (64bit) (large files) (huge files)
*** Report for user quotas on device /dev/loop0
Block grace time: 7days; Inode grace time: 7days
                        Space limits                File limits
User            used    soft    hard  grace    used  soft  hard  grace
----------------------------------------------------------------------
root      --     13K      0K      0K              2     0     0       
sanityusr --      0K      0K   4096K              0     0     0       

Statistics:
Total blocks: 7
Data blocks: 1
Entries: 2
Used average: 2.000000

pcc:
  -
    pccpath: /mnt/pcc.d10e.sanity-pcc/d10e.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: uid={500}
2+0 records in
2+0 records out
2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.072616 s, 28.9 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/f10e.sanity-pcc] [of=/dev/null] [bs=1M] [count=2]
2+0 records in
2+0 records out
2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0100249 s, 209 MB/s
/mnt/lustre/f10e.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x2000032e1
      lmm_object_id:     0x34
      lmm_fid:           [0x2000032e1:0x34:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0xcf:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
5+0 records in
5+0 records out
5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.108465 s, 48.3 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/f10e.sanity-pcc] [of=/dev/null] [bs=1M] [count=5]
5+0 records in
5+0 records out
5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0208931 s, 251 MB/s
file: /mnt/lustre/f10e.sanity-pcc, type: none
/mnt/lustre/f10e.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         wp,pccro
  lcm_layout_gen:    5
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x2000032e1
      lmm_object_id:     0x34
      lmm_fid:           [0x2000032e1:0x34:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0xcf:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d10e.sanity-pcc is idle now
PASS 10e (8s)

== sanity-pcc test 10f: Tolerate -EDQUOT failure when auto PCC-RO attach with group quota ========================================================== 14:59:24 (1761245964)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.172977 s, 303 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d10f.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 0b3e73e9-7948-4f9c-9bc6-c1e265d459c7
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f10f.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=0b3e73e9-7948-4f9c-9bc6-c1e265d459c7 (extents) (64bit) (large files) (huge files)
*** Report for group quotas on device /dev/loop0
Block grace time: 7days; Inode grace time: 7days
                        Space limits                File limits
Group           used    soft    hard  grace    used  soft  hard  grace
----------------------------------------------------------------------
root      --     13K      0K      0K              2     0     0       
sanityusr --      0K      0K   4096K              0     0     0       

Statistics:
Total blocks: 7
Data blocks: 1
Entries: 2
Used average: 2.000000

pcc:
  -
    pccpath: /mnt/pcc.d10f.sanity-pcc/d10f.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: gid={500}
2+0 records in
2+0 records out
2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0402584 s, 52.1 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/f10f.sanity-pcc] [of=/dev/null] [bs=1M] [count=2]
2+0 records in
2+0 records out
2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0105298 s, 199 MB/s
/mnt/lustre/f10f.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x2000032e1
      lmm_object_id:     0x36
      lmm_fid:           [0x2000032e1:0x36:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0xcf:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
5+0 records in
5+0 records out
5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.127382 s, 41.2 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/f10f.sanity-pcc] [of=/dev/null] [bs=1M] [count=5]
5+0 records in
5+0 records out
5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0182875 s, 287 MB/s
file: /mnt/lustre/f10f.sanity-pcc, type: none
/mnt/lustre/f10f.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         wp,pccro
  lcm_layout_gen:    5
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x2000032e1
      lmm_object_id:     0x36
      lmm_fid:           [0x2000032e1:0x36:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0xcf:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d10f.sanity-pcc is idle now
PASS 10f (8s)

== sanity-pcc test 11: Test attach fault injection with simulated PCC file path ========================================================== 14:59:32 (1761245972)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118144 s, 444 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d11.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 1498777b-7a3e-4477-8341-171cdf346bc0
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f11.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=1498777b-7a3e-4477-8341-171cdf346bc0 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d11.sanity-pcc/d11.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Lustre file: /mnt/lustre/f11.sanity-pcc LPCC dir: /mnt/pcc.d11.sanity-pcc/d11.sanity-pcc/32d9
Lustre file: /mnt/lustre/f11.sanity-pcc LPCC dir: /mnt/pcc.d11.sanity-pcc/d11.sanity-pcc/32db
lfs pcc pcc: cannot get UNLOCK lease, ext 10 for [0x2000032e1:0x3a:0x0]: Operation not permitted (1)
lfs pcc pcc: cannot attach with ID: 2: Operation not permitted (1)
attach: cannot attach '/mnt/lustre/f11.sanity-pcc' to PCC with attach ID '2': Operation not permitted
lfs pcc pcc: cannot get UNLOCK lease, ext 10 for [0x2000032e1:0x3b:0x0]: Invalid argument (22)
lfs pcc pcc: cannot attach with ID: 2: Invalid argument (22)
attach: cannot attach '/mnt/lustre/f11.sanity-pcc' to PCC with attach ID '2': Invalid argument
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d11.sanity-pcc is idle now
PASS 11 (8s)

== sanity-pcc test 12: RW-PCC attach races with concurrent HSM remove ========================================================== 14:59:40 (1761245980)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-pcc.test_12/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
fail_loc=0x1414
fail_val=20
/mnt/lustre/f12.sanity-pcc: (0x0000000d) released exists archived, archive_id:2
Cleanup PCC backend on /mnt/lustre
PASS 12 (28s)

== sanity-pcc test 13a: Test auto RW-PCC create caching for UID/GID rule ========================================================== 15:00:08 (1761246008)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-pcc.test_13a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
pcc:
  -
    pccpath: /tmp/arc1/sanity-pcc.test_13a/
    hsmtool: posix_v2
    rwid: 2
    roid: 0
    flags: 90
    autocache: uid={500}
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00990738 s, 103 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00541254 s, 189 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/tests/truncate] [/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc] [256]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/tests/truncate] [/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc] [2048]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00386256 s, 265 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc]
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Cleanup PCC backend on /mnt/lustre
pcc:
  -
    pccpath: /tmp/arc1/sanity-pcc.test_13a/
    hsmtool: posix_v2
    rwid: 2
    roid: 0
    flags: 90
    autocache: gid={500}
lfs mkdir: dirstripe error on '/mnt/lustre/d13a.sanity-pcc': stripe already set
lfs setdirstripe: cannot create dir '/mnt/lustre/d13a.sanity-pcc': File exists
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00599221 s, 171 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00780265 s, 131 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/tests/truncate] [/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc] [256]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/tests/truncate] [/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc] [2048]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00539157 s, 190 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc]
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Cleanup PCC backend on /mnt/lustre
Cleanup PCC backend on /mnt/lustre
Cleanup PCC backend on /mnt/lustre
PASS 13a (17s)

== sanity-pcc test 13b: Test auto RW-PCC create caching for file name with wildcard ========================================================== 15:00:25 (1761246025)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-pcc.test_13b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
pcc:
  -
    pccpath: /tmp/arc1/sanity-pcc.test_13b/
    hsmtool: posix_v2
    rwid: 2
    roid: 0
    flags: 90
    autocache: fname={*.h5 suffix.* Mid*dle}
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00547881 s, 187 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d13b.sanity-pcc/suffix.doc] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0042175 s, 243 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d13b.sanity-pcc/MidPADdle] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00484074 s, 212 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d13b.sanity-pcc/Midpad] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0141892 s, 72.2 kB/s
Cleanup PCC backend on /mnt/lustre
PASS 13b (7s)

== sanity-pcc test 13c: Check auto RW-PCC create caching for UID/GID/ProjID/fname rule ========================================================== 15:00:32 (1761246032)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg624-client.virtnet /mnt/lustre (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre opts:
Stopping clients: oleg624-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg624-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg624-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg624-server'
oleg624-server: oleg624-server.virtnet: executing load_modules_local
oleg624-server: Loading modules from /home/green/git/lustre-release/lustre
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
oleg624-server: detected 4 online CPUs by sysfs
oleg624-server: MODOPTS_LIBCFS=
oleg624-server: Force libcfs to create 2 CPU partitions
Setup mgs, mdt, osts
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-MDT0000
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0000
Start ost2: mount -t lustre -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff927e83f3d000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff927ec0523800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927e83f3d000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927ec0523800.idle_timeout=debug
disable quota as required
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.138491 s, 379 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d13c.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: d6a9f3e3-9136-4afc-9cf8-49043f6421f2
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f13c.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=d6a9f3e3-9136-4afc-9cf8-49043f6421f2 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d13c.sanity-pcc/d13c.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d13c.sanity-pcc/d13c.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 0
    flags: 9e
    autocache: projid={100 200}&fname={*.h5},uid={500}&gid={500}
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.011083 s, 92.4 kB/s
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00355365 s, 288 kB/s
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00620785 s, 165 kB/s
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0153909 s, 66.5 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d13c.sanity-pcc/ugidcache] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00790511 s, 130 kB/s
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d13c.sanity-pcc is idle now
PASS 13c (86s)

== sanity-pcc test 14: Revocation of the layout lock should detach the file automatically ========================================================== 15:01:58 (1761246118)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-pcc.test_14/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
ldlm.namespaces.lustre-MDT0000-mdc-ffff927e83f3d000.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff927ec0523800.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff927e83f3d000.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff927ec0523800.lru_size=clear
Cleanup PCC backend on /mnt/lustre
PASS 14 (8s)

== sanity-pcc test 15: Test auto attach at open when file is still valid cached ========================================================== 15:02:06 (1761246126)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121916 s, 430 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d15.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 827d83ca-694a-4c38-8817-e10fc58df554
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f15.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=827d83ca-694a-4c38-8817-e10fc58df554 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d15.sanity-pcc/d15.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Verify open attach for non-root user
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0352661 s, 29.0 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-w] [-i] [2] [/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc]
file: /mnt/lustre/d15.sanity-pcc/f15.sanity-pcc, type: readwrite, PCC_file: /d15.sanity-pcc/3aa0/0x200003ab1:0x11:0x0, open_count: 0, flags: 0
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc]
ldlm.namespaces.lustre-MDT0000-mdc-ffff927e83f3d000.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff927ec0523800.lru_size=clear
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [multiop] [/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc] [oc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [-k] [/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [multiop] [/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc] [oc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc]
Verify auto attach at open for RW-PCC
ldlm.namespaces.lustre-MDT0000-mdc-ffff927e83f3d000.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff927ec0523800.lru_size=clear
Verify auto attach at open for RO-PCC
ldlm.namespaces.lustre-MDT0000-mdc-ffff927e83f3d000.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff927ec0523800.lru_size=clear
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d15.sanity-pcc is idle now
PASS 15 (11s)

== sanity-pcc test 16: Test detach with different options ========================================================== 15:02:17 (1761246137)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.144092 s, 364 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d16.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 8d61e208-a524-44c7-a4f1-d742de5f62b3
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f16.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=8d61e208-a524-44c7-a4f1-d742de5f62b3 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d16.sanity-pcc/d16.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Test detach for RW-PCC
Test for reusing valid PCC cache
Test for the default detach
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Test detach for RO-PCC
detach_dataCleanup PCC backend on /mnt/lustre
/mnt/pcc.d16.sanity-pcc is idle now
PASS 16 (13s)

== sanity-pcc test 17: Test auto attach for layout refresh ========================================================== 15:02:30 (1761246150)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.1541 s, 340 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d17.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 806d0d7f-3378-4bef-a381-81724fbc0621
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f17.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=806d0d7f-3378-4bef-a381-81724fbc0621 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d17.sanity-pcc/d17.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d17.sanity-pcc/d17.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 0
    flags: 94
    autocache: projid={100}
Verify auto attach during IO for truncate
Verify auto attach during IO for read/write
multiop /mnt/lustre/f17.sanity-pcc vO_r
TMPPIPE=/tmp/multiop_open_wait_pipe.50268
client oleg624-client.virtnet multiop_bg started multiop_pid=50279
ldlm.namespaces.lustre-MDT0000-mdc-ffff927e83f3d000.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff927ec0523800.lru_size=clear
Stopping multiop_pid=50279 (kill 50279 on oleg624-client.virtnet)
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d17.sanity-pcc is idle now
PASS 17 (19s)

== sanity-pcc test 18: Verify size correctness after re-attach the file ========================================================== 15:02:49 (1761246169)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120911 s, 434 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d18.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 24737477-2b49-42c6-800a-46f10829f41f
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f18.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=24737477-2b49-42c6-800a-46f10829f41f (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d18.sanity-pcc/d18.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d18.sanity-pcc/d18.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 0
    flags: 9e
    autocache: projid={100}
4+0 records in
4+0 records out
4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.183325 s, 22.9 MB/s
file: /mnt/lustre/f18.sanity-pcc, type: readwrite, PCC_file: /d18.sanity-pcc/3aac/0x200003ab1:0x1d:0x0, open_count: 0, flags: 0
file: /mnt/lustre/f18.sanity-pcc, type: none
/mnt/lustre/f18.sanity-pcc has size 4194304 OK
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00500745 s, 204 kB/s
/mnt/lustre2/f18.sanity-pcc has size 1049600 OK
file: /mnt/lustre/f18.sanity-pcc, type: none
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d18.sanity-pcc is idle now
PASS 18 (11s)

== sanity-pcc test 19: Verify the file re-attach works as expected ========================================================== 15:03:00 (1761246180)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.164798 s, 318 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d19.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 8a5deaed-a9dd-4e7f-8619-7593f2934673
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f19.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=8a5deaed-a9dd-4e7f-8619-7593f2934673 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d19.sanity-pcc/d19.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d19.sanity-pcc is idle now
PASS 19 (10s)

== sanity-pcc test 20: Auto attach works after the inode was once evicted from cache ========================================================== 15:03:10 (1761246190)
120+0 records in
120+0 records out
125829120 bytes (126 MB, 120 MiB) copied, 0.364324 s, 345 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d20.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:   8192/122880             done                            
Creating filesystem with 122880 1k blocks and 30720 inodes
Filesystem UUID: 72c6adad-3715-40a3-b812-ffdac8b05cc8
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345, 73729

Allocating group tables:  0/15     done                            
Writing inode tables:  0/15     done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information:  0/15     done

/tmp/f20.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=72c6adad-3715-40a3-b812-ffdac8b05cc8 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d20.sanity-pcc/d20.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d20.sanity-pcc is idle now
PASS 20 (11s)

== sanity-pcc test 21a: PCC-RO storing as a plain HSM mirror component for plain layout ========================================================== 15:03:21 (1761246201)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.175518 s, 299 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d21a.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 01420678-1b07-4192-a719-b9c0c5fef5ea
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f21a.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=01420678-1b07-4192-a719-b9c0c5fef5ea (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d21a.sanity-pcc/d21a.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Plain layout info before PCC-RO attach '/mnt/lustre/f21a.sanity-pcc':
/mnt/lustre/f21a.sanity-pcc
lmm_magic:         0x0BD10BD0
lmm_seq:           0x200003ab1
lmm_object_id:     0x29
lmm_fid:           [0x200003ab1:0x29:0x0]
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    0
lmm_stripe_offset: 0
	obdidx		 objid		 objid		 group
	     0	           267	        0x10b	   0x240000400


FLR layout info after PCC-RO attach '/mnt/lustre/f21a.sanity-pcc':
/mnt/lustre/f21a.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x29
      lmm_fid:           [0x200003ab1:0x29:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x10b:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''

FLR layout info after PCC-RO detach '/mnt/lustre/f21a.sanity-pcc':
/mnt/lustre/f21a.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x29
      lmm_fid:           [0x200003ab1:0x29:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x10b:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''

FLR layout info after RO-PCC attach /mnt/lustre/f21a.sanity-pcc again:
/mnt/lustre/f21a.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x29
      lmm_fid:           [0x200003ab1:0x29:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x10b:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''

FLR layout info after RO-PCC detach '/mnt/lustre/f21a.sanity-pcc' again:
/mnt/lustre/f21a.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x29
      lmm_fid:           [0x200003ab1:0x29:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x10b:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d21a.sanity-pcc is idle now
PASS 21a (8s)

== sanity-pcc test 21b: PCC-RO stroing as a plain HSM mirror component for FLR layouts ========================================================== 15:03:29 (1761246209)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105225 s, 498 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d21b.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 00eeb9e9-269e-487f-9b2b-b3f21cfcae82
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f21b.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=00eeb9e9-269e-487f-9b2b-b3f21cfcae82 (extents) (64bit) (large files) (huge files)
FLR layout before PCC-RO attach '/mnt/lustre/f21b.sanity-pcc':
/mnt/lustre/f21b.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          288
  lcm_flags:         ro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2a
      lmm_fid:           [0x200003ab1:0x2a:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x10c:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x10c:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         208
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2a
      lmm_fid:           [0x200003ab1:0x2a:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x10d:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x10d:0x0] }


FLR layout after PCC-RO attach '/mnt/lustre/f21b.sanity-pcc':
/mnt/lustre/f21b.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          408
  lcm_flags:         ro,pccro
  lcm_layout_gen:    3
  lcm_mirror_count:  3
  lcm_entry_count:   3
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         176
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2a
      lmm_fid:           [0x200003ab1:0x2a:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x10c:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x10c:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         256
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2a
      lmm_fid:           [0x200003ab1:0x2a:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x10d:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x10d:0x0] }

  - lcme_id:             196611
    lcme_mirror_id:      3
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         336
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''

FLR layout info after PCC-RO detach '/mnt/lustre/f21b.sanity-pcc':
/mnt/lustre/f21b.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          408
  lcm_flags:         ro,pccro
  lcm_layout_gen:    3
  lcm_mirror_count:  3
  lcm_entry_count:   3
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         176
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2a
      lmm_fid:           [0x200003ab1:0x2a:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x10c:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x10c:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         256
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2a
      lmm_fid:           [0x200003ab1:0x2a:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x10d:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x10d:0x0] }

  - lcme_id:             196611
    lcme_mirror_id:      3
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         336
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''

FLR layout after PCC-RO attach '/mnt/lustre/f21b.sanity-pcc' again:
/mnt/lustre/f21b.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          408
  lcm_flags:         ro,pccro
  lcm_layout_gen:    3
  lcm_mirror_count:  3
  lcm_entry_count:   3
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         176
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2a
      lmm_fid:           [0x200003ab1:0x2a:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x10c:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x10c:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         256
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2a
      lmm_fid:           [0x200003ab1:0x2a:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x10d:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x10d:0x0] }

  - lcme_id:             196611
    lcme_mirror_id:      3
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         336
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''

FLR layout info after PCC-RO detach '/mnt/lustre/f21b.sanity-pcc':
/mnt/lustre/f21b.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          408
  lcm_flags:         ro,pccro
  lcm_layout_gen:    3
  lcm_mirror_count:  3
  lcm_entry_count:   3
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         176
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2a
      lmm_fid:           [0x200003ab1:0x2a:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x10c:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x10c:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         256
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2a
      lmm_fid:           [0x200003ab1:0x2a:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x10d:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x10d:0x0] }

  - lcme_id:             196611
    lcme_mirror_id:      3
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         336
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d21b.sanity-pcc is idle now
PASS 21b (8s)

== sanity-pcc test 21c: Verify HSM release works storing PCC-RO as HSM mirror component ========================================================== 15:03:37 (1761246217)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0988499 s, 530 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d21c.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: d3aa86cb-51ad-49a6-a22b-a1b8827514a0
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f21c.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=d3aa86cb-51ad-49a6-a22b-a1b8827514a0 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d21c.sanity-pcc/d21c.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Waiting 200s for 'SUCCEED'
/mnt/lustre/f21c.sanity-pcc: (0x00000009) exists archived, archive_id:2
/mnt/lustre/f21c.sanity-pcc
  lcm_layout_gen:    3
  lcm_mirror_count:  2
  lcm_entry_count:   2
    lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0,released
      lmm_layout_gen:    0
      lmm_stripe_offset: 0

    lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
/mnt/lustre/f21c.sanity-pcc: (0x0000000d) released exists archived, archive_id:2
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d21c.sanity-pcc is idle now
PASS 21c (10s)

== sanity-pcc test 21d: Write should invalidate PCC-RO caching ========================================================== 15:03:47 (1761246227)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.15998 s, 328 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d21d.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 863afda6-f708-4f4e-9a04-101fb48509f4
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f21d.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=863afda6-f708-4f4e-9a04-101fb48509f4 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d21d.sanity-pcc/d21d.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
/mnt/lustre/f21d.sanity-pcc
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    0
lmm_stripe_offset: 1
	obdidx		 objid		 objid		 group
	     1	           270	        0x10e	   0x280000400

PCC-RO attach '/mnt/lustre/f21d.sanity-pcc':
/mnt/lustre/f21d.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2d
      lmm_fid:           [0x200003ab1:0x2d:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x10e:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Write invalidated PCC-RO cache:
/mnt/lustre/f21d.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         wp
  lcm_layout_gen:    4
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2d
      lmm_fid:           [0x200003ab1:0x2d:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x10e:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init,stale
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,dirty,archived,0xb
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d21d.sanity-pcc is idle now
PASS 21d (7s)

== sanity-pcc test 21e: Truncate should invalidate PCC-RO caching ========================================================== 15:03:54 (1761246234)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0990438 s, 529 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d21e.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 868b1b2a-7466-4572-9a4a-4287a24de47c
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f21e.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=868b1b2a-7466-4572-9a4a-4287a24de47c (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d21e.sanity-pcc/d21e.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
/mnt/lustre/f21e.sanity-pcc
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    0
lmm_stripe_offset: 0
	obdidx		 objid		 objid		 group
	     0	           271	        0x10f	   0x240000400

PCC-RO attach '/mnt/lustre/f21e.sanity-pcc':
/mnt/lustre/f21e.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2f
      lmm_fid:           [0x200003ab1:0x2f:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x10f:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Trucate invalidate PCC-RO file '/mnt/lustre/f21e.sanity-pcc':
/mnt/lustre/f21e.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         wp
  lcm_layout_gen:    4
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2f
      lmm_fid:           [0x200003ab1:0x2f:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x10f:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init,stale
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,dirty,archived,0xb
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d21e.sanity-pcc is idle now
PASS 21e (7s)

== sanity-pcc test 21f: mmap write should invalidate PCC-RO caching ========================================================== 15:04:01 (1761246241)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.173374 s, 302 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d21f.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 0aeeda94-e0b8-4ecb-b3d6-073506130b43
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f21f.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=0aeeda94-e0b8-4ecb-b3d6-073506130b43 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d21f.sanity-pcc/d21f.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
/mnt/lustre/f21f.sanity-pcc
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    0
lmm_stripe_offset: 1
	obdidx		 objid		 objid		 group
	     1	           271	        0x10f	   0x280000400

PCC-RO attach '/mnt/lustre/f21f.sanity-pcc':
/mnt/lustre/f21f.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x30
      lmm_fid:           [0x200003ab1:0x30:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x10f:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Mmap write invalidate PCC-RO caching:
/mnt/lustre/f21f.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         wp
  lcm_layout_gen:    4
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x30
      lmm_fid:           [0x200003ab1:0x30:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x10f:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init,stale
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,dirty,archived,0xb
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d21f.sanity-pcc is idle now
PASS 21f (7s)

== sanity-pcc test 21g: PCC-RO for file under FLR write pending state ========================================================== 15:04:08 (1761246248)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.218728 s, 240 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d21g.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 978250c7-f94f-456b-b820-ad9e1a5949bd
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f21g.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=978250c7-f94f-456b-b820-ad9e1a5949bd (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d21g.sanity-pcc/d21g.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
FLR layout before PCC-RO attach '/mnt/lustre/f21g.sanity-pcc':
/mnt/lustre/f21g.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          288
  lcm_flags:         wp
  lcm_layout_gen:    3
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x32
      lmm_fid:           [0x200003ab1:0x32:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x110:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x110:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init,stale
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         208
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x32
      lmm_fid:           [0x200003ab1:0x32:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x111:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x111:0x0] }

FLR layout after PCC-RO attach '/mnt/lustre/f21g.sanity-pcc':
/mnt/lustre/f21g.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          408
  lcm_flags:         wp,pccro
  lcm_layout_gen:    4
  lcm_mirror_count:  3
  lcm_entry_count:   3
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         176
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x32
      lmm_fid:           [0x200003ab1:0x32:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x110:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x110:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init,stale
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         256
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x32
      lmm_fid:           [0x200003ab1:0x32:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x111:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x111:0x0] }

  - lcme_id:             196612
    lcme_mirror_id:      3
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         336
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Layout after Write invalidate '/mnt/lustre/f21g.sanity-pcc':
/mnt/lustre/f21g.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          408
  lcm_flags:         wp
  lcm_layout_gen:    5
  lcm_mirror_count:  3
  lcm_entry_count:   3
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         176
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x32
      lmm_fid:           [0x200003ab1:0x32:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x110:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x110:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init,stale
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         256
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x32
      lmm_fid:           [0x200003ab1:0x32:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x111:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x111:0x0] }

  - lcme_id:             196612
    lcme_mirror_id:      3
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         336
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,0x9
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d21g.sanity-pcc is idle now
PASS 21g (10s)

== sanity-pcc test 21h: Extend mirror once file was PCC-RO cached ========================================================== 15:04:18 (1761246258)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.182147 s, 288 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d21h.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: f9f78994-6635-4882-bd77-2ea8222468b2
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f21h.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=f9f78994-6635-4882-bd77-2ea8222468b2 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d21h.sanity-pcc/d21h.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
FLR layout before PCC-RO attach '/mnt/lustre/f21h.sanity-pcc':
/mnt/lustre/f21h.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          288
  lcm_flags:         ro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x35
      lmm_fid:           [0x200003ab1:0x35:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x112:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x112:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         208
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x35
      lmm_fid:           [0x200003ab1:0x35:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x113:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x113:0x0] }


FLR layout after PCC-RO attach '/mnt/lustre/f21h.sanity-pcc':
/mnt/lustre/f21h.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          408
  lcm_flags:         ro,pccro
  lcm_layout_gen:    3
  lcm_mirror_count:  3
  lcm_entry_count:   3
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         176
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x35
      lmm_fid:           [0x200003ab1:0x35:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x112:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x112:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         256
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x35
      lmm_fid:           [0x200003ab1:0x35:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x113:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x113:0x0] }

  - lcme_id:             196611
    lcme_mirror_id:      3
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         336
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''

FLR layout after extend a mirror:
/mnt/lustre/f21h.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          536
  lcm_flags:         ro,pccro
  lcm_layout_gen:    4
  lcm_mirror_count:  4
  lcm_entry_count:   4
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         224
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x35
      lmm_fid:           [0x200003ab1:0x35:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x112:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x112:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         304
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x35
      lmm_fid:           [0x200003ab1:0x35:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x113:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x113:0x0] }

  - lcme_id:             196611
    lcme_mirror_id:      3
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         384
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
  - lcme_id:             262145
    lcme_mirror_id:      4
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         456
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x35
      lmm_fid:           [0x200003ab1:0x35:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   8388608
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x114:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x114:0x0] }

file: /mnt/lustre/f21h.sanity-pcc, type: none

FLR layout after PCC-RO attach '/mnt/lustre/f21h.sanity-pcc' again:
/mnt/lustre/f21h.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          536
  lcm_flags:         ro,pccro
  lcm_layout_gen:    4
  lcm_mirror_count:  4
  lcm_entry_count:   4
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         224
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x35
      lmm_fid:           [0x200003ab1:0x35:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x112:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x112:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         304
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x35
      lmm_fid:           [0x200003ab1:0x35:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x113:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x113:0x0] }

  - lcme_id:             196611
    lcme_mirror_id:      3
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         384
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
  - lcme_id:             262145
    lcme_mirror_id:      4
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         456
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x35
      lmm_fid:           [0x200003ab1:0x35:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   8388608
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x114:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x114:0x0] }

Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d21h.sanity-pcc is idle now
PASS 21h (9s)

== sanity-pcc test 21i: HSM release increase layout gen, should invalidate PCC-RO cache ========================================================== 15:04:27 (1761246267)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.154473 s, 339 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d21i.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: a143c39b-2096-4cd0-8646-77810beee985
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f21i.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=a143c39b-2096-4cd0-8646-77810beee985 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d21i.sanity-pcc/d21i.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
/mnt/lustre/f21i.sanity-pcc: (0x00000009) exists archived, archive_id:2
Layout after HSM release /mnt/lustre/f21i.sanity-pcc:
/mnt/lustre/f21i.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    4
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x37
      lmm_fid:           [0x200003ab1:0x37:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0,released
      lmm_layout_gen:    2
      lmm_stripe_offset: 16

  - lcme_id:             131075
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    343597384136
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
PCC state /mnt/lustre/f21i.sanity-pcc:
file: /mnt/lustre/f21i.sanity-pcc, type: none
Layout after PCC-RO attach /mnt/lustre/f21i.sanity-pcc again:
/mnt/lustre/f21i.sanity-pcc
lmm_magic:         0x0BD10BD0
lmm_seq:           0x200003ab1
lmm_object_id:     0x37
lmm_fid:           [0x200003ab1:0x37:0x0]
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    5
lmm_stripe_offset: 0
	obdidx		 objid		 objid		 group
	     0	           278	        0x116	   0x240000400

PCC state:
file: /mnt/lustre/f21i.sanity-pcc, type: readonly, PCC_file: /d21i.sanity-pcc/3a86/0x200003ab1:0x37:0x0, open_count: 0, flags: 0
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d21i.sanity-pcc is idle now
PASS 21i (10s)

== sanity-pcc test 21j: PCC-RO for encrypted file ======== 15:04:38 (1761246278)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.193323 s, 271 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d21j.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: de4cd73f-d5d7-4b3e-b346-a411555d1fc1
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f21j.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=de4cd73f-d5d7-4b3e-b346-a411555d1fc1 (extents) (64bit) (large files) (huge files)
Stopping client oleg624-client.virtnet /mnt/lustre (opts:)
Starting client: oleg624-client.virtnet:  -o user_xattr,flock,test_dummy_encryption 192.168.206.124@tcp:/lustre /mnt/lustre
384001842
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d21j.sanity-pcc/d21j.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
5000+0 records in
5000+0 records out
5000 bytes (5.0 kB, 4.9 KiB) copied, 0.0157423 s, 318 kB/s
/mnt/lustre/d21j.sanity-pcc/f21j.sanity-pcc
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    0
lmm_stripe_offset: 1
	obdidx		 objid		 objid		 group
	     1	           278	        0x116	   0x280000400

PCC-RO attach '/mnt/lustre/d21j.sanity-pcc/f21j.sanity-pcc':
/mnt/lustre/d21j.sanity-pcc/f21j.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab3
      lmm_object_id:     0x2
      lmm_fid:           [0x200003ab3:0x2:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x116:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    8594128896
      lhm_archive_ver:   9663677440
      lhm_archive_uuid:  ''
/mnt/lustre/d21j.sanity-pcc/f21j.sanity-pcc_2
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    0
lmm_stripe_offset: 0
	obdidx		 objid		 objid		 group
	     0	           279	        0x117	   0x240000400

PCC-RO attach '/mnt/lustre/d21j.sanity-pcc/f21j.sanity-pcc_2':
/mnt/lustre/d21j.sanity-pcc/f21j.sanity-pcc_2
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab3
      lmm_object_id:     0x3
      lmm_fid:           [0x200003ab3:0x3:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x117:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
1 keys reaped
Cleanup PCC backend on /mnt/lustre
Stopping client oleg624-client.virtnet /mnt/lustre (opts:)
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
/mnt/pcc.d21j.sanity-pcc is idle now
PASS 21j (14s)

== sanity-pcc test 22: Test RO-PCC attach for the HSM released file ========================================================== 15:04:51 (1761246291)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114263 s, 459 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d22.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: b5c4f45d-93d7-4c14-bacf-a444e7d3edac
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f22.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=b5c4f45d-93d7-4c14-bacf-a444e7d3edac (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d22.sanity-pcc/d22.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Layout after PCC-RO attach /mnt/lustre/f22.sanity-pcc:
/mnt/lustre/f22.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    3
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab4
      lmm_object_id:     0x1
      lmm_fid:           [0x200003ab4:0x1:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    2
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x118:0x0] }

  - lcme_id:             131075
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Layout after HSM release /mnt/lustre/f22.sanity-pcc:
/mnt/lustre/f22.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    4
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab4
      lmm_object_id:     0x1
      lmm_fid:           [0x200003ab4:0x1:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0,released
      lmm_layout_gen:    2
      lmm_stripe_offset: 0

  - lcme_id:             131075
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Layout after PCC-RO attach /mnt/lustre/f22.sanity-pcc again:
/mnt/lustre/f22.sanity-pcc
lmm_magic:         0x0BD10BD0
lmm_seq:           0x200003ab4
lmm_object_id:     0x1
lmm_fid:           [0x200003ab4:0x1:0x0]
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    5
lmm_stripe_offset: 1
	obdidx		 objid		 objid		 group
	     1	           280	        0x118	   0x280000400

Layout after PCC-RO detach /mnt/lustre/f22.sanity-pcc:
/mnt/lustre/f22.sanity-pcc
lmm_magic:         0x0BD10BD0
lmm_seq:           0x200003ab4
lmm_object_id:     0x1
lmm_fid:           [0x200003ab4:0x1:0x0]
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    5
lmm_stripe_offset: 1
	obdidx		 objid		 objid		 group
	     1	           280	        0x118	   0x280000400

Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d22.sanity-pcc is idle now
PASS 22 (14s)

== sanity-pcc test 23: Test write/truncate/mmap-write invalidating RO-PCC caching ========================================================== 15:05:05 (1761246305)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.150286 s, 349 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d23.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 5afc7529-764e-46dc-9630-0edd90c6479f
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f23.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=5afc7529-764e-46dc-9630-0edd90c6479f (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d23.sanity-pcc/d23.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Write should invalidate the RO-PCC cache:
/mnt/lustre/f23.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         wp
  lcm_layout_gen:    4
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab4
      lmm_object_id:     0x9
      lmm_fid:           [0x200003ab4:0x9:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x11a:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init,stale
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,dirty,archived,0xb
      lhm_archive_id:    8594128896
      lhm_archive_ver:   9663677440
      lhm_archive_uuid:  ''
PCC-RO attach '/mnt/lustre/f23.sanity-pcc' again:
/mnt/lustre/f23.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         wp,pccro
  lcm_layout_gen:    5
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab4
      lmm_object_id:     0x9
      lmm_fid:           [0x200003ab4:0x9:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x11a:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    8594128896
      lhm_archive_ver:   9663677440
      lhm_archive_uuid:  ''
Truncate invalidate the RO-PCC cache:
/mnt/lustre/f23.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         wp
  lcm_layout_gen:    6
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab4
      lmm_object_id:     0x9
      lmm_fid:           [0x200003ab4:0x9:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x11a:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,0x9
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Finish trucate operation
Mmap write invalidates RO-PCC caching
/mnt/lustre/f23.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         wp
  lcm_layout_gen:    6
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab4
      lmm_object_id:     0x9
      lmm_fid:           [0x200003ab4:0x9:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x11a:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,0x9
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
PCC-RO attach '/mnt/lustre/f23.sanity-pcc' again:
/mnt/lustre/f23.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         wp,pccro
  lcm_layout_gen:    7
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab4
      lmm_object_id:     0x9
      lmm_fid:           [0x200003ab4:0x9:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x11a:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Mmap write /mnt/lustre/f23.sanity-pcc via multiop
/mnt/lustre/f23.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         wp
  lcm_layout_gen:    8
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab4
      lmm_object_id:     0x9
      lmm_fid:           [0x200003ab4:0x9:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x11a:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,0x9
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d23.sanity-pcc is idle now
PASS 23 (9s)

== sanity-pcc test 24a: Test RO-PCC with non-root user === 15:05:15 (1761246315)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.10409 s, 504 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d24a.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 6fabb20e-a665-4b17-9b48-6179ad65e198
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f24a.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=6fabb20e-a665-4b17-9b48-6179ad65e198 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d24a.sanity-pcc/d24a.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d24a.sanity-pcc/d24a.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 2
    flags: a0
    autocache: projid={100}
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d24a.sanity-pcc/f24a.sanity-pcc] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0195689 s, 52.3 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-r] [-i] [2] [/mnt/lustre/d24a.sanity-pcc/f24a.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d24a.sanity-pcc/f24a.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00392695 s, 261 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [-k] [/mnt/lustre/d24a.sanity-pcc/f24a.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/pcc.d24a.sanity-pcc/d24a.sanity-pcc/3ab8/0x200003ab4:0xc:0x0]
touch: cannot touch '/mnt/pcc.d24a.sanity-pcc/d24a.sanity-pcc/3ab8/0x200003ab4:0xc:0x0': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/pcc.d24a.sanity-pcc/d24a.sanity-pcc/3ab8/0x200003ab4:0xc:0x0] [of=/dev/null] [bs=1024] [count=1]
dd: failed to open '/mnt/pcc.d24a.sanity-pcc/d24a.sanity-pcc/3ab8/0x200003ab4:0xc:0x0': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/pcc.d24a.sanity-pcc/d24a.sanity-pcc/3ab8/0x200003ab4:0xc:0x0] [bs=1024] [count=1]
dd: failed to open '/mnt/pcc.d24a.sanity-pcc/d24a.sanity-pcc/3ab8/0x200003ab4:0xc:0x0': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-r] [-i] [2] [/mnt/lustre/d24a.sanity-pcc/f24a.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/d24a.sanity-pcc/f24a.sanity-pcc]
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d24a.sanity-pcc is idle now
PASS 24a (7s)

== sanity-pcc test 24b: General permission test for RO-PCC ========================================================== 15:05:23 (1761246323)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.162055 s, 324 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d24b.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 9fe7e918-1bc9-4a0a-9c32-88baaa3bfac4
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f24b.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=9fe7e918-1bc9-4a0a-9c32-88baaa3bfac4 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d24b.sanity-pcc/d24b.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0148439 s, 69.0 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc] [bs=1024] [count=1]
dd: failed to open '/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
dd: failed to open '/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc] [bs=1024] [count=1]
dd: failed to open '/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
dd: failed to open '/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00440761 s, 232 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc]
detach: cannot detach '/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc' from PCC: Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00689406 s, 149 kB/s
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d24b.sanity-pcc is idle now
PASS 24b (8s)

== sanity-pcc test 25: Tolerate fake read failure for RO-PCC ========================================================== 15:05:31 (1761246331)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108099 s, 485 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d25.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 1d733384-194f-4cd3-8e8d-4d0eec6f0fdd
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f25.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=1d733384-194f-4cd3-8e8d-4d0eec6f0fdd (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d25.sanity-pcc/d25.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
fail_loc=0x1411
fail_loc=0
fail_loc=0x1411
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d25.sanity-pcc is idle now
PASS 25 (9s)

== sanity-pcc test 26: Repeat the attach/detach when the file has multiple openers ========================================================== 15:05:41 (1761246341)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.168984 s, 310 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d26.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: ae1468be-3d9d-4d64-9100-35405d27d769
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f26.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=ae1468be-3d9d-4d64-9100-35405d27d769 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d26.sanity-pcc/d26.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
multiop /mnt/lustre/f26.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.65627
client oleg624-client.virtnet multiop_bg started multiop_pid=65637
Stopping multiop_pid=65637 (kill 65637 on oleg624-client.virtnet)
multiop /mnt/lustre/f26.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.65739
client oleg624-client.virtnet multiop_bg started multiop_pid=65749
Stopping multiop_pid=65749 (kill 65749 on oleg624-client.virtnet)
multiop /mnt/lustre/f26.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.65852
client oleg624-client.virtnet multiop_bg started multiop_pid=65862
Stopping multiop_pid=65862 (kill 65862 on oleg624-client.virtnet)
multiop /mnt/lustre/f26.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.65965
client oleg624-client.virtnet multiop_bg started multiop_pid=65975
Stopping multiop_pid=65975 (kill 65975 on oleg624-client.virtnet)
multiop /mnt/lustre/f26.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.66103
client oleg624-client.virtnet multiop_bg started multiop_pid=66113
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Stopping multiop_pid=66113 (kill 66113 on oleg624-client.virtnet)
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d26.sanity-pcc is idle now
PASS 26 (36s)

== sanity-pcc test 27: Auto attach at open when the file has multiple openers ========================================================== 15:06:16 (1761246376)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.164127 s, 319 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d27.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 9c36e768-7d12-43f8-b477-826f7cc143cb
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f27.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=9c36e768-7d12-43f8-b477-826f7cc143cb (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d27.sanity-pcc/d27.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
multiop /mnt/lustre/f27.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.66960
client oleg624-client.virtnet multiop_bg started multiop_pid=66970
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Stopping multiop_pid=66970 (kill 66970 on oleg624-client.virtnet)
multiop /mnt/lustre/f27.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.67101
client oleg624-client.virtnet multiop_bg started multiop_pid=67111
ldlm.namespaces.lustre-MDT0000-mdc-ffff927e83f3d000.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff927ea03be800.lru_size=clear
Waiting 200s for 'SUCCEED'
Stopping multiop_pid=67111 (kill 67111 on oleg624-client.virtnet)
multiop /mnt/lustre/f27.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.67240
client oleg624-client.virtnet multiop_bg started multiop_pid=67250
Stopping multiop_pid=67250 (kill 67250 on oleg624-client.virtnet)
multiop /mnt/lustre/f27.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.67356
client oleg624-client.virtnet multiop_bg started multiop_pid=67366
ldlm.namespaces.lustre-MDT0000-mdc-ffff927e83f3d000.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff927ea03be800.lru_size=clear
Stopping multiop_pid=67366 (kill 67366 on oleg624-client.virtnet)
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d27.sanity-pcc is idle now
PASS 27 (32s)

== sanity-pcc test 28: RW-PCC attach should fail when the file has cluster-wide openers ========================================================== 15:06:48 (1761246408)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.219619 s, 239 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d28.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 2b2ee2a5-8ebd-407b-babf-88ae27d3af64
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f28.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=2b2ee2a5-8ebd-407b-babf-88ae27d3af64 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d28.sanity-pcc/d28.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
multiop /mnt/lustre/f28.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.68164
client oleg624-client.virtnet multiop_bg started multiop_pid=68174
lfs pcc pcc: cannot get WRITE lease, ext 0 for [0x200003ab4:0x24:0x0]: Device or resource busy (16)
lfs pcc pcc: cannot get lease: Device or resource busy (16)
attach: cannot attach '/mnt/lustre/f28.sanity-pcc' to PCC with attach ID '2': Device or resource busy
Stopping multiop_pid=68174 (kill 68174 on oleg624-client.virtnet)
multiop /mnt/lustre2/f28.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.7559
lfs pcc pcc: cannot get WRITE lease, ext 0 for [0x200003ab4:0x24:0x0]: Device or resource busy (16)
lfs pcc pcc: cannot get lease: Device or resource busy (16)
attach: cannot attach '/mnt/lustre/f28.sanity-pcc' to PCC with attach ID '2': Device or resource busy
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d28.sanity-pcc is idle now
PASS 28 (13s)

== sanity-pcc test 29a: Auto readonly caching on RO-PCC backend for O_RDONLY open ========================================================== 15:07:02 (1761246422)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg624-client.virtnet /mnt/lustre (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre opts:
Stopping clients: oleg624-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg624-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg624-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg624-server'
oleg624-server: oleg624-server.virtnet: executing load_modules_local
oleg624-server: Loading modules from /home/green/git/lustre-release/lustre
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
oleg624-server: detected 4 online CPUs by sysfs
oleg624-server: MODOPTS_LIBCFS=
oleg624-server: Force libcfs to create 2 CPU partitions
Setup mgs, mdt, osts
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-MDT0000
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0000
Start ost2: mount -t lustre -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff927e83812800.idle_timeout=debug
osc.lustre-OST0000-osc-ffff927e902a8000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927e83812800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927e902a8000.idle_timeout=debug
disable quota as required
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.131008 s, 400 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d29a.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: e1f4a66a-bd21-4cf4-abdf-93400788c3c0
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f29a.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=e1f4a66a-bd21-4cf4-abdf-93400788c3c0 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d29a.sanity-pcc/d29a.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d29a.sanity-pcc/d29a.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 2
    flags: ae
    autocache: projid={100}
  100 P /mnt/lustre/d29a.sanity-pcc/f29a.sanity-pcc
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d29a.sanity-pcc is idle now
PASS 29a (94s)

== sanity-pcc test 29b: Auto PCC-RO attach in atomic_open ========================================================== 15:08:36 (1761246516)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.112365 s, 467 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d29b.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: c48f2454-eaf1-4cf2-8c16-3aca6a471877
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f29b.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=c48f2454-eaf1-4cf2-8c16-3aca6a471877 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d29b.sanity-pcc/d29b.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: fname={*.dat}
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0435738 s, 94.0 kB/s
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00448755 s, 913 kB/s
file: /mnt/lustre/myfile.dat, type: readonly, PCC_file: /d29b.sanity-pcc/4282/0x200004281:0x3:0x0, open_count: 0, flags: 0
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00346328 s, 1.2 MB/s
vm.drop_caches = 3
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0504615 s, 81.2 kB/s
file: /mnt/lustre/myfile.dat, type: readonly, PCC_file: /d29b.sanity-pcc/4282/0x200004281:0x3:0x0, open_count: 0, flags: 0
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d29b.sanity-pcc is idle now
PASS 29b (12s)

== sanity-pcc test 30: Test lctl pcc del command ========= 15:08:48 (1761246528)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.313766 s, 167 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d30.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 5e56edb2-eff0-4dc9-85c2-7cb660aed773
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f30.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=5e56edb2-eff0-4dc9-85c2-7cb660aed773 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d30.sanity-pcc/d30.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d30.sanity-pcc/d30.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 2
    flags: be
    autocache: projid={100}
check file 0:'4289' under directory '/mnt/pcc.d30.sanity-pcc/d30.sanity-pcc'
check file 0:'428b' under directory '/mnt/pcc.d30.sanity-pcc/d30.sanity-pcc'
check file 0:'4287' under directory '/mnt/pcc.d30.sanity-pcc/d30.sanity-pcc'
check file 1:'0x200004281:0x8:0x0' under directory '/mnt/pcc.d30.sanity-pcc/d30.sanity-pcc/4289'
Handle the file: 0x200004281:0x8:0x0
Remove non-cached file: /mnt/pcc.d30.sanity-pcc/d30.sanity-pcc/4289/0x200004281:0x8:0x0 flags: 1
check file 1:'0x200004281:0xa:0x0' under directory '/mnt/pcc.d30.sanity-pcc/d30.sanity-pcc/428b'
Handle the file: 0x200004281:0xa:0x0
Detach and remove the PCC cached file: 0x200004281:0xa:0x0
check file 1:'0x200004281:0x6:0x0' under directory '/mnt/pcc.d30.sanity-pcc/d30.sanity-pcc/4287'
Handle the file: 0x200004281:0x6:0x0
Detach and remove the PCC cached file: 0x200004281:0x6:0x0
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d30.sanity-pcc is idle now
PASS 30 (12s)

== sanity-pcc test 31: Test lctl pcc del command with --keep option ========================================================== 15:09:00 (1761246540)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.137213 s, 382 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d31.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 10784230-6c54-4a35-a8f6-30fc1a6c4f96
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f31.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=10784230-6c54-4a35-a8f6-30fc1a6c4f96 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d31.sanity-pcc/d31.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d31.sanity-pcc/d31.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 2
    flags: b0
    autocache: projid={100}
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d31.sanity-pcc is idle now
PASS 31 (12s)

== sanity-pcc test 32: Test for RO-PCC when PCC copy is deleted ========================================================== 15:09:12 (1761246552)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.157513 s, 333 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d32.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 191febdf-0895-4732-967a-749f65978373
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f32.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=191febdf-0895-4732-967a-749f65978373 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d32.sanity-pcc/d32.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
multiop /mnt/lustre/f32.sanity-pcc vo_rc
TMPPIPE=/tmp/multiop_open_wait_pipe.74191
client oleg624-client.virtnet multiop_bg started multiop_pid=74201
Stopping multiop_pid=74201 (kill 74201 on oleg624-client.virtnet)
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d32.sanity-pcc is idle now
PASS 32 (18s)

 SKIP: sanity-pcc test_33 skipping ALWAYS excluded test 33

== sanity-pcc test 34: Cache rule with comparator (>, <) for Project ID range ========================================================== 15:09:32 (1761246572)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg624-client.virtnet /mnt/lustre (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre opts:
Stopping clients: oleg624-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg624-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg624-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg624-server'
oleg624-server: oleg624-server.virtnet: executing load_modules_local
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
oleg624-server: Loading modules from /home/green/git/lustre-release/lustre
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
oleg624-server: detected 4 online CPUs by sysfs
oleg624-server: MODOPTS_LIBCFS=
oleg624-server: Force libcfs to create 2 CPU partitions
Setup mgs, mdt, osts
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-MDT0000
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0000
Start ost2: mount -t lustre -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff927ec040f800.idle_timeout=debug
osc.lustre-OST0000-osc-ffff927ec0522000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927ec040f800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927ec0522000.idle_timeout=debug
disable quota as required
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.213029 s, 246 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d34.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: e783b6a6-837a-41b6-86df-8a1e4fc794f1
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f34.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=e783b6a6-837a-41b6-86df-8a1e4fc794f1 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d34.sanity-pcc/d34.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d34.sanity-pcc/d34.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 5
    flags: ae
    autocache: projid>{100}
   99 - /mnt/lustre/f34.sanity-pcc
  101 - /mnt/lustre/f34.sanity-pcc
Cleanup PCC backend on /mnt/lustre
pcc:
  -
    pccpath: /mnt/pcc.d34.sanity-pcc/d34.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 5
    flags: ae
    autocache: projid<{100}
  102 - /mnt/lustre/f34.sanity-pcc
   99 - /mnt/lustre/f34.sanity-pcc
Cleanup PCC backend on /mnt/lustre
pcc:
  -
    pccpath: /mnt/pcc.d34.sanity-pcc/d34.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 5
    flags: ae
    autocache: projid<{120}&projid>{110}
  105 - /mnt/lustre/f34.sanity-pcc
  121 - /mnt/lustre/f34.sanity-pcc
  115 - /mnt/lustre/f34.sanity-pcc
Cleanup PCC backend on /mnt/lustre
Cleanup PCC backend on /mnt/lustre
Cleanup PCC backend on /mnt/lustre
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d34.sanity-pcc is idle now
PASS 34 (115s)

== sanity-pcc test 35: mmap fault test =================== 15:11:26 (1761246686)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103355 s, 507 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d35.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: d10b75d2-f47c-4309-894c-35c19d6aaf80
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f35.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=d10b75d2-f47c-4309-894c-35c19d6aaf80 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d35.sanity-pcc/d35.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d35.sanity-pcc is idle now
PASS 35 (10s)

== sanity-pcc test 36a: Stale RW-PCC copy should be deleted after remove the PCC backend ========================================================== 15:11:37 (1761246697)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.206577 s, 254 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d36a.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: c5d78548-727d-44e7-81d9-a8b0805d2c1a
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f36a.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=c5d78548-727d-44e7-81d9-a8b0805d2c1a (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d36a.sanity-pcc/d36a.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
check file 0:'4a52' under directory '/mnt/pcc.d36a.sanity-pcc/d36a.sanity-pcc'
check file 1:'0x200004a51:0x3:0x0' under directory '/mnt/pcc.d36a.sanity-pcc/d36a.sanity-pcc/4a52'
Handle the file: 0x200004a51:0x3:0x0
Remove non-cached file: /mnt/pcc.d36a.sanity-pcc/d36a.sanity-pcc/4a52/0x200004a51:0x3:0x0 flags: 1
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d36a.sanity-pcc is idle now
PASS 36a (9s)

== sanity-pcc test 36b: Stale RO-PCC copy should be deleted after remove the PCC backend ========================================================== 15:11:47 (1761246707)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108826 s, 482 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d36b.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/5120032768/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: c39e0275-8ea6-4f86-95db-c6154d796c48
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f36b.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=c39e0275-8ea6-4f86-95db-c6154d796c48 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d36b.sanity-pcc/d36b.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
check file 0:'4a54' under directory '/mnt/pcc.d36b.sanity-pcc/d36b.sanity-pcc'
check file 1:'0x200004a51:0x5:0x0' under directory '/mnt/pcc.d36b.sanity-pcc/d36b.sanity-pcc/4a54'
Handle the file: 0x200004a51:0x5:0x0
Remove non-cached file: /mnt/pcc.d36b.sanity-pcc/d36b.sanity-pcc/4a54/0x200004a51:0x5:0x0 flags: 1
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d36b.sanity-pcc is idle now
PASS 36b (10s)

== sanity-pcc test 37: Multiple readers on a shared file with PCC-RO mode ========================================================== 15:11:57 (1761246717)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.222022 s, 236 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d37.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 09ee9008-e3be-4f10-9a95-8f4fdff5d294
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f37.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=09ee9008-e3be-4f10-9a95-8f4fdff5d294 (extents) (64bit) (large files) (huge files)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.347344 s, 151 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
/tmp/f37.sanity-pcc on /mnt/pcc.d37.sanity-pcc type ext4 (rw,relatime,quota,usrquota,grpquota)
umount: /mnt/pcc.d37.sanity-pcc.2: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
/tmp/f37.sanity-pcc on /mnt/pcc.d37.sanity-pcc type ext4 (rw,relatime,quota,usrquota,grpquota)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 76046c73-3581-48e3-83d0-20108ce49e28
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f37.sanity-pcc.2: Linux rev 1.0 ext4 filesystem data, UUID=76046c73-3581-48e3-83d0-20108ce49e28 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d37.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: a0
    autocache: projid={2}
pcc:
  -
    pccpath: /mnt/pcc.d37.sanity-pcc.2
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: a0
    autocache: projid={2}
file: /mnt/lustre/d37.sanity-pcc/f37.sanity-pcc, type: readonly, PCC_file: /4a56/0x200004a51:0x7:0x0, open_count: 0, flags: 0
file: /mnt/lustre2/d37.sanity-pcc/f37.sanity-pcc, type: readonly, PCC_file: /4a56/0x200004a51:0x7:0x0, open_count: 0, flags: 0
/mnt/pcc.d37.sanity-pcc.2 is idle now
/mnt/pcc.d37.sanity-pcc is idle now
PASS 37 (14s)

== sanity-pcc test 38: Verify LFS pcc state does not trigger prefetch for auto PCC-RO ========================================================== 15:12:11 (1761246731)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg624-client.virtnet /mnt/lustre (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre opts:
Stopping clients: oleg624-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg624-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg624-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg624-server'
oleg624-server: oleg624-server.virtnet: executing load_modules_local
oleg624-server: Loading modules from /home/green/git/lustre-release/lustre
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
oleg624-server: detected 4 online CPUs by sysfs
oleg624-server: MODOPTS_LIBCFS=
oleg624-server: Force libcfs to create 2 CPU partitions
Setup mgs, mdt, osts
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-MDT0000
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0000
Start ost2: mount -t lustre -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff927e86a10800.idle_timeout=debug
osc.lustre-OST0000-osc-ffff927ea04d9800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927e86a10800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927ea04d9800.idle_timeout=debug
disable quota as required
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.226023 s, 232 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d38.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/5120024576/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: df9ee2d2-b766-41c1-b158-d289024cb3a0
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f38.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=df9ee2d2-b766-41c1-b158-d289024cb3a0 (extents) (64bit) (large files) (huge files)
file: /mnt/lustre/d38.sanity-pcc/f38.sanity-pcc, type: none
QQQQQ
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d38.sanity-pcc is idle now
PASS 38 (110s)

== sanity-pcc test 39: Test Project quota on loop PCC device ========================================================== 15:14:02 (1761246842)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg624-client.virtnet /mnt/lustre (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre opts:
Stopping clients: oleg624-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg624-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg624-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg624-server'
oleg624-server: oleg624-server.virtnet: executing load_modules_local
oleg624-server: Loading modules from /home/green/git/lustre-release/lustre
oleg624-server: detected 4 online CPUs by sysfs
oleg624-server: MODOPTS_LIBCFS=
oleg624-server: Force libcfs to create 2 CPU partitions
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
Setup mgs, mdt, osts
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-MDT0000
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0000
Start ost2: mount -t lustre -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff927e83f3c800.idle_timeout=debug
osc.lustre-OST0000-osc-ffff927ea0955000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927e83f3c800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927ea0955000.idle_timeout=debug
disable quota as required
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111514 s, 470 MB/s
umount: /mnt/pcc.d39.sanity-pcc: not mounted.
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 114836aa-03ba-4e9d-88a5-c39436e070c3
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f39.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=114836aa-03ba-4e9d-88a5-c39436e070c3 (extents) (64bit) (large files) (huge files)
/tmp/f39.sanity-pcc on /mnt/pcc.d39.sanity-pcc type ext4 (rw,relatime,prjquota)
project quota on /mnt/pcc.d39.sanity-pcc (/dev/loop0) is on (enforced)
*** Report for project quotas on device /dev/loop0
Block grace time: 7days; Inode grace time: 7days
                        Space limits                File limits
Project         used    soft    hard  grace    used  soft  hard  grace
----------------------------------------------------------------------
#0        --     13K      0K      0K              2     0     0       
#100      --      0K      0K   4096K              0     0     0       


pcc:
  -
    pccpath: /mnt/pcc.d39.sanity-pcc/d39.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={100}
2+0 records in
2+0 records out
2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0581918 s, 36.0 MB/s
  100 - /mnt/lustre/d39.sanity-pcc/f39.sanity-pcc
2+0 records in
2+0 records out
2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0228011 s, 92.0 MB/s
file: /mnt/lustre/d39.sanity-pcc/f39.sanity-pcc, type: readonly, PCC_file: /d39.sanity-pcc/59f3/0x2000059f1:0x2:0x0, open_count: 0, flags: 0
*** Report for project quotas on device /dev/loop0
Block grace time: 7days; Inode grace time: 7days
                        Space limits                File limits
Project         used    soft    hard  grace    used  soft  hard  grace
----------------------------------------------------------------------
#0        --     15K      0K      0K              4     0     0       
#100      --   2048K      0K   4096K              1     0     0       


5+0 records in
5+0 records out
5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.104579 s, 50.1 MB/s
5+0 records in
5+0 records out
5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0142301 s, 368 MB/s
*** Report for project quotas on device /dev/loop0
Block grace time: 7days; Inode grace time: 7days
                        Space limits                File limits
Project         used    soft    hard  grace    used  soft  hard  grace
----------------------------------------------------------------------
#0        --     15K      0K      0K              4     0     0       
#100      --      0K      0K   4096K              0     0     0       


file: /mnt/lustre/d39.sanity-pcc/f39.sanity-pcc, type: none
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d39.sanity-pcc is idle now
PASS 39 (111s)

== sanity-pcc test 40: Test async open attach in the background for PCC-RO file ========================================================== 15:15:53 (1761246953)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg624-client.virtnet /mnt/lustre (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre opts:
Stopping clients: oleg624-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg624-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg624-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg624-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg624-server'
oleg624-server: oleg624-server.virtnet: executing load_modules_local
oleg624-server: Loading modules from /home/green/git/lustre-release/lustre
oleg624-server: detected 4 online CPUs by sysfs
oleg624-server: MODOPTS_LIBCFS=
oleg624-server: Force libcfs to create 2 CPU partitions
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1034: echo: write error: Device or resource busy
oleg624-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1035: echo: write error: Device or resource busy
Setup mgs, mdt, osts
Start mds1: mount -t lustre -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-MDT0000
Start ost1: mount -t lustre -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0000
Start ost2: mount -t lustre -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg624-server: oleg624-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg624-client: oleg624-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Starting client: oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Starting client oleg624-client.virtnet:  -o user_xattr,flock 192.168.206.124@tcp:/lustre /mnt/lustre2
Started clients oleg624-client.virtnet: 
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff927e83f39000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff927ea0953800.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927e83f39000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff927ea0953800.idle_timeout=debug
disable quota as required
200+0 records in
200+0 records out
209715200 bytes (210 MB, 200 MiB) copied, 0.558153 s, 376 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d40.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:   8192/204800             done                            
Creating filesystem with 204800 1k blocks and 51200 inodes
Filesystem UUID: 72a83bb7-a7a1-4de7-868b-5d309e3028d0
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345, 73729

Allocating group tables:  0/25     done                            
Writing inode tables:  0/25     done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information:  0/25     done

/tmp/f40.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=72a83bb7-a7a1-4de7-868b-5d309e3028d0 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d40.sanity-pcc/d40.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={100}
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.790662 s, 66.3 MB/s
  100 - /mnt/lustre/d40.sanity-pcc/f40.sanity-pcc
file: /mnt/lustre/d40.sanity-pcc/f40.sanity-pcc, type: none
ldlm.namespaces.lustre-OST0000-osc-ffff927e83f39000.lru_size=clear
ldlm.namespaces.lustre-OST0000-osc-ffff927ea0953800.lru_size=clear
ldlm.namespaces.lustre-OST0001-osc-ffff927e83f39000.lru_size=clear
ldlm.namespaces.lustre-OST0001-osc-ffff927ea0953800.lru_size=clear
osc.lustre-OST0000-osc-ffff927e83f39000.stats=clear
osc.lustre-OST0000-osc-ffff927ea0953800.stats=clear
osc.lustre-OST0001-osc-ffff927e83f39000.stats=clear
osc.lustre-OST0001-osc-ffff927ea0953800.stats=clear
fail_val=1
fail_loc=0x214
llite.lustre-ffff927e83f39000.pcc_async_threshold=5MB
llite.lustre-ffff927ea0953800.pcc_async_threshold=5MB
Test open attach with pcc_async_threshold=5MB
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 2.11889 s, 495 kB/s
Before: 0 After: 3
file: /mnt/lustre/d40.sanity-pcc/f40.sanity-pcc, type: none, flags: attaching
/home/green/git/lustre-release/lustre/utils/lfs pcc state /mnt/lustre/d40.sanity-pcc/f40.sanity-pcc | grep -E -c 'type: readonly'
Waiting 50s for '1'
Updated after 9s: want '1' got '1'
file: /mnt/lustre/d40.sanity-pcc/f40.sanity-pcc, type: none
llite.lustre-ffff927e83f39000.pcc_async_threshold=1G
llite.lustre-ffff927ea0953800.pcc_async_threshold=1G
ldlm.namespaces.lustre-OST0000-osc-ffff927e83f39000.lru_size=clear
ldlm.namespaces.lustre-OST0000-osc-ffff927ea0953800.lru_size=clear
ldlm.namespaces.lustre-OST0001-osc-ffff927e83f39000.lru_size=clear
ldlm.namespaces.lustre-OST0001-osc-ffff927ea0953800.lru_size=clear
osc.lustre-OST0000-osc-ffff927e83f39000.stats=clear
osc.lustre-OST0000-osc-ffff927ea0953800.stats=clear
osc.lustre-OST0001-osc-ffff927e83f39000.stats=clear
osc.lustre-OST0001-osc-ffff927ea0953800.stats=clear
Test open attach with async_threshold=1G
file: /mnt/lustre/d40.sanity-pcc/f40.sanity-pcc, type: readonly, PCC_file: /d40.sanity-pcc/61c3/0x2000061c1:0x2:0x0, open_count: 0, flags: 0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149971 s, 69.9 MB/s
Before: 50 After: 50
Time1: 3 Time2: 11
file: /mnt/lustre/d40.sanity-pcc/f40.sanity-pcc, type: none
llite.lustre-ffff927e83f39000.pcc_async_threshold=5MB
llite.lustre-ffff927ea0953800.pcc_async_threshold=5MB
ldlm.namespaces.lustre-OST0000-osc-ffff927e83f39000.lru_size=clear
ldlm.namespaces.lustre-OST0000-osc-ffff927ea0953800.lru_size=clear
ldlm.namespaces.lustre-OST0001-osc-ffff927e83f39000.lru_size=clear
ldlm.namespaces.lustre-OST0001-osc-ffff927ea0953800.lru_size=clear
Read 1MB data with async_threshold=5MB
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 1.08988 s, 962 kB/s
/home/green/git/lustre-release/lustre/utils/lfs pcc state /mnt/lustre/d40.sanity-pcc/f40.sanity-pcc | grep -E -c 'type: readonly'
Waiting 50s for '1'
Updated after 9s: want '1' got '1'
file: /mnt/lustre/d40.sanity-pcc/f40.sanity-pcc, type: none
llite.lustre-ffff927e83f39000.pcc_async_threshold=1G
llite.lustre-ffff927ea0953800.pcc_async_threshold=1G
ldlm.namespaces.lustre-OST0000-osc-ffff927e83f39000.lru_size=clear
ldlm.namespaces.lustre-OST0000-osc-ffff927ea0953800.lru_size=clear
ldlm.namespaces.lustre-OST0001-osc-ffff927e83f39000.lru_size=clear
ldlm.namespaces.lustre-OST0001-osc-ffff927ea0953800.lru_size=clear
Read 1MB data with async_threshold=1G
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151622 s, 69.2 MB/s
Time1: 2 Time2: 10
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d40.sanity-pcc is idle now
PASS 40 (135s)

== sanity-pcc test 41: Test mtime rule for PCC-RO open attach with O_RDONLY mode ========================================================== 15:18:08 (1761247088)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0949792 s, 552 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d41.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: f8eea128-51c0-44b7-b601-7cc9c5e5ff14
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f41.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=f8eea128-51c0-44b7-b601-7cc9c5e5ff14 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d41.sanity-pcc/d41.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: mtime>{1m}
pcc_ro_data
pcc_ro_data
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d41.sanity-pcc is idle now
PASS 41 (7s)

== sanity-pcc test 42: PCC attach without attach ID specified ========================================================== 15:18:15 (1761247095)
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.157547 s, 399 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d42.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: 4d44e7e2-0581-4552-a5cb-32e49eb4fa29
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f42.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=4d44e7e2-0581-4552-a5cb-32e49eb4fa29 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d42.sanity-pcc/d42.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={100}
file: /mnt/lustre/f42.sanity-pcc, type: readonly, PCC_file: /d42.sanity-pcc/61c5/0x2000061c1:0x4:0x0, open_count: 0, flags: 0
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d42.sanity-pcc is idle now
PASS 42 (7s)

== sanity-pcc test 43: Auto attach at open() should add capacity owner check ========================================================== 15:18:22 (1761247102)
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.129427 s, 486 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d43.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: 8a70dddc-8325-4131-90bc-8f783cf08421
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f43.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=8a70dddc-8325-4131-90bc-8f783cf08421 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d43.sanity-pcc/d43.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: size<{100M}
file: /mnt/lustre/f43.sanity-pcc, type: none
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-r] [/mnt/lustre/f43.sanity-pcc]
lfs pcc pcc: cannot attach the file to PCC with ID 0 failed: Operation not permitted (1)
attach: cannot attach '/mnt/lustre/f43.sanity-pcc' to PCC with attach ID '0': Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/f43.sanity-pcc]
file: /mnt/lustre/f43.sanity-pcc, type: none
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d43.sanity-pcc is idle now
PASS 43 (6s)

== sanity-pcc test 44: Verify valid auto attach without re-fetching the whole files ========================================================== 15:18:28 (1761247108)
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.137341 s, 458 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d44.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: 6cd18c07-57b6-4778-bf08-1ef0054b1ee8
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f44.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=6cd18c07-57b6-4778-bf08-1ef0054b1ee8 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d44.sanity-pcc/d44.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
llite.lustre-ffff927e83f39000.pcc_async_threshold=0
llite.lustre-ffff927ea0953800.pcc_async_threshold=0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.881188 s, 59.5 MB/s
/mnt/lustre/f44.sanity-pcc
lmm_magic:         0x0BD10BD0
lmm_seq:           0x2000061c1
lmm_object_id:     0x6
lmm_fid:           [0x2000061c1:0x6:0x0]
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    0
lmm_stripe_offset: 1
	obdidx		 objid		 objid		 group
	     1	           452	        0x1c4	   0x280000400

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.526639 s, 99.6 MB/s50+0 records in
50+0 records out

52428800 bytes (52 MB, 50 MiB) copied, 0.53741 s, 97.6 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.52402 s, 100 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.613099 s, 85.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.598454 s, 87.6 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.607681 s, 86.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.564277 s, 92.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.567168 s, 92.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.586377 s, 89.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.583048 s, 89.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.67105 s, 78.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.598816 s, 87.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.635238 s, 82.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.623636 s, 84.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.713316 s, 73.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.656015 s, 79.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0602571 s, 870 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118046 s, 444 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0508982 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.207463 s, 253 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.225051 s, 233 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.199571 s, 263 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.233755 s, 224 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.199694 s, 263 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.235812 s, 222 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.301016 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.225934 s, 232 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.297833 s, 176 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.03964 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.423395 s, 124 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.388971 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0592866 s, 884 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.314778 s, 167 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0624462 s, 840 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.405635 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0478092 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0660267 s, 794 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100414 s, 522 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0970676 s, 540 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0832826 s, 630 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0880634 s, 595 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0839086 s, 625 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0413178 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0472413 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0983195 s, 533 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0977579 s, 536 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0815492 s, 643 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.139823 s, 375 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.148812 s, 352 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.122161 s, 429 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.140061 s, 374 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0466187 s, 1.1 GB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.267517 s, 196 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.270209 s, 194 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.191501 s, 274 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.240808 s, 218 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0483997 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120535 s, 435 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0763921 s, 686 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.265922 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0401361 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0718567 s, 730 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0431477 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0574492 s, 913 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0719751 s, 728 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0513184 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0550816 s, 952 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0989613 s, 530 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.074951 s, 700 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0713565 s, 735 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.11367 s, 461 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.130856 s, 401 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0861463 s, 609 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0695523 s, 754 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0478543 s, 1.1 GB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.156165 s, 336 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.12938 s, 405 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.040481 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.165524 s, 317 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.102769 s, 510 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0993416 s, 528 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0698235 s, 751 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0868262 s, 604 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0999227 s, 525 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.092017 s, 570 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0565262 s, 928 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118312 s, 443 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113593 s, 462 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12913 s, 406 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0596543 s, 879 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.122018 s, 430 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.165202 s, 317 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0399756 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.164587 s, 319 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.11173 s, 469 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0864047 s, 607 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.197304 s, 266 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0914497 s, 573 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.202077 s, 259 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0804007 s, 652 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0905421 s, 579 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.117923 s, 445 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.127953 s, 410 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0895954 s, 585 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.166481 s, 315 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0611614 s, 857 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.11199 s, 468 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110858 s, 473 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.168264 s, 312 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.072127 s, 727 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.155047 s, 338 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.177446 s, 295 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.14884 s, 352 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0388606 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0729775 s, 718 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.102682 s, 511 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126258 s, 415 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.167375 s, 313 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0691056 s, 759 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.10449 s, 502 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.232678 s, 225 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.204516 s, 256 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.166204 s, 315 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.15148 s, 346 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106259 s, 493 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0754621 s, 695 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.170806 s, 307 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.187174 s, 280 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.187819 s, 279 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.048554 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.139688 s, 375 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103539 s, 506 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0379798 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0576578 s, 909 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0429305 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0547243 s, 958 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0453519 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0789474 s, 664 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.138796 s, 378 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0916469 s, 572 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.160535 s, 327 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.202237 s, 259 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0555482 s, 944 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0695124 s, 754 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.108111 s, 485 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0993072 s, 528 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123568 s, 424 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106246 s, 493 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0951702 s, 551 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.112501 s, 466 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.212649 s, 247 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.22467 s, 233 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.102895 s, 510 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120768 s, 434 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.249 s, 211 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0825625 s, 635 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.13083 s, 401 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.16714 s, 314 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.176518 s, 297 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.138619 s, 378 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0703638 s, 745 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.18524 s, 283 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.182395 s, 287 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.128632 s, 408 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.052493 s, 999 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0869924 s, 603 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107077 s, 490 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.137007 s, 383 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107326 s, 488 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.131228 s, 400 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0879902 s, 596 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110463 s, 475 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0506956 s, 1.0 GB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.138363 s, 379 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.129026 s, 406 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.203502 s, 258 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.195996 s, 267 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.142172 s, 369 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.260469 s, 201 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0992692 s, 528 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0453311 s, 1.2 GB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0519582 s, 1.0 GB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0979192 s, 535 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.335963 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0766233 s, 684 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0659219 s, 795 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0719143 s, 729 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0431273 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0708987 s, 739 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.198047 s, 265 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0726865 s, 721 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.212608 s, 247 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.143029 s, 367 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.255688 s, 205 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0741448 s, 707 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.209087 s, 251 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0667242 s, 786 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.275568 s, 190 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.14413 s, 364 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0608374 s, 862 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.257342 s, 204 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0685605 s, 765 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0711344 s, 737 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.328164 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.290209 s, 181 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0343824 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107584 s, 487 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126553 s, 414 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.106476 s, 492 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113976 s, 460 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.145252 s, 361 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0687405 s, 763 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0647952 s, 809 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0564382 s, 929 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0865077 s, 606 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.086788 s, 604 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.106349 s, 493 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.163747 s, 320 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121966 s, 430 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.258283 s, 203 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.253902 s, 206 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.165803 s, 316 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.303906 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.130852 s, 401 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.189361 s, 277 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.262963 s, 199 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108483 s, 483 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.192881 s, 272 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.187321 s, 280 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103795 s, 505 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.287627 s, 182 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.271272 s, 193 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146498 s, 358 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.158832 s, 330 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0833621 s, 629 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.132002 s, 397 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.211485 s, 248 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.185815 s, 282 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.199416 s, 263 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.157248 s, 333 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.147677 s, 355 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.117674 s, 446 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.10406 s, 504 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.168808 s, 311 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.186782 s, 281 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.183097 s, 286 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.175312 s, 299 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.222205 s, 236 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0855201 s, 613 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0851299 s, 616 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.208996 s, 251 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.257054 s, 204 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0599448 s, 875 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.201168 s, 261 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0679557 s, 772 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120745 s, 434 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.124566 s, 421 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0433738 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.245754 s, 213 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105963 s, 495 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0952362 s, 551 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126479 s, 415 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0417105 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.184132 s, 285 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.142608 s, 368 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.15992 s, 328 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.081615 s, 642 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.164769 s, 318 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.236072 s, 222 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.180081 s, 291 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146895 s, 357 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.302088 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.172074 s, 305 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.338301 s, 155 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.234519 s, 224 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.41752 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.15114 s, 347 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12475 s, 420 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.168811 s, 311 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153346 s, 342 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153851 s, 341 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.244388 s, 215 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.208782 s, 251 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0622215 s, 843 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0878496 s, 597 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0605512 s, 866 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0766514 s, 684 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.174428 s, 301 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0821412 s, 638 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.216974 s, 242 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0982059 s, 534 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.122968 s, 426 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.206096 s, 254 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0895737 s, 585 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0681968 s, 769 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.164393 s, 319 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.226104 s, 232 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.1576 s, 333 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.169366 s, 310 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0476285 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0623767 s, 841 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0928425 s, 565 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.122083 s, 429 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.101109 s, 519 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.182698 s, 287 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.189893 s, 276 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.159985 s, 328 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.203791 s, 257 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.225807 s, 232 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.183204 s, 286 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.13166 s, 398 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0731951 s, 716 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.225495 s, 233 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.182143 s, 288 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.194899 s, 269 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0983023 s, 533 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121574 s, 431 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.104013 s, 504 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0513387 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0684042 s, 766 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120342 s, 436 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114975 s, 456 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136451 s, 384 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.115271 s, 455 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0925162 s, 567 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.133601 s, 392 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.242593 s, 216 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110804 s, 473 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.112437 s, 466 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126369 s, 415 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0836407 s, 627 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.091594 s, 572 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.195755 s, 268 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0527986 s, 993 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0635515 s, 825 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0770374 s, 681 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0373315 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.139875 s, 375 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.125637 s, 417 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0444785 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121024 s, 433 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0401868 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.167862 s, 312 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.1584 s, 331 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.059761 s, 877 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.134393 s, 390 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.192912 s, 272 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0473332 s, 1.1 GB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.149216 s, 351 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0508764 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0839562 s, 624 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0541901 s, 967 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0540985 s, 969 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0856609 s, 612 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126712 s, 414 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111932 s, 468 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0813268 s, 645 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108517 s, 483 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118178 s, 444 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120194 s, 436 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107118 s, 489 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0937067 s, 559 MB/s50+0 records in
50+0 records out

52428800 bytes (52 MB, 50 MiB) copied, 0.116361 s, 451 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136851 s, 383 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.117051 s, 448 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.228755 s, 229 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12345 s, 425 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0323889 s, 1.6 GB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.160705 s, 326 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0677511 s, 774 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0952731 s, 550 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0431917 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0546582 s, 959 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.191313 s, 274 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.244272 s, 215 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0630299 s, 832 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.172579 s, 304 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.185018 s, 283 MB/s

52428800 bytes (52 MB, 50 MiB) copied, 0.215468 s, 243 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.211303 s, 248 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120523 s, 435 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.261687 s, 200 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.148857 s, 352 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.20019 s, 262 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.277466 s, 189 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.205694 s, 255 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123535 s, 424 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.230141 s, 228 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.191374 s, 274 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.211251 s, 248 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.138815 s, 378 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.190708 s, 275 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.268986 s, 195 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.231687 s, 226 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136791 s, 383 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.210471 s, 249 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103486 s, 507 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0854674 s, 613 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0794704 s, 660 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.163207 s, 321 MB/s50+0 records in
50+0 records out

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.03942 s, 1.3 GB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.180476 s, 291 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.124703 s, 420 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.185606 s, 282 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0853565 s, 614 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0439445 s, 1.2 GB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.1595 s, 329 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.159923 s, 328 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.156579 s, 335 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.239643 s, 219 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.103858 s, 505 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0970517 s, 540 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.396837 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.323964 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.129505 s, 405 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.31662 s, 166 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.267015 s, 196 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.269496 s, 195 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.299625 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120577 s, 435 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.196877 s, 266 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0585324 s, 896 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0784357 s, 668 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126761 s, 414 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0938294 s, 559 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.177454 s, 295 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.161365 s, 325 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0991803 s, 529 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.141381 s, 371 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.10598 s, 495 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105292 s, 498 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123517 s, 424 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0967103 s, 542 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120197 s, 436 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.127938 s, 410 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.295998 s, 177 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0817539 s, 641 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.333753 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.208455 s, 252 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.104036 s, 504 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0433049 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0500272 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0380989 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110228 s, 476 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.072051 s, 728 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.148684 s, 353 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.05149 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0597024 s, 878 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.150226 s, 349 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0918786 s, 571 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.154867 s, 339 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.112314 s, 467 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100759 s, 520 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0373375 s, 1.4 GB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.220889 s, 237 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.219247 s, 239 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0622419 s, 842 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0918737 s, 571 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12747 s, 411 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146763 s, 357 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106752 s, 491 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0670764 s, 782 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0704399 s, 744 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0609438 s, 860 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.074116 s, 707 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0251748 s, 2.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.112015 s, 468 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.14204 s, 369 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.15374 s, 341 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0941354 s, 557 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.144009 s, 364 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0755226 s, 694 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146291 s, 358 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.104294 s, 503 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.159037 s, 330 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.2 s, 262 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.124763 s, 420 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0945191 s, 555 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.12058 s, 435 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.237808 s, 220 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123068 s, 426 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0946202 s, 554 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106015 s, 495 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.148054 s, 354 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.116454 s, 450 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0512736 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0634769 s, 826 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0386065 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0432309 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0339423 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0352592 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0286656 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0603674 s, 868 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0691971 s, 758 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0977043 s, 537 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.119064 s, 440 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0493061 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0994082 s, 527 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120847 s, 434 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.180638 s, 290 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.21565 s, 243 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.229846 s, 228 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.197634 s, 265 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0895174 s, 586 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.213914 s, 245 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.109221 s, 480 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.182733 s, 287 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113123 s, 463 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0666337 s, 787 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0340981 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.112999 s, 464 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.109483 s, 479 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0759665 s, 690 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0648428 s, 809 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.141477 s, 371 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.188837 s, 278 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0354313 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.162193 s, 323 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0372096 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0378337 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0758299 s, 691 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0421351 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110962 s, 472 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0727931 s, 720 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0715346 s, 733 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.173625 s, 302 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0572355 s, 916 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.116654 s, 449 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.104592 s, 501 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.141299 s, 371 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121759 s, 431 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0667912 s, 785 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.249016 s, 211 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.15084 s, 348 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.157767 s, 332 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.138443 s, 379 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.193709 s, 271 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.077467 s, 677 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103167 s, 508 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.157181 s, 334 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126466 s, 415 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12718 s, 412 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.196467 s, 267 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.063409 s, 827 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.177512 s, 295 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.17441 s, 301 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.247565 s, 212 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.15626 s, 336 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0660703 s, 794 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0500645 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0533203 s, 983 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0569312 s, 921 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0860063 s, 610 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.128607 s, 408 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.188077 s, 279 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118604 s, 442 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.195689 s, 268 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.165123 s, 318 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.164306 s, 319 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.131157 s, 400 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.318592 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0496941 s, 1.1 GB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.21726 s, 241 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.274481 s, 191 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.22614 s, 232 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.246727 s, 212 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.158879 s, 330 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0570259 s, 919 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.032677 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.13677 s, 383 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.149921 s, 350 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0840599 s, 624 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113235 s, 463 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0813868 s, 644 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.149065 s, 352 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.239368 s, 219 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.11667 s, 449 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.143101 s, 366 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113498 s, 462 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.134472 s, 390 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.122613 s, 428 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.236939 s, 221 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.215521 s, 243 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.206223 s, 254 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.230557 s, 227 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.109903 s, 477 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113221 s, 463 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107465 s, 488 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.101559 s, 516 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.184393 s, 284 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.14356 s, 365 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0514925 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0882504 s, 594 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0319363 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.117313 s, 447 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.212365 s, 247 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.221868 s, 236 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.228643 s, 229 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.2641 s, 199 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.205895 s, 255 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107009 s, 490 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.142819 s, 367 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.212314 s, 247 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.230973 s, 227 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.124531 s, 421 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0389594 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.135962 s, 386 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.116969 s, 448 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.104447 s, 502 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0710478 s, 738 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0605643 s, 866 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0395862 s, 1.3 GB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.118423 s, 443 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.073551 s, 713 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.134443 s, 390 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.195517 s, 268 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113236 s, 463 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0755303 s, 694 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.13815 s, 380 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.172183 s, 304 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.182834 s, 287 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.176257 s, 297 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.261478 s, 201 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.212475 s, 247 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.306297 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107907 s, 486 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.339991 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146422 s, 358 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.145992 s, 359 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113773 s, 461 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.160856 s, 326 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12366 s, 424 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.170733 s, 307 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.218899 s, 240 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.263447 s, 199 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0823105 s, 637 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103298 s, 508 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.066915 s, 784 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0506871 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.102132 s, 513 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.194221 s, 270 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.145496 s, 360 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0611456 s, 857 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0684274 s, 766 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.343638 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.249041 s, 211 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.109962 s, 477 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0776453 s, 675 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.13356 s, 393 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153168 s, 342 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.213692 s, 245 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.147123 s, 356 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0828289 s, 633 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0317781 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0702787 s, 746 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.043865 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111482 s, 470 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.133802 s, 392 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.269075 s, 195 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.187277 s, 280 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.301253 s, 174 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.286401 s, 183 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.207212 s, 253 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103501 s, 507 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.262166 s, 200 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.236925 s, 221 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.192725 s, 272 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.207265 s, 253 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114578 s, 458 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0625718 s, 838 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.179691 s, 292 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.115095 s, 456 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.171232 s, 306 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110828 s, 473 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0886789 s, 591 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.116884 s, 449 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.171987 s, 305 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.143665 s, 365 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.125316 s, 418 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100412 s, 522 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0570187 s, 920 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0861116 s, 609 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0330348 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0472002 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0529231 s, 991 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0579779 s, 904 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0333185 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.071941 s, 729 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0650221 s, 806 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0969839 s, 541 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0633224 s, 828 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0966339 s, 543 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0354233 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0761026 s, 689 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136833 s, 383 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.138234 s, 379 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.156468 s, 335 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118832 s, 441 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123043 s, 426 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.163616 s, 320 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.186871 s, 281 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.138466 s, 379 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.256313 s, 205 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0715601 s, 733 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0596691 s, 879 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0637941 s, 822 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.125818 s, 417 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0351593 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.137109 s, 382 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0393151 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0449912 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0652361 s, 804 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0757772 s, 692 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0720958 s, 727 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0572762 s, 915 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0471915 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0395184 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0441744 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0878071 s, 597 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103702 s, 506 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0919546 s, 570 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0720322 s, 728 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0730385 s, 718 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0687546 s, 763 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0959144 s, 547 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110989 s, 472 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0968148 s, 542 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0401093 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0288185 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0331829 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0511173 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0318236 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0442733 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0428068 s, 1.2 GB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.116708 s, 449 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.119504 s, 439 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0618387 s, 848 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0899858 s, 583 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.16173 s, 324 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.204604 s, 256 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0697967 s, 751 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0749839 s, 699 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106379 s, 493 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.119512 s, 439 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0756288 s, 693 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0381202 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.112027 s, 468 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0688238 s, 762 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.168937 s, 310 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.102569 s, 511 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.117145 s, 448 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.11245 s, 466 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0322526 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0490721 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0465769 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0372914 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0309551 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0422194 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.037284 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0292756 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0360642 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0528161 s, 993 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0469878 s, 1.1 GB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.125643 s, 417 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.128737 s, 407 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100435 s, 522 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0561958 s, 933 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0499843 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103396 s, 507 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.13203 s, 397 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0474858 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0775548 s, 676 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0289911 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0914583 s, 573 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0903679 s, 580 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0339242 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0252783 s, 2.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.053577 s, 979 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0452464 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0400253 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0320536 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0749309 s, 700 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0593139 s, 884 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0687925 s, 762 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0540618 s, 970 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0441641 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0434142 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0282924 s, 1.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0414276 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0688808 s, 761 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0903109 s, 581 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0865823 s, 606 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106614 s, 492 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.137315 s, 382 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.13878 s, 378 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0924647 s, 567 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.178301 s, 294 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.145171 s, 361 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.160812 s, 326 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.13913 s, 377 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.13103 s, 400 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.134497 s, 390 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0472018 s, 1.1 GB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105885 s, 495 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.113376 s, 462 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105678 s, 496 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0834441 s, 628 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0300801 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0951147 s, 551 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.1659 s, 316 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.155027 s, 338 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.194605 s, 269 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.046136 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0697242 s, 752 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0649932 s, 807 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.316292 s, 166 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0857433 s, 611 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0942949 s, 556 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.138278 s, 379 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.118248 s, 443 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0441502 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0490966 s, 1.1 GB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126693 s, 414 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0884701 s, 593 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103493 s, 507 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.152662 s, 343 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.138117 s, 380 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153236 s, 342 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.137553 s, 381 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136714 s, 383 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.142102 s, 369 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121423 s, 432 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121281 s, 432 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0383125 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0954291 s, 549 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111321 s, 471 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.0438806 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.116914 s, 448 MB/s

50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0348262 s, 1.5 GB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0783157 s, 669 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0774426 s, 677 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0984706 s, 532 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.102517 s, 511 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0618565 s, 848 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0865749 s, 606 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106988 s, 490 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0331622 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0318636 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.094928 s, 552 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0888908 s, 590 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0305882 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0499486 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0858121 s, 611 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.088787 s, 591 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.116035 s, 452 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.140385 s, 373 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.157975 s, 332 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.153793 s, 341 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.189538 s, 277 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.137336 s, 382 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.266776 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.129007 s, 406 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.157241 s, 333 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.191615 s, 274 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.115527 s, 454 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.179116 s, 293 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.177565 s, 295 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.231685 s, 226 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.156451 s, 335 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118474 s, 443 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.070246 s, 746 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.130049 s, 403 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.208515 s, 251 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.117175 s, 447 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.18235 s, 288 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.070012 s, 749 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.210798 s, 249 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.263472 s, 199 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.304226 s, 172 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.174729 s, 300 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.109126 s, 480 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.193835 s, 270 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.117605 s, 446 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.147672 s, 355 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.170479 s, 308 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.180773 s, 290 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.2142 s, 245 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.119998 s, 437 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0582505 s, 900 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0605821 s, 865 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0752074 s, 697 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0826012 s, 635 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136732 s, 383 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110919 s, 473 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0902281 s, 581 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.147435 s, 356 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.141186 s, 371 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0947067 s, 554 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107438 s, 488 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.14598 s, 359 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.175538 s, 299 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.090166 s, 581 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.254488 s, 206 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121212 s, 433 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.257639 s, 203 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.138341 s, 379 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.339839 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136142 s, 385 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.189159 s, 277 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.177687 s, 295 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.207344 s, 253 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.208982 s, 251 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.240412 s, 218 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.157576 s, 333 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.178347 s, 294 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.189592 s, 277 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.243625 s, 215 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.067933 s, 772 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.119069 s, 440 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0324951 s, 1.6 GB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.102213 s, 513 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.104328 s, 503 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0357554 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0845323 s, 620 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107694 s, 487 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110628 s, 474 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.134542 s, 390 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.124367 s, 422 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.168037 s, 312 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.145836 s, 360 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.188561 s, 278 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.167512 s, 313 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.1362 s, 385 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.297168 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.231555 s, 226 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.176792 s, 297 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.232125 s, 226 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.363663 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.240573 s, 218 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.373245 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.144524 s, 363 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.134236 s, 391 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.372845 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.170396 s, 308 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.203135 s, 258 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0738429 s, 710 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.132281 s, 396 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.16308 s, 321 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.156538 s, 335 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.196286 s, 267 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.278441 s, 188 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0698676 s, 750 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0674328 s, 777 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.104937 s, 500 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0721864 s, 726 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0300444 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.157698 s, 332 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.183072 s, 286 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217023 s, 242 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.246885 s, 212 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0751034 s, 698 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.20893 s, 251 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.237382 s, 221 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.336567 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.286124 s, 183 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.15309 s, 342 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.435635 s, 120 MB/s50+0 records in
50+0 records out

52428800 bytes (52 MB, 50 MiB) copied, 0.411557 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.180707 s, 290 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.24912 s, 210 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.390604 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.390875 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.119753 s, 438 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.237962 s, 220 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.257401 s, 204 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.390264 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.224951 s, 233 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.163662 s, 320 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103814 s, 505 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.124267 s, 422 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12925 s, 406 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107408 s, 488 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.138739 s, 378 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.138351 s, 379 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0417109 s, 1.3 GB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0386306 s, 1.4 GB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0790726 s, 663 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.253005 s, 207 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.155379 s, 337 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.286295 s, 183 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0851963 s, 615 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.395812 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.049804 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0275554 s, 1.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0328962 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0829176 s, 632 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0853681 s, 614 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.137094 s, 382 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0886547 s, 591 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0567773 s, 923 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.133708 s, 392 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.178521 s, 294 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0280989 s, 1.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.163959 s, 320 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0727938 s, 720 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111833 s, 469 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.083866 s, 625 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.13211 s, 397 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.171708 s, 305 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0824238 s, 636 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.142577 s, 368 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0717654 s, 731 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.131685 s, 398 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0644146 s, 814 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110835 s, 473 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.215688 s, 243 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.139464 s, 376 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153237 s, 342 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0964242 s, 544 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.131841 s, 398 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105202 s, 498 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.178801 s, 293 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0883905 s, 593 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0911621 s, 575 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.182956 s, 287 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.19994 s, 262 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0784434 s, 668 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.249729 s, 210 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121619 s, 431 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.116976 s, 448 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.147591 s, 355 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.165662 s, 316 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.191757 s, 273 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103647 s, 506 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0564196 s, 929 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.117174 s, 447 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0690549 s, 759 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.193872 s, 270 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0458028 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.119286 s, 440 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.191373 s, 274 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.105088 s, 499 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136165 s, 385 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111066 s, 472 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.130251 s, 403 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.189693 s, 276 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.230754 s, 227 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.195405 s, 268 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.154807 s, 339 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.247902 s, 211 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.221021 s, 237 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.10836 s, 484 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0958741 s, 547 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.101587 s, 516 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105184 s, 498 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.102437 s, 512 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.197872 s, 265 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114722 s, 457 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.294904 s, 178 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.282597 s, 186 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.27673 s, 189 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114935 s, 456 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.212501 s, 247 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217793 s, 241 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.14071 s, 373 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.207153 s, 253 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.228856 s, 229 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.308891 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.132889 s, 395 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0564087 s, 929 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0733028 s, 715 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0518912 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0937619 s, 559 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.070476 s, 744 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0597817 s, 877 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0567616 s, 924 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.132247 s, 396 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0591985 s, 886 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0893958 s, 586 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0929709 s, 564 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0249154 s, 2.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.102982 s, 509 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.25163 s, 208 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.208662 s, 251 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105465 s, 497 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106166 s, 494 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.260935 s, 201 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.363269 s, 144 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.34345 s, 153 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.286187 s, 183 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0555407 s, 944 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.308426 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.523504 s, 100 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.369013 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.507984 s, 103 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0367817 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.168123 s, 312 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0364979 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.439256 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.083254 s, 630 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.202295 s, 259 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0806972 s, 650 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.165375 s, 317 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0263969 s, 2.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.11468 s, 457 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.140282 s, 374 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0549422 s, 954 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105316 s, 498 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.139681 s, 375 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.29448 s, 178 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.207763 s, 252 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108043 s, 485 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0639764 s, 820 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.22747 s, 230 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153659 s, 341 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.271541 s, 193 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.332615 s, 158 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.119704 s, 438 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.22421 s, 234 MB/s50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.17083 s, 307 MB/s

52428800 bytes (52 MB, 50 MiB) copied, 0.192591 s, 272 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.228909 s, 229 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.191242 s, 274 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.259469 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.221285 s, 237 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146226 s, 359 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.144347 s, 363 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0810144 s, 647 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0865875 s, 606 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0700688 s, 748 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0801332 s, 654 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.190307 s, 275 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.256711 s, 204 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113165 s, 463 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0302097 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0962432 s, 545 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0765084 s, 685 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.182929 s, 287 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111638 s, 470 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0941749 s, 557 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.170122 s, 308 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.202388 s, 259 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.25489 s, 206 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.174513 s, 300 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0558736 s, 938 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0718166 s, 730 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.315585 s, 166 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.1527 s, 343 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0781468 s, 671 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0945053 s, 555 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0652347 s, 804 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.32323 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.135292 s, 388 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0639096 s, 820 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0697148 s, 752 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0662473 s, 791 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0427377 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.074514 s, 704 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0637383 s, 823 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.21363 s, 245 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0547587 s, 957 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0349987 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.133983 s, 391 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0937202 s, 559 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0706142 s, 742 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113013 s, 464 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.258374 s, 203 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.393283 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120862 s, 434 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0897875 s, 584 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.459314 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.332677 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.194942 s, 269 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.600922 s, 87.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.216699 s, 242 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0454129 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.184552 s, 284 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.074621 s, 703 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0569727 s, 920 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0913382 s, 574 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100823 s, 520 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0898163 s, 584 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.176482 s, 297 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.157901 s, 332 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.163075 s, 322 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0957513 s, 548 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.13923 s, 377 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.158226 s, 331 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.139145 s, 377 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.199982 s, 262 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.055915 s, 938 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.129303 s, 405 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.246042 s, 213 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.145236 s, 361 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.219873 s, 238 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.128601 s, 408 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.180402 s, 291 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0287705 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.213654 s, 245 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0950948 s, 551 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.27969 s, 187 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.189537 s, 277 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.27544 s, 190 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.293355 s, 179 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.134573 s, 390 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.325464 s, 161 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105266 s, 498 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0310857 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0309584 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.208977 s, 251 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.31742 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.302432 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.087594 s, 599 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0403559 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0509599 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.089469 s, 586 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0896892 s, 585 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0789232 s, 664 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0685429 s, 765 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.128197 s, 409 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.122997 s, 426 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.376164 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107266 s, 489 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0731605 s, 717 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.204273 s, 257 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0771515 s, 680 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.348778 s, 150 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.266084 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0358783 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0794316 s, 660 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.345579 s, 152 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.537976 s, 97.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0770969 s, 680 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.326897 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.346187 s, 151 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.393908 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118636 s, 442 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.139724 s, 375 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.598944 s, 87.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.635033 s, 82.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0190744 s, 2.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121813 s, 430 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.119856 s, 437 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0384905 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.226269 s, 232 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.310665 s, 169 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.171128 s, 306 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.116252 s, 451 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0670444 s, 782 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.206658 s, 254 MB/s50+0 records in
50+0 records out

52428800 bytes (52 MB, 50 MiB) copied, 0.22129 s, 237 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.300317 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.245483 s, 214 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.35215 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.162962 s, 322 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.128241 s, 409 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.349036 s, 150 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.330757 s, 159 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.307524 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0785108 s, 668 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0862559 s, 608 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.343915 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.133707 s, 392 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0441931 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.104454 s, 502 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.135451 s, 387 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0551107 s, 951 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0616835 s, 850 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.067643 s, 775 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0888813 s, 590 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.098389 s, 533 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.101018 s, 519 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.167196 s, 314 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0705954 s, 743 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0552794 s, 948 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.148438 s, 353 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.149011 s, 352 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.181648 s, 289 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0661807 s, 792 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.11788 s, 445 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.144149 s, 364 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.199494 s, 263 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.13627 s, 385 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.233115 s, 225 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.148882 s, 352 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.312272 s, 168 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.394359 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.431582 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.482276 s, 109 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.401385 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.272008 s, 193 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.189866 s, 276 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.345421 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.255738 s, 205 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0976446 s, 537 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0450048 s, 1.2 GB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.553805 s, 94.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.322026 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.174071 s, 301 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0631477 s, 830 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.162598 s, 322 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.158761 s, 330 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0806934 s, 650 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.180734 s, 290 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153612 s, 341 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.186085 s, 282 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.276346 s, 190 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.160932 s, 326 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136217 s, 385 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0714604 s, 734 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146223 s, 359 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.189718 s, 276 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.177717 s, 295 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.114795 s, 457 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118913 s, 441 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0510923 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.189167 s, 277 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.164924 s, 318 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121198 s, 433 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.122243 s, 429 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.112471 s, 466 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0610888 s, 858 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0744319 s, 704 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.141943 s, 369 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0936269 s, 560 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0913488 s, 574 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0477705 s, 1.1 GB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0475272 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.067192 s, 780 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0499755 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.07073 s, 741 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111794 s, 469 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0538665 s, 973 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.173063 s, 303 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0835313 s, 628 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0620372 s, 845 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.149655 s, 350 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.188741 s, 278 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0770769 s, 680 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.112127 s, 468 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.228839 s, 229 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.269856 s, 194 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0552336 s, 949 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.25416 s, 206 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0564849 s, 928 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.165549 s, 317 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.15671 s, 335 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.142971 s, 367 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.180004 s, 291 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0714026 s, 734 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.129334 s, 405 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126716 s, 414 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0457736 s, 1.1 GB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0611108 s, 858 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0693191 s, 756 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0563321 s, 931 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0300631 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0830612 s, 631 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0866163 s, 605 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0657539 s, 797 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0438311 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.207747 s, 252 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0758083 s, 692 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.22069 s, 238 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.143426 s, 366 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.242321 s, 216 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.247179 s, 212 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.215782 s, 243 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.022427 s, 2.3 GB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.318387 s, 165 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.29577 s, 177 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.304455 s, 172 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.325449 s, 161 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.439167 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.352656 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.28524 s, 184 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.469542 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.376713 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.117251 s, 447 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.247096 s, 212 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0934566 s, 561 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.174888 s, 300 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.202703 s, 259 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0887316 s, 591 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0710343 s, 738 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0862636 s, 608 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.129912 s, 404 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100561 s, 521 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.154279 s, 340 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.23911 s, 219 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0629076 s, 833 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.165292 s, 317 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.133672 s, 392 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136775 s, 383 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.205807 s, 255 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.33842 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.265635 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.26543 s, 198 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.159496 s, 329 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146945 s, 357 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.18267 s, 287 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.172244 s, 304 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.134459 s, 390 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.149769 s, 350 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.382945 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.156765 s, 334 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0810459 s, 647 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.763078 s, 68.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0379164 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.67247 s, 78.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.279652 s, 187 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.297183 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.327655 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.356056 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.449187 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.396646 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123704 s, 424 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.151099 s, 347 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.154533 s, 339 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.180626 s, 290 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.280399 s, 187 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.244292 s, 215 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.266262 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.273201 s, 192 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.168615 s, 311 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.176432 s, 297 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.357982 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217957 s, 241 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.874962 s, 59.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0573345 s, 914 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0563512 s, 930 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0834946 s, 628 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.259035 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0420663 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.116157 s, 451 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.242219 s, 216 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0970859 s, 540 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0422535 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0531179 s, 987 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.055375 s, 947 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0470394 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0967931 s, 542 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.03636 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.102098 s, 514 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.186781 s, 281 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0879881 s, 596 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0912071 s, 575 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.186419 s, 281 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.128587 s, 408 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.152733 s, 343 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0822164 s, 638 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0571987 s, 917 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0967435 s, 542 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0328587 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0381135 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0662997 s, 791 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0487025 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0968589 s, 541 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0600306 s, 873 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.272656 s, 192 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0227593 s, 2.3 GB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.176832 s, 296 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217042 s, 242 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.206058 s, 254 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.205897 s, 255 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106437 s, 493 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0779956 s, 672 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0765195 s, 685 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0983024 s, 533 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0443273 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.186224 s, 282 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.230483 s, 227 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.129778 s, 404 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0683986 s, 767 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0959141 s, 547 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0912612 s, 574 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0709178 s, 739 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0815798 s, 643 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0942738 s, 556 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.075515 s, 694 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0858246 s, 611 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0547089 s, 958 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0779156 s, 673 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0455307 s, 1.2 GB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153135 s, 342 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.153554 s, 341 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.208149 s, 252 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.224292 s, 234 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.090958 s, 576 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.129259 s, 406 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.246217 s, 213 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.175231 s, 299 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.191918 s, 273 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.185052 s, 283 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.152451 s, 344 MB/s50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.211776 s, 248 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217587 s, 241 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.155929 s, 336 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.142283 s, 368 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.10234 s, 512 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0379609 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0554259 s, 946 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0440898 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.137497 s, 381 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.195752 s, 268 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.240517 s, 218 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0638696 s, 821 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.118602 s, 442 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.171593 s, 306 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0978637 s, 536 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0549185 s, 955 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0444097 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.28077 s, 187 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.392582 s, 134 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.140359 s, 374 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.10997 s, 477 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.260759 s, 201 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.244247 s, 215 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.154692 s, 339 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.375454 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0838429 s, 625 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0347828 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0292947 s, 1.8 GB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.417507 s, 126 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.143863 s, 364 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.26155 s, 200 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.544172 s, 96.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.589591 s, 88.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0871295 s, 602 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.192672 s, 272 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.142006 s, 369 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0672525 s, 780 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.259521 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110061 s, 476 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.347327 s, 151 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.178098 s, 294 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.603373 s, 86.9 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.150095 s, 349 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126258 s, 415 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0573907 s, 914 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.492805 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.206203 s, 254 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.176067 s, 298 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103014 s, 509 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.101824 s, 515 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.265623 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.179554 s, 292 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0178783 s, 2.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.293846 s, 178 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0982403 s, 534 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.209577 s, 250 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.242446 s, 216 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0743628 s, 705 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0403365 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12149 s, 432 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.469873 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.194351 s, 270 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.165861 s, 316 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.416243 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.252711 s, 207 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.566187 s, 92.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.419782 s, 125 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.389732 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0914502 s, 573 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.201995 s, 260 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.144401 s, 363 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.259091 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.159623 s, 328 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.313027 s, 167 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.387135 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.502607 s, 104 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.453059 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0586716 s, 894 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.651951 s, 80.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.138337 s, 379 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0736912 s, 711 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.591614 s, 88.6 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.133899 s, 392 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.130419 s, 402 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.324266 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.144577 s, 363 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.328362 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106215 s, 494 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.133163 s, 394 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.117733 s, 445 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.203748 s, 257 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.129261 s, 406 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.321291 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.287612 s, 182 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0288461 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.312194 s, 168 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.331069 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0375104 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.145398 s, 361 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.246166 s, 213 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0777844 s, 674 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113377 s, 462 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0239029 s, 2.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0636289 s, 824 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103643 s, 506 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0540878 s, 969 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121052 s, 433 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100978 s, 519 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0791892 s, 662 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0613752 s, 854 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.135207 s, 388 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.177034 s, 296 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110301 s, 475 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.102444 s, 512 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.128397 s, 408 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108392 s, 484 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0609344 s, 860 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0742927 s, 706 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0934675 s, 561 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0540311 s, 970 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.143238 s, 366 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108017 s, 485 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.192759 s, 272 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.125983 s, 416 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.162037 s, 324 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.163689 s, 320 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.038573 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.156825 s, 334 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.300878 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118886 s, 441 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0290914 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0729843 s, 718 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0577943 s, 907 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.14858 s, 353 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.185311 s, 283 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0763636 s, 687 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.444553 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0767436 s, 683 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0246238 s, 2.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0632368 s, 829 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.252747 s, 207 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0616355 s, 851 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.318096 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.615683 s, 85.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0869175 s, 603 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0439102 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.074393 s, 705 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0672454 s, 780 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0506715 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.115466 s, 454 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114314 s, 459 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0548933 s, 955 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.083485 s, 628 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0457663 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0276344 s, 1.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0512432 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0528591 s, 992 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0612203 s, 856 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0435653 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0634578 s, 826 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0425156 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0802645 s, 653 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0376295 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0646917 s, 810 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.119307 s, 439 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0537078 s, 976 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.14824 s, 354 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.148215 s, 354 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0487552 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.138227 s, 379 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0889158 s, 590 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0665282 s, 788 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.115607 s, 454 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100262 s, 523 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.211375 s, 248 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.178906 s, 293 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.211858 s, 247 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153996 s, 340 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0611499 s, 857 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0554222 s, 946 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.116619 s, 450 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.208788 s, 251 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.323998 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0972054 s, 539 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.214581 s, 244 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.204089 s, 257 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.221069 s, 237 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.234112 s, 224 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.240856 s, 218 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113816 s, 461 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.162108 s, 323 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.055495 s, 945 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0491865 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.034719 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0652196 s, 804 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.028875 s, 1.8 GB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0499906 s, 1.0 GB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0735994 s, 712 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0814992 s, 643 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0848576 s, 618 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0379257 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0949551 s, 552 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.183994 s, 285 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.200163 s, 262 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0604591 s, 867 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0938406 s, 559 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.195866 s, 268 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.18265 s, 287 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0857296 s, 612 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105945 s, 495 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.272221 s, 193 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.148385 s, 353 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.155957 s, 336 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.130392 s, 402 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.166896 s, 314 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.267839 s, 196 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111103 s, 472 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0948947 s, 552 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.373189 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0725504 s, 723 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.258244 s, 203 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.359146 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12377 s, 424 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.115363 s, 454 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0861097 s, 609 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121497 s, 432 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.147629 s, 355 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.049063 s, 1.1 GB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0702375 s, 746 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0532617 s, 984 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0291436 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0363682 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0422167 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0397492 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0607697 s, 863 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0492948 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0623455 s, 841 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0788559 s, 665 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.133368 s, 393 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.112104 s, 468 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.133522 s, 393 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.139604 s, 376 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108995 s, 481 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.102666 s, 511 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0446609 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.127143 s, 412 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0973876 s, 538 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0682463 s, 768 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0802583 s, 653 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0961451 s, 545 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0848153 s, 618 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0785325 s, 668 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118147 s, 444 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0825057 s, 635 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.161152 s, 325 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0704247 s, 744 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0867957 s, 604 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12075 s, 434 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0520922 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.102579 s, 511 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.135795 s, 386 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0582038 s, 901 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0867771 s, 604 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.101731 s, 515 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.15253 s, 344 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.187245 s, 280 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.209575 s, 250 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.203381 s, 258 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114355 s, 458 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.159936 s, 328 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110672 s, 474 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0279031 s, 1.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0404833 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0380025 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0442094 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0428697 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.045218 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0451098 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0293447 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0399623 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0645909 s, 812 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0939991 s, 558 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0845806 s, 620 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.084443 s, 621 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0799874 s, 655 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.156947 s, 334 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.11748 s, 446 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105162 s, 499 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.177672 s, 295 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.075062 s, 698 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0870461 s, 602 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.120745 s, 434 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.101678 s, 516 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.117796 s, 445 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0557146 s, 941 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0377834 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0648143 s, 809 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.052964 s, 990 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0812807 s, 645 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0678662 s, 773 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0855201 s, 613 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0637086 s, 823 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0486959 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.036925 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0579112 s, 905 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0895774 s, 585 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.093009 s, 564 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0994975 s, 527 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120456 s, 435 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.147672 s, 355 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.119947 s, 437 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.164899 s, 318 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0855059 s, 613 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.197893 s, 265 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.191443 s, 274 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.265262 s, 198 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103455 s, 507 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.221493 s, 237 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0798356 s, 657 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0655266 s, 800 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.145842 s, 359 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.151296 s, 347 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.128551 s, 408 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.17013 s, 308 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0909761 s, 576 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0662863 s, 791 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.117128 s, 448 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0556993 s, 941 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0728474 s, 720 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0938536 s, 559 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0772601 s, 679 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.039997 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0833167 s, 629 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126335 s, 415 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153903 s, 341 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0941008 s, 557 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.140487 s, 373 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.048792 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0869594 s, 603 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.289469 s, 181 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.146709 s, 357 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0790517 s, 663 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.162798 s, 322 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.194705 s, 269 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.163799 s, 320 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.177472 s, 295 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153872 s, 341 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.048891 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0442911 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0465654 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0409507 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0709063 s, 739 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0669942 s, 783 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0885244 s, 592 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0712402 s, 736 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.1477 s, 355 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.150968 s, 347 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0744801 s, 704 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.140132 s, 374 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.19339 s, 271 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.128091 s, 409 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.122376 s, 428 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0928245 s, 565 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.101831 s, 515 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.104617 s, 501 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108519 s, 483 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0498727 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0520071 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0962425 s, 545 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105557 s, 497 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0977746 s, 536 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0857077 s, 612 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0656903 s, 798 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120826 s, 434 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136126 s, 385 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.121332 s, 432 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0965538 s, 543 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.117809 s, 445 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0425711 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0797348 s, 658 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0497941 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0465103 s, 1.1 GB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.104984 s, 499 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.159754 s, 328 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0903186 s, 580 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.115407 s, 454 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.129787 s, 404 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114508 s, 458 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0578797 s, 906 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103333 s, 507 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.223134 s, 235 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.11762 s, 446 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0969599 s, 541 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0914674 s, 573 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0453767 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0727559 s, 721 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.175443 s, 299 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153998 s, 340 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0595562 s, 880 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0518365 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0500923 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.039048 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0378651 s, 1.4 GB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.059931 s, 875 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0566251 s, 926 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0643061 s, 815 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0682209 s, 769 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0523125 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0881533 s, 595 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0782345 s, 670 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0861145 s, 609 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0893547 s, 587 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.117583 s, 446 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0535937 s, 978 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0697997 s, 751 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.18553 s, 283 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0280255 s, 1.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0959 s, 547 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0338838 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0277604 s, 1.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0813604 s, 644 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0658879 s, 796 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.161285 s, 325 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.150139 s, 349 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0736463 s, 712 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.19341 s, 271 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0926393 s, 566 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.163403 s, 321 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.292711 s, 179 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.16602 s, 316 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.308552 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.21863 s, 240 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.327365 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0825127 s, 635 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.169872 s, 309 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.182388 s, 287 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0828208 s, 633 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.215538 s, 243 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.322818 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.165445 s, 317 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.229814 s, 228 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.252251 s, 208 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111943 s, 468 MB/s

50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.242519 s, 216 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0962654 s, 545 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217545 s, 241 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12873 s, 407 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0943838 s, 555 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.102535 s, 511 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.112004 s, 468 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.164944 s, 318 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146375 s, 358 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118689 s, 442 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0516684 s, 1.0 GB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121783 s, 431 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.140853 s, 372 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0816453 s, 642 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0704339 s, 744 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107156 s, 489 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.116418 s, 450 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110811 s, 473 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.212475 s, 247 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.182282 s, 288 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.119586 s, 438 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.150851 s, 348 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153555 s, 341 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0515219 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.363932 s, 144 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.150721 s, 348 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.164943 s, 318 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0673524 s, 778 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0980819 s, 535 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0954294 s, 549 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108697 s, 482 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.344788 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0425888 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.276931 s, 189 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0787746 s, 666 MB/s
Finish ========
/mnt/lustre/f44.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x2000061c1
      lmm_object_id:     0x6
      lmm_fid:           [0x2000061c1:0x6:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x1c4:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
llite.lustre-ffff927e83f39000.stats=
snapshot_time             1761247171.763158311 secs.nsecs
start_time                1761247111.288216956 secs.nsecs
elapsed_time              60.474941355 secs.nsecs
read_bytes                100914 samples [bytes] 192512 1048576 105813901312 110953038054686720
read                      100912 samples [usecs] 227 372430 285053241 12144156562473
ioctl                     1 samples [reqs]
open                      2129 samples [usecs] 6 198703 12317502 566732278608
close                     2129 samples [usecs] 4 134588 2802526 118844618404
seek                      1973 samples [usecs] 3 1384 20555 5041705
setattr                   1 samples [usecs] 41868 41868 41868 1752929424
getattr                   17 samples [usecs] 183 14640 25253 259485773
mknod                     1 samples [usecs] 35142 35142 35142 1234960164
inode_permission          6151 samples [usecs] 1 120870 8015058 209806884252
opencount                 2130 samples [reqs] 1 2129 2267386 3218930906
openclosetime             2128 samples [usecs] 32 221423 59863319 3506966358053
hybrid_noswitch           100912 samples [reqs]
llite.lustre-ffff927ea0953800.stats=
snapshot_time             1761247171.763500781 secs.nsecs
start_time                1761247111.288326836 secs.nsecs
elapsed_time              60.475173945 secs.nsecs
attach 0 detach 0 auto_attach 0
llite.lustre-ffff927e83f39000.pcc_async_threshold=1073741824
llite.lustre-ffff927ea0953800.pcc_async_threshold=1073741824
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d44.sanity-pcc is idle now
PASS 44 (69s)

== sanity-pcc test 45: Concurrent read access from two mount points ========================================================== 15:19:37 (1761247177)
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 0.286736 s, 366 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d45.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:   8192/102400             done                            
Creating filesystem with 102400 1k blocks and 25584 inodes
Filesystem UUID: 09685893-1d17-41e2-be74-26f39a8bf746
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345, 73729

Allocating group tables:  0/13     done                            
Writing inode tables:  0/13     done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information:  0/13     done

/tmp/f45.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=09685893-1d17-41e2-be74-26f39a8bf746 (extents) (64bit) (large files) (huge files)
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 0.363118 s, 289 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
/tmp/f45.sanity-pcc on /mnt/pcc.d45.sanity-pcc type ext4 (rw,relatime,quota,usrquota,grpquota)
umount: /mnt/pcc.d45.sanity-pcc.2: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
/tmp/f45.sanity-pcc on /mnt/pcc.d45.sanity-pcc type ext4 (rw,relatime,quota,usrquota,grpquota)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:   8192/102400             done                            
Creating filesystem with 102400 1k blocks and 25584 inodes
Filesystem UUID: 47312c0a-4871-473d-9a1f-a41c88d11918
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345, 73729

Allocating group tables:  0/13     done                            
Writing inode tables:  0/13     done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information:  0/13     done

/tmp/f45.sanity-pcc.2: Linux rev 1.0 ext4 filesystem data, UUID=47312c0a-4871-473d-9a1f-a41c88d11918 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d45.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
pcc:
  -
    pccpath: /mnt/pcc.d45.sanity-pcc.2
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
llite.lustre-ffff927e83f39000.pcc_async_threshold=0
llite.lustre-ffff927ea0953800.pcc_async_threshold=0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.861712 s, 60.8 MB/s
/mnt/lustre/f45.sanity-pcc
lmm_magic:         0x0BD10BD0
lmm_seq:           0x2000061c1
lmm_object_id:     0x8
lmm_fid:           [0x2000061c1:0x8:0x0]
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    0
lmm_stripe_offset: 1
	obdidx		 objid		 objid		 group
	     1	           453	        0x1c5	   0x280000400

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.663614 s, 79.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.651874 s, 80.4 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.462725 s, 113 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.465434 s, 113 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.666089 s, 78.7 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.470945 s, 111 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.617565 s, 84.9 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.608996 s, 86.1 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.659268 s, 79.5 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.627704 s, 83.5 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.488862 s, 107 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.700332 s, 74.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.652864 s, 80.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.665252 s, 78.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.697379 s, 75.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.503504 s, 104 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.063363 s, 827 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0849074 s, 617 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.297809 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.140845 s, 372 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.237978 s, 220 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.292942 s, 179 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.291011 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.245406 s, 214 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.358942 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.156676 s, 335 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.382292 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.279488 s, 188 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.292977 s, 179 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.35017 s, 150 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.413982 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.296613 s, 177 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.313382 s, 167 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0580836 s, 903 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.262636 s, 200 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0422457 s, 1.2 GB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0368326 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0526218 s, 996 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.345387 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.441921 s, 119 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.194544 s, 269 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.399523 s, 131 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.313685 s, 167 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.39094 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.174543 s, 300 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.428384 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.272792 s, 192 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.276562 s, 190 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.232612 s, 225 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123726 s, 424 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.134728 s, 389 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0960752 s, 546 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.231098 s, 227 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.225448 s, 233 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.393903 s, 133 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.353178 s, 148 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.320585 s, 164 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.4879 s, 21.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.58617 s, 20.3 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.50926 s, 20.9 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 2.51762 s, 20.8 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 2.51595 s, 20.8 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 2.50897 s, 20.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.49905 s, 21.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.52035 s, 20.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.50947 s, 20.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.51693 s, 20.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.467267 s, 112 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.53399 s, 20.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.166562 s, 315 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 2.56102 s, 20.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.56072 s, 20.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.220849 s, 237 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.553501 s, 94.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.411229 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146178 s, 359 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.408927 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.279765 s, 187 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.180922 s, 290 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108689 s, 482 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.276513 s, 190 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136255 s, 385 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.166952 s, 314 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.167003 s, 314 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.151194 s, 347 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 3.01927 s, 17.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.298485 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.276335 s, 190 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.595546 s, 88.0 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 3.22669 s, 16.2 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.374888 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.391156 s, 134 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.316004 s, 166 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.507347 s, 103 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.374677 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.511969 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.337643 s, 155 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.433661 s, 121 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.453671 s, 116 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.642982 s, 81.5 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.346137 s, 151 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 3.44318 s, 15.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.466877 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.523402 s, 100 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.739664 s, 70.9 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.255148 s, 205 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.701075 s, 74.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.361066 s, 145 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.420425 s, 125 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.425208 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.557604 s, 94.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.279159 s, 188 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126136 s, 416 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.513017 s, 102 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.366647 s, 143 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.132011 s, 397 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.208133 s, 252 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.176255 s, 297 MB/s50+0 records in
50+0 records out

52428800 bytes (52 MB, 50 MiB) copied, 0.204046 s, 257 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.20233 s, 259 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.22693 s, 231 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.265972 s, 197 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.235605 s, 223 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.293731 s, 178 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.371742 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.42962 s, 122 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.35716 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.283768 s, 185 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.314875 s, 167 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.389017 s, 135 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.308898 s, 170 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.279672 s, 187 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.259436 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.315457 s, 166 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.29215 s, 179 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.367093 s, 143 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.358321 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.384619 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.383326 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.373924 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.423414 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.319198 s, 164 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.262309 s, 200 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.370255 s, 142 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.350207 s, 150 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.4489 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.192409 s, 272 MB/s50+0 records in
50+0 records out

52428800 bytes (52 MB, 50 MiB) copied, 0.252335 s, 208 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.24942 s, 210 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.322211 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217879 s, 241 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.167918 s, 312 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.275332 s, 190 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.192176 s, 273 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.344295 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.251225 s, 209 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.230146 s, 228 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111178 s, 472 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.243383 s, 215 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.234105 s, 224 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.109952 s, 477 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.242969 s, 216 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.261884 s, 200 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.310701 s, 169 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.294582 s, 178 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.278952 s, 188 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.232019 s, 226 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.243934 s, 215 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.163682 s, 320 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.276813 s, 189 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.254809 s, 206 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.190189 s, 276 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.295838 s, 177 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.223139 s, 235 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.294937 s, 178 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.214685 s, 244 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.278284 s, 188 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.258269 s, 203 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.233947 s, 224 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.259184 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.135683 s, 386 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.2898 s, 181 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.184554 s, 284 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.291411 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.249969 s, 210 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.317629 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.20363 s, 257 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.230286 s, 228 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.336213 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.308864 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.2833 s, 185 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.265727 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.269488 s, 195 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.227487 s, 230 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.200982 s, 261 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.305032 s, 172 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.317877 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.294748 s, 178 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.360111 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.248053 s, 211 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.369011 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.224627 s, 233 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.389444 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.434524 s, 121 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.379453 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.235375 s, 223 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.326166 s, 161 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.275678 s, 190 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.285185 s, 184 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.385485 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.402117 s, 130 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.329811 s, 159 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.234714 s, 223 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.282923 s, 185 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.377405 s, 139 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.410797 s, 128 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.231559 s, 226 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.367167 s, 143 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.37232 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.409202 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.384086 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.303917 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.416786 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.350847 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.292503 s, 179 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.291634 s, 180 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.406622 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.327412 s, 160 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.291143 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.218709 s, 240 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.363324 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.258504 s, 203 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.256134 s, 205 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.324113 s, 162 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.296712 s, 177 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.220837 s, 237 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.304383 s, 172 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.203353 s, 258 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.214247 s, 245 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103747 s, 505 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.175768 s, 298 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.311603 s, 168 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.181431 s, 289 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.253249 s, 207 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.168251 s, 312 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.169251 s, 310 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.269764 s, 194 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.212401 s, 247 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.226789 s, 231 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.29665 s, 177 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.378414 s, 139 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.294362 s, 178 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.32142 s, 163 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.332231 s, 158 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.450208 s, 116 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.460172 s, 114 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.369283 s, 142 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.341508 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.360022 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.401272 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.560768 s, 93.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.41393 s, 127 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.427996 s, 122 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.404973 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.42788 s, 123 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.451249 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.336677 s, 156 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.460018 s, 114 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.371617 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.473889 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.296197 s, 177 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.512545 s, 102 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.411286 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.397827 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.372472 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.461654 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.468841 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.377347 s, 139 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.252339 s, 208 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.48236 s, 109 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.282808 s, 185 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.354807 s, 148 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.232047 s, 226 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.406271 s, 129 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.281101 s, 187 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.361477 s, 145 MB/s50+0 records in
50+0 records out

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.425808 s, 123 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.348511 s, 150 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.414456 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.203285 s, 258 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.199627 s, 263 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.214385 s, 245 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.156115 s, 336 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.291176 s, 180 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.221796 s, 236 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.351103 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.188215 s, 279 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.325505 s, 161 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.203691 s, 257 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.170616 s, 307 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.165073 s, 318 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146024 s, 359 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.219191 s, 239 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.270795 s, 194 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.216839 s, 242 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.306785 s, 171 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.194158 s, 270 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.280643 s, 187 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.292162 s, 179 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.274979 s, 191 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.312699 s, 168 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.301023 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.337014 s, 156 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.386519 s, 136 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.369597 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.277107 s, 189 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.36015 s, 146 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.377731 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.329181 s, 159 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.37515 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.343313 s, 153 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.309519 s, 169 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.441013 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.341241 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.291551 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.382901 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.333987 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.472081 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.379368 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.30935 s, 169 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.307076 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.237493 s, 221 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.255187 s, 205 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.406534 s, 129 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.251097 s, 209 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.338562 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.215362 s, 243 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.202492 s, 259 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.141981 s, 369 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.303623 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.127153 s, 412 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.301335 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.306011 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.323868 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.227908 s, 230 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.163595 s, 320 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.283456 s, 185 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.198751 s, 264 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.23038 s, 228 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.296569 s, 177 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.276647 s, 190 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.348178 s, 151 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.235074 s, 223 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.312749 s, 168 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.344472 s, 152 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.367706 s, 143 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.307164 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.283835 s, 185 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.437539 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.387896 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.304446 s, 172 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.397066 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.402194 s, 130 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.370269 s, 142 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.35287 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.304346 s, 172 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.402799 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.390131 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.250338 s, 209 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.248176 s, 211 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.404694 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.22469 s, 233 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.477158 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.352275 s, 149 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.316159 s, 166 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.330694 s, 159 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.186558 s, 281 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.204031 s, 257 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.382204 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.401142 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.429298 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.260056 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.295956 s, 177 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.246843 s, 212 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.31045 s, 169 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.289045 s, 181 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.274192 s, 191 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.282729 s, 185 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.277092 s, 189 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.29901 s, 175 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.360136 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.369485 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.311586 s, 168 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.394132 s, 133 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.32923 s, 159 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.242418 s, 216 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.325695 s, 161 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.331981 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.324094 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.331871 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.328818 s, 159 MB/s50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.412638 s, 127 MB/s
50+0 records in
50+0 records out

52428800 bytes (52 MB, 50 MiB) copied, 0.362522 s, 145 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.328073 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.335869 s, 156 MB/s
50+0 records in
50+0 records out

52428800 bytes (52 MB, 50 MiB) copied, 0.331742 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.402402 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.304389 s, 172 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.29472 s, 178 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.433972 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.342553 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.322907 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.23675 s, 221 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.203128 s, 258 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.399364 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0826392 s, 634 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.266267 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.235878 s, 222 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.376282 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.199474 s, 263 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.329783 s, 159 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.413921 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.195686 s, 268 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.199251 s, 263 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.222112 s, 236 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.141828 s, 370 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.274666 s, 191 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118971 s, 441 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.145667 s, 360 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.233047 s, 225 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.203695 s, 257 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.402541 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.406667 s, 129 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.45563 s, 115 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.33823 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.494329 s, 106 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.327795 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.332989 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.443187 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.396079 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.360537 s, 145 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.393294 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.430876 s, 122 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.470314 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.519242 s, 101 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.333875 s, 157 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.490097 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.393612 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.422903 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.46563 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.45634 s, 115 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.411379 s, 127 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.486675 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.358981 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.331135 s, 158 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.412424 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.333811 s, 157 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.338343 s, 155 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.357059 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.20506 s, 256 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.331786 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.44764 s, 117 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.209091 s, 251 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.313475 s, 167 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.424162 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.450982 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.402 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.388488 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.407287 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.332714 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.352239 s, 149 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.259614 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.371998 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.319494 s, 164 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.218811 s, 240 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.359898 s, 146 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.309102 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.237831 s, 220 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.246611 s, 213 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217506 s, 241 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.34996 s, 150 MB/s
50+0 records in
50+0 records out

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.376584 s, 139 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.286973 s, 183 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.229749 s, 228 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.240296 s, 218 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.089351 s, 587 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.301926 s, 174 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.26665 s, 197 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.374524 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.11762 s, 446 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.335518 s, 156 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.352543 s, 149 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.179416 s, 292 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.335036 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.337373 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.276564 s, 190 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.293021 s, 179 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.154523 s, 339 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.286805 s, 183 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.236761 s, 221 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.259844 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.350703 s, 149 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.333654 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.37948 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.317602 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.213068 s, 246 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.381946 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.280439 s, 187 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.425918 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.250939 s, 209 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.448112 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.265374 s, 198 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.358804 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.26044 s, 201 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.323499 s, 162 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.285212 s, 184 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.272752 s, 192 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.361712 s, 145 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.345039 s, 152 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.332944 s, 157 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.204556 s, 256 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.160011 s, 328 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.405153 s, 129 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.501234 s, 105 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.211733 s, 248 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.39936 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.191644 s, 274 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.543448 s, 96.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.327023 s, 160 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.323416 s, 162 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.436714 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.487909 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.381651 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.095584 s, 549 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.423365 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.440593 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.445658 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.601902 s, 87.1 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.476358 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.458078 s, 114 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.498036 s, 105 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.492579 s, 106 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.295783 s, 177 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.519369 s, 101 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.445853 s, 118 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.348281 s, 151 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.507915 s, 103 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.339502 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.33598 s, 156 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.40517 s, 129 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.416669 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.143288 s, 366 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.447261 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.660555 s, 79.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.329612 s, 159 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.363312 s, 144 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.245398 s, 214 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.325427 s, 161 MB/s50+0 records in
50+0 records out

52428800 bytes (52 MB, 50 MiB) copied, 0.533056 s, 98.4 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.499963 s, 105 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.139927 s, 375 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.306267 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.388016 s, 135 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.272101 s, 193 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.340135 s, 154 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.314105 s, 167 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.449778 s, 117 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.211534 s, 248 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.345955 s, 152 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.316339 s, 166 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.399411 s, 131 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.431384 s, 122 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.451371 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.32927 s, 159 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.359915 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.36576 s, 143 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.354482 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.419422 s, 125 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.422881 s, 124 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.371175 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.358441 s, 146 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.455111 s, 115 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.454491 s, 115 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.50272 s, 104 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.396373 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.45674 s, 115 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.452411 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.424701 s, 123 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.424034 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.266392 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.449404 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.302363 s, 173 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.300293 s, 175 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.43068 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.378503 s, 139 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.344364 s, 152 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.415642 s, 126 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.427047 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.286578 s, 183 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.303626 s, 173 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.417298 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.272206 s, 193 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.358899 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.499012 s, 105 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.3028 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.431181 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.241977 s, 217 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.332148 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.276383 s, 190 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.30886 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.39917 s, 131 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.34826 s, 151 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.372298 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.317241 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.415723 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.305442 s, 172 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.315005 s, 166 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.378953 s, 138 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.377845 s, 139 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.35868 s, 146 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.275422 s, 190 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.337448 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.332123 s, 158 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.419421 s, 125 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.166895 s, 314 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.115378 s, 454 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.382072 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.251025 s, 209 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.457867 s, 115 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.233554 s, 224 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.333719 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.303618 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.339036 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.192641 s, 272 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.371462 s, 141 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.142196 s, 369 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.412098 s, 127 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.340066 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.360461 s, 145 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.276741 s, 189 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.28032 s, 187 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.33082 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.254088 s, 206 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.306864 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.26836 s, 195 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.530465 s, 98.8 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.204046 s, 257 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0940449 s, 557 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.361758 s, 145 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.289281 s, 181 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.291203 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.466883 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.286047 s, 183 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.272147 s, 193 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.362586 s, 145 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.307675 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.294979 s, 178 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.343238 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.459506 s, 114 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.382296 s, 137 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.477535 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.313562 s, 167 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.379977 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.436376 s, 120 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.535931 s, 97.8 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.376527 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.4558 s, 115 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.429214 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.428273 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.337683 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.283544 s, 185 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.38592 s, 136 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.451846 s, 116 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.327927 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.404346 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.411133 s, 128 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.527598 s, 99.4 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.31773 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.3039 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.471895 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.353972 s, 148 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.350154 s, 150 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.264499 s, 198 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.433793 s, 121 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.289469 s, 181 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.389159 s, 135 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.378202 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.309343 s, 169 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.28764 s, 182 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.470142 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.28549 s, 184 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.254456 s, 206 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.3451 s, 152 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.342262 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.24238 s, 216 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.370708 s, 141 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.276478 s, 190 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.368847 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.34482 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.350915 s, 149 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.592818 s, 88.4 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.531094 s, 98.7 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.474523 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.29565 s, 177 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.435649 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.436035 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.476363 s, 110 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.325925 s, 161 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.42312 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.273995 s, 191 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.314753 s, 167 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.397917 s, 132 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.307525 s, 170 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.313747 s, 167 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0524537 s, 1000 MB/s50+0 records in
50+0 records out

52428800 bytes (52 MB, 50 MiB) copied, 0.369013 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.352236 s, 149 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.27173 s, 193 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.329967 s, 159 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.184643 s, 284 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.201032 s, 261 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.237517 s, 221 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0952916 s, 550 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.419612 s, 125 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.16589 s, 316 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.181827 s, 288 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0788646 s, 665 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.186067 s, 282 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.116481 s, 450 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.0888396 s, 590 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.225246 s, 233 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.322332 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.263567 s, 199 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.225158 s, 233 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.317192 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.194292 s, 270 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.337113 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.301382 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.260727 s, 201 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.378282 s, 139 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.332932 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.202823 s, 258 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.399903 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.380923 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.478263 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.429765 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.370715 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.533846 s, 98.2 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.633907 s, 82.7 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.484207 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.408073 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.39141 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.513692 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.407694 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.429499 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.433713 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.471888 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.406902 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.440696 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.442487 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.320522 s, 164 MB/s50+0 records in
50+0 records out

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.380492 s, 138 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.479789 s, 109 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.515053 s, 102 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.443911 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.359436 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.398349 s, 132 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.20023 s, 262 MB/s50+0 records in
50+0 records out

52428800 bytes (52 MB, 50 MiB) copied, 0.263723 s, 199 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.277885 s, 189 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.155239 s, 338 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.441346 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.352263 s, 149 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.337666 s, 155 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.257307 s, 204 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.306853 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.223299 s, 235 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.226675 s, 231 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.219164 s, 239 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.248957 s, 211 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.194267 s, 270 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.302449 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.310646 s, 169 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.292451 s, 179 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.290194 s, 181 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.326348 s, 161 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.270326 s, 194 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.275572 s, 190 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.223245 s, 235 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.372871 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.182624 s, 287 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.191374 s, 274 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.353624 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.262088 s, 200 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.343619 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.395755 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.318269 s, 165 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.375514 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.277969 s, 189 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.372745 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.238734 s, 220 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.361909 s, 145 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.272785 s, 192 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.338196 s, 155 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.283591 s, 185 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.330124 s, 159 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.328137 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.383824 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.216518 s, 242 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.296524 s, 177 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.358293 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.220549 s, 238 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.331713 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.295666 s, 177 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.383492 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.398224 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.336349 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.230306 s, 228 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.279119 s, 188 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.290206 s, 181 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.329353 s, 159 MB/s50+0 records in
50+0 records out

52428800 bytes (52 MB, 50 MiB) copied, 0.302493 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.358216 s, 146 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.331626 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.284245 s, 184 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.249214 s, 210 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.444054 s, 118 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.301058 s, 174 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.357712 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.281776 s, 186 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.438131 s, 120 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.343315 s, 153 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.269564 s, 194 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.305076 s, 172 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.298731 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.246514 s, 213 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.22356 s, 235 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.300196 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.327657 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.148552 s, 353 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.238392 s, 220 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.354369 s, 148 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.364892 s, 144 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.380819 s, 138 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.300237 s, 175 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.180536 s, 290 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.310193 s, 169 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.223303 s, 235 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.215542 s, 243 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.212209 s, 247 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.224195 s, 234 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.346778 s, 151 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.288393 s, 182 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.235272 s, 223 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.204214 s, 257 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.307521 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.362219 s, 145 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.290583 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.284544 s, 184 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.34642 s, 151 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.352621 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.328801 s, 159 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.278754 s, 188 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.380981 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.439057 s, 119 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.321675 s, 163 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.4379 s, 120 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.476669 s, 110 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.460777 s, 114 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.35575 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.387607 s, 135 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.316089 s, 166 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.235462 s, 223 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.18317 s, 286 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.335543 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.279836 s, 187 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.453368 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.479982 s, 109 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.368452 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.354573 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.441683 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.447559 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.45818 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.2083 s, 252 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.208505 s, 251 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.343789 s, 153 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.202949 s, 258 MB/s

52428800 bytes (52 MB, 50 MiB) copied, 0.468399 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.324327 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.239342 s, 219 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.423512 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.425618 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.42617 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.478772 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.239954 s, 218 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.413623 s, 127 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.388347 s, 135 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.380618 s, 138 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.392976 s, 133 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.484596 s, 108 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.376951 s, 139 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.398849 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.517429 s, 101 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.361751 s, 145 MB/s

52428800 bytes (52 MB, 50 MiB) copied, 0.525988 s, 99.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.30741 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.393448 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.185803 s, 282 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.411275 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.369537 s, 142 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.271324 s, 193 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.220913 s, 237 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.222209 s, 236 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.354754 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.339353 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.356406 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0850081 s, 617 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.403305 s, 130 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0476539 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.232089 s, 226 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.469199 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.434565 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.351546 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.25022 s, 210 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.184189 s, 285 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.359592 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.289989 s, 181 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.279786 s, 187 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.250594 s, 209 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.274183 s, 191 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.274864 s, 191 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.288886 s, 181 MB/s50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.334128 s, 157 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.297175 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.312507 s, 168 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.382126 s, 137 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.34558 s, 152 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.386771 s, 136 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.407137 s, 129 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.426555 s, 123 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.457455 s, 115 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.248281 s, 211 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.447133 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.330987 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.444323 s, 118 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.401625 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.399391 s, 131 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.273888 s, 191 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.187922 s, 279 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.33029 s, 159 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.378488 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.351839 s, 149 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.459914 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.375181 s, 140 MB/s50+0 records in
50+0 records out

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.311192 s, 168 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.426058 s, 123 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.417439 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.252597 s, 208 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.228477 s, 229 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.441517 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.414576 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.301618 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.342278 s, 153 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.306983 s, 171 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.385207 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.390104 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.302125 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.336105 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.32735 s, 160 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.398925 s, 131 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.308769 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.344537 s, 152 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.452156 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.356689 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.293849 s, 178 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.292638 s, 179 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.403463 s, 130 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.422012 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.322735 s, 162 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.308173 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.237592 s, 221 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.365746 s, 143 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.33304 s, 157 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.32223 s, 163 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.335745 s, 156 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.417783 s, 125 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.128355 s, 408 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.375494 s, 140 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.264678 s, 198 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.268833 s, 195 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.235212 s, 223 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.317072 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.219953 s, 238 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.350739 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.287622 s, 182 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.445798 s, 118 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.240401 s, 218 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.345488 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.380557 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.2111 s, 248 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.341382 s, 154 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.372993 s, 141 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.368668 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.336953 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.285538 s, 184 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.291928 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.483521 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.476799 s, 110 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.490964 s, 107 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.545406 s, 96.1 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.522014 s, 100 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.536207 s, 97.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.360362 s, 145 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.398673 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.406712 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.383689 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.360391 s, 145 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.288409 s, 182 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.318511 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.39845 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.254796 s, 206 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.331249 s, 158 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.265203 s, 198 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.310661 s, 169 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.408865 s, 128 MB/s50+0 records in
50+0 records out
50+0 records in
50+0 records out

52428800 bytes (52 MB, 50 MiB) copied, 0.275858 s, 190 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.136832 s, 383 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.386311 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.2591 s, 202 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.412351 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.219654 s, 239 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.220096 s, 238 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.176242 s, 297 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.214808 s, 244 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.269252 s, 195 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.205703 s, 255 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.295582 s, 177 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.204853 s, 256 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.316142 s, 166 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.374806 s, 140 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.182584 s, 287 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.382314 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.403295 s, 130 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.337441 s, 155 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.338541 s, 155 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.353264 s, 148 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.359449 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.439713 s, 119 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.372861 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.333704 s, 157 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.457983 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.299015 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.302813 s, 173 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.386863 s, 136 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.379621 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.331427 s, 158 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.291427 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.478581 s, 110 MB/s
50+0 records in
50+0 records out

52428800 bytes (52 MB, 50 MiB) copied, 0.348183 s, 151 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.430375 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.414316 s, 127 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.34505 s, 152 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.399183 s, 131 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.376151 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.300566 s, 174 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.267621 s, 196 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.323556 s, 162 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.262903 s, 199 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.258009 s, 203 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.334894 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.280823 s, 187 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.220762 s, 237 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.228442 s, 230 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.353977 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.209475 s, 250 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.252467 s, 208 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.331146 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.239477 s, 219 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.281838 s, 186 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.216148 s, 243 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.207417 s, 253 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.234431 s, 224 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.201823 s, 260 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.122736 s, 427 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.205947 s, 255 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.152855 s, 343 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123259 s, 425 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217238 s, 241 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.193282 s, 271 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.245627 s, 213 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.157095 s, 334 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.142268 s, 369 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.198349 s, 264 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.152289 s, 344 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.216881 s, 242 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.17967 s, 292 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.228919 s, 229 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.162537 s, 323 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.228227 s, 230 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.181138 s, 289 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.235069 s, 223 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.329713 s, 159 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.217575 s, 241 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.231295 s, 227 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.213153 s, 246 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.218337 s, 240 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.252997 s, 207 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.310325 s, 169 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.272043 s, 193 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.340666 s, 154 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.31463 s, 167 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.276298 s, 190 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.358362 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.266642 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.267909 s, 196 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.419498 s, 125 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.442508 s, 118 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.346787 s, 151 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.384868 s, 136 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.465458 s, 113 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.513114 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.281858 s, 186 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.445799 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.49381 s, 106 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.43515 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.476672 s, 110 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.438295 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.304007 s, 172 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.582997 s, 89.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.240212 s, 218 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.379084 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.595215 s, 88.1 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.594084 s, 88.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.462509 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.152514 s, 344 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.464079 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.399762 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.354577 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.343519 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.434409 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.298959 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.278392 s, 188 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.299438 s, 175 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.162565 s, 323 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.48732 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.158184 s, 331 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.382297 s, 137 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.339728 s, 154 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.2158 s, 243 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.397396 s, 132 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.278452 s, 188 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.098988 s, 530 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.249275 s, 210 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.286059 s, 183 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.353319 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.304547 s, 172 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.144102 s, 364 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.316514 s, 166 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.326657 s, 161 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.341552 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.332914 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.334888 s, 157 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.271799 s, 193 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.287669 s, 182 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.264595 s, 198 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.21363 s, 245 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.34129 s, 154 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.281941 s, 186 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.296786 s, 177 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.268033 s, 196 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.338559 s, 155 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.28083 s, 187 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.271664 s, 193 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.429405 s, 122 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.36826 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.315952 s, 166 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.364983 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.179016 s, 293 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.375362 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.362138 s, 145 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.332515 s, 158 MB/s50+0 records in
50+0 records out

50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.311906 s, 168 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.355272 s, 148 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.363926 s, 144 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.414365 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.28696 s, 183 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.304753 s, 172 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.405358 s, 129 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.314624 s, 167 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.391003 s, 134 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.425701 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.235544 s, 223 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.490177 s, 107 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.396939 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.298603 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.263261 s, 199 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.336824 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.370127 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.407627 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.257162 s, 204 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.34244 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.434793 s, 121 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.285948 s, 183 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.361197 s, 145 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.456633 s, 115 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.392068 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.324475 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.240435 s, 218 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.364635 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.52974 s, 99.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.353213 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.316512 s, 166 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.231974 s, 226 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.231144 s, 227 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.4957 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.371337 s, 141 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.453415 s, 116 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.576048 s, 91.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.192939 s, 272 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.3965 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.554604 s, 94.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.477078 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.343444 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.562926 s, 93.1 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.329699 s, 159 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.329358 s, 159 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.366069 s, 143 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.376109 s, 139 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.672648 s, 77.9 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.497654 s, 105 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.480339 s, 109 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.275612 s, 190 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.29988 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.717707 s, 73.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.671235 s, 78.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.469051 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.376286 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.568047 s, 92.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.390829 s, 134 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.420033 s, 125 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.382928 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.473501 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.491669 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.311229 s, 168 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.431089 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.418421 s, 125 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.521376 s, 101 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.342802 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.392574 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.324181 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.560984 s, 93.5 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.508409 s, 103 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.312611 s, 168 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0800781 s, 655 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.290087 s, 181 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.368239 s, 142 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.233566 s, 224 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.374715 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.38332 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.416652 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.393575 s, 133 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.212081 s, 247 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.44974 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.446616 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.384607 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.170323 s, 308 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.440257 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.275089 s, 191 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.544299 s, 96.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.449364 s, 117 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.26263 s, 200 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.510633 s, 103 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.306587 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.356497 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.470127 s, 112 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.478903 s, 109 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.18167 s, 289 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.470368 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.203617 s, 257 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.188955 s, 277 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.375061 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.514658 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.493028 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.354758 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.311097 s, 169 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.488993 s, 107 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.459801 s, 114 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.417555 s, 126 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.65625 s, 79.9 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.326971 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.379929 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.29621 s, 177 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.335872 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.300041 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.272909 s, 192 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.422809 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107501 s, 488 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.542505 s, 96.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.566028 s, 92.6 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.334133 s, 157 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.320339 s, 164 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.127454 s, 411 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.348687 s, 150 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.32539 s, 161 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.231342 s, 227 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.257264 s, 204 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.371861 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.272438 s, 192 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.198662 s, 264 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.40796 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.334481 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.297556 s, 176 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.236536 s, 222 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.343218 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.368201 s, 142 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.310519 s, 169 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.149983 s, 350 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.347267 s, 151 MB/s
50+0 records in
50+0 records out

52428800 bytes (52 MB, 50 MiB) copied, 0.358481 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.302394 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.208265 s, 252 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.267576 s, 196 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.24146 s, 217 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.32398 s, 162 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.420833 s, 125 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.370546 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.400363 s, 131 MB/s50+0 records in
50+0 records out

52428800 bytes (52 MB, 50 MiB) copied, 0.301213 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.445264 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.356389 s, 147 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.34386 s, 152 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.354918 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.307671 s, 170 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.416969 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.304303 s, 172 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.317632 s, 165 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.288901 s, 181 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.355574 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.35564 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.212816 s, 246 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.282862 s, 185 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.328616 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.336862 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.247921 s, 211 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.320025 s, 164 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.237156 s, 221 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.421781 s, 124 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.403227 s, 130 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.241843 s, 217 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.271847 s, 193 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.307074 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.342505 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.191128 s, 274 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.381733 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.442249 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.373018 s, 141 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.464529 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.471029 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.456823 s, 115 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.371288 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.373861 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.405451 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.505735 s, 104 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.346342 s, 151 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.319811 s, 164 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.3322 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.372393 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.489075 s, 107 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.448629 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.524406 s, 100 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.406587 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.19821 s, 265 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.423359 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.285298 s, 184 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.373325 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.298654 s, 176 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.302299 s, 173 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.363173 s, 144 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.324878 s, 161 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.358551 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.293067 s, 179 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.181604 s, 289 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.280315 s, 187 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.154262 s, 340 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.152028 s, 345 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.202573 s, 259 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.252366 s, 208 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.205138 s, 256 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.274907 s, 191 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.231246 s, 227 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.293811 s, 178 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.268097 s, 196 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.219854 s, 238 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.303738 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.278581 s, 188 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.318518 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.269902 s, 194 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.338521 s, 155 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.364973 s, 144 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.351135 s, 149 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.310098 s, 169 MB/s50+0 records in
50+0 records out

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.319326 s, 164 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.326345 s, 161 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.370425 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.325013 s, 161 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.30093 s, 174 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.308998 s, 170 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.196492 s, 267 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.329405 s, 159 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.322047 s, 163 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.343445 s, 153 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.292473 s, 179 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.313376 s, 167 MB/s


50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.335967 s, 156 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.190393 s, 275 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.337217 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.141744 s, 370 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.160407 s, 327 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.109045 s, 481 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.16124 s, 325 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.180999 s, 290 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.293811 s, 178 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.150653 s, 348 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.283307 s, 185 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121619 s, 431 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.192427 s, 272 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.177573 s, 295 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111349 s, 471 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.183002 s, 286 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123625 s, 424 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.174145 s, 301 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.171564 s, 306 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.177099 s, 296 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146153 s, 359 MB/s50+0 records in
50+0 records out

52428800 bytes (52 MB, 50 MiB) copied, 0.13746 s, 381 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.142579 s, 368 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.19435 s, 270 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.149141 s, 352 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.129273 s, 406 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.159764 s, 328 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.297115 s, 176 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.330835 s, 158 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.297153 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.368532 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.376397 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.400863 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.415093 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.356822 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.449292 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.354407 s, 148 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.346823 s, 151 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.480502 s, 109 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.373506 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.366775 s, 143 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.35238 s, 149 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.378816 s, 138 MB/s50+0 records in
50+0 records out

52428800 bytes (52 MB, 50 MiB) copied, 0.305866 s, 171 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.380246 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.484427 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.572173 s, 91.6 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.340061 s, 154 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.222398 s, 236 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.356415 s, 147 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.276661 s, 190 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.175069 s, 299 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.378613 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.404257 s, 130 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.303546 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.325446 s, 161 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.335464 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.19666 s, 267 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100601 s, 521 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.20201 s, 260 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0511169 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.285427 s, 184 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.282208 s, 186 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.183151 s, 286 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.101712 s, 515 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.245187 s, 214 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0337474 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.104638 s, 501 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0939413 s, 558 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0741236 s, 707 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0907768 s, 578 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0855285 s, 613 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0860745 s, 609 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0917479 s, 571 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0981821 s, 534 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153152 s, 342 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.201308 s, 260 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.284007 s, 185 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.256805 s, 204 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146929 s, 357 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.352991 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.434099 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.40096 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.451443 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.493106 s, 106 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.333118 s, 157 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.429709 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.513918 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.510279 s, 103 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.498474 s, 105 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.308823 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.36798 s, 142 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.368378 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.315945 s, 166 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.427217 s, 123 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.504745 s, 104 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.48753 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.321085 s, 163 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.477859 s, 110 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.445026 s, 118 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.500076 s, 105 MB/s

50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.353303 s, 148 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.433899 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.410378 s, 128 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.589526 s, 88.9 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.359372 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.294247 s, 178 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.519515 s, 101 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.222343 s, 236 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.28801 s, 182 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.253375 s, 207 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.209318 s, 250 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.351742 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.132012 s, 397 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.437693 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.407367 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.418989 s, 125 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.340194 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.484006 s, 108 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.543533 s, 96.5 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.377771 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.354935 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.488259 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.512333 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.518728 s, 101 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.495259 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.464629 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.499584 s, 105 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.582414 s, 90.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.400524 s, 131 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.553251 s, 94.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.421586 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.562178 s, 93.3 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.568137 s, 92.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0717705 s, 731 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.768486 s, 68.2 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.198507 s, 264 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.396636 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.452298 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.576133 s, 91.0 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.523386 s, 100 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.470799 s, 111 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.458836 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.444239 s, 118 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.208375 s, 252 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.478588 s, 110 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.237851 s, 220 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.386512 s, 136 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.359709 s, 146 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.413914 s, 127 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.392821 s, 133 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.408993 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.266713 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.588691 s, 89.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.386693 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.490634 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.525065 s, 99.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.31661 s, 166 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.394676 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.653744 s, 80.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.454172 s, 115 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.36607 s, 143 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.551536 s, 95.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.587071 s, 89.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.542585 s, 96.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.468467 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.425957 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.494175 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.70381 s, 74.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.634354 s, 82.6 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.438883 s, 119 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.527532 s, 99.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.390605 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.411672 s, 127 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.404022 s, 130 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.386729 s, 136 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.474564 s, 110 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.562134 s, 93.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.598044 s, 87.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.626935 s, 83.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.513257 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.239432 s, 219 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.295348 s, 178 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.356026 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.283604 s, 185 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.221416 s, 237 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.305847 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.537069 s, 97.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.456917 s, 115 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.45169 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.394138 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.32926 s, 159 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.319879 s, 164 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.369203 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.312209 s, 168 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.578665 s, 90.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.218605 s, 240 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.646184 s, 81.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.240709 s, 218 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.593788 s, 88.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.63683 s, 82.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.255602 s, 205 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.593672 s, 88.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.655219 s, 80.0 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.469101 s, 112 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.462381 s, 113 MB/s50+0 records in
50+0 records out

50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.549304 s, 95.4 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.485631 s, 108 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.516191 s, 102 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.269052 s, 195 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.528645 s, 99.2 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.493485 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.547179 s, 95.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.612878 s, 85.5 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.443043 s, 118 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.366909 s, 143 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.392744 s, 133 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.351026 s, 149 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.311999 s, 168 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.605278 s, 86.6 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.371611 s, 141 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.335395 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.173302 s, 303 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.24633 s, 213 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.21791 s, 241 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.184417 s, 284 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.158781 s, 330 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.144946 s, 362 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.216711 s, 242 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.18182 s, 288 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105909 s, 495 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217085 s, 242 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100155 s, 523 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.286423 s, 183 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.256366 s, 205 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.334076 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.350969 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.302891 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.398739 s, 131 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.302689 s, 173 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.31944 s, 164 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.410644 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.32623 s, 161 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.362574 s, 145 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.329209 s, 159 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.423613 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.352815 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.377677 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.511583 s, 102 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.433914 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.50484 s, 104 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.530871 s, 98.8 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.402649 s, 130 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.437142 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.299717 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.330567 s, 159 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.474899 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.345924 s, 152 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.599311 s, 87.5 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.443036 s, 118 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.426785 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.467882 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.345907 s, 152 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.593736 s, 88.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.378791 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.206406 s, 254 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.176027 s, 298 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.483069 s, 109 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.510709 s, 103 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.619744 s, 84.6 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.263391 s, 199 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.377139 s, 139 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.362915 s, 144 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.340096 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.309365 s, 169 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.183791 s, 285 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.317189 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.460315 s, 114 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.402258 s, 130 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.323115 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0446447 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.270555 s, 194 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.272311 s, 193 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.340238 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.262365 s, 200 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.364555 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.410462 s, 128 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.322953 s, 162 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.377893 s, 139 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.455198 s, 115 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.440705 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.459053 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.383818 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.343848 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.603037 s, 86.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.359712 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.409959 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.480407 s, 109 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.307179 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.559196 s, 93.8 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.525176 s, 99.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.465826 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.354295 s, 148 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.448945 s, 117 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.422493 s, 124 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.424617 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.483687 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.494164 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.313057 s, 167 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.298912 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.127299 s, 412 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.41495 s, 126 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.313952 s, 167 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.388714 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.518994 s, 101 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.296513 s, 177 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.318343 s, 165 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.391481 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.137 s, 383 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.153313 s, 342 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118974 s, 441 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.247248 s, 212 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.168603 s, 311 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.48034 s, 109 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.201316 s, 260 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.325652 s, 161 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.23913 s, 219 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.321213 s, 163 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.326061 s, 161 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.268247 s, 195 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.211549 s, 248 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.297455 s, 176 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.429958 s, 122 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.405959 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.302908 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.468457 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.444106 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.281739 s, 186 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.408129 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.419108 s, 125 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.395741 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.456483 s, 115 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.320732 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.482628 s, 109 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.441675 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.487785 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.327577 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.462941 s, 113 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.50013 s, 105 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.539577 s, 97.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.493894 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.470587 s, 111 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.343441 s, 153 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.349103 s, 150 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.560741 s, 93.5 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.385635 s, 136 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.577128 s, 90.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.618175 s, 84.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120736 s, 434 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.327203 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.526737 s, 99.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.525683 s, 99.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.340384 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0448953 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.516702 s, 101 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.447727 s, 117 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.467849 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.330389 s, 159 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.568475 s, 92.2 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.434863 s, 121 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.39385 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.592046 s, 88.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.372577 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.236382 s, 222 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.317083 s, 165 MB/s50+0 records in
50+0 records out

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.291801 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.684281 s, 76.6 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.452468 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.319203 s, 164 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.594066 s, 88.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.558557 s, 93.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.03444 s, 50.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.400949 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.341459 s, 154 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.40859 s, 128 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.509273 s, 103 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.386977 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.569916 s, 92.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.532231 s, 98.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.530065 s, 98.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.359171 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.34199 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.359689 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.388498 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.44452 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.422548 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.370614 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.395399 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.258654 s, 203 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.116746 s, 449 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.246578 s, 213 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.331126 s, 158 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.282414 s, 186 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.335678 s, 156 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.132276 s, 396 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.281985 s, 186 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.166462 s, 315 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.278617 s, 188 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.212421 s, 247 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.428502 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.52167 s, 101 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.288348 s, 182 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.231613 s, 226 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.212663 s, 247 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.249195 s, 210 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.229426 s, 229 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.357222 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.234349 s, 224 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.271703 s, 193 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.270771 s, 194 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.278049 s, 189 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.392475 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114441 s, 458 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.479043 s, 109 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.404249 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.491426 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.473179 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.455049 s, 115 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.374301 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.363421 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.841203 s, 62.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.430309 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.279291 s, 188 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.311147 s, 169 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.283099 s, 185 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.483979 s, 108 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.480597 s, 109 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.292124 s, 179 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.427873 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.56447 s, 92.9 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.285651 s, 184 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.289921 s, 181 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.142314 s, 368 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.494463 s, 106 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.435486 s, 120 MB/s50+0 records in
50+0 records out

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.565366 s, 92.7 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.826978 s, 63.4 MB/s

50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.386349 s, 136 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.19935 s, 263 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.281842 s, 186 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.214655 s, 244 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.36253 s, 145 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.244055 s, 215 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.468562 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.377923 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.294214 s, 178 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.547838 s, 95.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.294098 s, 178 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.297424 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.380575 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.299309 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.301173 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.212174 s, 247 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.398494 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.396737 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.347577 s, 151 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.33905 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.360384 s, 145 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.347684 s, 151 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.35702 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.31568 s, 166 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.34052 s, 154 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.496509 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.300156 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.345134 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.544442 s, 96.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.554867 s, 94.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.437065 s, 120 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.478327 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.51189 s, 102 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.371675 s, 141 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.508075 s, 103 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.414432 s, 127 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.400451 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.588023 s, 89.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.328294 s, 160 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.444244 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.485291 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.357124 s, 147 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.323324 s, 162 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.385178 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.740172 s, 70.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.408795 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.634704 s, 82.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.513677 s, 102 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.588033 s, 89.2 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.648165 s, 80.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.413075 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.317618 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.448378 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.321896 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.381592 s, 137 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.071918 s, 729 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.407251 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.404535 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.572561 s, 91.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.838912 s, 62.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.825732 s, 63.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12494 s, 420 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.634992 s, 82.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.596495 s, 87.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0311909 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.292358 s, 179 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.567611 s, 92.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.949485 s, 55.2 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.20754 s, 43.4 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.275525 s, 190 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.369623 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.579332 s, 90.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.611446 s, 85.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.466358 s, 112 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.60215 s, 87.1 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.197222 s, 266 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.495959 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.219589 s, 239 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.30808 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.274068 s, 191 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.791243 s, 66.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111099 s, 472 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.588149 s, 89.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.306026 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.891549 s, 58.8 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.36817 s, 142 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.152508 s, 344 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.824847 s, 63.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0428789 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.415852 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.469014 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.462184 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.236073 s, 222 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.252692 s, 207 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.313336 s, 167 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.297493 s, 176 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.310135 s, 169 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.30724 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.316504 s, 166 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.298275 s, 176 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.243179 s, 216 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.274873 s, 191 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.453004 s, 116 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.16201 s, 324 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.373579 s, 140 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.533702 s, 98.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.575081 s, 91.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.452855 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.405459 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.507862 s, 103 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.687223 s, 76.3 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.550381 s, 95.3 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.549027 s, 95.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.467452 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.465638 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.452861 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.543567 s, 96.5 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.647407 s, 81.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.544098 s, 96.4 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.165321 s, 317 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.454348 s, 115 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.48538 s, 108 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.494937 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.36731 s, 143 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.823321 s, 63.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.660243 s, 79.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.348415 s, 150 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.226302 s, 232 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.756215 s, 69.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.385435 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0425176 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.380319 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.394646 s, 133 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.711313 s, 73.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.1774 s, 44.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.50937 s, 103 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.797853 s, 65.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.594062 s, 88.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.450386 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.592061 s, 88.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.28318 s, 185 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.58514 s, 89.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.515354 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.505881 s, 104 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.11577 s, 47.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.377382 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.402226 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.396113 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.610658 s, 85.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.548002 s, 95.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.61843 s, 84.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.376639 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.28828 s, 40.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.384059 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.513194 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.317681 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.28579 s, 40.8 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.49603 s, 106 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.439824 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.474917 s, 110 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.889349 s, 59.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.778661 s, 67.3 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.832354 s, 63.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.02413 s, 51.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.855454 s, 61.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.974922 s, 53.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.603334 s, 86.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.411255 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.516443 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.915367 s, 57.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.627986 s, 83.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.752093 s, 69.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.688167 s, 76.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.900518 s, 58.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.466154 s, 112 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.626916 s, 83.6 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.6088 s, 86.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.488559 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.33014 s, 159 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.278113 s, 189 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.721935 s, 72.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.360865 s, 145 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217853 s, 241 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.510111 s, 103 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.356498 s, 147 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.300538 s, 174 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.195792 s, 268 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.338027 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.359289 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.302651 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.441456 s, 119 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.408457 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.499976 s, 105 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.465814 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.56698 s, 92.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.564433 s, 92.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.489471 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.558101 s, 93.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.209969 s, 250 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.312215 s, 168 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.209382 s, 250 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.425587 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.51895 s, 101 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.317202 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.358872 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.335119 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.542091 s, 96.7 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.282292 s, 186 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.364722 s, 144 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.979085 s, 53.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.360137 s, 146 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.488288 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.25936 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.547076 s, 95.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.25894 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.45187 s, 116 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.76734 s, 68.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.42916 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118308 s, 443 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.471296 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.437219 s, 120 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.393853 s, 133 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.476343 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.423231 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.419573 s, 125 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.410893 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.360045 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.205418 s, 255 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.220929 s, 237 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.651192 s, 80.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.216452 s, 242 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.299564 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.191727 s, 273 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.241889 s, 217 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.353624 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.332057 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.219359 s, 239 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.27078 s, 194 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.625192 s, 83.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.435061 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.451934 s, 116 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.444857 s, 118 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.49507 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.338912 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.54291 s, 96.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.351264 s, 149 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.360986 s, 145 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.450596 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.310707 s, 169 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.354803 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.481582 s, 109 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.421416 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.399716 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.431332 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.352733 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.41004 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.552912 s, 94.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.541329 s, 96.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.499373 s, 105 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.435694 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.51091 s, 103 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.354623 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.437088 s, 120 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.528082 s, 99.3 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.153478 s, 342 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.325961 s, 161 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.250638 s, 209 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.319695 s, 164 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.339974 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.465754 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.214014 s, 245 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.318795 s, 164 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.230069 s, 228 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.336862 s, 156 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.307689 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.34033 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.496784 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.345442 s, 152 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.468942 s, 112 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.379866 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.36784 s, 143 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.317367 s, 165 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.401876 s, 130 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.407669 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.524843 s, 99.9 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.30168 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.463717 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.380399 s, 138 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.436973 s, 120 MB/s

50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.492169 s, 107 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.149298 s, 351 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.396971 s, 132 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.363915 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.635356 s, 82.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.283724 s, 185 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.472068 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.489363 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.700463 s, 74.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.543561 s, 96.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.482231 s, 109 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.519478 s, 101 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.405931 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.519664 s, 101 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.469447 s, 112 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.302301 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.640476 s, 81.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.222532 s, 236 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.348487 s, 150 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.539086 s, 97.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.381464 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.594752 s, 88.2 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.182127 s, 288 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.448448 s, 117 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.338972 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.501044 s, 105 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.55556 s, 94.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.33981 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.500488 s, 105 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.43974 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.51318 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.500465 s, 105 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.304844 s, 172 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.583756 s, 89.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.537548 s, 97.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.451671 s, 116 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.255349 s, 205 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.320888 s, 163 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.281192 s, 186 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.437771 s, 120 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.394232 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.414316 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.400659 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.543413 s, 96.5 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.353251 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.678174 s, 77.3 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.353616 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.403976 s, 130 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.393055 s, 133 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.986787 s, 53.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.585372 s, 89.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.363966 s, 144 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.417266 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.313117 s, 167 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.516497 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0929366 s, 564 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.380705 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.460648 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.342231 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.209621 s, 250 MB/s50+0 records in
50+0 records out

52428800 bytes (52 MB, 50 MiB) copied, 0.46966 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.415123 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.282937 s, 185 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.372534 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.397263 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.245785 s, 213 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.387403 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.21963 s, 239 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.421186 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.304421 s, 172 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.580254 s, 90.4 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.120814 s, 434 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.250465 s, 209 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.618171 s, 84.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.336849 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.292511 s, 179 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.395525 s, 133 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.204798 s, 256 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.609412 s, 86.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.508337 s, 103 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.437854 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.483741 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.395519 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.301421 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.591651 s, 88.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.443425 s, 118 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.224618 s, 233 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.577565 s, 90.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.47431 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.420504 s, 125 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.707896 s, 74.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.443355 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.748419 s, 70.1 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.512926 s, 102 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.66135 s, 79.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.523478 s, 100 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.551638 s, 95.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.452194 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.520368 s, 101 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.777825 s, 67.4 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.807268 s, 64.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.342494 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.405557 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.536307 s, 97.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.641284 s, 81.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.58925 s, 89.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.337405 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.246686 s, 213 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.450198 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.410771 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.572778 s, 91.5 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.411739 s, 127 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0752799 s, 696 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.661022 s, 79.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.528801 s, 99.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.455705 s, 115 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.133602 s, 392 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.437204 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.459618 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.184388 s, 284 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.16912 s, 310 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.528992 s, 99.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.561997 s, 93.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.280837 s, 187 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.391363 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.35038 s, 150 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.415583 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.317052 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.241371 s, 217 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.374898 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.421202 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.445469 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.34729 s, 151 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.326521 s, 161 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.515679 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.507987 s, 103 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.466421 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.436436 s, 120 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.529251 s, 99.1 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.345744 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.5241 s, 100 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.375155 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.562895 s, 93.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.406767 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.465475 s, 113 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.410964 s, 128 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.396513 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.303224 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.614885 s, 85.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.662577 s, 79.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.442951 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.476256 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.599507 s, 87.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.655516 s, 80.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.19771 s, 265 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.475044 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.306383 s, 171 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.484141 s, 108 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.179829 s, 292 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.462913 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106253 s, 493 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.456669 s, 115 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.29568 s, 177 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.211095 s, 248 MB/s

52428800 bytes (52 MB, 50 MiB) copied, 0.295927 s, 177 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.428301 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.444631 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.318372 s, 165 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.261912 s, 200 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.262998 s, 199 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.277236 s, 189 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.312682 s, 168 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.193319 s, 271 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.300021 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.165924 s, 316 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.189072 s, 277 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.473289 s, 111 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.389292 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.416163 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.40275 s, 130 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.517801 s, 101 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.38585 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.436722 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.385545 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.458043 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.322371 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.477693 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.45823 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.522426 s, 100 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.425747 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.313355 s, 167 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.245476 s, 214 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.348232 s, 151 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.440122 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.241483 s, 217 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.569341 s, 92.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.421718 s, 124 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.47392 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.442575 s, 118 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.38119 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.453379 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.331826 s, 158 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.466535 s, 112 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.549976 s, 95.3 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.575271 s, 91.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.616492 s, 85.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.39742 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.618028 s, 84.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.820292 s, 63.9 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.505163 s, 104 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.614407 s, 85.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.46619 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.574506 s, 91.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.492789 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.743961 s, 70.5 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.672635 s, 77.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.395981 s, 132 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.628749 s, 83.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.506906 s, 103 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.688744 s, 76.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.696975 s, 75.2 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.522596 s, 100 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.61476 s, 85.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.593492 s, 88.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.347042 s, 151 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.465997 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.363782 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.627367 s, 83.6 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.598279 s, 87.6 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.275701 s, 190 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.404781 s, 130 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.42468 s, 123 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.562855 s, 93.1 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.501875 s, 104 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.122584 s, 428 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.499145 s, 105 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.334788 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.204449 s, 256 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.402586 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.158463 s, 331 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.389651 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.463119 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.303319 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.226286 s, 232 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.382796 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.346353 s, 151 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.423666 s, 124 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.454945 s, 115 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.413974 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.397887 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.518008 s, 101 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.437958 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.291506 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.437314 s, 120 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.260599 s, 201 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.49296 s, 106 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.524167 s, 100 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.619071 s, 84.7 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.506554 s, 104 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.520833 s, 101 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.444994 s, 118 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.575692 s, 91.1 MB/s50+0 records in
50+0 records out

52428800 bytes (52 MB, 50 MiB) copied, 0.609787 s, 86.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.595835 s, 88.0 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.612391 s, 85.6 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.441558 s, 119 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.310022 s, 169 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.276594 s, 190 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.597611 s, 87.7 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.512844 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.484538 s, 108 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.501925 s, 104 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.60333 s, 86.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.588254 s, 89.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.461991 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.447958 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.288651 s, 182 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.237251 s, 221 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217022 s, 242 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.413757 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.660982 s, 79.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.297755 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.307962 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.386586 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.294215 s, 178 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.484023 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.503561 s, 104 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.519143 s, 101 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.713329 s, 73.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.67633 s, 77.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.654691 s, 80.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.632743 s, 82.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.689926 s, 76.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.02864 s, 51.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.701696 s, 74.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.431638 s, 121 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.741412 s, 70.7 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.515305 s, 102 MB/s50+0 records in
50+0 records out

52428800 bytes (52 MB, 50 MiB) copied, 0.677872 s, 77.3 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.589787 s, 88.9 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.581651 s, 90.1 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.598331 s, 87.6 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.740849 s, 70.8 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.609593 s, 86.0 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.750599 s, 69.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.271129 s, 193 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.414095 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.582426 s, 90.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.585248 s, 89.6 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.275769 s, 190 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.780553 s, 67.2 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.52687 s, 99.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.649403 s, 80.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.254877 s, 206 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.233548 s, 224 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.568556 s, 92.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.210257 s, 249 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.532509 s, 98.5 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.890297 s, 58.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.765563 s, 68.5 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.324478 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.350933 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.368136 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.414469 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.277681 s, 189 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.176963 s, 296 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.53598 s, 97.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.573815 s, 91.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.625626 s, 83.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.591125 s, 88.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.490758 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.628733 s, 83.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.25634 s, 205 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.486474 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.598447 s, 87.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.450339 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.467798 s, 112 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.373397 s, 140 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.536284 s, 97.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.582818 s, 90.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.789415 s, 66.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.507656 s, 103 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0508372 s, 1.0 GB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.635684 s, 82.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.303473 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.60019 s, 87.4 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.53178 s, 98.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.205188 s, 256 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.691484 s, 75.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.606331 s, 86.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.572067 s, 91.6 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.471963 s, 111 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.394866 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.384822 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.911578 s, 57.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.348092 s, 151 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.522101 s, 100 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.363592 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.324303 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.166792 s, 314 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.477423 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.323871 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.178145 s, 294 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.591382 s, 88.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.551802 s, 95.0 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.398899 s, 131 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.190978 s, 275 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.583835 s, 89.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.583569 s, 89.8 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.506185 s, 104 MB/s

50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.712484 s, 73.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.740986 s, 70.8 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.604523 s, 86.7 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.405208 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.377919 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.55941 s, 93.7 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.393084 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.749952 s, 69.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.567864 s, 92.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.505205 s, 104 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.439662 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.565905 s, 92.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.671198 s, 78.1 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.468144 s, 112 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.457917 s, 114 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.391246 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.441382 s, 119 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.288475 s, 182 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.831908 s, 63.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.485898 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.570759 s, 91.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.317011 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.517566 s, 101 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.573121 s, 91.5 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.652159 s, 80.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.313951 s, 167 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.47211 s, 111 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.530025 s, 98.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.562241 s, 93.2 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.479561 s, 109 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0788784 s, 665 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.305016 s, 172 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.443816 s, 118 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.353652 s, 148 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.636759 s, 82.3 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.642059 s, 81.7 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.344353 s, 152 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.425546 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.445751 s, 118 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.491455 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.348538 s, 150 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.498492 s, 105 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.36857 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.235998 s, 222 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.403525 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.435186 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.253229 s, 207 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.452019 s, 116 MB/s
/mnt/lustre/f45.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x2000061c1
      lmm_object_id:     0x8
      lmm_fid:           [0x2000061c1:0x8:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x1c5:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
llite.lustre-ffff927e83f39000.stats=
snapshot_time             1761247243.646064536 secs.nsecs
start_time                1761247182.515393223 secs.nsecs
elapsed_time              61.130671313 secs.nsecs
read_bytes                2211 samples [bytes] 4096 1048576 2306867200 2415750258098176
read                      65350 samples [usecs] 230 838722 465852945 25242000370247
ioctl                     1 samples [reqs]
open                      1308 samples [usecs] 9 110874 1003499 61760968779
close                     1308 samples [usecs] 4 44067 459252 9584374994
seek                      1306 samples [usecs] 3 18279 42440 384373714
setattr                   1 samples [usecs] 119786 119786 119786 14348685796
getattr                   32 samples [usecs] 165 21234 49047 719935625
mknod                     1 samples [usecs] 21176 21176 21176 448422976
inode_permission          5216 samples [usecs] 1 78666 2033645 47284900589
opencount                 1309 samples [reqs] 1 1308 856087 746792355
openclosetime             1307 samples [usecs] 3 329936 67649288 7309554480846
pcc_attach                1 samples [reqs]
pcc_hit_bytes             1263 samples [bytes] 52428800 52428800 66217574400 3471707964702720000
pcc_attach_bytes          1 samples [bytes] 52428800 52428800 52428800 2748779069440000
hybrid_noswitch           2201 samples [reqs]
llite.lustre-ffff927ea0953800.stats=
snapshot_time             1761247243.646152819 secs.nsecs
start_time                1761247182.515426654 secs.nsecs
elapsed_time              61.130726165 secs.nsecs
read_bytes                2607 samples [bytes] 8192 1048576 2726297600 2857913618006016
read                      63100 samples [usecs] 224 2792276 483253176 59052153831324
open                      1262 samples [usecs] 8 242785 1836426 304307337374
close                     1262 samples [usecs] 6 55271 459884 13495008970
seek                      1261 samples [usecs] 3 132216 234325 20400472829
inode_permission          2522 samples [usecs] 1 165318 1975953 108391337957
opencount                 1262 samples [reqs] 1 1246 776897 645588127
openclosetime             1245 samples [usecs] 77 430199 62953841 6732354887237
pcc_attach                1 samples [reqs]
pcc_hit_bytes             1210 samples [bytes] 52428800 52428800 63438848000 3326022674022400000
pcc_attach_bytes          1 samples [bytes] 52428800 52428800 52428800 2748779069440000
hybrid_noswitch           2601 samples [reqs]
attach 2 detach 0 auto_attach 0
llite.lustre-ffff927e83f39000.pcc_async_threshold=1073741824
llite.lustre-ffff927ea0953800.pcc_async_threshold=1073741824
/mnt/pcc.d45.sanity-pcc.2 is idle now
/mnt/pcc.d45.sanity-pcc is idle now
PASS 45 (75s)

== sanity-pcc test 46: Verify PCC mode setting works correctly ========================================================== 15:20:52 (1761247252)
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.122473 s, 514 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d46.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: b49a8e73-e01c-49bd-b5d1-31da75fe4644
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f46.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=b49a8e73-e01c-49bd-b5d1-31da75fe4644 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d46.sanity-pcc/d46.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [id]
uid=500(sanityusr) gid=500(sanityusr) groups=500(sanityusr),0(root)
Mode: 0400
llite.lustre-ffff927e83f39000.pcc_mode=0
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-r] [/mnt/lustre/f46.sanity-pcc]
lfs pcc pcc: cannot attach the file to PCC with ID 0 failed: Operation not permitted (1)
attach: cannot attach '/mnt/lustre/f46.sanity-pcc' to PCC with attach ID '0': Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [cat] [/mnt/lustre/f46.sanity-pcc]
QQQQQ
llite.lustre-ffff927e83f39000.pcc_mode=0400
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-r] [/mnt/lustre/f46.sanity-pcc]
lfs pcc pcc: cannot attach the file to PCC with ID 0 failed: Operation not permitted (1)
attach: cannot attach '/mnt/lustre/f46.sanity-pcc' to PCC with attach ID '0': Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [cat] [/mnt/lustre/f46.sanity-pcc]
QQQQQ
llite.lustre-ffff927e83f39000.pcc_mode=0004
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [cat] [/mnt/lustre/f46.sanity-pcc]
QQQQQ
file: /mnt/lustre/f46.sanity-pcc, type: readonly, PCC_file: /d46.sanity-pcc/61cb/0x2000061c1:0xa:0x0, open_count: 0, flags: 0
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/f46.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [stat] [/mnt/lustre/f46.sanity-pcc]
  File: /mnt/lustre/f46.sanity-pcc
  Size: 6         	Blocks: 1          IO Block: 4194304 regular file
Device: 2c54f966h/743766374d	Inode: 144115607925686282  Links: 1
Access: (0664/-rw-rw-r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2025-10-23 15:20:54.000000000 -0400
Modify: 2025-10-23 15:20:54.000000000 -0400
Change: 2025-10-23 15:20:54.000000000 -0400
 Birth: 2025-10-23 15:20:54.000000000 -0400
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/f46.sanity-pcc]
llite.lustre-ffff927e83f39000.pcc_mode=0040
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [cat] [/mnt/lustre/f46.sanity-pcc]
QQQQQ
file: /mnt/lustre/f46.sanity-pcc, type: readonly, PCC_file: /d46.sanity-pcc/61cb/0x2000061c1:0xa:0x0, open_count: 0, flags: 0
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/f46.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-r] [/mnt/lustre/f46.sanity-pcc]
  File: /mnt/lustre/f46.sanity-pcc
  Size: 6         	Blocks: 2          IO Block: 4194304 regular file
Device: 2c54f966h/743766374d	Inode: 144115607925686282  Links: 1
Access: (0660/-rw-rw----)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2025-10-23 15:20:55.000000000 -0400
Modify: 2025-10-23 15:20:54.000000000 -0400
Change: 2025-10-23 15:20:55.000000000 -0400
 Birth: 2025-10-23 15:20:54.000000000 -0400
file: /mnt/lustre/f46.sanity-pcc, type: readonly, PCC_file: /d46.sanity-pcc/61cb/0x2000061c1:0xa:0x0, open_count: 0, flags: 0
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/f46.sanity-pcc]
llite.lustre-ffff927e83f39000.pcc_mode=0400
llite.lustre-ffff927e83f39000.pcc_mode=0400
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d46.sanity-pcc is idle now
PASS 46 (8s)

== sanity-pcc test 47: mtime should be kept once file attached into PCC ========================================================== 15:21:00 (1761247260)
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.139112 s, 452 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d47.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: 41ea06d8-d892-435b-88ad-d4075acb2ad8
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f47.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=41ea06d8-d892-435b-88ad-d4075acb2ad8 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d47.sanity-pcc/d47.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
QQQQQ
/home/green/git/lustre-release/lustre/utils/lfs pcc state /mnt/lustre/f47.sanity-pcc | grep -E -c 'type: readonly'
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d47.sanity-pcc is idle now
PASS 47 (11s)

== sanity-pcc test 48: PCC state should check whether the file in local PCC cache ========================================================== 15:21:11 (1761247271)
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.113701 s, 553 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d48.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: 2ef7e44f-7c37-4941-b7a2-4c7ad530c502
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f48.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=2ef7e44f-7c37-4941-b7a2-4c7ad530c502 (extents) (64bit) (large files) (huge files)
QQQQQ
file: /mnt/lustre/f48.sanity-pcc, type: readonly, PCC_file: /d48.sanity-pcc/61cd/0x2000061c1:0xc:0x0 (unlinked), open_count: 0, flags: 4
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d48.sanity-pcc is idle now
PASS 48 (6s)

== sanity-pcc test 96: Auto attach from multiple read process on a node ========================================================== 15:21:17 (1761247277)
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.162244 s, 388 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d96.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: 1f502f2e-58f2-4198-9235-a8ed7c5035a5
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f96.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=1f502f2e-58f2-4198-9235-a8ed7c5035a5 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d96.sanity-pcc/d96.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
llite.lustre-ffff927e83f39000.pcc_async_threshold=1G
llite.lustre-ffff927ea0953800.pcc_async_threshold=1G
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.06223 s, 49.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.02176 s, 51.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.02804 s, 51.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.11753 s, 46.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.12099 s, 46.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.12303 s, 46.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0660978 s, 793 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0819341 s, 640 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0709709 s, 739 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0526845 s, 995 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0714545 s, 734 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0972785 s, 539 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0649183 s, 808 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0370852 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0884792 s, 593 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0744459 s, 704 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0604382 s, 867 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0859975 s, 610 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0878916 s, 597 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0989678 s, 530 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0622521 s, 842 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.142111 s, 369 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.067836 s, 773 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0811791 s, 646 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106531 s, 492 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.116276 s, 451 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0741757 s, 707 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106082 s, 494 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0319206 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0947664 s, 553 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121769 s, 431 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.115077 s, 456 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0559419 s, 937 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126455 s, 415 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.116551 s, 450 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.052719 s, 994 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0217826 s, 2.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.096726 s, 542 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0796546 s, 658 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0643877 s, 814 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.071305 s, 735 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0754071 s, 695 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0979271 s, 535 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0513661 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0909999 s, 576 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0874054 s, 600 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.101624 s, 516 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123288 s, 425 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.247182 s, 212 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.151484 s, 346 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123189 s, 426 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0404569 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.02763 s, 1.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0927018 s, 566 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0573118 s, 915 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.134621 s, 389 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.13093 s, 400 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0438395 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0643273 s, 815 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106949 s, 490 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.149298 s, 351 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0989722 s, 530 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.189026 s, 277 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0839684 s, 624 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.117123 s, 448 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120198 s, 436 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0289595 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0669785 s, 783 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0968921 s, 541 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0908044 s, 577 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0546028 s, 960 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0936254 s, 560 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0756837 s, 693 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.076577 s, 685 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0620964 s, 844 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0951786 s, 551 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.129811 s, 404 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0994387 s, 527 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0300417 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0722223 s, 726 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0985284 s, 532 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0314786 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0611667 s, 857 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0498543 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0866909 s, 605 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0471237 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.021128 s, 2.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0673119 s, 779 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0586986 s, 893 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0971109 s, 540 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0372028 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0595601 s, 880 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.072294 s, 725 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107988 s, 486 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.032186 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.062752 s, 835 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0687553 s, 763 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0817056 s, 642 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.112674 s, 465 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0331225 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0486109 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0401698 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0668997 s, 784 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0400676 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0297818 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0353186 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0963002 s, 544 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0600024 s, 874 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118074 s, 444 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0572731 s, 915 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0614574 s, 853 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0478831 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0447102 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0416623 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0323315 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0571975 s, 917 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0529642 s, 990 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0460279 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0245859 s, 2.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0303922 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0506019 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0585702 s, 895 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0972889 s, 539 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.069998 s, 749 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0885453 s, 592 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0961118 s, 545 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0448189 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0397552 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0856511 s, 612 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0929704 s, 564 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0454551 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.048072 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0411452 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0911966 s, 575 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0504323 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0522188 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0540435 s, 970 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0664066 s, 790 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0553038 s, 948 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0821126 s, 638 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.093175 s, 563 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103075 s, 509 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0480743 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0704378 s, 744 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0487034 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0457029 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0459528 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0605504 s, 866 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0603332 s, 869 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.045396 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0802251 s, 654 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.083087 s, 631 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0671747 s, 780 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0867749 s, 604 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0515033 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0461146 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0596952 s, 878 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0708264 s, 740 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0512238 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0354456 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0519303 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0605104 s, 866 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0647179 s, 810 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0354869 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0645277 s, 813 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0830609 s, 631 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0834115 s, 629 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0538146 s, 974 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0759908 s, 690 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0384299 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.104645 s, 501 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0288793 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0576511 s, 909 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0875282 s, 599 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0671193 s, 781 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0296027 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0758265 s, 691 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0926816 s, 566 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106176 s, 494 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0591866 s, 886 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0734502 s, 714 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0332988 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0363527 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.144173 s, 364 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.117441 s, 446 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.11445 s, 458 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107924 s, 486 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.168385 s, 311 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.102063 s, 514 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0981877 s, 534 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0887262 s, 591 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.053647 s, 977 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0799221 s, 656 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0303366 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0970698 s, 540 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.130606 s, 401 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0992688 s, 528 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.124805 s, 420 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0920085 s, 570 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0185116 s, 2.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0368362 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0639625 s, 820 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0608612 s, 861 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0793217 s, 661 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0456993 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0708834 s, 740 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.109954 s, 477 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0242544 s, 2.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0268393 s, 2.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0595555 s, 880 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0246625 s, 2.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0391534 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0252487 s, 2.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0654915 s, 801 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.080113 s, 654 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.115504 s, 454 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0645814 s, 812 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.064787 s, 809 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0496407 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.09731 s, 539 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0680362 s, 771 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.073787 s, 711 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0990614 s, 529 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.076017 s, 690 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0444565 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0816054 s, 642 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0825612 s, 635 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121066 s, 433 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0595705 s, 880 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0782619 s, 670 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0868054 s, 604 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0975271 s, 538 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0753346 s, 696 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0971348 s, 540 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0773574 s, 678 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0903415 s, 580 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108283 s, 484 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0861529 s, 609 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0319034 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.102805 s, 510 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.040038 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0287159 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0724961 s, 723 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0844553 s, 621 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0925267 s, 567 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0868414 s, 604 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0979628 s, 535 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0710569 s, 738 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0792526 s, 662 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0856141 s, 612 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0690245 s, 760 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.035417 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0996197 s, 526 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0339987 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0899497 s, 583 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0370109 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0501449 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0239648 s, 2.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.029745 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0469021 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0332023 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0733229 s, 715 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0333364 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.073116 s, 717 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.096909 s, 541 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0617813 s, 849 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.025091 s, 2.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0559422 s, 937 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0303064 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.032448 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.048641 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0581302 s, 902 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0765794 s, 685 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0422242 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0662596 s, 791 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0339249 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0661678 s, 792 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0439769 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0867169 s, 605 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.116148 s, 451 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0510455 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0340621 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.117316 s, 447 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0645222 s, 813 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0552683 s, 949 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.069012 s, 760 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0746931 s, 702 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0653289 s, 803 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0786737 s, 666 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0892397 s, 588 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.135586 s, 387 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0453853 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0758367 s, 691 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0649534 s, 807 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.125579 s, 417 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105298 s, 498 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.205619 s, 255 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0558003 s, 940 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0642574 s, 816 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.13378 s, 392 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.167769 s, 313 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0983451 s, 533 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.271377 s, 193 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0804161 s, 652 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.150921 s, 347 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0838011 s, 626 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0723658 s, 724 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0876903 s, 598 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0590633 s, 888 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0663697 s, 790 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.122866 s, 427 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103983 s, 504 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0942055 s, 557 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0933011 s, 562 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.138057 s, 380 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.137121 s, 382 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.119206 s, 440 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.031611 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0913959 s, 574 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.177386 s, 296 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0877498 s, 597 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136668 s, 384 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.161637 s, 324 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0866456 s, 605 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0394281 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0592674 s, 885 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0903952 s, 580 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0519452 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0868842 s, 603 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12797 s, 410 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.125464 s, 418 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0823893 s, 636 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.102406 s, 512 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0927871 s, 565 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.134024 s, 391 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0773364 s, 678 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0912098 s, 575 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0314442 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0539124 s, 972 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0662802 s, 791 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0268837 s, 2.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0462491 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0401619 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0942852 s, 556 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0845225 s, 620 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0382182 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0326567 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0349369 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0590131 s, 888 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0499019 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0372915 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0371784 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0252939 s, 2.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0820469 s, 639 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.062497 s, 839 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0641125 s, 818 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0701461 s, 747 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0312719 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.06908 s, 759 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126658 s, 414 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.16006 s, 328 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0293267 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0239009 s, 2.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.076856 s, 682 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0414692 s, 1.3 GB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0554664 s, 945 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0771213 s, 680 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12396 s, 423 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105475 s, 497 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.15363 s, 341 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.119009 s, 441 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0872244 s, 601 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.051334 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.10255 s, 511 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114965 s, 456 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0256513 s, 2.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0297251 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0874945 s, 599 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0665816 s, 787 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0374606 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0818614 s, 640 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106975 s, 490 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0516642 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0318757 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0458475 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108226 s, 484 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0466364 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0347309 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0780514 s, 672 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0498474 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0297828 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107754 s, 487 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.044775 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.147257 s, 356 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.035464 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0217024 s, 2.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.1119 s, 469 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.133482 s, 393 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0407594 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.147764 s, 355 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0566795 s, 925 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0627775 s, 835 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0553134 s, 948 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0671012 s, 781 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0788642 s, 665 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0557746 s, 940 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0849497 s, 617 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0585889 s, 895 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0432576 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0530814 s, 988 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0388024 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0197336 s, 2.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0949447 s, 552 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0630329 s, 832 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.130143 s, 403 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0941268 s, 557 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0287008 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0681292 s, 770 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0407882 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0756874 s, 693 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0257078 s, 2.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0436258 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0802337 s, 653 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0876311 s, 598 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0937454 s, 559 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0505099 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0512894 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0399304 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0633557 s, 828 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0504269 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0989022 s, 530 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0735627 s, 713 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0972466 s, 539 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0192705 s, 2.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.109527 s, 479 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0615543 s, 852 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0230358 s, 2.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.115547 s, 454 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0895241 s, 586 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0467294 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0742251 s, 706 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0183452 s, 2.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0941606 s, 557 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0985898 s, 532 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.083271 s, 630 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0826889 s, 634 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0351521 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0251827 s, 2.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0664191 s, 789 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0269199 s, 1.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0909573 s, 576 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0702286 s, 747 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0578242 s, 907 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0660576 s, 794 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0652263 s, 804 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.046383 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0607872 s, 862 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0411049 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0294277 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0992104 s, 528 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0999369 s, 525 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0242193 s, 2.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0605607 s, 866 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0498103 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0510623 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0811381 s, 646 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0640918 s, 818 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0838008 s, 626 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0387436 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0382292 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0599511 s, 875 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0655663 s, 800 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0733571 s, 715 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0474033 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0615058 s, 852 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0612866 s, 855 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0786088 s, 667 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0852402 s, 615 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0870093 s, 603 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0894345 s, 586 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0515774 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0625054 s, 839 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0692944 s, 757 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0809492 s, 648 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0643966 s, 814 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.132428 s, 396 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0235528 s, 2.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0254743 s, 2.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0712713 s, 736 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0444262 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0630837 s, 831 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0237749 s, 2.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0483228 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0471221 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0546189 s, 960 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0235608 s, 2.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0413438 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0615347 s, 852 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0285496 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.045996 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.133842 s, 392 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111494 s, 470 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0872353 s, 601 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0440439 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0359947 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0951781 s, 551 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0715035 s, 733 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.028813 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.063436 s, 826 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0427588 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0469333 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0657629 s, 797 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.03123 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0510118 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0535001 s, 980 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0643359 s, 815 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0551606 s, 950 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0659778 s, 795 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0624201 s, 840 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0370267 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0411558 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0483703 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0926311 s, 566 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0753132 s, 696 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0512702 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0940833 s, 557 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0540385 s, 970 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.11321 s, 463 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0789173 s, 664 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0693189 s, 756 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0469121 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.053667 s, 977 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0593023 s, 884 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0329902 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0823209 s, 637 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120121 s, 436 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0590868 s, 887 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0595752 s, 880 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0394115 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.122287 s, 429 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0968264 s, 541 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0824709 s, 636 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0355351 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0601176 s, 872 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0326469 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0718816 s, 729 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0434064 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0627164 s, 836 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0485172 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0267922 s, 2.0 GB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0583045 s, 899 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0659306 s, 795 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0708419 s, 740 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0701082 s, 748 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0512447 s, 1.0 GB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108269 s, 484 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0764533 s, 686 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.135865 s, 386 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.105012 s, 499 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.047119 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108251 s, 484 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0489571 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0637985 s, 822 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0411123 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.036854 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0654112 s, 802 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0650352 s, 806 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0655394 s, 800 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.10856 s, 483 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0759538 s, 690 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0924236 s, 567 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.096114 s, 545 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0824715 s, 636 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121775 s, 431 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.067132 s, 781 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0811616 s, 646 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0718005 s, 730 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0312574 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0461867 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0747469 s, 701 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0481941 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0783715 s, 669 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136401 s, 384 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0319185 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0368429 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0505388 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.053078 s, 988 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0761686 s, 688 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0234601 s, 2.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0325405 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0614162 s, 854 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0385344 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.050898 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0636288 s, 824 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.039346 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0408059 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0602509 s, 870 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0553202 s, 948 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0253452 s, 2.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0474253 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0608939 s, 861 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0327061 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0965104 s, 543 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0871791 s, 601 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0815596 s, 643 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0817557 s, 641 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0730426 s, 718 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0488526 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0324906 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0475121 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0818472 s, 641 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0717713 s, 730 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113518 s, 462 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0636406 s, 824 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.141504 s, 371 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.030088 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0387792 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0487943 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0528675 s, 992 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12732 s, 412 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0524338 s, 1000 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.089451 s, 586 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0604775 s, 867 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0628941 s, 834 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0759113 s, 691 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0428473 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0700692 s, 748 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0392825 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0464605 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0690227 s, 760 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0877179 s, 598 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.046966 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.053218 s, 985 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0566342 s, 926 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0279483 s, 1.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0568887 s, 922 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0519612 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0508806 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0646156 s, 811 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0350826 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0701804 s, 747 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0759275 s, 691 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.054276 s, 966 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0758606 s, 691 MB/s
Finish ========
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0766716 s, 684 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0345278 s, 1.5 GB/s
detach: must specify one or more FIDs
Detach given files from the Persistent Client Cache.
usage: lfs pcc detach [-k] FILE [...]

lfs commands used to interact with PCC features:
lfs pcc attach - attach given files to Persistent Client Cache
lfs pcc attach_fid - attach given files into PCC by FID(s)
lfs pcc state  - display the PCC state for given files
lfs pcc detach - detach given files from Persistent Client Cache
lfs pcc detach_fid - detach given files from PCC by FID(s)
lfs pcc delete - delete the PCC layout componenet for given files
lfs pcc pin - pin give files for PCC
lfs pcc unpin - unpin given files for PCC

llite.lustre-ffff927e83f39000.pcc_async_threshold=1073741824
llite.lustre-ffff927ea0953800.pcc_async_threshold=1073741824
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d96.sanity-pcc is idle now
PASS 96 (71s)

== sanity-pcc test 97: two mmap I/O and layout lock cancel ========================================================== 15:22:28 (1761247348)
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.249187 s, 252 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d97.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: 39c23cee-7ee3-4b01-bc97-ac063bef5cb5
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f97.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=39c23cee-7ee3-4b01-bc97-ac063bef5cb5 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d97.sanity-pcc/d97.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
llite.lustre-ffff927e83f39000.pcc_async_threshold=1G
llite.lustre-ffff927ea0953800.pcc_async_threshold=1G
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.05378 s, 49.8 MB/s
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
llite.lustre-ffff927e83f39000.pcc_async_threshold=1073741824
llite.lustre-ffff927ea0953800.pcc_async_threshold=1073741824
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d97.sanity-pcc is idle now
PASS 97 (132s)

== sanity-pcc test 98: racer between auto attach and mmap I/O ========================================================== 15:24:40 (1761247480)
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.119485 s, 527 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d98.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: d2398f39-e514-47b4-8bac-6618abd5f383
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f98.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=d2398f39-e514-47b4-8bac-6618abd5f383 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d98.sanity-pcc/d98.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
llite.lustre-ffff927e83f39000.pcc_async_threshold=0
llite.lustre-ffff927ea0953800.pcc_async_threshold=0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.02223 s, 51.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.941256 s, 55.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.987397 s, 53.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.992195 s, 52.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0880463 s, 595 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0543672 s, 964 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123838 s, 423 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.11249 s, 47.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.00223 s, 52.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.15542 s, 45.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.21763 s, 43.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.63302 s, 32.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.64387 s, 31.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.772673 s, 67.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.819926 s, 63.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.622307 s, 84.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.9496 s, 26.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.648739 s, 80.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.66718 s, 31.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.77372 s, 29.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.67958 s, 31.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.98442 s, 26.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.09844 s, 25.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.08537 s, 25.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0978493 s, 536 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.394005 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.129541 s, 405 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.14432 s, 45.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.16929 s, 44.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.16104 s, 45.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.764124 s, 68.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.958766 s, 54.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.68783 s, 31.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.863597 s, 60.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.762041 s, 68.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.401316 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.483662 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.10448 s, 47.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.0708 s, 49.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.08326 s, 48.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.30803 s, 40.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.07957 s, 48.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.09058 s, 48.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.787587 s, 66.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.883685 s, 59.3 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.21905 s, 43.0 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 1.02228 s, 51.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.3379 s, 39.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.52213 s, 34.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.39755 s, 37.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0787105 s, 666 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0409308 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.767386 s, 68.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.585878 s, 89.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.330194 s, 159 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.734201 s, 71.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.352591 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.739166 s, 70.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.69801 s, 30.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.69339 s, 31.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.72797 s, 30.3 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.14677 s, 45.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.02325 s, 51.2 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 1.11201 s, 47.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.32862 s, 39.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.79475 s, 29.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.85945 s, 28.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.705675 s, 74.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0632684 s, 829 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0826744 s, 634 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0753851 s, 695 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.81322 s, 28.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.49241 s, 35.1 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 1.49303 s, 35.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.862422 s, 60.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.17502 s, 44.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.906938 s, 57.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.786697 s, 66.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.865707 s, 60.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.762487 s, 68.8 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.72375 s, 30.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.81431 s, 28.9 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 1.84006 s, 28.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0510299 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0831882 s, 630 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.332727 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.804738 s, 65.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.403832 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.96914 s, 54.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.10701 s, 47.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.07867 s, 48.6 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.104757 s, 500 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.0650545 s, 806 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.920286 s, 57.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.914816 s, 57.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.20609 s, 43.5 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.112148 s, 467 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.406116 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0792363 s, 662 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.994042 s, 52.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.00235 s, 52.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.891837 s, 58.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.689765 s, 76.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.697449 s, 75.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.61128 s, 85.8 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.658441 s, 79.6 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.727586 s, 72.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.833008 s, 62.9 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.48664 s, 108 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.607021 s, 86.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.485115 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.663201 s, 79.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.582709 s, 90.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.24296 s, 42.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.724081 s, 72.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.642267 s, 81.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.059 s, 49.5 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.37738 s, 38.1 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 1.37545 s, 38.1 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.748644 s, 70.0 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 1.04962 s, 50.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.693774 s, 75.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.15745 s, 45.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.90425 s, 27.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.770566 s, 68.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.389643 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.64796 s, 80.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.28308 s, 40.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.35549 s, 38.7 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.25241 s, 41.9 MB/s

llite.lustre-ffff927e83f39000.pcc_async_threshold=1073741824
llite.lustre-ffff927ea0953800.pcc_async_threshold=1073741824
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d98.sanity-pcc is idle now
PASS 98 (73s)

== sanity-pcc test 99: race among unlink | mmap read | write | detach for PCC-RO file ========================================================== 15:25:53 (1761247553)
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.136052 s, 462 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d99.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: e1d3bec7-f3b0-4e86-91fb-493735cc4b09
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f99.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=e1d3bec7-f3b0-4e86-91fb-493735cc4b09 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.08839 s, 48.2 MB/s
Read /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.14533 s, 45.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.18557 s, 44.2 MB/s
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.38444 s, 37.9 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0699056 s, 750 MB/s
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.06927 s, 49.0 MB/s
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0350451 s, 1.5 GB/s
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.644187 s, 81.4 MB/s
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.542082 s, 96.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.858571 s, 61.1 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.686155 s, 76.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.900308 s, 58.2 MB/s
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.19783 s, 43.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0265777 s, 2.0 GB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Read /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.953656 s, 55.0 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100844 s, 520 MB/s
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.999767 s, 52.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0739301 s, 709 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Read /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.65423 s, 80.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.1293 s, 46.4 MB/s
Read /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.8934 s, 27.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0218661 s, 2.4 GB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Read /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.29041 s, 40.6 MB/s
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114644 s, 457 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.00425 s, 52.2 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.37622 s, 38.1 MB/s
Read /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.991233 s, 52.9 MB/s
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0940738 s, 557 MB/s
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.21417 s, 43.2 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.62849 s, 32.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0971946 s, 539 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Read /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.993422 s, 52.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0504479 s, 1.0 GB/s
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.32328 s, 39.6 MB/s
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0352955 s, 1.5 GB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.6653 s, 31.5 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.491293 s, 107 MB/s
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.08228 s, 48.4 MB/s
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106926 s, 490 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Read /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.04028 s, 50.4 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0772919 s, 678 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Read /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.00482 s, 52.2 MB/s
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.846712 s, 61.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.731264 s, 71.7 MB/s
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.07916 s, 48.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0292392 s, 1.8 GB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.747558 s, 70.1 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.18238 s, 44.3 MB/s
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.07162 s, 48.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.14351 s, 45.8 MB/s
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.15877 s, 45.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.41092 s, 37.2 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Read /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.20165 s, 43.6 MB/s
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.43242 s, 36.6 MB/s
Read /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.109711 s, 478 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.23359 s, 42.5 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0470622 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.936517 s, 56.0 MB/s
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.77367 s, 29.6 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Read /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.98492 s, 26.4 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.87318 s, 28.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0268489 s, 2.0 GB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Read /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.40967 s, 37.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0473154 s, 1.1 GB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Read /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.844487 s, 62.1 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.267 s, 41.4 MB/s
Read /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
==== DONE ====
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.54373 s, 34.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0416903 s, 1.3 GB/s
==== DONE WIAT ====
osc.lustre-OST0000-osc-ffff927e83f39000.rpc_stats=
snapshot_time:            1761247618.970754294 secs.nsecs
start_time:               1761247022.157915190 secs.nsecs
elapsed_time:             596.812839104 secs.nsecs
read RPCs in flight:  0
write RPCs in flight: 0
DIO RPCs in flight: 0
pending write pages:  0
pending read pages:   0

			read			write
pages per rpc         rpcs   % cum % |       rpcs   % cum %
1:		       210   4   4   |          3   0   0
2:		         7   0   4   |          0   0   0
4:		         1   0   4   |          0   0   0
8:		         3   0   4   |          0   0   0
16:		       475   9  13   |          0   0   0
32:		        35   0  14   |          0   0   0
64:		        51   0  15   |          0   0   0
128:		        71   1  16   |          0   0   0
256:		      4283  83 100   |       1950  99 100

			read			write
rpcs in flight        rpcs   % cum % |       rpcs   % cum %
1:		      1205  23  23   |        361  18  18
2:		       500   9  33   |        658  33  52
3:		       338   6  39   |        417  21  73
4:		       316   6  45   |        252  12  86
5:		       254   4  50   |        107   5  91
6:		       261   5  55   |         69   3  95
7:		       313   6  62   |         40   2  97
8:		       483   9  71   |         27   1  98
9:		      1263  24  96   |         22   1 100
10:		        13   0  96   |          0   0 100
11:		        14   0  96   |          0   0 100
12:		        12   0  96   |          0   0 100
13:		        11   0  97   |          0   0 100
14:		        11   0  97   |          0   0 100
15:		        12   0  97   |          0   0 100
16:		        10   0  97   |          0   0 100
17:		         9   0  97   |          0   0 100
18:		         8   0  97   |          0   0 100
19:		         8   0  98   |          0   0 100
20:		         8   0  98   |          0   0 100
21:		         7   0  98   |          0   0 100
22:		         6   0  98   |          0   0 100
23:		         6   0  98   |          0   0 100
24:		         6   0  98   |          0   0 100
25:		         5   0  98   |          0   0 100
26:		         5   0  98   |          0   0 100
27:		         5   0  99   |          0   0 100
28:		         6   0  99   |          0   0 100
29:		         5   0  99   |          0   0 100
30:		         4   0  99   |          0   0 100
31:		        32   0 100   |          0   0 100

			read			write
offset                rpcs   % cum % |       rpcs   % cum %
0:		       102   1   1   |         42   2   2
1:		        21   0   2   |          0   0   2
2:		        36   0   3   |          0   0   2
4:		         0   0   3   |          0   0   2
8:		         1   0   3   |          0   0   2
16:		        41   0   3   |          0   0   2
32:		        64   1   5   |          0   0   2
64:		        83   1   6   |          0   0   2
128:		        96   1   8   |          0   0   2
256:		       113   2  10   |         39   1   4
512:		       234   4  15   |         78   3   8
1024:		       486   9  24   |        156   7  16
2048:		       806  15  40   |        312  15  32
4096:		      1461  28  69   |        624  31  64
8192:		      1592  30 100   |        702  35 100

			read			write
RPC latency (us)       count   % cum % |       count   % cum %
0:		         0   0   0   |          0   0   0
1:		         0   0   0   |          0   0   0
2:		         0   0   0   |          0   0   0
4:		         0   0   0   |          0   0   0
8:		         0   0   0   |          0   0   0
16:		         0   0   0   |          0   0   0
32:		         0   0   0   |          0   0   0
64:		         0   0   0   |          0   0   0
128:		         0   0   0   |          0   0   0
256:		         0   0   0   |          0   0   0
512:		         0   0   0   |          0   0   0
1024:		         0   0   0   |          0   0   0
2048:		        19   0   0   |          1   0   0
4096:		       184   3   3   |          1   0   0
8192:		       373   7  11   |        117   5   6
16384:		       787  15  26   |        726  37  43
32768:		      1714  33  59   |        870  44  87
65536:		      1804  35  95   |        262  13 101
131072:		       344   6 101   |         21   1 102
262144:		        31   0 102   |          0   0 102
524288:		         0   0 102   |          0   0 102
1048576:		         0   0 102   |          0   0 102
2097152:		         0   0 102   |          0   0 102
4194304:		         0   0 102   |          0   0 102
8388608:		         0   0 102   |          0   0 102
16777216:		         0   0 102   |          0   0 102
33554432:		         0   0 102   |          0   0 102
67108864:		         0   0 102   |          0   0 102
134217728:		         0   0 102   |          0   0 102
268435456:		         0   0 102   |          0   0 102
536870912:		         0   0 102   |          0   0 102
1073741824:		         0   0 102   |          0   0 102
osc.lustre-OST0000-osc-ffff927ea0953800.rpc_stats=
snapshot_time:            1761247618.970947254 secs.nsecs
start_time:               1761247024.647042071 secs.nsecs
elapsed_time:             594.323905183 secs.nsecs
read RPCs in flight:  0
write RPCs in flight: 0
DIO RPCs in flight: 0
pending write pages:  0
pending read pages:   0

			read			write
pages per rpc         rpcs   % cum % |       rpcs   % cum %
1:		         0   0   0   |          0   0   0
2:		         0   0   0   |          0   0   0
4:		         0   0   0   |          0   0   0
8:		         0   0   0   |          0   0   0
16:		         0   0   0   |          0   0   0
32:		         0   0   0   |          0   0   0
64:		         0   0   0   |          0   0   0
128:		         0   0   0   |          0   0   0
256:		        50 100 100   |          0   0   0

			read			write
rpcs in flight        rpcs   % cum % |       rpcs   % cum %
1:		         5  10  10   |          0   0   0
2:		         3   6  16   |          0   0   0
3:		         2   4  20   |          0   0   0
4:		         2   4  24   |          0   0   0
5:		         1   2  26   |          0   0   0
6:		         1   2  28   |          0   0   0
7:		         3   6  34   |          0   0   0
8:		         9  18  52   |          0   0   0
9:		        24  48 100   |          0   0   0

			read			write
offset                rpcs   % cum % |       rpcs   % cum %
0:		         1   2   2   |          0   0   0
1:		         0   0   2   |          0   0   0
2:		         0   0   2   |          0   0   0
4:		         0   0   2   |          0   0   0
8:		         0   0   2   |          0   0   0
16:		         0   0   2   |          0   0   0
32:		         0   0   2   |          0   0   0
64:		         0   0   2   |          0   0   0
128:		         0   0   2   |          0   0   0
256:		         1   2   4   |          0   0   0
512:		         2   4   8   |          0   0   0
1024:		         4   8  16   |          0   0   0
2048:		         8  16  32   |          0   0   0
4096:		        16  32  64   |          0   0   0
8192:		        18  36 100   |          0   0   0

			read			write
RPC latency (us)       count   % cum % |       count   % cum %
0:		         0   0   0   |          0   0   0
1:		         0   0   0   |          0   0   0
2:		         0   0   0   |          0   0   0
4:		         0   0   0   |          0   0   0
8:		         0   0   0   |          0   0   0
16:		         0   0   0   |          0   0   0
32:		         0   0   0   |          0   0   0
64:		         0   0   0   |          0   0   0
128:		         0   0   0   |          0   0   0
256:		         0   0   0   |          0   0   0
512:		         0   0   0   |          0   0   0
1024:		         0   0   0   |          0   0   0
2048:		         0   0   0   |          0   0   0
4096:		         0   0   0   |          0   0   0
8192:		         1   2   2   |          0   0   0
16384:		         4   8  10   |          0   0   0
32768:		         3   6  16   |          0   0   0
65536:		         9  18  34   |          0   0   0
131072:		        33  66 100   |          0   0   0
osc.lustre-OST0001-osc-ffff927e83f39000.rpc_stats=
snapshot_time:            1761247618.971048765 secs.nsecs
start_time:               1761247022.159854505 secs.nsecs
elapsed_time:             596.811194260 secs.nsecs
read RPCs in flight:  0
write RPCs in flight: 0
DIO RPCs in flight: 0
pending write pages:  0
pending read pages:   0

			read			write
pages per rpc         rpcs   % cum % |       rpcs   % cum %
1:		         3   0   0   |          3   1   1
2:		         0   0   0   |          0   0   1
4:		         0   0   0   |          0   0   1
8:		         0   0   0   |          0   0   1
16:		         0   0   0   |          0   0   1
32:		         0   0   0   |          0   0   1
64:		         0   0   0   |          0   0   1
128:		         1   0   1   |          0   0   1
256:		       352  98 100   |        150  98 100

			read			write
rpcs in flight        rpcs   % cum % |       rpcs   % cum %
1:		        38  10  10   |         40  26  26
2:		        28   7  18   |         79  51  77
3:		        19   5  23   |         26  16  94
4:		        19   5  29   |          1   0  95
5:		        14   3  33   |          4   2  98
6:		        14   3  37   |          2   1  99
7:		        18   5  42   |          1   0 100
8:		        37  10  52   |          0   0 100
9:		       169  47 100   |          0   0 100

			read			write
offset                rpcs   % cum % |       rpcs   % cum %
0:		        12   3   3   |          6   3   3
1:		         0   0   3   |          0   0   3
2:		         0   0   3   |          0   0   3
4:		         0   0   3   |          0   0   3
8:		         0   0   3   |          0   0   3
16:		         0   0   3   |          0   0   3
32:		         0   0   3   |          0   0   3
64:		         0   0   3   |          0   0   3
128:		         0   0   3   |          0   0   3
256:		         8   2   5   |          3   1   5
512:		        14   3   9   |          6   3   9
1024:		        29   8  17   |         12   7  17
2048:		        55  15  33   |         24  15  33
4096:		       112  31  64   |         48  31  64
8192:		       126  35 100   |         54  35 100

			read			write
RPC latency (us)       count   % cum % |       count   % cum %
0:		         0   0   0   |          0   0   0
1:		         0   0   0   |          0   0   0
2:		         0   0   0   |          0   0   0
4:		         0   0   0   |          0   0   0
8:		         0   0   0   |          0   0   0
16:		         0   0   0   |          0   0   0
32:		         0   0   0   |          0   0   0
64:		         0   0   0   |          0   0   0
128:		         0   0   0   |          0   0   0
256:		         0   0   0   |          0   0   0
512:		         0   0   0   |          0   0   0
1024:		         0   0   0   |          0   0   0
2048:		         1   0   0   |          1   0   0
4096:		         2   0   0   |          1   0   1
8192:		         2   0   1   |         34  22  23
16384:		         8   2   3   |         87  56  80
32768:		        89  25  28   |         31  20 100
65536:		        55  15  44   |          1   0 101
131072:		         0   0  44   |          0   0 101
262144:		         0   0  44   |          0   0 101
524288:		        43  12  56   |          0   0 101
1048576:		       163  45 101   |          0   0 101
2097152:		         0   0 101   |          0   0 101
4194304:		         0   0 101   |          0   0 101
8388608:		         0   0 101   |          0   0 101
16777216:		         0   0 101   |          0   0 101
33554432:		         0   0 101   |          0   0 101
67108864:		         0   0 101   |          0   0 101
134217728:		         0   0 101   |          0   0 101
268435456:		         0   0 101   |          0   0 101
536870912:		         0   0 101   |          0   0 101
1073741824:		         0   0 101   |          0   0 101
osc.lustre-OST0001-osc-ffff927ea0953800.rpc_stats=
snapshot_time:            1761247618.971441049 secs.nsecs
start_time:               1761247024.647577026 secs.nsecs
elapsed_time:             594.323864023 secs.nsecs
read RPCs in flight:  0
write RPCs in flight: 0
DIO RPCs in flight: 0
pending write pages:  0
pending read pages:   0

			read			write
pages per rpc         rpcs   % cum % |       rpcs   % cum %
1:		         0   0   0   |          0   0   0
2:		         0   0   0   |          0   0   0
4:		         1   0   0   |          0   0   0
8:		         1   0   1   |          0   0   0
16:		         0   0   1   |          0   0   0
32:		         0   0   1   |          0   0   0
64:		         0   0   1   |          0   0   0
128:		         1   0   1   |          0   0   0
256:		       150  98 100   |          0   0   0

			read			write
rpcs in flight        rpcs   % cum % |       rpcs   % cum %
1:		        10   6   6   |          0   0   0
2:		         8   5  11   |          0   0   0
3:		         8   5  16   |          0   0   0
4:		         6   3  20   |          0   0   0
5:		         7   4  25   |          0   0   0
6:		         7   4  30   |          0   0   0
7:		         8   5  35   |          0   0   0
8:		        23  15  50   |          0   0   0
9:		        76  49 100   |          0   0   0

			read			write
offset                rpcs   % cum % |       rpcs   % cum %
0:		         3   1   1   |          0   0   0
1:		         0   0   1   |          0   0   0
2:		         0   0   1   |          0   0   0
4:		         0   0   1   |          0   0   0
8:		         0   0   1   |          0   0   0
16:		         0   0   1   |          0   0   0
32:		         0   0   1   |          0   0   0
64:		         0   0   1   |          0   0   0
128:		         0   0   1   |          0   0   0
256:		         3   1   3   |          0   0   0
512:		         6   3   7   |          0   0   0
1024:		        13   8  16   |          0   0   0
2048:		        24  15  32   |          0   0   0
4096:		        50  32  64   |          0   0   0
8192:		        54  35 100   |          0   0   0

			read			write
RPC latency (us)       count   % cum % |       count   % cum %
0:		         0   0   0   |          0   0   0
1:		         0   0   0   |          0   0   0
2:		         0   0   0   |          0   0   0
4:		         0   0   0   |          0   0   0
8:		         0   0   0   |          0   0   0
16:		         0   0   0   |          0   0   0
32:		         0   0   0   |          0   0   0
64:		         0   0   0   |          0   0   0
128:		         0   0   0   |          0   0   0
256:		         0   0   0   |          0   0   0
512:		         0   0   0   |          0   0   0
1024:		         0   0   0   |          0   0   0
2048:		         1   0   0   |          0   0   0
4096:		         0   0   0   |          0   0   0
8192:		         0   0   0   |          0   0   0
16384:		        12   7   8   |          0   0   0
32768:		        60  39  47   |          0   0   0
65536:		        66  43  90   |          0   0   0
131072:		        16  10 101   |          0   0   0
262144:		         0   0 101   |          0   0   0
524288:		         0   0 101   |          0   0   0
1048576:		         0   0 101   |          0   0   0
2097152:		         0   0 101   |          0   0   0
4194304:		         0   0 101   |          0   0   0
8388608:		         0   0 101   |          0   0   0
16777216:		         0   0 101   |          0   0   0
33554432:		         0   0 101   |          0   0   0
67108864:		         0   0 101   |          0   0   0
134217728:		         0   0 101   |          0   0   0
268435456:		         0   0 101   |          0   0   0
536870912:		         0   0 101   |          0   0   0
1073741824:		         0   0 101   |          0   0   0
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d99.sanity-pcc is idle now
PASS 99 (72s)

== sanity-pcc test 99b: race among unlink | two readers | write | detach for PCC-RO file ========================================================== 15:27:05 (1761247625)
200+0 records in
200+0 records out
209715200 bytes (210 MB, 200 MiB) copied, 0.877717 s, 239 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d99b.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:   8192/204800 57344/204800             done                            
Creating filesystem with 204800 1k blocks and 51200 inodes
Filesystem UUID: 012c6a6c-f426-4c26-8797-4faca0adc4c6
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345, 73729

Allocating group tables:  0/25     done                            
Writing inode tables:  0/25     done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information:  0/25     done

/tmp/f99b.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=012c6a6c-f426-4c26-8797-4faca0adc4c6 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.19673 s, 43.8 MB/s
Read /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.36218 s, 38.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.56215 s, 33.6 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0755193 s, 694 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0988999 s, 530 MB/s
Read /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.15105 s, 45.5 MB/s
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.70135 s, 30.8 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0465538 s, 1.1 GB/s
Read /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0784562 s, 668 MB/s
Read /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.814807 s, 64.3 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Read /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.070256 s, 746 MB/s
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.06109 s, 25.4 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.14296 s, 45.9 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.885 s, 27.8 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.79773 s, 29.2 MB/s
Read /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0931432 s, 563 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.893664 s, 58.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0505527 s, 1.0 GB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Read /mnt/lustre/f99b.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.19005 s, 44.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.91718 s, 27.3 MB/s
Read /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.17457 s, 24.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.91026 s, 27.4 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.3213 s, 39.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.43878 s, 36.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0459621 s, 1.1 GB/s
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
Read /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.40764 s, 37.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.42807 s, 36.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0305925 s, 1.7 GB/s
Read /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.72403 s, 30.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.60122 s, 32.7 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0479372 s, 1.1 GB/s
Read /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.993598 s, 52.8 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.62109 s, 32.3 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.74713 s, 30.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.45 s, 36.2 MB/s
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.109342 s, 479 MB/s
Read /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.652159 s, 80.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.045498 s, 1.2 GB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.42013 s, 36.9 MB/s
Read /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.3806 s, 38.0 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Read /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.36141 s, 38.5 MB/s
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.36902 s, 38.3 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.23494 s, 42.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0365777 s, 1.4 GB/s
Read /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.953706 s, 55.0 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.55381 s, 33.7 MB/s
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.755883 s, 69.4 MB/s
Read /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0513945 s, 1.0 GB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.35264 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.01194 s, 51.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0285838 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0226675 s, 2.3 GB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Read /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.86329 s, 60.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.684096 s, 76.6 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Read /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.30401 s, 40.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.30138 s, 40.3 MB/s
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0304233 s, 1.7 GB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Read /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.831078 s, 63.1 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.42575 s, 36.8 MB/s
Read /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.66145 s, 31.6 MB/s
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.30349 s, 40.2 MB/s
Read /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.86003 s, 28.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0590519 s, 888 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0237232 s, 2.2 GB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Read /mnt/lustre/f99b.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.14794 s, 45.7 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.69908 s, 30.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0629384 s, 833 MB/s
Read /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.17423 s, 44.6 MB/s
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Read /mnt/lustre/f99b.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0921317 s, 569 MB/s
Read /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.77842 s, 29.5 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.74721 s, 30.0 MB/s
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.74058 s, 30.1 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.37337 s, 38.2 MB/s
Read /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.04142 s, 50.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0323389 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0545552 s, 961 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Read /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0242388 s, 2.2 GB/s
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.811822 s, 64.6 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.3796 s, 38.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0631792 s, 830 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121958 s, 430 MB/s
Read /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.35988 s, 38.6 MB/s
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.12107 s, 24.7 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Read /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0595224 s, 881 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0681512 s, 769 MB/s
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
Read /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.647923 s, 80.9 MB/s
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0': No such file or directory
Read /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.56082 s, 33.6 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61f0/0x2000061c1:0x31:0x0
==== DONE ====
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.49999 s, 35.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.49651 s, 35.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.042096 s, 1.2 GB/s
==== DONE WIAT ====
osc.lustre-OST0000-osc-ffff927e83f39000.rpc_stats=
snapshot_time:            1761247692.412470732 secs.nsecs
start_time:               1761247022.157915190 secs.nsecs
elapsed_time:             670.254555542 secs.nsecs
read RPCs in flight:  0
write RPCs in flight: 0
DIO RPCs in flight: 0
pending write pages:  0
pending read pages:   0

			read			write
pages per rpc         rpcs   % cum % |       rpcs   % cum %
1:		       210   3   3   |          3   0   0
2:		         7   0   3   |          0   0   0
4:		         1   0   3   |          0   0   0
8:		         3   0   3   |          0   0   0
16:		       475   6  10   |          0   0   0
32:		        35   0  10   |          0   0   0
64:		        51   0  11   |          0   0   0
128:		        71   1  12   |          0   0   0
256:		      5955  87 100   |       3450  99 100

			read			write
rpcs in flight        rpcs   % cum % |       rpcs   % cum %
1:		      1464  21  21   |        539  15  15
2:		       685  10  31   |       1041  30  45
3:		       501   7  38   |        730  21  66
4:		       498   7  46   |        472  13  80
5:		       411   6  52   |        271   7  88
6:		       419   6  58   |        179   5  93
7:		       459   6  65   |        101   2  96
8:		       632   9  74   |         57   1  98
9:		      1536  22  97   |         63   1 100
10:		        13   0  97   |          0   0 100
11:		        14   0  97   |          0   0 100
12:		        12   0  97   |          0   0 100
13:		        11   0  97   |          0   0 100
14:		        11   0  97   |          0   0 100
15:		        12   0  98   |          0   0 100
16:		        10   0  98   |          0   0 100
17:		         9   0  98   |          0   0 100
18:		         8   0  98   |          0   0 100
19:		         8   0  98   |          0   0 100
20:		         8   0  98   |          0   0 100
21:		         7   0  98   |          0   0 100
22:		         6   0  98   |          0   0 100
23:		         6   0  99   |          0   0 100
24:		         6   0  99   |          0   0 100
25:		         5   0  99   |          0   0 100
26:		         5   0  99   |          0   0 100
27:		         5   0  99   |          0   0 100
28:		         6   0  99   |          0   0 100
29:		         5   0  99   |          0   0 100
30:		         4   0  99   |          0   0 100
31:		        32   0 100   |          0   0 100

			read			write
offset                rpcs   % cum % |       rpcs   % cum %
0:		       141   2   2   |         72   2   2
1:		        21   0   2   |          0   0   2
2:		        36   0   2   |          0   0   2
4:		         0   0   2   |          0   0   2
8:		         1   0   2   |          0   0   2
16:		        41   0   3   |          0   0   2
32:		        64   0   4   |          0   0   2
64:		        83   1   5   |          0   0   2
128:		        96   1   7   |          0   0   2
256:		       147   2   9   |         69   1   4
512:		       304   4  13   |        138   3   8
1024:		       618   9  22   |        276   7  16
2048:		      1058  15  38   |        552  15  32
4096:		      1996  29  67   |       1104  31  64
8192:		      2202  32 100   |       1242  35 100

			read			write
RPC latency (us)       count   % cum % |       count   % cum %
0:		         0   0   0   |          0   0   0
1:		         0   0   0   |          0   0   0
2:		         0   0   0   |          0   0   0
4:		         0   0   0   |          0   0   0
8:		         0   0   0   |          0   0   0
16:		         0   0   0   |          0   0   0
32:		         0   0   0   |          0   0   0
64:		         0   0   0   |          0   0   0
128:		         0   0   0   |          0   0   0
256:		         0   0   0   |          0   0   0
512:		         0   0   0   |          0   0   0
1024:		         0   0   0   |          0   0   0
2048:		        19   0   0   |          1   0   0
4096:		       184   2   2   |          2   0   0
8192:		       384   5   8   |        141   4   4
16384:		       939  13  22   |        969  28  32
32768:		      2375  34  57   |       1522  44  76
65536:		      2524  37  94   |        796  23  99
131072:		       509   7 101   |         99   2 102
262144:		        34   0 102   |          3   0 102
524288:		         0   0 102   |          0   0 102
1048576:		         0   0 102   |          0   0 102
2097152:		         0   0 102   |          0   0 102
4194304:		         0   0 102   |          0   0 102
8388608:		         0   0 102   |          0   0 102
16777216:		         0   0 102   |          0   0 102
33554432:		         0   0 102   |          0   0 102
67108864:		         0   0 102   |          0   0 102
134217728:		         0   0 102   |          0   0 102
268435456:		         0   0 102   |          0   0 102
536870912:		         0   0 102   |          0   0 102
1073741824:		         0   0 102   |          0   0 102
osc.lustre-OST0000-osc-ffff927ea0953800.rpc_stats=
snapshot_time:            1761247692.412626685 secs.nsecs
start_time:               1761247024.647042071 secs.nsecs
elapsed_time:             667.765584614 secs.nsecs
read RPCs in flight:  0
write RPCs in flight: 0
DIO RPCs in flight: 0
pending write pages:  0
pending read pages:   0

			read			write
pages per rpc         rpcs   % cum % |       rpcs   % cum %
1:		         0   0   0   |          0   0   0
2:		         0   0   0   |          0   0   0
4:		         0   0   0   |          0   0   0
8:		         0   0   0   |          0   0   0
16:		         0   0   0   |          0   0   0
32:		         0   0   0   |          0   0   0
64:		         0   0   0   |          0   0   0
128:		         0   0   0   |          0   0   0
256:		        50 100 100   |          0   0   0

			read			write
rpcs in flight        rpcs   % cum % |       rpcs   % cum %
1:		         5  10  10   |          0   0   0
2:		         3   6  16   |          0   0   0
3:		         2   4  20   |          0   0   0
4:		         2   4  24   |          0   0   0
5:		         1   2  26   |          0   0   0
6:		         1   2  28   |          0   0   0
7:		         3   6  34   |          0   0   0
8:		         9  18  52   |          0   0   0
9:		        24  48 100   |          0   0   0

			read			write
offset                rpcs   % cum % |       rpcs   % cum %
0:		         1   2   2   |          0   0   0
1:		         0   0   2   |          0   0   0
2:		         0   0   2   |          0   0   0
4:		         0   0   2   |          0   0   0
8:		         0   0   2   |          0   0   0
16:		         0   0   2   |          0   0   0
32:		         0   0   2   |          0   0   0
64:		         0   0   2   |          0   0   0
128:		         0   0   2   |          0   0   0
256:		         1   2   4   |          0   0   0
512:		         2   4   8   |          0   0   0
1024:		         4   8  16   |          0   0   0
2048:		         8  16  32   |          0   0   0
4096:		        16  32  64   |          0   0   0
8192:		        18  36 100   |          0   0   0

			read			write
RPC latency (us)       count   % cum % |       count   % cum %
0:		         0   0   0   |          0   0   0
1:		         0   0   0   |          0   0   0
2:		         0   0   0   |          0   0   0
4:		         0   0   0   |          0   0   0
8:		         0   0   0   |          0   0   0
16:		         0   0   0   |          0   0   0
32:		         0   0   0   |          0   0   0
64:		         0   0   0   |          0   0   0
128:		         0   0   0   |          0   0   0
256:		         0   0   0   |          0   0   0
512:		         0   0   0   |          0   0   0
1024:		         0   0   0   |          0   0   0
2048:		         0   0   0   |          0   0   0
4096:		         0   0   0   |          0   0   0
8192:		         1   2   2   |          0   0   0
16384:		         4   8  10   |          0   0   0
32768:		         3   6  16   |          0   0   0
65536:		         9  18  34   |          0   0   0
131072:		        33  66 100   |          0   0   0
osc.lustre-OST0001-osc-ffff927e83f39000.rpc_stats=
snapshot_time:            1761247692.412721475 secs.nsecs
start_time:               1761247022.159854505 secs.nsecs
elapsed_time:             670.252866970 secs.nsecs
read RPCs in flight:  0
write RPCs in flight: 0
DIO RPCs in flight: 0
pending write pages:  0
pending read pages:   0

			read			write
pages per rpc         rpcs   % cum % |       rpcs   % cum %
1:		         3   0   0   |          3   1   1
2:		         0   0   0   |          0   0   1
4:		         0   0   0   |          0   0   1
8:		         0   0   0   |          0   0   1
16:		         0   0   0   |          0   0   1
32:		         0   0   0   |          0   0   1
64:		         0   0   0   |          0   0   1
128:		         1   0   1   |          0   0   1
256:		       352  98 100   |        150  98 100

			read			write
rpcs in flight        rpcs   % cum % |       rpcs   % cum %
1:		        38  10  10   |         40  26  26
2:		        28   7  18   |         79  51  77
3:		        19   5  23   |         26  16  94
4:		        19   5  29   |          1   0  95
5:		        14   3  33   |          4   2  98
6:		        14   3  37   |          2   1  99
7:		        18   5  42   |          1   0 100
8:		        37  10  52   |          0   0 100
9:		       169  47 100   |          0   0 100

			read			write
offset                rpcs   % cum % |       rpcs   % cum %
0:		        12   3   3   |          6   3   3
1:		         0   0   3   |          0   0   3
2:		         0   0   3   |          0   0   3
4:		         0   0   3   |          0   0   3
8:		         0   0   3   |          0   0   3
16:		         0   0   3   |          0   0   3
32:		         0   0   3   |          0   0   3
64:		         0   0   3   |          0   0   3
128:		         0   0   3   |          0   0   3
256:		         8   2   5   |          3   1   5
512:		        14   3   9   |          6   3   9
1024:		        29   8  17   |         12   7  17
2048:		        55  15  33   |         24  15  33
4096:		       112  31  64   |         48  31  64
8192:		       126  35 100   |         54  35 100

			read			write
RPC latency (us)       count   % cum % |       count   % cum %
0:		         0   0   0   |          0   0   0
1:		         0   0   0   |          0   0   0
2:		         0   0   0   |          0   0   0
4:		         0   0   0   |          0   0   0
8:		         0   0   0   |          0   0   0
16:		         0   0   0   |          0   0   0
32:		         0   0   0   |          0   0   0
64:		         0   0   0   |          0   0   0
128:		         0   0   0   |          0   0   0
256:		         0   0   0   |          0   0   0
512:		         0   0   0   |          0   0   0
1024:		         0   0   0   |          0   0   0
2048:		         1   0   0   |          1   0   0
4096:		         2   0   0   |          1   0   1
8192:		         2   0   1   |         34  22  23
16384:		         8   2   3   |         87  56  80
32768:		        89  25  28   |         31  20 100
65536:		        55  15  44   |          1   0 101
131072:		         0   0  44   |          0   0 101
262144:		         0   0  44   |          0   0 101
524288:		        43  12  56   |          0   0 101
1048576:		       163  45 101   |          0   0 101
2097152:		         0   0 101   |          0   0 101
4194304:		         0   0 101   |          0   0 101
8388608:		         0   0 101   |          0   0 101
16777216:		         0   0 101   |          0   0 101
33554432:		         0   0 101   |          0   0 101
67108864:		         0   0 101   |          0   0 101
134217728:		         0   0 101   |          0   0 101
268435456:		         0   0 101   |          0   0 101
536870912:		         0   0 101   |          0   0 101
1073741824:		         0   0 101   |          0   0 101
osc.lustre-OST0001-osc-ffff927ea0953800.rpc_stats=
snapshot_time:            1761247692.412980873 secs.nsecs
start_time:               1761247024.647577026 secs.nsecs
elapsed_time:             667.765403847 secs.nsecs
read RPCs in flight:  0
write RPCs in flight: 0
DIO RPCs in flight: 0
pending write pages:  0
pending read pages:   0

			read			write
pages per rpc         rpcs   % cum % |       rpcs   % cum %
1:		         0   0   0   |          0   0   0
2:		         0   0   0   |          0   0   0
4:		         1   0   0   |          0   0   0
8:		         1   0   1   |          0   0   0
16:		         0   0   1   |          0   0   0
32:		         0   0   1   |          0   0   0
64:		         0   0   1   |          0   0   0
128:		         1   0   1   |          0   0   0
256:		       150  98 100   |          0   0   0

			read			write
rpcs in flight        rpcs   % cum % |       rpcs   % cum %
1:		        10   6   6   |          0   0   0
2:		         8   5  11   |          0   0   0
3:		         8   5  16   |          0   0   0
4:		         6   3  20   |          0   0   0
5:		         7   4  25   |          0   0   0
6:		         7   4  30   |          0   0   0
7:		         8   5  35   |          0   0   0
8:		        23  15  50   |          0   0   0
9:		        76  49 100   |          0   0   0

			read			write
offset                rpcs   % cum % |       rpcs   % cum %
0:		         3   1   1   |          0   0   0
1:		         0   0   1   |          0   0   0
2:		         0   0   1   |          0   0   0
4:		         0   0   1   |          0   0   0
8:		         0   0   1   |          0   0   0
16:		         0   0   1   |          0   0   0
32:		         0   0   1   |          0   0   0
64:		         0   0   1   |          0   0   0
128:		         0   0   1   |          0   0   0
256:		         3   1   3   |          0   0   0
512:		         6   3   7   |          0   0   0
1024:		        13   8  16   |          0   0   0
2048:		        24  15  32   |          0   0   0
4096:		        50  32  64   |          0   0   0
8192:		        54  35 100   |          0   0   0

			read			write
RPC latency (us)       count   % cum % |       count   % cum %
0:		         0   0   0   |          0   0   0
1:		         0   0   0   |          0   0   0
2:		         0   0   0   |          0   0   0
4:		         0   0   0   |          0   0   0
8:		         0   0   0   |          0   0   0
16:		         0   0   0   |          0   0   0
32:		         0   0   0   |          0   0   0
64:		         0   0   0   |          0   0   0
128:		         0   0   0   |          0   0   0
256:		         0   0   0   |          0   0   0
512:		         0   0   0   |          0   0   0
1024:		         0   0   0   |          0   0   0
2048:		         1   0   0   |          0   0   0
4096:		         0   0   0   |          0   0   0
8192:		         0   0   0   |          0   0   0
16384:		        12   7   8   |          0   0   0
32768:		        60  39  47   |          0   0   0
65536:		        66  43  90   |          0   0   0
131072:		        16  10 101   |          0   0   0
262144:		         0   0 101   |          0   0   0
524288:		         0   0 101   |          0   0   0
1048576:		         0   0 101   |          0   0   0
2097152:		         0   0 101   |          0   0   0
4194304:		         0   0 101   |          0   0   0
8388608:		         0   0 101   |          0   0   0
16777216:		         0   0 101   |          0   0   0
33554432:		         0   0 101   |          0   0   0
67108864:		         0   0 101   |          0   0   0
134217728:		         0   0 101   |          0   0   0
268435456:		         0   0 101   |          0   0   0
536870912:		         0   0 101   |          0   0   0
1073741824:		         0   0 101   |          0   0   0
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d99b.sanity-pcc is idle now
PASS 99b (74s)

== sanity-pcc test 100: race among PCC unlink | read | write | detach for PCC-RO file ========================================================== 15:28:19 (1761247699)
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.181756 s, 346 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d100.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: 93801a54-7ea0-47cf-ab4a-973badcc47bf
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f100.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=93801a54-7ea0-47cf-ab4a-973badcc47bf (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.944152 s, 55.5 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0': No such file or directory
7+0 records in
7+0 records out
7340032 bytes (7.3 MB, 7.0 MiB) copied, 0.52417 s, 14.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196709 s, 53.3 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
31+0 records in
31+0 records out
32505856 bytes (33 MB, 31 MiB) copied, 0.260931 s, 125 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.32492 s, 39.6 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.0900866 s, 582 MB/s

Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.958149 s, 54.7 MB/s
0+0 records in
0+0 records out
0 bytes copied, 0.177383 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.0084646 s, 0.0 kB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
29+0 records in
29+0 records out
30408704 bytes (30 MB, 29 MiB) copied, 0.200167 s, 152 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
43+0 records in
43+0 records out
45088768 bytes (45 MB, 43 MiB) copied, 0.109231 s, 413 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.09478 s, 47.9 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
23+0 records in
23+0 records out
24117248 bytes (24 MB, 23 MiB) copied, 0.104429 s, 231 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
12+0 records in
12+0 records out
12582912 bytes (13 MB, 12 MiB) copied, 0.0271663 s, 463 MB/s
25+0 records in
25+0 records out
26214400 bytes (26 MB, 25 MiB) copied, 0.0608585 s, 431 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.25102 s, 41.9 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.427746 s, 123 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
0+0 records in
0+0 records out
0 bytes copied, 0.0915734 s, 0.0 kB/s
3+0 records in
3+0 records out
3145728 bytes (3.1 MB, 3.0 MiB) copied, 0.0231337 s, 136 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
23+0 records in
23+0 records out
24117248 bytes (24 MB, 23 MiB) copied, 0.364166 s, 66.2 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
47+0 records in
47+0 records out
49283072 bytes (49 MB, 47 MiB) copied, 0.509787 s, 96.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.52217 s, 34.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0584277 s, 897 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
0+0 records in
0+0 records out
0 bytes copied, 0.0228042 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.011335 s, 0.0 kB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
41+0 records in
41+0 records out
42991616 bytes (43 MB, 41 MiB) copied, 0.593736 s, 72.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.33728 s, 39.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0705586 s, 743 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0452636 s, 1.2 GB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
0+0 records in
0+0 records out
0 bytes copied, 0.0312295 s, 0.0 kB/s
15+0 records in
15+0 records out
15728640 bytes (16 MB, 15 MiB) copied, 0.0483495 s, 325 MB/s
15+0 records in
15+0 records out
15728640 bytes (16 MB, 15 MiB) copied, 0.044294 s, 355 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.88064 s, 27.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.936574 s, 56.0 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
Detach /mnt/lustre/f100.sanity-pcc ...
49+1 records in
49+1 records out
51515392 bytes (52 MB, 49 MiB) copied, 0.473712 s, 109 MB/s
0+0 records in
0+0 records out
0 bytes copied, 0.208814 s, 0.0 kB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
17+0 records in
17+0 records out
17825792 bytes (18 MB, 17 MiB) copied, 0.177097 s, 101 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
30+0 records in
30+0 records out
31457280 bytes (31 MB, 30 MiB) copied, 0.0813219 s, 387 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.57009 s, 33.4 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
32+0 records in
32+0 records out
33554432 bytes (34 MB, 32 MiB) copied, 0.97058 s, 34.6 MB/s
4+0 records in
4+0 records out
4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.0274668 s, 153 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
23+0 records in
23+0 records out
24117248 bytes (24 MB, 23 MiB) copied, 0.311872 s, 77.3 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.70349 s, 30.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.90554 s, 57.9 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
6+0 records in
6+0 records out
6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.189342 s, 33.2 MB/s
13+0 records in
13+0 records out
13631488 bytes (14 MB, 13 MiB) copied, 0.0545447 s, 250 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.554163 s, 94.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.62192 s, 32.3 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Detach /mnt/lustre/f100.sanity-pcc ...
0+0 records in
0+0 records out
0 bytes copied, 0.0548142 s, 0.0 kB/s
6+0 records in
6+0 records out
6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0202745 s, 310 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
Detach /mnt/lustre/f100.sanity-pcc ...
30+0 records in
30+0 records out
31457280 bytes (31 MB, 30 MiB) copied, 0.474057 s, 66.4 MB/s
42+0 records in
42+0 records out
44040192 bytes (44 MB, 42 MiB) copied, 0.0450899 s, 977 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.40629 s, 37.3 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
31+0 records in
31+0 records out
32505856 bytes (33 MB, 31 MiB) copied, 0.141615 s, 230 MB/s
0+0 records in
0+0 records out
0 bytes copied, 0.0115373 s, 0.0 kB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
30+0 records in
30+0 records out
31457280 bytes (31 MB, 30 MiB) copied, 0.550033 s, 57.2 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
41+0 records in
41+0 records out
42991616 bytes (43 MB, 41 MiB) copied, 0.115728 s, 371 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.8815 s, 27.9 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0479123 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0910263 s, 576 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
12+0 records in
12+0 records out
12582912 bytes (13 MB, 12 MiB) copied, 0.351933 s, 35.8 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
31+0 records in
31+0 records out
32505856 bytes (33 MB, 31 MiB) copied, 0.0359195 s, 905 MB/s
31+0 records in
31+0 records out
32505856 bytes (33 MB, 31 MiB) copied, 0.0706192 s, 460 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.47271 s, 35.6 MB/s
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
12+0 records in
12+0 records out
12582912 bytes (13 MB, 12 MiB) copied, 0.769549 s, 16.4 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195038 s, 53.8 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
28+0 records in
28+0 records out
29360128 bytes (29 MB, 28 MiB) copied, 0.353041 s, 83.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.13567 s, 46.2 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.097886 s, 536 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0354054 s, 1.5 GB/s
0+0 records in
0+0 records out
0 bytes copied, 0.0135952 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.0118678 s, 0.0 kB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
29+0 records in
29+0 records out
30408704 bytes (30 MB, 29 MiB) copied, 0.290529 s, 105 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.17388 s, 44.7 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0505745 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.04192 s, 1.3 GB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
27+0 records in
27+0 records out
28311552 bytes (28 MB, 27 MiB) copied, 0.425097 s, 66.6 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
49+0 records in
49+0 records out
51380224 bytes (51 MB, 49 MiB) copied, 0.114388 s, 449 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.30626 s, 40.1 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
13+0 records in
13+0 records out
13631488 bytes (14 MB, 13 MiB) copied, 0.427888 s, 31.9 MB/s
2+0 records in
2+0 records out
2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0214935 s, 97.6 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
15+0 records in
15+0 records out
15728640 bytes (16 MB, 15 MiB) copied, 0.34574 s, 45.5 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.15338 s, 24.3 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.0918 s, 48.0 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0': No such file or directory
dd: warning: partial read (368640 bytes); suggest iflag=fullblock
7+3 records in
7+3 records out
8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.0308676 s, 272 MB/s
30+0 records in
30+0 records out
31457280 bytes (31 MB, 30 MiB) copied, 0.0784671 s, 401 MB/s
42+0 records in
42+0 records out
44040192 bytes (44 MB, 42 MiB) copied, 0.0554049 s, 795 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.2763 s, 41.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0570964 s, 918 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0374268 s, 1.4 GB/s
Detach /mnt/lustre/f100.sanity-pcc ...
18+0 records in
18+0 records out
18874368 bytes (19 MB, 18 MiB) copied, 0.229993 s, 82.1 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
24+0 records in
24+0 records out
25165824 bytes (25 MB, 24 MiB) copied, 0.0532125 s, 473 MB/s
24+0 records in
24+0 records out
25165824 bytes (25 MB, 24 MiB) copied, 0.0309424 s, 813 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
24+0 records in
24+0 records out
25165824 bytes (25 MB, 24 MiB) copied, 0.0106656 s, 2.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.73308 s, 30.3 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
Detach /mnt/lustre/f100.sanity-pcc ...
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
10+1 records in
10+1 records out
10919936 bytes (11 MB, 10 MiB) copied, 1.00262 s, 10.9 MB/s
3+0 records in
3+0 records out
3145728 bytes (3.1 MB, 3.0 MiB) copied, 0.0709608 s, 44.3 MB/s
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
24+0 records in
24+0 records out
25165824 bytes (25 MB, 24 MiB) copied, 0.425248 s, 59.2 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
40+0 records in
40+0 records out
41943040 bytes (42 MB, 40 MiB) copied, 0.140862 s, 298 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.47199 s, 35.6 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.116084 s, 9.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273126 s, 38.4 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.30967 s, 40.0 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.0864 s, 48.3 MB/s
3+0 records in
3+0 records out
3145728 bytes (3.1 MB, 3.0 MiB) copied, 0.183066 s, 17.2 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.0584779 s, 287 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
38+0 records in
38+0 records out
39845888 bytes (40 MB, 38 MiB) copied, 0.54921 s, 72.6 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
49+0 records in
49+0 records out
51380224 bytes (51 MB, 49 MiB) copied, 0.123263 s, 417 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.04364 s, 25.7 MB/s
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
0+0 records in
0+0 records out
0 bytes copied, 0.000371722 s, 0.0 kB/s
Detach /mnt/lustre/f100.sanity-pcc ...
0+0 records in
0+0 records out
0 bytes copied, 0.147203 s, 0.0 kB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
dd: warning: partial read (950272 bytes); suggest iflag=fullblock
47+2 records in
47+2 records out
50331648 bytes (50 MB, 48 MiB) copied, 0.830805 s, 60.6 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.62317 s, 32.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108464 s, 483 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
0+0 records in
0+0 records out
0 bytes copied, 0.0535644 s, 0.0 kB/s
0+0 records in
0+0 records out
0 bytes copied, 0.0837842 s, 0.0 kB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
Detach /mnt/lustre/f100.sanity-pcc ...
14+0 records in
14+0 records out
14680064 bytes (15 MB, 14 MiB) copied, 0.472858 s, 31.0 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
33+0 records in
33+0 records out
34603008 bytes (35 MB, 33 MiB) copied, 0.0562602 s, 615 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
46+0 records in
46+0 records out
48234496 bytes (48 MB, 46 MiB) copied, 0.0838365 s, 575 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.11714 s, 24.8 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
14+0 records in
14+0 records out
14680064 bytes (15 MB, 14 MiB) copied, 0.816183 s, 18.0 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0527603 s, 19.9 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
36+0 records in
36+0 records out
37748736 bytes (38 MB, 36 MiB) copied, 0.56218 s, 67.1 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.39064 s, 37.7 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0787655 s, 666 MB/s
10+0 records in
10+0 records out
10485760 bytes (10 MB, 10 MiB) copied, 0.0976249 s, 107 MB/s
0+0 records in
0+0 records out
0 bytes copied, 0.0407284 s, 0.0 kB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
Detach /mnt/lustre/f100.sanity-pcc ...
25+0 records in
25+0 records out
26214400 bytes (26 MB, 25 MiB) copied, 0.338739 s, 77.4 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
49+0 records in
49+0 records out
51380224 bytes (51 MB, 49 MiB) copied, 0.0472705 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.48925 s, 35.2 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
48+0 records in
48+0 records out
50331648 bytes (50 MB, 48 MiB) copied, 0.338029 s, 149 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0614246 s, 17.1 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
34+0 records in
34+0 records out
35651584 bytes (36 MB, 34 MiB) copied, 0.412973 s, 86.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.1103 s, 47.2 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0279828 s, 1.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0380396 s, 1.4 GB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0': No such file or directory
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0': No such file or directory
17+0 records in
17+0 records out
17825792 bytes (18 MB, 17 MiB) copied, 0.318622 s, 55.9 MB/s
0+0 records in
0+0 records out
0 bytes copied, 0.125744 s, 0.0 kB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Detach /mnt/lustre/f100.sanity-pcc ...
21+0 records in
21+0 records out
22020096 bytes (22 MB, 21 MiB) copied, 0.353394 s, 62.3 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/618b/0x2000061c1:0x4a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
31+0 records in
31+0 records out
32505856 bytes (33 MB, 31 MiB) copied, 0.042244 s, 769 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.39443 s, 37.6 MB/s
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d100.sanity-pcc is idle now
PASS 100 (70s)

== sanity-pcc test 101a: Test auto attach in mount namespace (simulated container) ========================================================== 15:29:29 (1761247769)
creating user namespace for 500
sanityu+  128692  1.0  0.0 217184   968 pts/0    S+   15:29   0:00 sleep 600
root      128694  0.0  0.0 224088  2064 pts/0    S+   15:29   0:00 grep sleep
Created NS: child (sleep) pid=128692 in 0 seconds
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [newuidmap] [128692] [0] [500] [1]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [newgidmap] [128692] [0] [500] [1]
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.119896 s, 437 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d101a.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: e1bec404-82fe-4081-a1c8-179b1a915a74
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f101a.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=e1bec404-82fe-4081-a1c8-179b1a915a74 (extents) (64bit) (large files) (huge files)
Check for temp file in PCC mount
Check for temp file in PCC mount from inside namespace
Starting copytool 'agt1' on 'oleg624-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d101a.sanity-pcc/d101a.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Verify open attach from inside mount namespace
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00515663 s, 199 kB/s
file: /mnt/lustre/d101a.sanity-pcc/f101a.sanity-pcc, type: readwrite, PCC_file: /d101a.sanity-pcc/619f/0x2000061c1:0x5e:0x0, open_count: 0, flags: 0
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/d101a.sanity-pcc/f101a.sanity-pcc]
ldlm.namespaces.lustre-MDT0000-mdc-ffff927e83f39000.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff927ea0953800.lru_size=clear
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/d101a.sanity-pcc/f101a.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [multiop] [/mnt/lustre/d101a.sanity-pcc/f101a.sanity-pcc] [oc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/d101a.sanity-pcc/f101a.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/d101a.sanity-pcc/f101a.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/d101a.sanity-pcc/f101a.sanity-pcc]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.000727276 s, 1.4 MB/s
Verify auto attach at open from inside NS for RW-PCC
ldlm.namespaces.lustre-MDT0000-mdc-ffff927e83f39000.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff927ea0953800.lru_size=clear
Waiting 200s for 'SUCCEED'
Updated after 2s: want 'SUCCEED' got 'SUCCEED'
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d101a.sanity-pcc is idle now
PASS 101a (13s)

== sanity-pcc test 102: PCC-RO should not hange for io_uring I/O engine ========================================================== 15:29:42 (1761247782)
Your kernel does not support io_uring
 SKIP: sanity-pcc test_102 kernel does not support io_uring fully
SKIP 102 (3s)

== sanity-pcc test 203: Verify attach/hit bytes statistics data ========================================================== 15:29:45 (1761247785)
10+0 records in
10+0 records out
10485760 bytes (10 MB, 10 MiB) copied, 0.0362495 s, 289 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d203.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/10240           done                            
Creating filesystem with 10240 1k blocks and 2560 inodes
Filesystem UUID: 846e0722-1ffd-4e9d-843b-6e491b2fd491
Superblock backups stored on blocks: 
	8193

Allocating group tables: 0/2   done                            
Writing inode tables: 0/2   done                            
Creating journal (2048 blocks): done
Writing superblocks and filesystem accounting information: 0/2   done

/tmp/f203.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=846e0722-1ffd-4e9d-843b-6e491b2fd491 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d203.sanity-pcc/d203.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0136915 s, 74.8 kB/s
==== stats ====
llite.lustre-ffff927e83f39000.stats=
snapshot_time             1761247787.895754589 secs.nsecs
start_time                1761247787.782053650 secs.nsecs
elapsed_time              0.113700939 secs.nsecs
read_bytes                1 samples [bytes] 1024 1024 1024 1048576
write_bytes               1 samples [bytes] 1024 1024 1024 1048576
read                      3 samples [usecs] 195 4816 5223 23276825
write                     1 samples [usecs] 4461 4461 4461 19900521
open                      3 samples [usecs] 29 22390 22470 501315542
close                     3 samples [usecs] 3659 8903 17929 121456379
getattr                   2 samples [usecs] 86 8339 8425 69546317
mknod                     1 samples [usecs] 16158 16158 16158 261080964
inode_permission          7 samples [usecs] 2 4894 5462 24075078
opencount                 3 samples [reqs] 1 3 6 14
openclosetime             2 samples [usecs] 17213 18912 36125 653951113
pcc_attach                1 samples [reqs]
pcc_hit_bytes             2 samples [bytes] 1024 1024 2048 2097152
pcc_attach_bytes          1 samples [bytes] 1024 1024 1024 1048576
hybrid_noswitch           3 samples [reqs]
llite.lustre-ffff927ea0953800.stats=
snapshot_time             1761247787.895827192 secs.nsecs
start_time                1761247787.782091350 secs.nsecs
elapsed_time              0.113735842 secs.nsecs
attach_num: 1, attach_bytes: 1024, hit_num: 2, hit_bytes: 2048
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d203.sanity-pcc is idle now
PASS 203 (7s)

== sanity-pcc test 204a: pin/unpin pcc flag ============== 15:29:53 (1761247793)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.127734 s, 410 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d204a.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 44b1b938-1da6-4556-a3b0-0a5fea324ed8
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f204a.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=44b1b938-1da6-4556-a3b0-0a5fea324ed8 (extents) (64bit) (large files) (huge files)
getfattr: Removing leading '/' from absolute path names
# file: mnt/lustre/f204a.sanity-pcc.dat
trusted.pin="[hsm: 2]"

getfattr: Removing leading '/' from absolute path names
getfattr: Removing leading '/' from absolute path names
# file: mnt/lustre/f204a.sanity-pcc.dat
trusted.pin="[hsm: 2,hsm: 100]"

getfattr: Removing leading '/' from absolute path names
getfattr: Removing leading '/' from absolute path names
# file: mnt/lustre/f204a.sanity-pcc.dat
trusted.pin="[hsm: 2,hsm: 100]"

getfattr: Removing leading '/' from absolute path names
# file: mnt/lustre/f204a.sanity-pcc.dat
trusted.pin="[hsm: 2]"

getfattr: Removing leading '/' from absolute path names
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d204a.sanity-pcc is idle now
PASS 204a (9s)

== sanity-pcc test 204b: Permission check for the pin/unpin operation ========================================================== 15:30:01 (1761247801)
mdt.lustre-MDT0000.enable_pin_gid=0
/home/green/git/lustre-release/lustre/tests/sanity-pcc.sh: illegal option -- p
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [pin] [-i] [100] [/mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc]
pin: cannot pin '/mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc' for PCC: Operation not permitted
getfattr: Removing leading '/' from absolute path names
# file: mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc
trusted.pin="[hsm: 100]"

running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [unpin] [-i] [100] [/mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc]
unpin: cannot unpin '/mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc' for PCC: Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [pin] [-i] [100] [/mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc]
pin: cannot pin '/mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc' for PCC: Operation not permitted
mdt.lustre-MDT0000.enable_pin_gid=-1
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [pin] [-i] [100] [/mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [unpin] [-i] [100] [/mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc]
mdt.lustre-MDT0000.enable_pin_gid=500
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [pin] [-i] [100] [/mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [unpin] [-i] [100] [/mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc]
mdt.lustre-MDT0000.enable_pin_gid=0
PASS 204b (9s)

== sanity-pcc test 204c: PCC pin/unpin without attach ID specified ========================================================== 15:30:10 (1761247810)
pin: failed to get id for '/mnt/lustre/f204c.sanity-pcc': No such file or directory
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.190939 s, 330 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
umount: /mnt/pcc.d204c.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg624-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg624-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=378180k,mode=700)
192.168.200.253:/exports/testreports/56321/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.24,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.124@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
192.168.206.124@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,encrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: fad50a64-4f53-4ca4-820a-b2eb5b4a4d0d
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f204c.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=fad50a64-4f53-4ca4-820a-b2eb5b4a4d0d (extents) (64bit) (large files) (huge files)
getfattr: Removing leading '/' from absolute path names
# file: mnt/lustre/f204c.sanity-pcc
trusted.pin="[hsm: 2]"

getfattr: Removing leading '/' from absolute path names
/mnt/lustre/f204c.sanity-pcc: trusted.pin: No such attribute
/mnt/lustre/f204c.sanity-pcc: trusted.pin: No such attribute
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d204c.sanity-pcc is idle now
PASS 204c (8s)
== sanity-pcc test complete, duration 2741 sec =========== 15:30:18 (1761247818)
sanity-pcc: FAIL: test_1c expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0
sanity-pcc: FAIL: test_1d expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0
=== sanity-pcc: start cleanup 15:30:19 (1761247819) ===
Stopping clients: oleg624-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg624-client.virtnet /mnt/lustre2 opts:
=== sanity-pcc: finish cleanup 15:30:28 (1761247828) ===