-----============= acceptance-small: sanity-pcc ============----- Tue Apr  1 03:44:01 EDT 2025
mgs: Rocky Linux release 8.10 (Green Obsidian)
MGS_OS_ID_LIKE=rhel centos fedora rocky
MGS_OS_VERSION_ID=8.10
MGS_OS_ID=rocky
MGS_OS_VERSION_CODE=134873088
mds1: Rocky Linux release 8.10 (Green Obsidian)
MDS1_OS_VERSION_ID=8.10
MDS1_OS_VERSION_CODE=134873088
MDS1_OS_ID_LIKE=rhel centos fedora rocky
MDS1_OS_ID=rocky
ost1: Rocky Linux release 8.10 (Green Obsidian)
OST1_OS_VERSION_CODE=134873088
OST1_OS_ID_LIKE=rhel centos fedora rocky
OST1_OS_VERSION_ID=8.10
OST1_OS_ID=rocky
client: Rocky Linux release 8.10 (Green Obsidian)
CLIENT_OS_ID=rocky
CLIENT_OS_VERSION_CODE=134873088
CLIENT_OS_VERSION_ID=8.10
CLIENT_OS_ID_LIKE=rhel centos fedora rocky
=== sanity-pcc: start setup 03:44:37 (1743493477) ===
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
oleg635-client.virtnet: executing check_config_client /mnt/lustre
oleg635-client.virtnet: Checking config lustre mounted on /mnt/lustre
Checking servers environments
Checking clients oleg635-client.virtnet environments
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff8ab3c6144000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff8ab3ca821000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3c6144000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3ca821000.idle_timeout=debug
disable quota as required
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
=== sanity-pcc: finish setup 03:45:51 (1743493551) ===
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [true]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d0_runas_test/f7350]
nobody:x:65534:
oleg635-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanity-pcc.*ex': No such file or directory
excepting tests: 33
Killing existing copytools on oleg635-client.virtnet
pkill: pidfile not valid
Try `pkill --help' for more information.
Set HSM on and start
Set sanity-hsm HSM policy

== sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 03:46:33 (1743493593)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.348048 s, 151 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d1a.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 66836576-0dd9-447c-af38-8b213369a31f
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f1a.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=66836576-0dd9-447c-af38-8b213369a31f (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d1a.sanity-pcc/d1a.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
using SAVE_PROJECT_SUPPORTED=0
1+0 records in
1+0 records out
7654321 bytes (7.7 MB, 7.3 MiB) copied, 0.845632 s, 9.1 MB/s
Restore testing...
Attach and detach testing
Start to detach the /mnt/lustre/d1a.sanity-pcc/f1a.sanity-pcc
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d1a.sanity-pcc is idle now
PASS 1a (45s)

== sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 03:47:19 (1743493639)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.326263 s, 161 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d1b.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/5120016384/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 6fbd806b-0054-41fc-93c1-c142bc07f715
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f1b.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=6fbd806b-0054-41fc-93c1-c142bc07f715 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d1b.sanity-pcc/d1b.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
using SAVE_PROJECT_SUPPORTED=0
1+0 records in
1+0 records out
7654321 bytes (7.7 MB, 7.3 MiB) copied, 0.69001 s, 11.1 MB/s
Restore testing...
Attach and detach testing
Start to detach the /mnt/lustre/d1b.sanity-pcc/f1b.sanity-pcc
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d1b.sanity-pcc is idle now
PASS 1b (54s)

== sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 03:48:13 (1743493693)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg635-client.virtnet /mnt/lustre (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre opts:
Stopping clients: oleg635-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg635-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg635-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg635-server'
oleg635-server: oleg635-server.virtnet: executing load_modules_local
oleg635-server: Loading modules from /home/green/git/lustre-release/lustre
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
oleg635-server: detected 4 online CPUs by sysfs
oleg635-server: MODOPTS_LIBCFS=
oleg635-server: Force libcfs to create 2 CPU partitions
Setup mgs, mdt, osts
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-MDT0000
Starting ost1: -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0000
Starting ost2: -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff8ab3c6144000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff8ab3c62d4000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3c6144000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3c62d4000.idle_timeout=debug
disable quota as required
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.461126 s, 114 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d1c.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: cc42ee8a-70f9-4f28-9090-dba68ee4cb94
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f1c.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=cc42ee8a-70f9-4f28-9090-dba68ee4cb94 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
1+0 records in
1+0 records out
7654321 bytes (7.7 MB, 7.3 MiB) copied, 0.731851 s, 10.5 MB/s
 sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 
  Trace dump:
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7235:error()
  = /home/green/git/lustre-release/lustre/tests/sanity-pcc.sh:166:check_lpcc_state()
  = /home/green/git/lustre-release/lustre/tests/sanity-pcc.sh:365:lpcc_rw_test()
  = /home/green/git/lustre-release/lustre/tests/sanity-pcc.sh:426:test_1c()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7608:run_one()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7671:run_one_logged()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7489:run_test()
  = /home/green/git/lustre-release/lustre/tests/sanity-pcc.sh:428:main()
Dumping lctl log to /tmp/testlogs//sanity-pcc.test_1c.*.1743493926.log
rsync: chown "/tmp/testlogs/.sanity-pcc.test_1c.debug_log.oleg635-server.1743493926.log.WcSQ08" failed: Operation not permitted (1)
rsync: chown "/tmp/testlogs/.sanity-pcc.test_1c.dmesg.oleg635-server.1743493926.log.3yYXYh" failed: Operation not permitted (1)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1670) [generator=3.1.3]
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d1c.sanity-pcc is idle now
FAIL 1c (247s)

== sanity-pcc test 1d: Test Project ID with remote access ========================================================== 03:52:39 (1743493959)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg635-client.virtnet /mnt/lustre (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre opts:
Stopping clients: oleg635-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg635-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg635-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg635-server'
oleg635-server: oleg635-server.virtnet: executing load_modules_local
oleg635-server: Loading modules from /home/green/git/lustre-release/lustre
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
oleg635-server: detected 4 online CPUs by sysfs
oleg635-server: MODOPTS_LIBCFS=
oleg635-server: Force libcfs to create 2 CPU partitions
Setup mgs, mdt, osts
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-MDT0000
Starting ost1: -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0000
Starting ost2: -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff8ab3c6959000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff8ab3c96d9000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3c6959000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3c96d9000.idle_timeout=debug
disable quota as required
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.661653 s, 79.2 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d1d.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 4ccc2f3c-5db3-4013-b85a-aeca2f8e188c
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f1d.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=4ccc2f3c-5db3-4013-b85a-aeca2f8e188c (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
1+0 records in
1+0 records out
7654321 bytes (7.7 MB, 7.3 MiB) copied, 0.602748 s, 12.7 MB/s
 sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 
  Trace dump:
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7235:error()
  = /home/green/git/lustre-release/lustre/tests/sanity-pcc.sh:166:check_lpcc_state()
  = /home/green/git/lustre-release/lustre/tests/sanity-pcc.sh:365:lpcc_rw_test()
  = /home/green/git/lustre-release/lustre/tests/sanity-pcc.sh:431:test_1d()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7608:run_one()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7671:run_one_logged()
  = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7489:run_test()
  = /home/green/git/lustre-release/lustre/tests/sanity-pcc.sh:433:main()
Dumping lctl log to /tmp/testlogs//sanity-pcc.test_1d.*.1743494192.log
rsync: chown "/tmp/testlogs/.sanity-pcc.test_1d.debug_log.oleg635-server.1743494192.log.6z67yr" failed: Operation not permitted (1)
rsync: chown "/tmp/testlogs/.sanity-pcc.test_1d.dmesg.oleg635-server.1743494192.log.TpvE9E" failed: Operation not permitted (1)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1670) [generator=3.1.3]
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d1d.sanity-pcc is idle now
FAIL 1d (247s)

== sanity-pcc test 1e: Test RW-PCC with non-root user ==== 03:57:02 (1743494222)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-pcc.test_1e/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
pcc:
  -
    pccpath: /tmp/arc1/sanity-pcc.test_1e/
    hsmtool: posix_v2
    rwid: 2
    roid: 0
    flags: 90
    autocache: projid={100}
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d1e.sanity-pcc/f1e.sanity-pcc] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0353206 s, 29.0 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-w] [-i] [2] [/mnt/lustre/d1e.sanity-pcc/f1e.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d1e.sanity-pcc/f1e.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00539369 s, 190 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/tests/truncate] [/mnt/lustre/d1e.sanity-pcc/f1e.sanity-pcc] [256]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/tests/truncate] [/mnt/lustre/d1e.sanity-pcc/f1e.sanity-pcc] [2048]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d1e.sanity-pcc/f1e.sanity-pcc] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0175239 s, 58.4 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [-k] [/mnt/lustre/d1e.sanity-pcc/f1e.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/tmp/arc1/sanity-pcc.test_1e//13a4/0x2000013a1:0x5:0x0]
touch: cannot touch '/tmp/arc1/sanity-pcc.test_1e//13a4/0x2000013a1:0x5:0x0': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/tmp/arc1/sanity-pcc.test_1e//13a4/0x2000013a1:0x5:0x0] [of=/dev/null] [bs=1024] [count=1]
dd: failed to open '/tmp/arc1/sanity-pcc.test_1e//13a4/0x2000013a1:0x5:0x0': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/tmp/arc1/sanity-pcc.test_1e//13a4/0x2000013a1:0x5:0x0] [bs=1024] [count=1]
dd: failed to open '/tmp/arc1/sanity-pcc.test_1e//13a4/0x2000013a1:0x5:0x0': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-w] [-i] [2] [/mnt/lustre/d1e.sanity-pcc/f1e.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/d1e.sanity-pcc/f1e.sanity-pcc]
Cleanup PCC backend on /mnt/lustre
PASS 1e (26s)

== sanity-pcc test 1f: Test auto RW-PCC cache with non-root user ========================================================== 03:57:29 (1743494249)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg635-client.virtnet /mnt/lustre (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre opts:
Stopping clients: oleg635-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg635-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg635-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg635-server'
oleg635-server: oleg635-server.virtnet: executing load_modules_local
oleg635-server: Loading modules from /home/green/git/lustre-release/lustre
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
oleg635-server: detected 4 online CPUs by sysfs
oleg635-server: MODOPTS_LIBCFS=
oleg635-server: Force libcfs to create 2 CPU partitions
Setup mgs, mdt, osts
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-MDT0000
Starting ost1: -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0000
Starting ost2: -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff8ab3c6e2c000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff8ab3c9de1000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3c6e2c000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3c9de1000.idle_timeout=debug
disable quota as required
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.348322 s, 151 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d1f.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 0bc3d9ec-16fc-4c1f-b430-c6e5396d0541
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f1f.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=0bc3d9ec-16fc-4c1f-b430-c6e5396d0541 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d1f.sanity-pcc/d1f.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d1f.sanity-pcc/f1f.sanity-pcc] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0109731 s, 93.3 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d1f.sanity-pcc/f1f.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00631773 s, 162 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/tests/truncate] [/mnt/lustre/d1f.sanity-pcc/f1f.sanity-pcc] [256]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/tests/truncate] [/mnt/lustre/d1f.sanity-pcc/f1f.sanity-pcc] [2048]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d1f.sanity-pcc/f1f.sanity-pcc] [bs=256] [count=1]
1+0 records in
1+0 records out
256 bytes copied, 0.0122021 s, 21.0 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/pcc.d1f.sanity-pcc/d1f.sanity-pcc/1b73/0x200001b71:0x2:0x0]
touch: cannot touch '/mnt/pcc.d1f.sanity-pcc/d1f.sanity-pcc/1b73/0x200001b71:0x2:0x0': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/pcc.d1f.sanity-pcc/d1f.sanity-pcc/1b73/0x200001b71:0x2:0x0] [of=/dev/null] [bs=1024] [count=1]
dd: failed to open '/mnt/pcc.d1f.sanity-pcc/d1f.sanity-pcc/1b73/0x200001b71:0x2:0x0': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/pcc.d1f.sanity-pcc/d1f.sanity-pcc/1b73/0x200001b71:0x2:0x0] [bs=1024] [count=1]
dd: failed to open '/mnt/pcc.d1f.sanity-pcc/d1f.sanity-pcc/1b73/0x200001b71:0x2:0x0': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/d1f.sanity-pcc/f1f.sanity-pcc]
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d1f.sanity-pcc is idle now
PASS 1f (234s)

== sanity-pcc test 1g: General permission test for RW-PCC ========================================================== 04:01:22 (1743494482)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.489562 s, 107 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d1g.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: cf466cc1-d087-4936-9927-94db04cefed8
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f1g.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=cf466cc1-d087-4936-9927-94db04cefed8 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d1g.sanity-pcc/d1g.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0475288 s, 21.5 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/f1g.sanity-pcc] [bs=1024] [count=1]
dd: failed to open '/mnt/lustre/f1g.sanity-pcc': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/f1g.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
dd: failed to open '/mnt/lustre/f1g.sanity-pcc': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/f1g.sanity-pcc] [bs=1024] [count=1]
dd: failed to open '/mnt/lustre/f1g.sanity-pcc': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/f1g.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
dd: failed to open '/mnt/lustre/f1g.sanity-pcc': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/f1g.sanity-pcc] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0130159 s, 78.7 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/f1g.sanity-pcc]
detach: cannot detach '/mnt/lustre/f1g.sanity-pcc' from PCC: Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/f1g.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/f1g.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0333322 s, 30.7 kB/s
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d1g.sanity-pcc is idle now
PASS 1g (28s)

== sanity-pcc test 2a: Test multi open when creating ===== 04:01:50 (1743494510)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg635-client.virtnet /mnt/lustre (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre opts:
Stopping clients: oleg635-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg635-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg635-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg635-server'
oleg635-server: oleg635-server.virtnet: executing load_modules_local
oleg635-server: Loading modules from /home/green/git/lustre-release/lustre
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
oleg635-server: detected 4 online CPUs by sysfs
oleg635-server: MODOPTS_LIBCFS=
oleg635-server: Force libcfs to create 2 CPU partitions
Setup mgs, mdt, osts
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-MDT0000
Starting ost1: -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0000
Starting ost2: -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff8ab3c60d1000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff8ab3cbe0c000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3c60d1000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3cbe0c000.idle_timeout=debug
disable quota as required
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.70349 s, 74.5 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d2a.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: f78b0379-d688-4bee-9d3d-51b3c7e50af2
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f2a.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=f78b0379-d688-4bee-9d3d-51b3c7e50af2 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d2a.sanity-pcc/d2a.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
multiop /mnt/lustre/d2a.sanity-pcc/multiop vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.24230
client oleg635-client.virtnet multiop_bg started multiop_pid=24241
---------- 1 root root 14 Apr  1 04:05 /mnt/pcc.d2a.sanity-pcc/d2a.sanity-pcc/2343/0x200002341:0x2:0x0
Stopping multiop_pid=24241 (kill 24241 on oleg635-client.virtnet)
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d2a.sanity-pcc is idle now
PASS 2a (237s)

== sanity-pcc test 2b: Test multi remote open when creating ========================================================== 04:05:47 (1743494747)

 SKIP: sanity-pcc test_2b Need 2 or more clients, have 1
SKIP 2b (8s)

== sanity-pcc test 2c: Test multi open on different mount points when creating ========================================================== 04:05:55 (1743494755)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg635-client.virtnet /mnt/lustre (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre opts:
Stopping clients: oleg635-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg635-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg635-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg635-server'
oleg635-server: oleg635-server.virtnet: executing load_modules_local
oleg635-server: Loading modules from /home/green/git/lustre-release/lustre
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
oleg635-server: detected 4 online CPUs by sysfs
oleg635-server: MODOPTS_LIBCFS=
oleg635-server: Force libcfs to create 2 CPU partitions
Setup mgs, mdt, osts
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-MDT0000
Starting ost1: -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0000
Starting ost2: -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff8ab3c67d1000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff8ab3ca821000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3c67d1000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3ca821000.idle_timeout=debug
disable quota as required
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.815577 s, 64.3 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d2c.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: e44dceb0-a8d5-4e5b-9520-2f4085367cf6
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f2c.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=e44dceb0-a8d5-4e5b-9520-2f4085367cf6 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d2c.sanity-pcc/d2c.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
multiop /mnt/lustre/d2c.sanity-pcc/f2c.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.27294
client oleg635-client.virtnet multiop_bg started multiop_pid=27304
Stopping multiop_pid=27304 (kill 27304 on oleg635-client.virtnet)
multiopen_dataCleanup PCC backend on /mnt/lustre
/mnt/pcc.d2c.sanity-pcc is idle now
PASS 2c (229s)

== sanity-pcc test 3a: Repeat attach/detach operations === 04:09:44 (1743494984)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-pcc.test_3a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0401433 s, 25.5 kB/s
Start to RW-PCC attach/detach the file: /mnt/lustre/d3a.sanity-pcc/f3a.sanity-pcc
Repeat to RW-PCC attach/detach the same file: /mnt/lustre/d3a.sanity-pcc/f3a.sanity-pcc
Start to RO-PCC attach/detach the file: /mnt/lustre/d3a.sanity-pcc/f3a.sanity-pcc
Repeat to RO-PCC attach/detach the same file: /mnt/lustre/d3a.sanity-pcc/f3a.sanity-pcc
Cleanup PCC backend on /mnt/lustre
PASS 3a (23s)

== sanity-pcc test 3b: Repeat attach/detach operations on multiple clients ========================================================== 04:10:07 (1743495007)

 SKIP: sanity-pcc test_3b Need 3 or more clients, have 1
SKIP 3b (7s)

== sanity-pcc test 4: Auto cache test for mmap =========== 04:10:15 (1743495015)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg635-client.virtnet /mnt/lustre (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre opts:
Stopping clients: oleg635-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg635-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg635-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg635-server'
oleg635-server: oleg635-server.virtnet: executing load_modules_local
oleg635-server: Loading modules from /home/green/git/lustre-release/lustre
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
oleg635-server: detected 4 online CPUs by sysfs
oleg635-server: MODOPTS_LIBCFS=
oleg635-server: Force libcfs to create 2 CPU partitions
Setup mgs, mdt, osts
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-MDT0000
Starting ost1: -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0000
Starting ost2: -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff8ab3c7961000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff8ab3cb3bc000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3c7961000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3cb3bc000.idle_timeout=debug
disable quota as required
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.208322 s, 252 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d4.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: d46015be-4ff7-44ff-979d-a85af93ba2f8
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f4.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=d46015be-4ff7-44ff-979d-a85af93ba2f8 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d4.sanity-pcc/d4.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
mmap test1: basic mmap operation (PASS, 0.11348s)
mmap test2: MAP_PRIVATE not write back (PASS, 0.13278s)
mmap test3: concurrent mmap ops on two nodes (PASS, 2.1339s)
mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 4.4593s)
mmap test5: read/write file to/from the buffer which mmapped to just this file (PASS, 0.14667s)
mmap test6: check mmap write/read content on two nodes (PASS, 1.4841s)
mmap test7: file i/o with an unmapped buffer (SKIPPED, 0s)
mmap test8: SIGBUS for beyond file size (SKIPPED, 0s)
mmap test9: SIGBUS for negative file offset (SKIPPED, 0s)
mmap test10: multi-thread mmap access (PASS, 0.73848s)
mmap test11: multi-thread shared mmap (PASS, 0.82518s)
mmap test10: mtime not change for readonly mmap access (PASS, 1.0386s)
ldlm.namespaces.lustre-MDT0000-mdc-ffff8ab3c7961000.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff8ab3cb3bc000.lru_size=clear
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d4.sanity-pcc is idle now
PASS 4 (216s)

== sanity-pcc test 5: Mmap & cat a RW-PCC cached file ==== 04:13:51 (1743495231)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.453938 s, 115 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d5.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 2baf06f8-db91-41e8-9887-a61d32fc5a5c
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f5.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=2baf06f8-db91-41e8-9887-a61d32fc5a5c (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d5.sanity-pcc/d5.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d5.sanity-pcc is idle now
PASS 5 (26s)

== sanity-pcc test 6: Test mmap write on RW-PCC ========== 04:14:17 (1743495257)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.443469 s, 118 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d6.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/5120032768/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: b8ebe743-e304-40ac-bda0-eca8bfa74465
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f6.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=b8ebe743-e304-40ac-bda0-eca8bfa74465 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d6.sanity-pcc/d6.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d6.sanity-pcc is idle now
PASS 6 (27s)

== sanity-pcc test 7a: Fake file detached between fault() and page_mkwrite() for RW-PCC ========================================================== 04:14:44 (1743495284)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.352333 s, 149 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d7a.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 10d45a36-9bfb-41b0-8a9f-7de9311ca379
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f7a.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=10d45a36-9bfb-41b0-8a9f-7de9311ca379 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d7a.sanity-pcc/d7a.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
fail_loc=0x1412
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d7a.sanity-pcc is idle now
PASS 7a (26s)

== sanity-pcc test 7b: Test the race with concurrent mkwrite and detach ========================================================== 04:15:10 (1743495310)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.441124 s, 119 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d7b.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 9fd0695d-8d6c-4b33-8f8a-c1182392f903
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f7b.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=9fd0695d-8d6c-4b33-8f8a-c1182392f903 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d7b.sanity-pcc/d7b.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
fail_loc=0x1413
fail_val=20
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d7b.sanity-pcc is idle now
PASS 7b (68s)

== sanity-pcc test 8: Test fake -ENOSPC tolerance for RW-PCC ========================================================== 04:16:18 (1743495378)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.324452 s, 162 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d8.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/5120049152/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: eb5e2a78-54f0-4eba-86d6-12f4243122b4
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f8.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=eb5e2a78-54f0-4eba-86d6-12f4243122b4 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d8.sanity-pcc/d8.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
fail_loc=0x1411
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d8.sanity-pcc is idle now
PASS 8 (23s)

== sanity-pcc test 9: Test -ENOSPC tolerance on loop PCC device for RW-PCC ========================================================== 04:16:42 (1743495402)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.55515 s, 94.4 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.9a: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: f6050b9e-ac74-40b9-8057-945be4ed80a3
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f9.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=f6050b9e-ac74-40b9-8057-945be4ed80a3 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.9a/d9.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.9a/d9.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 0
    flags: 9e
    autocache: projid={100}
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 7.41026 s, 8.5 MB/s
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.9a is idle now
PASS 9 (33s)

== sanity-pcc test 10a: Test RW-PCC with user quota on loop PCC device ========================================================== 04:17:15 (1743495435)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.219887 s, 238 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d10a.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: b32e588d-aa9a-46d2-b39e-d14df9b4e09b
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f10a.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=b32e588d-aa9a-46d2-b39e-d14df9b4e09b (extents) (64bit) (large files) (huge files)
*** Report for user quotas on device /dev/loop0
Block grace time: 7days; Inode grace time: 7days
                        Space limits                File limits
User            used    soft    hard  grace    used  soft  hard  grace
----------------------------------------------------------------------
root      --     13K      0K      0K              2     0     0       
sanityusr --      0K      0K  20480K              0     0     0       

Statistics:
Total blocks: 7
Data blocks: 1
Entries: 2
Used average: 2.000000

Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d10a.sanity-pcc/d10a.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d10a.sanity-pcc/d10a.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 0
    flags: 9e
    autocache: projid={100}
15+0 records in
15+0 records out
15728640 bytes (16 MB, 15 MiB) copied, 0.943887 s, 16.7 MB/s
15+0 records in
15+0 records out
15728640 bytes (16 MB, 15 MiB) copied, 0.702585 s, 22.4 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-i] [2] [-w] [/mnt/lustre/d10a.sanity-pcc/uquotaA]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-i] [2] [-w] [/mnt/lustre/d10a.sanity-pcc/uquotaB]
lfs pcc pcc: cannot get UNLOCK lease, ext 10 for [0x2000032e1:0x26:0x0]: Disk quota exceeded (122)
lfs pcc pcc: cannot attach with ID: 2: Disk quota exceeded (122)
attach: cannot attach '/mnt/lustre/d10a.sanity-pcc/uquotaB' to PCC with attach ID '2': Disk quota exceeded
Test -EDQUOT error tolerance for RW-PCC
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d10a.sanity-pcc/uquotaA] [bs=1M] [count=30]
30+0 records in
30+0 records out
31457280 bytes (31 MB, 30 MiB) copied, 3.86824 s, 8.1 MB/s
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d10a.sanity-pcc is idle now
PASS 10a (37s)

== sanity-pcc test 10b: Test RW-PCC with group quota on loop PCC device ========================================================== 04:17:52 (1743495472)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.448707 s, 117 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d10b.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 7e06ab65-3f7d-4670-9a2a-c88ebeea8b86
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f10b.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=7e06ab65-3f7d-4670-9a2a-c88ebeea8b86 (extents) (64bit) (large files) (huge files)
*** Report for group quotas on device /dev/loop0
Block grace time: 7days; Inode grace time: 7days
                        Space limits                File limits
Group           used    soft    hard  grace    used  soft  hard  grace
----------------------------------------------------------------------
root      --     13K      0K      0K              2     0     0       
sanityusr --      0K      0K  20480K              0     0     0       

Statistics:
Total blocks: 7
Data blocks: 1
Entries: 2
Used average: 2.000000

Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d10b.sanity-pcc/d10b.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d10b.sanity-pcc/d10b.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 0
    flags: 9e
    autocache: projid={100}
15+0 records in
15+0 records out
15728640 bytes (16 MB, 15 MiB) copied, 0.83359 s, 18.9 MB/s
15+0 records in
15+0 records out
15728640 bytes (16 MB, 15 MiB) copied, 0.77 s, 20.4 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-i] [2] [-w] [/mnt/lustre/d10b.sanity-pcc/gquotaA]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-i] [2] [-w] [/mnt/lustre/d10b.sanity-pcc/gquotaB]
lfs pcc pcc: cannot get UNLOCK lease, ext 10 for [0x2000032e1:0x2b:0x0]: Disk quota exceeded (122)
lfs pcc pcc: cannot attach with ID: 2: Disk quota exceeded (122)
attach: cannot attach '/mnt/lustre/d10b.sanity-pcc/gquotaB' to PCC with attach ID '2': Disk quota exceeded
Test -EDQUOT error tolerance for RW-PCC
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d10b.sanity-pcc/gquotaA] [bs=1M] [count=30]
30+0 records in
30+0 records out
31457280 bytes (31 MB, 30 MiB) copied, 4.29623 s, 7.3 MB/s
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d10b.sanity-pcc is idle now
PASS 10b (35s)

== sanity-pcc test 10c: Test RO-PCC with user quota on loop PCC device ========================================================== 04:18:27 (1743495507)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.263473 s, 199 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d10c.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 2ae05560-5362-4fab-b975-c788b4e7a002
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f10c.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=2ae05560-5362-4fab-b975-c788b4e7a002 (extents) (64bit) (large files) (huge files)
*** Report for user quotas on device /dev/loop0
Block grace time: 7days; Inode grace time: 7days
                        Space limits                File limits
User            used    soft    hard  grace    used  soft  hard  grace
----------------------------------------------------------------------
root      --     13K      0K      0K              2     0     0       
sanityusr --      0K      0K  20480K              0     0     0       

Statistics:
Total blocks: 7
Data blocks: 1
Entries: 2
Used average: 2.000000

Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d10c.sanity-pcc/d10c.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d10c.sanity-pcc/d10c.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 2
    flags: ae
    autocache: projid={100}
15+0 records in
15+0 records out
15728640 bytes (16 MB, 15 MiB) copied, 0.825574 s, 19.1 MB/s
15+0 records in
15+0 records out
15728640 bytes (16 MB, 15 MiB) copied, 0.927773 s, 17.0 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-i] [2] [/mnt/lustre/d10c.sanity-pcc/uquotaA]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-i] [2] [/mnt/lustre/d10c.sanity-pcc/uquotaB]
lfs pcc pcc: cannot attach the file to PCC with ID 2 failed: Disk quota exceeded (122)
attach: cannot attach '/mnt/lustre/d10c.sanity-pcc/uquotaB' to PCC with attach ID '2': Disk quota exceeded
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d10c.sanity-pcc is idle now
PASS 10c (29s)

== sanity-pcc test 10d: Test RO-PCC with group quota on loop PCC device ========================================================== 04:18:57 (1743495537)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.518763 s, 101 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d10d.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 162b8fcd-09b1-4d6d-afca-40283dab10f4
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f10d.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=162b8fcd-09b1-4d6d-afca-40283dab10f4 (extents) (64bit) (large files) (huge files)
*** Report for group quotas on device /dev/loop0
Block grace time: 7days; Inode grace time: 7days
                        Space limits                File limits
Group           used    soft    hard  grace    used  soft  hard  grace
----------------------------------------------------------------------
root      --     13K      0K      0K              2     0     0       
sanityusr --      0K      0K  20480K              0     0     0       

Statistics:
Total blocks: 7
Data blocks: 1
Entries: 2
Used average: 2.000000

Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d10d.sanity-pcc/d10d.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d10d.sanity-pcc/d10d.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 2
    flags: ae
    autocache: projid={100}
15+0 records in
15+0 records out
15728640 bytes (16 MB, 15 MiB) copied, 0.716766 s, 21.9 MB/s
15+0 records in
15+0 records out
15728640 bytes (16 MB, 15 MiB) copied, 0.767729 s, 20.5 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-i] [2] [/mnt/lustre/d10d.sanity-pcc/gquotaA]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-i] [2] [/mnt/lustre/d10d.sanity-pcc/gquotaB]
lfs pcc pcc: cannot attach the file to PCC with ID 2 failed: Disk quota exceeded (122)
attach: cannot attach '/mnt/lustre/d10d.sanity-pcc/gquotaB' to PCC with attach ID '2': Disk quota exceeded
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d10d.sanity-pcc is idle now
PASS 10d (28s)

== sanity-pcc test 10e: Tolerate -EDQUOT failure when auto PCC-RO attach with user quota ========================================================== 04:19:26 (1743495566)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.480058 s, 109 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d10e.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: cbe968f1-3884-44e2-bc8c-af4934a2b586
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f10e.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=cbe968f1-3884-44e2-bc8c-af4934a2b586 (extents) (64bit) (large files) (huge files)
*** Report for user quotas on device /dev/loop0
Block grace time: 7days; Inode grace time: 7days
                        Space limits                File limits
User            used    soft    hard  grace    used  soft  hard  grace
----------------------------------------------------------------------
root      --     13K      0K      0K              2     0     0       
sanityusr --      0K      0K   4096K              0     0     0       

Statistics:
Total blocks: 7
Data blocks: 1
Entries: 2
Used average: 2.000000

pcc:
  -
    pccpath: /mnt/pcc.d10e.sanity-pcc/d10e.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: uid={500}
2+0 records in
2+0 records out
2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.122136 s, 17.2 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/f10e.sanity-pcc] [of=/dev/null] [bs=1M] [count=2]
2+0 records in
2+0 records out
2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0131732 s, 159 MB/s
/mnt/lustre/f10e.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x2000032e1
      lmm_object_id:     0x34
      lmm_fid:           [0x2000032e1:0x34:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0xcf:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
5+0 records in
5+0 records out
5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.226332 s, 23.2 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/f10e.sanity-pcc] [of=/dev/null] [bs=1M] [count=5]
5+0 records in
5+0 records out
5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0294598 s, 178 MB/s
file: /mnt/lustre/f10e.sanity-pcc, type: none
/mnt/lustre/f10e.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         wp,pccro
  lcm_layout_gen:    5
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x2000032e1
      lmm_object_id:     0x34
      lmm_fid:           [0x2000032e1:0x34:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0xcf:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d10e.sanity-pcc is idle now
PASS 10e (25s)

== sanity-pcc test 10f: Tolerate -EDQUOT failure when auto PCC-RO attach with group quota ========================================================== 04:19:50 (1743495590)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.252979 s, 207 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d10f.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: cf41dc39-c5a7-43fa-8c24-44bdc778e5c7
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f10f.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=cf41dc39-c5a7-43fa-8c24-44bdc778e5c7 (extents) (64bit) (large files) (huge files)
*** Report for group quotas on device /dev/loop0
Block grace time: 7days; Inode grace time: 7days
                        Space limits                File limits
Group           used    soft    hard  grace    used  soft  hard  grace
----------------------------------------------------------------------
root      --     13K      0K      0K              2     0     0       
sanityusr --      0K      0K   4096K              0     0     0       

Statistics:
Total blocks: 7
Data blocks: 1
Entries: 2
Used average: 2.000000

pcc:
  -
    pccpath: /mnt/pcc.d10f.sanity-pcc/d10f.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: gid={500}
2+0 records in
2+0 records out
2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.128809 s, 16.3 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/f10f.sanity-pcc] [of=/dev/null] [bs=1M] [count=2]
2+0 records in
2+0 records out
2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.047571 s, 44.1 MB/s
/mnt/lustre/f10f.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x2000032e1
      lmm_object_id:     0x36
      lmm_fid:           [0x2000032e1:0x36:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0xcf:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
5+0 records in
5+0 records out
5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.181848 s, 28.8 MB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/f10f.sanity-pcc] [of=/dev/null] [bs=1M] [count=5]
5+0 records in
5+0 records out
5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0218832 s, 240 MB/s
file: /mnt/lustre/f10f.sanity-pcc, type: none
/mnt/lustre/f10f.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         wp,pccro
  lcm_layout_gen:    5
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x2000032e1
      lmm_object_id:     0x36
      lmm_fid:           [0x2000032e1:0x36:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0xcf:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d10f.sanity-pcc is idle now
PASS 10f (25s)

== sanity-pcc test 11: Test attach fault injection with simulated PCC file path ========================================================== 04:20:15 (1743495615)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.397064 s, 132 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d11.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: ea74c39e-168b-48ae-85b7-83c8137d1580
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f11.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=ea74c39e-168b-48ae-85b7-83c8137d1580 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d11.sanity-pcc/d11.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Lustre file: /mnt/lustre/f11.sanity-pcc LPCC dir: /mnt/pcc.d11.sanity-pcc/d11.sanity-pcc/32d9
Lustre file: /mnt/lustre/f11.sanity-pcc LPCC dir: /mnt/pcc.d11.sanity-pcc/d11.sanity-pcc/32db
lfs pcc pcc: cannot get UNLOCK lease, ext 10 for [0x2000032e1:0x3a:0x0]: Operation not permitted (1)
lfs pcc pcc: cannot attach with ID: 2: Operation not permitted (1)
attach: cannot attach '/mnt/lustre/f11.sanity-pcc' to PCC with attach ID '2': Operation not permitted
lfs pcc pcc: cannot get UNLOCK lease, ext 10 for [0x2000032e1:0x3b:0x0]: Invalid argument (22)
lfs pcc pcc: cannot attach with ID: 2: Invalid argument (22)
attach: cannot attach '/mnt/lustre/f11.sanity-pcc' to PCC with attach ID '2': Invalid argument
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d11.sanity-pcc is idle now
PASS 11 (27s)

== sanity-pcc test 12: RW-PCC attach races with concurrent HSM remove ========================================================== 04:20:42 (1743495642)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-pcc.test_12/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
fail_loc=0x1414
fail_val=20
/mnt/lustre/f12.sanity-pcc: (0x0000000d) released exists archived, archive_id:2
Cleanup PCC backend on /mnt/lustre
PASS 12 (42s)

== sanity-pcc test 13a: Test auto RW-PCC create caching for UID/GID rule ========================================================== 04:21:24 (1743495684)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-pcc.test_13a/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
pcc:
  -
    pccpath: /tmp/arc1/sanity-pcc.test_13a/
    hsmtool: posix_v2
    rwid: 2
    roid: 0
    flags: 90
    autocache: uid={500}
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0155501 s, 65.9 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00588887 s, 174 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/tests/truncate] [/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc] [256]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/tests/truncate] [/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc] [2048]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0129604 s, 79.0 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc]
Cleanup PCC backend on /mnt/lustre
pcc:
  -
    pccpath: /tmp/arc1/sanity-pcc.test_13a/
    hsmtool: posix_v2
    rwid: 2
    roid: 0
    flags: 90
    autocache: gid={500}
lfs mkdir: dirstripe error on '/mnt/lustre/d13a.sanity-pcc': stripe already set
lfs setdirstripe: cannot create dir '/mnt/lustre/d13a.sanity-pcc': File exists
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0101872 s, 101 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00802565 s, 128 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/tests/truncate] [/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc] [256]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/tests/truncate] [/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc] [2048]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00821829 s, 125 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/d13a.sanity-pcc/f13a.sanity-pcc]
Cleanup PCC backend on /mnt/lustre
Cleanup PCC backend on /mnt/lustre
Cleanup PCC backend on /mnt/lustre
PASS 13a (31s)

== sanity-pcc test 13b: Test auto RW-PCC create caching for file name with wildcard ========================================================== 04:21:56 (1743495716)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-pcc.test_13b/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
pcc:
  -
    pccpath: /tmp/arc1/sanity-pcc.test_13b/
    hsmtool: posix_v2
    rwid: 2
    roid: 0
    flags: 90
    autocache: fname={*.h5 suffix.* Mid*dle}
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00500192 s, 205 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d13b.sanity-pcc/suffix.doc] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.013643 s, 75.1 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d13b.sanity-pcc/MidPADdle] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0171723 s, 59.6 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d13b.sanity-pcc/Midpad] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0173872 s, 58.9 kB/s
Cleanup PCC backend on /mnt/lustre
PASS 13b (20s)

== sanity-pcc test 13c: Check auto RW-PCC create caching for UID/GID/ProjID/fname rule ========================================================== 04:22:16 (1743495736)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg635-client.virtnet /mnt/lustre (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre opts:
Stopping clients: oleg635-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg635-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg635-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg635-server'
oleg635-server: oleg635-server.virtnet: executing load_modules_local
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
oleg635-server: Loading modules from /home/green/git/lustre-release/lustre
oleg635-server: detected 4 online CPUs by sysfs
oleg635-server: MODOPTS_LIBCFS=
oleg635-server: Force libcfs to create 2 CPU partitions
Setup mgs, mdt, osts
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-MDT0000
Starting ost1: -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0000
Starting ost2: -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff8ab3c7999000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff8ab3cbd11000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3c7999000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3cbd11000.idle_timeout=debug
disable quota as required
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.670333 s, 78.2 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d13c.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: a127dda9-e9a1-48b8-9799-6146b066c39e
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f13c.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=a127dda9-e9a1-48b8-9799-6146b066c39e (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d13c.sanity-pcc/d13c.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d13c.sanity-pcc/d13c.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 0
    flags: 9e
    autocache: projid={100 200}&fname={*.h5},uid={500}&gid={500}
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0341241 s, 30.0 kB/s
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0133157 s, 76.9 kB/s
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0480553 s, 21.3 kB/s
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0176954 s, 57.9 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d13c.sanity-pcc/ugidcache] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.014994 s, 68.3 kB/s
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d13c.sanity-pcc is idle now
PASS 13c (229s)

== sanity-pcc test 14: Revocation of the layout lock should detach the file automatically ========================================================== 04:26:04 (1743495964)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/tmp/arc1/sanity-pcc.test_14/ --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
ldlm.namespaces.lustre-MDT0000-mdc-ffff8ab3c7999000.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff8ab3cbd11000.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff8ab3c7999000.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff8ab3cbd11000.lru_size=clear
Cleanup PCC backend on /mnt/lustre
PASS 14 (23s)

== sanity-pcc test 15: Test auto attach at open when file is still valid cached ========================================================== 04:26:27 (1743495987)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.199503 s, 263 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d15.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 49c2b4ed-a557-4767-9e6a-7139cbe412d9
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f15.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=49c2b4ed-a557-4767-9e6a-7139cbe412d9 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d15.sanity-pcc/d15.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Verify open attach for non-root user
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.031451 s, 32.6 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-w] [-i] [2] [/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc]
file: /mnt/lustre/d15.sanity-pcc/f15.sanity-pcc, type: readwrite, PCC_file: /d15.sanity-pcc/3aa0/0x200003ab1:0x11:0x0, open_count: 0, flags: 0
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc]
ldlm.namespaces.lustre-MDT0000-mdc-ffff8ab3c7999000.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff8ab3cbd11000.lru_size=clear
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [multiop] [/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc] [oc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [-k] [/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [multiop] [/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc] [oc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/d15.sanity-pcc/f15.sanity-pcc]
Verify auto attach at open for RW-PCC
ldlm.namespaces.lustre-MDT0000-mdc-ffff8ab3c7999000.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff8ab3cbd11000.lru_size=clear
Verify auto attach at open for RO-PCC
ldlm.namespaces.lustre-MDT0000-mdc-ffff8ab3c7999000.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff8ab3cbd11000.lru_size=clear
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d15.sanity-pcc is idle now
PASS 15 (36s)

== sanity-pcc test 16: Test detach with different options ========================================================== 04:27:04 (1743496024)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.339366 s, 154 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d16.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 5bc785b2-4712-40fa-acef-13530fddb898
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f16.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=5bc785b2-4712-40fa-acef-13530fddb898 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d16.sanity-pcc/d16.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Test detach for RW-PCC
Test for reusing valid PCC cache
Test for the default detach
Test detach for RO-PCC
detach_dataCleanup PCC backend on /mnt/lustre
/mnt/pcc.d16.sanity-pcc is idle now
PASS 16 (30s)

== sanity-pcc test 17: Test auto attach for layout refresh ========================================================== 04:27:34 (1743496054)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.482845 s, 109 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d17.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: ca740c7e-bc59-4bbc-8dfe-301f59d8755a
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f17.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=ca740c7e-bc59-4bbc-8dfe-301f59d8755a (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d17.sanity-pcc/d17.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d17.sanity-pcc/d17.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 0
    flags: 94
    autocache: projid={100}
Verify auto attach during IO for truncate
Verify auto attach during IO for read/write
multiop /mnt/lustre/f17.sanity-pcc vO_r
TMPPIPE=/tmp/multiop_open_wait_pipe.49688
client oleg635-client.virtnet multiop_bg started multiop_pid=49698
ldlm.namespaces.lustre-MDT0000-mdc-ffff8ab3c7999000.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff8ab3cbd11000.lru_size=clear
Stopping multiop_pid=49698 (kill 49698 on oleg635-client.virtnet)
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d17.sanity-pcc is idle now
PASS 17 (37s)

== sanity-pcc test 18: Verify size correctness after re-attach the file ========================================================== 04:28:10 (1743496090)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.378168 s, 139 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d18.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 7e2d40b5-afe4-4ef7-b622-a1f8e686a3d4
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f18.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=7e2d40b5-afe4-4ef7-b622-a1f8e686a3d4 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d18.sanity-pcc/d18.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d18.sanity-pcc/d18.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 0
    flags: 9e
    autocache: projid={100}
4+0 records in
4+0 records out
4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.260712 s, 16.1 MB/s
file: /mnt/lustre/f18.sanity-pcc, type: readwrite, PCC_file: /d18.sanity-pcc/3aac/0x200003ab1:0x1d:0x0, open_count: 0, flags: 0
file: /mnt/lustre/f18.sanity-pcc, type: none
/mnt/lustre/f18.sanity-pcc has size 4194304 OK
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0129799 s, 78.9 kB/s
/mnt/lustre2/f18.sanity-pcc has size 1049600 OK
file: /mnt/lustre/f18.sanity-pcc, type: none
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d18.sanity-pcc is idle now
PASS 18 (32s)

== sanity-pcc test 19: Verify the file re-attach works as expected ========================================================== 04:28:42 (1743496122)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.4201 s, 125 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d19.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: e83cf1c3-350d-4097-98d1-2093422834bb
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f19.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=e83cf1c3-350d-4097-98d1-2093422834bb (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d19.sanity-pcc/d19.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d19.sanity-pcc is idle now
PASS 19 (28s)

== sanity-pcc test 20: Auto attach works after the inode was once evicted from cache ========================================================== 04:29:10 (1743496150)
120+0 records in
120+0 records out
125829120 bytes (126 MB, 120 MiB) copied, 0.850555 s, 148 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d20.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:   8192/122880             done                            
Creating filesystem with 122880 1k blocks and 30720 inodes
Filesystem UUID: 8aa183f0-e408-4af8-a1cc-449d61f76b76
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345, 73729

Allocating group tables:  0/15     done                            
Writing inode tables:  0/15     done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information:  0/15     done

/tmp/f20.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=8aa183f0-e408-4af8-a1cc-449d61f76b76 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d20.sanity-pcc/d20.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d20.sanity-pcc is idle now
PASS 20 (32s)

== sanity-pcc test 21a: PCC-RO storing as a plain HSM mirror component for plain layout ========================================================== 04:29:42 (1743496182)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.228025 s, 230 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d21a.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: bf23c508-ffb9-43f6-a7ac-e292182dfd53
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f21a.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=bf23c508-ffb9-43f6-a7ac-e292182dfd53 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d21a.sanity-pcc/d21a.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Plain layout info before PCC-RO attach '/mnt/lustre/f21a.sanity-pcc':
/mnt/lustre/f21a.sanity-pcc
lmm_magic:         0x0BD10BD0
lmm_seq:           0x200003ab1
lmm_object_id:     0x29
lmm_fid:           [0x200003ab1:0x29:0x0]
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    0
lmm_stripe_offset: 1
	obdidx		 objid		 objid		 group
	     1	           267	        0x10b	   0x280000400


FLR layout info after PCC-RO attach '/mnt/lustre/f21a.sanity-pcc':
/mnt/lustre/f21a.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x29
      lmm_fid:           [0x200003ab1:0x29:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x10b:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''

FLR layout info after PCC-RO detach '/mnt/lustre/f21a.sanity-pcc':
/mnt/lustre/f21a.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x29
      lmm_fid:           [0x200003ab1:0x29:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x10b:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''

FLR layout info after RO-PCC attach /mnt/lustre/f21a.sanity-pcc again:
/mnt/lustre/f21a.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x29
      lmm_fid:           [0x200003ab1:0x29:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x10b:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''

FLR layout info after RO-PCC detach '/mnt/lustre/f21a.sanity-pcc' again:
/mnt/lustre/f21a.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x29
      lmm_fid:           [0x200003ab1:0x29:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x10b:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d21a.sanity-pcc is idle now
PASS 21a (26s)

== sanity-pcc test 21b: PCC-RO stroing as a plain HSM mirror component for FLR layouts ========================================================== 04:30:09 (1743496209)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.287779 s, 182 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d21b.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 6a54d9d1-6b2a-4ae9-a9b2-db6f9aba384b
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f21b.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=6a54d9d1-6b2a-4ae9-a9b2-db6f9aba384b (extents) (64bit) (large files) (huge files)
FLR layout before PCC-RO attach '/mnt/lustre/f21b.sanity-pcc':
/mnt/lustre/f21b.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          288
  lcm_flags:         ro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2a
      lmm_fid:           [0x200003ab1:0x2a:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x10c:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x10c:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         208
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2a
      lmm_fid:           [0x200003ab1:0x2a:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x10d:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x10d:0x0] }


FLR layout after PCC-RO attach '/mnt/lustre/f21b.sanity-pcc':
/mnt/lustre/f21b.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          408
  lcm_flags:         ro,pccro
  lcm_layout_gen:    3
  lcm_mirror_count:  3
  lcm_entry_count:   3
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         176
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2a
      lmm_fid:           [0x200003ab1:0x2a:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x10c:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x10c:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         256
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2a
      lmm_fid:           [0x200003ab1:0x2a:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x10d:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x10d:0x0] }

  - lcme_id:             196611
    lcme_mirror_id:      3
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         336
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''

FLR layout info after PCC-RO detach '/mnt/lustre/f21b.sanity-pcc':
/mnt/lustre/f21b.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          408
  lcm_flags:         ro,pccro
  lcm_layout_gen:    3
  lcm_mirror_count:  3
  lcm_entry_count:   3
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         176
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2a
      lmm_fid:           [0x200003ab1:0x2a:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x10c:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x10c:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         256
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2a
      lmm_fid:           [0x200003ab1:0x2a:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x10d:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x10d:0x0] }

  - lcme_id:             196611
    lcme_mirror_id:      3
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         336
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''

FLR layout after PCC-RO attach '/mnt/lustre/f21b.sanity-pcc' again:
/mnt/lustre/f21b.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          408
  lcm_flags:         ro,pccro
  lcm_layout_gen:    3
  lcm_mirror_count:  3
  lcm_entry_count:   3
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         176
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2a
      lmm_fid:           [0x200003ab1:0x2a:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x10c:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x10c:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         256
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2a
      lmm_fid:           [0x200003ab1:0x2a:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x10d:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x10d:0x0] }

  - lcme_id:             196611
    lcme_mirror_id:      3
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         336
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''

FLR layout info after PCC-RO detach '/mnt/lustre/f21b.sanity-pcc':
/mnt/lustre/f21b.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          408
  lcm_flags:         ro,pccro
  lcm_layout_gen:    3
  lcm_mirror_count:  3
  lcm_entry_count:   3
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         176
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2a
      lmm_fid:           [0x200003ab1:0x2a:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x10c:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x10c:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         256
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2a
      lmm_fid:           [0x200003ab1:0x2a:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x10d:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x10d:0x0] }

  - lcme_id:             196611
    lcme_mirror_id:      3
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         336
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d21b.sanity-pcc is idle now
PASS 21b (26s)

== sanity-pcc test 21c: Verify HSM release works storing PCC-RO as HSM mirror component ========================================================== 04:30:35 (1743496235)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.43535 s, 120 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d21c.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 28e426ae-7092-49f5-9d81-ad916199aca3
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f21c.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=28e426ae-7092-49f5-9d81-ad916199aca3 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d21c.sanity-pcc/d21c.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
/mnt/lustre/f21c.sanity-pcc: (0x00000009) exists archived, archive_id:2
/mnt/lustre/f21c.sanity-pcc
  lcm_layout_gen:    3
  lcm_mirror_count:  2
  lcm_entry_count:   2
    lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       released
      lmm_layout_gen:    0
      lmm_stripe_offset: 0

    lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
/mnt/lustre/f21c.sanity-pcc: (0x0000000d) released exists archived, archive_id:2
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d21c.sanity-pcc is idle now
PASS 21c (26s)

== sanity-pcc test 21d: Write should invalidate PCC-RO caching ========================================================== 04:31:01 (1743496261)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.440506 s, 119 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d21d.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 6f78e8c2-58f6-4ca0-ab39-858c9ae60eb3
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f21d.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=6f78e8c2-58f6-4ca0-ab39-858c9ae60eb3 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d21d.sanity-pcc/d21d.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
/mnt/lustre/f21d.sanity-pcc
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    0
lmm_stripe_offset: 1
	obdidx		 objid		 objid		 group
	     1	           270	        0x10e	   0x280000400

PCC-RO attach '/mnt/lustre/f21d.sanity-pcc':
/mnt/lustre/f21d.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2d
      lmm_fid:           [0x200003ab1:0x2d:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x10e:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Write invalidated PCC-RO cache:
/mnt/lustre/f21d.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         wp
  lcm_layout_gen:    4
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2d
      lmm_fid:           [0x200003ab1:0x2d:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x10e:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init,stale
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,dirty,archived,0xb
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d21d.sanity-pcc is idle now
PASS 21d (25s)

== sanity-pcc test 21e: Truncate should invalidate PCC-RO caching ========================================================== 04:31:26 (1743496286)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.488595 s, 107 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d21e.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: cb0fd75e-8999-4f13-b3aa-a2cba106b267
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f21e.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=cb0fd75e-8999-4f13-b3aa-a2cba106b267 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d21e.sanity-pcc/d21e.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
/mnt/lustre/f21e.sanity-pcc
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    0
lmm_stripe_offset: 0
	obdidx		 objid		 objid		 group
	     0	           271	        0x10f	   0x240000400

PCC-RO attach '/mnt/lustre/f21e.sanity-pcc':
/mnt/lustre/f21e.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2f
      lmm_fid:           [0x200003ab1:0x2f:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x10f:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Trucate invalidate PCC-RO file '/mnt/lustre/f21e.sanity-pcc':
/mnt/lustre/f21e.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         wp
  lcm_layout_gen:    4
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x2f
      lmm_fid:           [0x200003ab1:0x2f:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x10f:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init,stale
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,dirty,archived,0xb
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d21e.sanity-pcc is idle now
PASS 21e (24s)

== sanity-pcc test 21f: mmap write should invalidate PCC-RO caching ========================================================== 04:31:50 (1743496310)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.464643 s, 113 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d21f.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 03d221f4-9c70-4b40-8f7c-decbc88f9946
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f21f.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=03d221f4-9c70-4b40-8f7c-decbc88f9946 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d21f.sanity-pcc/d21f.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
/mnt/lustre/f21f.sanity-pcc
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    0
lmm_stripe_offset: 1
	obdidx		 objid		 objid		 group
	     1	           271	        0x10f	   0x280000400

PCC-RO attach '/mnt/lustre/f21f.sanity-pcc':
/mnt/lustre/f21f.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x30
      lmm_fid:           [0x200003ab1:0x30:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x10f:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Mmap write invalidate PCC-RO caching:
/mnt/lustre/f21f.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         wp
  lcm_layout_gen:    4
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x30
      lmm_fid:           [0x200003ab1:0x30:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x10f:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init,stale
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,dirty,archived,0xb
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d21f.sanity-pcc is idle now
PASS 21f (24s)

== sanity-pcc test 21g: PCC-RO for file under FLR write pending state ========================================================== 04:32:15 (1743496335)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.193437 s, 271 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d21g.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 6cc710cc-8014-449b-92ac-6058a1ca011c
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f21g.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=6cc710cc-8014-449b-92ac-6058a1ca011c (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d21g.sanity-pcc/d21g.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
FLR layout before PCC-RO attach '/mnt/lustre/f21g.sanity-pcc':
/mnt/lustre/f21g.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          288
  lcm_flags:         wp
  lcm_layout_gen:    3
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x32
      lmm_fid:           [0x200003ab1:0x32:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x110:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x110:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init,stale
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         208
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x32
      lmm_fid:           [0x200003ab1:0x32:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x111:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x111:0x0] }

FLR layout after PCC-RO attach '/mnt/lustre/f21g.sanity-pcc':
/mnt/lustre/f21g.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          408
  lcm_flags:         wp,pccro
  lcm_layout_gen:    4
  lcm_mirror_count:  3
  lcm_entry_count:   3
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         176
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x32
      lmm_fid:           [0x200003ab1:0x32:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x110:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x110:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init,stale
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         256
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x32
      lmm_fid:           [0x200003ab1:0x32:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x111:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x111:0x0] }

  - lcme_id:             196612
    lcme_mirror_id:      3
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         336
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Layout after Write invalidate '/mnt/lustre/f21g.sanity-pcc':
/mnt/lustre/f21g.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          408
  lcm_flags:         wp
  lcm_layout_gen:    5
  lcm_mirror_count:  3
  lcm_entry_count:   3
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         176
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x32
      lmm_fid:           [0x200003ab1:0x32:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x110:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x110:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init,stale
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         256
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x32
      lmm_fid:           [0x200003ab1:0x32:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x111:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x111:0x0] }

  - lcme_id:             196612
    lcme_mirror_id:      3
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         336
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,0x9
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d21g.sanity-pcc is idle now
PASS 21g (22s)

== sanity-pcc test 21h: Extend mirror once file was PCC-RO cached ========================================================== 04:32:37 (1743496357)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.207736 s, 252 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d21h.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: b94fc365-80ba-482e-aef7-b0023f2bf467
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f21h.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=b94fc365-80ba-482e-aef7-b0023f2bf467 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d21h.sanity-pcc/d21h.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
FLR layout before PCC-RO attach '/mnt/lustre/f21h.sanity-pcc':
/mnt/lustre/f21h.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          288
  lcm_flags:         ro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x35
      lmm_fid:           [0x200003ab1:0x35:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x112:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x112:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         208
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x35
      lmm_fid:           [0x200003ab1:0x35:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x113:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x113:0x0] }


FLR layout after PCC-RO attach '/mnt/lustre/f21h.sanity-pcc':
/mnt/lustre/f21h.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          408
  lcm_flags:         ro,pccro
  lcm_layout_gen:    3
  lcm_mirror_count:  3
  lcm_entry_count:   3
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         176
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x35
      lmm_fid:           [0x200003ab1:0x35:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x112:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x112:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         256
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x35
      lmm_fid:           [0x200003ab1:0x35:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x113:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x113:0x0] }

  - lcme_id:             196611
    lcme_mirror_id:      3
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         336
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''

FLR layout after extend a mirror:
/mnt/lustre/f21h.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          536
  lcm_flags:         ro,pccro
  lcm_layout_gen:    4
  lcm_mirror_count:  4
  lcm_entry_count:   4
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         224
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x35
      lmm_fid:           [0x200003ab1:0x35:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x112:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x112:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         304
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x35
      lmm_fid:           [0x200003ab1:0x35:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x113:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x113:0x0] }

  - lcme_id:             196611
    lcme_mirror_id:      3
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         384
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
  - lcme_id:             262145
    lcme_mirror_id:      4
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         456
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x35
      lmm_fid:           [0x200003ab1:0x35:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   8388608
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x114:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x114:0x0] }

file: /mnt/lustre/f21h.sanity-pcc, type: none

FLR layout after PCC-RO attach '/mnt/lustre/f21h.sanity-pcc' again:
/mnt/lustre/f21h.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          536
  lcm_flags:         ro,pccro
  lcm_layout_gen:    4
  lcm_mirror_count:  4
  lcm_entry_count:   4
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         224
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x35
      lmm_fid:           [0x200003ab1:0x35:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x112:0x0] }
      -   1: { l_ost_idx:   1, l_fid: [0x280000400:0x112:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         304
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x35
      lmm_fid:           [0x200003ab1:0x35:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   1048576
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x113:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x113:0x0] }

  - lcme_id:             196611
    lcme_mirror_id:      3
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         384
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
  - lcme_id:             262145
    lcme_mirror_id:      4
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         456
    lcme_size:           80
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x35
      lmm_fid:           [0x200003ab1:0x35:0x0]
      lmm_stripe_count:  2
      lmm_stripe_size:   8388608
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x114:0x0] }
      -   1: { l_ost_idx:   0, l_fid: [0x240000400:0x114:0x0] }

Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d21h.sanity-pcc is idle now
PASS 21h (24s)

== sanity-pcc test 21i: HSM release increase layout gen, should invalidate PCC-RO cache ========================================================== 04:33:02 (1743496382)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.43066 s, 122 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d21i.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 93ed7a94-32cd-4781-8a40-0409493cbb3e
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f21i.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=93ed7a94-32cd-4781-8a40-0409493cbb3e (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d21i.sanity-pcc/d21i.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
/mnt/lustre/f21i.sanity-pcc: (0x00000009) exists archived, archive_id:2
Layout after HSM release /mnt/lustre/f21i.sanity-pcc:
/mnt/lustre/f21i.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    4
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab1
      lmm_object_id:     0x37
      lmm_fid:           [0x200003ab1:0x37:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       released
      lmm_layout_gen:    2
      lmm_stripe_offset: 16

  - lcme_id:             131075
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    343597384136
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
PCC state /mnt/lustre/f21i.sanity-pcc:
file: /mnt/lustre/f21i.sanity-pcc, type: none
Layout after PCC-RO attach /mnt/lustre/f21i.sanity-pcc again:
/mnt/lustre/f21i.sanity-pcc
lmm_magic:         0x0BD10BD0
lmm_seq:           0x200003ab1
lmm_object_id:     0x37
lmm_fid:           [0x200003ab1:0x37:0x0]
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    5
lmm_stripe_offset: 1
	obdidx		 objid		 objid		 group
	     1	           278	        0x116	   0x280000400

PCC state:
file: /mnt/lustre/f21i.sanity-pcc, type: readonly, PCC_file: /d21i.sanity-pcc/3a86/0x200003ab1:0x37:0x0, open_count: 0, flags: 0
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d21i.sanity-pcc is idle now
PASS 21i (32s)

== sanity-pcc test 21j: PCC-RO for encrypted file ======== 04:33:35 (1743496415)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.56939 s, 92.1 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d21j.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: b03890e3-d136-4b79-a551-f4f480e801b4
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f21j.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=b03890e3-d136-4b79-a551-f4f480e801b4 (extents) (64bit) (large files) (huge files)
Stopping client oleg635-client.virtnet /mnt/lustre (opts:)
Starting client: oleg635-client.virtnet:  -o user_xattr,flock,test_dummy_encryption 192.168.206.135@tcp:/lustre /mnt/lustre
449905565
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d21j.sanity-pcc/d21j.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
5000+0 records in
5000+0 records out
5000 bytes (5.0 kB, 4.9 KiB) copied, 0.0902932 s, 55.4 kB/s
/mnt/lustre/d21j.sanity-pcc/f21j.sanity-pcc
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    0
lmm_stripe_offset: 0
	obdidx		 objid		 objid		 group
	     0	           278	        0x116	   0x240000400

PCC-RO attach '/mnt/lustre/d21j.sanity-pcc/f21j.sanity-pcc':
/mnt/lustre/d21j.sanity-pcc/f21j.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab3
      lmm_object_id:     0x2
      lmm_fid:           [0x200003ab3:0x2:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x116:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    4294967296
      lhm_archive_ver:   4493216720
      lhm_archive_uuid:  ''
/mnt/lustre/d21j.sanity-pcc/f21j.sanity-pcc_2
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    0
lmm_stripe_offset: 1
	obdidx		 objid		 objid		 group
	     1	           279	        0x117	   0x280000400

PCC-RO attach '/mnt/lustre/d21j.sanity-pcc/f21j.sanity-pcc_2':
/mnt/lustre/d21j.sanity-pcc/f21j.sanity-pcc_2
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab3
      lmm_object_id:     0x3
      lmm_fid:           [0x200003ab3:0x3:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x117:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    4294967296
      lhm_archive_ver:   4493216720
      lhm_archive_uuid:  ''
1 keys reaped
Cleanup PCC backend on /mnt/lustre
Stopping client oleg635-client.virtnet /mnt/lustre (opts:)
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
/mnt/pcc.d21j.sanity-pcc is idle now
PASS 21j (36s)

== sanity-pcc test 22: Test RO-PCC attach for the HSM released file ========================================================== 04:34:12 (1743496452)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.16883 s, 311 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d22.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: aa6742a3-e5e7-440f-ad1e-168aee1cc3f0
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f22.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=aa6742a3-e5e7-440f-ad1e-168aee1cc3f0 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d22.sanity-pcc/d22.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Layout after PCC-RO attach /mnt/lustre/f22.sanity-pcc:
/mnt/lustre/f22.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    3
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab4
      lmm_object_id:     0x1
      lmm_fid:           [0x200003ab4:0x1:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    2
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x118:0x0] }

  - lcme_id:             131075
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   4493216720
      lhm_archive_uuid:  ''
Layout after HSM release /mnt/lustre/f22.sanity-pcc:
/mnt/lustre/f22.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    4
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab4
      lmm_object_id:     0x1
      lmm_fid:           [0x200003ab4:0x1:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       released
      lmm_layout_gen:    2
      lmm_stripe_offset: 16

  - lcme_id:             131075
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    343597384136
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Layout after PCC-RO attach /mnt/lustre/f22.sanity-pcc again:
/mnt/lustre/f22.sanity-pcc
lmm_magic:         0x0BD10BD0
lmm_seq:           0x200003ab4
lmm_object_id:     0x1
lmm_fid:           [0x200003ab4:0x1:0x0]
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    5
lmm_stripe_offset: 0
	obdidx		 objid		 objid		 group
	     0	           280	        0x118	   0x240000400

Layout after PCC-RO detach /mnt/lustre/f22.sanity-pcc:
/mnt/lustre/f22.sanity-pcc
lmm_magic:         0x0BD10BD0
lmm_seq:           0x200003ab4
lmm_object_id:     0x1
lmm_fid:           [0x200003ab4:0x1:0x0]
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    5
lmm_stripe_offset: 0
	obdidx		 objid		 objid		 group
	     0	           280	        0x118	   0x240000400

Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d22.sanity-pcc is idle now
PASS 22 (25s)

== sanity-pcc test 23: Test write/truncate/mmap-write invalidating RO-PCC caching ========================================================== 04:34:37 (1743496477)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.207668 s, 252 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d23.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 82beeffa-029b-48ae-9ba3-7ddbd840998b
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f23.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=82beeffa-029b-48ae-9ba3-7ddbd840998b (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d23.sanity-pcc/d23.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Write should invalidate the RO-PCC cache:
/mnt/lustre/f23.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         wp
  lcm_layout_gen:    4
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab4
      lmm_object_id:     0x9
      lmm_fid:           [0x200003ab4:0x9:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x11a:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init,stale
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,dirty,archived,0xb
      lhm_archive_id:    4294967296
      lhm_archive_ver:   4493216720
      lhm_archive_uuid:  ''
PCC-RO attach '/mnt/lustre/f23.sanity-pcc' again:
/mnt/lustre/f23.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         wp,pccro
  lcm_layout_gen:    5
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab4
      lmm_object_id:     0x9
      lmm_fid:           [0x200003ab4:0x9:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x11a:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   4493216720
      lhm_archive_uuid:  ''
Truncate invalidate the RO-PCC cache:
/mnt/lustre/f23.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         wp
  lcm_layout_gen:    6
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab4
      lmm_object_id:     0x9
      lmm_fid:           [0x200003ab4:0x9:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x11a:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,0x9
      lhm_archive_id:    0
      lhm_archive_ver:   4493216720
      lhm_archive_uuid:  ''
Finish trucate operation
Mmap write invalidates RO-PCC caching
/mnt/lustre/f23.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         wp
  lcm_layout_gen:    6
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab4
      lmm_object_id:     0x9
      lmm_fid:           [0x200003ab4:0x9:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x11a:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,0x9
      lhm_archive_id:    0
      lhm_archive_ver:   4493216720
      lhm_archive_uuid:  ''
PCC-RO attach '/mnt/lustre/f23.sanity-pcc' again:
/mnt/lustre/f23.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         wp,pccro
  lcm_layout_gen:    7
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab4
      lmm_object_id:     0x9
      lmm_fid:           [0x200003ab4:0x9:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x11a:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   4493216720
      lhm_archive_uuid:  ''
Mmap write /mnt/lustre/f23.sanity-pcc via multiop
/mnt/lustre/f23.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         wp
  lcm_layout_gen:    8
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x200003ab4
      lmm_object_id:     0x9
      lmm_fid:           [0x200003ab4:0x9:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 1
      lmm_objects:
      -   0: { l_ost_idx:   1, l_fid: [0x280000400:0x11a:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,0x9
      lhm_archive_id:    343597384136
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d23.sanity-pcc is idle now
PASS 23 (19s)

== sanity-pcc test 24a: Test RO-PCC with non-root user === 04:34:56 (1743496496)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.413848 s, 127 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d24a.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/5120016384/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: a8b1fe6e-d6f9-4a0f-9115-c20f96b61946
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f24a.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=a8b1fe6e-d6f9-4a0f-9115-c20f96b61946 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d24a.sanity-pcc/d24a.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d24a.sanity-pcc/d24a.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 2
    flags: a0
    autocache: projid={100}
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d24a.sanity-pcc/f24a.sanity-pcc] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0416449 s, 24.6 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-r] [-i] [2] [/mnt/lustre/d24a.sanity-pcc/f24a.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d24a.sanity-pcc/f24a.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0144089 s, 71.1 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [-k] [/mnt/lustre/d24a.sanity-pcc/f24a.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/pcc.d24a.sanity-pcc/d24a.sanity-pcc/3ab8/0x200003ab4:0xc:0x0]
touch: cannot touch '/mnt/pcc.d24a.sanity-pcc/d24a.sanity-pcc/3ab8/0x200003ab4:0xc:0x0': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/pcc.d24a.sanity-pcc/d24a.sanity-pcc/3ab8/0x200003ab4:0xc:0x0] [of=/dev/null] [bs=1024] [count=1]
dd: failed to open '/mnt/pcc.d24a.sanity-pcc/d24a.sanity-pcc/3ab8/0x200003ab4:0xc:0x0': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/pcc.d24a.sanity-pcc/d24a.sanity-pcc/3ab8/0x200003ab4:0xc:0x0] [bs=1024] [count=1]
dd: failed to open '/mnt/pcc.d24a.sanity-pcc/d24a.sanity-pcc/3ab8/0x200003ab4:0xc:0x0': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-r] [-i] [2] [/mnt/lustre/d24a.sanity-pcc/f24a.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/d24a.sanity-pcc/f24a.sanity-pcc]
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d24a.sanity-pcc is idle now
PASS 24a (20s)

== sanity-pcc test 24b: General permission test for RO-PCC ========================================================== 04:35:16 (1743496516)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.137127 s, 382 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d24b.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 51810806-fa45-4561-9e99-3a876ca38d18
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f24b.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=51810806-fa45-4561-9e99-3a876ca38d18 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d24b.sanity-pcc/d24b.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0166314 s, 61.6 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc] [bs=1024] [count=1]
dd: failed to open '/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
dd: failed to open '/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/dev/zero] [of=/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc] [bs=1024] [count=1]
dd: failed to open '/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
dd: failed to open '/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc': Permission denied
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0226295 s, 45.3 kB/s
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc]
detach: cannot detach '/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc' from PCC: Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [dd] [if=/mnt/lustre/d24b.sanity-pcc/f24b.sanity-pcc] [of=/dev/null] [bs=1024] [count=1]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00903754 s, 113 kB/s
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d24b.sanity-pcc is idle now
PASS 24b (20s)

== sanity-pcc test 25: Tolerate fake read failure for RO-PCC ========================================================== 04:35:36 (1743496536)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.347771 s, 151 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d25.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: db7cf45c-c85d-4aa2-8048-80189603ed1d
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f25.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=db7cf45c-c85d-4aa2-8048-80189603ed1d (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d25.sanity-pcc/d25.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
fail_loc=0x1411
fail_loc=0
fail_loc=0x1411
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d25.sanity-pcc is idle now
PASS 25 (22s)

== sanity-pcc test 26: Repeat the attach/detach when the file has multiple openers ========================================================== 04:35:59 (1743496559)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.15028 s, 349 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d26.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: b9563d96-3a0d-4634-96e5-b4edc7748749
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f26.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=b9563d96-3a0d-4634-96e5-b4edc7748749 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d26.sanity-pcc/d26.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
multiop /mnt/lustre/f26.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.65086
client oleg635-client.virtnet multiop_bg started multiop_pid=65096
Stopping multiop_pid=65096 (kill 65096 on oleg635-client.virtnet)
multiop /mnt/lustre/f26.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.65199
client oleg635-client.virtnet multiop_bg started multiop_pid=65209
Stopping multiop_pid=65209 (kill 65209 on oleg635-client.virtnet)
multiop /mnt/lustre/f26.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.65312
client oleg635-client.virtnet multiop_bg started multiop_pid=65322
Stopping multiop_pid=65322 (kill 65322 on oleg635-client.virtnet)
multiop /mnt/lustre/f26.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.65425
client oleg635-client.virtnet multiop_bg started multiop_pid=65435
Stopping multiop_pid=65435 (kill 65435 on oleg635-client.virtnet)
multiop /mnt/lustre/f26.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.65564
client oleg635-client.virtnet multiop_bg started multiop_pid=65575
Stopping multiop_pid=65575 (kill 65575 on oleg635-client.virtnet)
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d26.sanity-pcc is idle now
PASS 26 (47s)

== sanity-pcc test 27: Auto attach at open when the file has multiple openers ========================================================== 04:36:47 (1743496607)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.293355 s, 179 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d27.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 81a8725a-eedc-49c2-ab4d-3be70473f70a
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f27.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=81a8725a-eedc-49c2-ab4d-3be70473f70a (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d27.sanity-pcc/d27.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
multiop /mnt/lustre/f27.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.66413
client oleg635-client.virtnet multiop_bg started multiop_pid=66423
Stopping multiop_pid=66423 (kill 66423 on oleg635-client.virtnet)
multiop /mnt/lustre/f27.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.66545
client oleg635-client.virtnet multiop_bg started multiop_pid=66555
ldlm.namespaces.lustre-MDT0000-mdc-ffff8ab3cbd11000.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff8ab3ea9c1000.lru_size=clear
Stopping multiop_pid=66555 (kill 66555 on oleg635-client.virtnet)
multiop /mnt/lustre/f27.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.66676
client oleg635-client.virtnet multiop_bg started multiop_pid=66687
Stopping multiop_pid=66687 (kill 66687 on oleg635-client.virtnet)
multiop /mnt/lustre/f27.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.66793
client oleg635-client.virtnet multiop_bg started multiop_pid=66803
ldlm.namespaces.lustre-MDT0000-mdc-ffff8ab3cbd11000.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff8ab3ea9c1000.lru_size=clear
Stopping multiop_pid=66803 (kill 66803 on oleg635-client.virtnet)
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d27.sanity-pcc is idle now
PASS 27 (43s)

== sanity-pcc test 28: RW-PCC attach should fail when the file has cluster-wide openers ========================================================== 04:37:31 (1743496651)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.284101 s, 185 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d28.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: b307df23-f9d1-4ed9-8250-c442f53b4891
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f28.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=b307df23-f9d1-4ed9-8250-c442f53b4891 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d28.sanity-pcc/d28.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
multiop /mnt/lustre/f28.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.67605
client oleg635-client.virtnet multiop_bg started multiop_pid=67615
lfs pcc pcc: cannot get WRITE lease, ext 0 for [0x200003ab4:0x24:0x0]: Device or resource busy (16)
lfs pcc pcc: cannot get lease: Device or resource busy (16)
attach: cannot attach '/mnt/lustre/f28.sanity-pcc' to PCC with attach ID '2': Device or resource busy
Stopping multiop_pid=67615 (kill 67615 on oleg635-client.virtnet)
multiop /mnt/lustre2/f28.sanity-pcc vO_c
TMPPIPE=/tmp/multiop_open_wait_pipe.7350
lfs pcc pcc: cannot get WRITE lease, ext 0 for [0x200003ab4:0x24:0x0]: Device or resource busy (16)
lfs pcc pcc: cannot get lease: Device or resource busy (16)
attach: cannot attach '/mnt/lustre/f28.sanity-pcc' to PCC with attach ID '2': Device or resource busy
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d28.sanity-pcc is idle now
PASS 28 (22s)

== sanity-pcc test 29a: Auto readonly caching on RO-PCC backend for O_RDONLY open ========================================================== 04:37:54 (1743496674)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg635-client.virtnet /mnt/lustre (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre opts:
Stopping clients: oleg635-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg635-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg635-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg635-server'
oleg635-server: oleg635-server.virtnet: executing load_modules_local
oleg635-server: Loading modules from /home/green/git/lustre-release/lustre
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
oleg635-server: detected 4 online CPUs by sysfs
oleg635-server: MODOPTS_LIBCFS=
oleg635-server: Force libcfs to create 2 CPU partitions
Setup mgs, mdt, osts
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-MDT0000
Starting ost1: -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0000
Starting ost2: -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff8ab3ea834000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff8ab3fdee1000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3ea834000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3fdee1000.idle_timeout=debug
disable quota as required
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.187944 s, 279 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d29a.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: f7ca57c1-2008-4b0e-93e7-f79f7cb96cf7
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f29a.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=f7ca57c1-2008-4b0e-93e7-f79f7cb96cf7 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d29a.sanity-pcc/d29a.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d29a.sanity-pcc/d29a.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 2
    flags: ae
    autocache: projid={100}
  100 P /mnt/lustre/d29a.sanity-pcc/f29a.sanity-pcc
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d29a.sanity-pcc is idle now
PASS 29a (198s)

== sanity-pcc test 29b: Auto PCC-RO attach in atomic_open ========================================================== 04:41:11 (1743496871)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.225111 s, 233 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d29b.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 0316ce27-e437-43e8-a93d-8fa827dd005e
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f29b.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=0316ce27-e437-43e8-a93d-8fa827dd005e (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d29b.sanity-pcc/d29b.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: fname={*.dat}
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0431599 s, 94.9 kB/s
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0110458 s, 371 kB/s
file: /mnt/lustre/myfile.dat, type: readonly, PCC_file: /d29b.sanity-pcc/4282/0x200004281:0x3:0x0, open_count: 0, flags: 0
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00809023 s, 506 kB/s
vm.drop_caches = 3
1+0 records in
1+0 records out
4096 bytes (4.1 kB, 4.0 KiB) copied, 0.121901 s, 33.6 kB/s
file: /mnt/lustre/myfile.dat, type: readonly, PCC_file: /d29b.sanity-pcc/4282/0x200004281:0x3:0x0, open_count: 0, flags: 0
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d29b.sanity-pcc is idle now
PASS 29b (21s)

== sanity-pcc test 30: Test lctl pcc del command ========= 04:41:32 (1743496892)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.242967 s, 216 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d30.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 4a06d0bb-c075-4bac-857e-3b3513ab5596
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f30.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=4a06d0bb-c075-4bac-857e-3b3513ab5596 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d30.sanity-pcc/d30.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d30.sanity-pcc/d30.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 2
    flags: be
    autocache: projid={100}
check file 0:'4287' under directory '/mnt/pcc.d30.sanity-pcc/d30.sanity-pcc'
check file 0:'428b' under directory '/mnt/pcc.d30.sanity-pcc/d30.sanity-pcc'
check file 0:'4289' under directory '/mnt/pcc.d30.sanity-pcc/d30.sanity-pcc'
check file 1:'0x200004281:0x6:0x0' under directory '/mnt/pcc.d30.sanity-pcc/d30.sanity-pcc/4287'
Handle the file: 0x200004281:0x6:0x0
Detach and remove the PCC cached file: 0x200004281:0x6:0x0
check file 1:'0x200004281:0xa:0x0' under directory '/mnt/pcc.d30.sanity-pcc/d30.sanity-pcc/428b'
Handle the file: 0x200004281:0xa:0x0
Detach and remove the PCC cached file: 0x200004281:0xa:0x0
check file 1:'0x200004281:0x8:0x0' under directory '/mnt/pcc.d30.sanity-pcc/d30.sanity-pcc/4289'
Handle the file: 0x200004281:0x8:0x0
Remove non-cached file: /mnt/pcc.d30.sanity-pcc/d30.sanity-pcc/4289/0x200004281:0x8:0x0 flags: 1
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d30.sanity-pcc is idle now
PASS 30 (20s)

== sanity-pcc test 31: Test lctl pcc del command with --keep option ========================================================== 04:41:52 (1743496912)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.203795 s, 257 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d31.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 9cad4b7d-6fa2-4cf4-8d9d-49e2f19d7e67
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f31.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=9cad4b7d-6fa2-4cf4-8d9d-49e2f19d7e67 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d31.sanity-pcc/d31.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d31.sanity-pcc/d31.sanity-pcc
    hsmtool: posix_v2
    rwid: 2
    roid: 2
    flags: b0
    autocache: projid={100}
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d31.sanity-pcc is idle now
PASS 31 (19s)

== sanity-pcc test 32: Test for RO-PCC when PCC copy is deleted ========================================================== 04:42:12 (1743496932)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.14377 s, 365 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d32.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 95ddce74-4d86-47d3-a485-5b0c3951e076
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f32.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=95ddce74-4d86-47d3-a485-5b0c3951e076 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d32.sanity-pcc/d32.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
multiop /mnt/lustre/f32.sanity-pcc vo_rc
TMPPIPE=/tmp/multiop_open_wait_pipe.73566
client oleg635-client.virtnet multiop_bg started multiop_pid=73576
Stopping multiop_pid=73576 (kill 73576 on oleg635-client.virtnet)
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d32.sanity-pcc is idle now
PASS 32 (28s)

 SKIP: sanity-pcc test_33 skipping ALWAYS excluded test 33

== sanity-pcc test 34: Cache rule with comparator (>, <) for Project ID range ========================================================== 04:42:43 (1743496963)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg635-client.virtnet /mnt/lustre (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre opts:
Stopping clients: oleg635-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg635-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg635-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg635-server'
oleg635-server: oleg635-server.virtnet: executing load_modules_local
oleg635-server: Loading modules from /home/green/git/lustre-release/lustre
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
oleg635-server: detected 4 online CPUs by sysfs
oleg635-server: MODOPTS_LIBCFS=
oleg635-server: Force libcfs to create 2 CPU partitions
Setup mgs, mdt, osts
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-MDT0000
Starting ost1: -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0000
Starting ost2: -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff8ab3c6024000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff8ab3fe34c000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3c6024000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3fe34c000.idle_timeout=debug
disable quota as required
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.225671 s, 232 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d34.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 9a2d70fd-5145-4ceb-8a67-905a52413377
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f34.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=9a2d70fd-5145-4ceb-8a67-905a52413377 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d34.sanity-pcc/d34.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
pcc:
  -
    pccpath: /mnt/pcc.d34.sanity-pcc/d34.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 5
    flags: ae
    autocache: projid>{100}
   99 - /mnt/lustre/f34.sanity-pcc
  101 - /mnt/lustre/f34.sanity-pcc
Cleanup PCC backend on /mnt/lustre
pcc:
  -
    pccpath: /mnt/pcc.d34.sanity-pcc/d34.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 5
    flags: ae
    autocache: projid<{100}
  102 - /mnt/lustre/f34.sanity-pcc
   99 - /mnt/lustre/f34.sanity-pcc
Cleanup PCC backend on /mnt/lustre
pcc:
  -
    pccpath: /mnt/pcc.d34.sanity-pcc/d34.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 5
    flags: ae
    autocache: projid<{120}&projid>{110}
  105 - /mnt/lustre/f34.sanity-pcc
  121 - /mnt/lustre/f34.sanity-pcc
  115 - /mnt/lustre/f34.sanity-pcc
Cleanup PCC backend on /mnt/lustre
Cleanup PCC backend on /mnt/lustre
Cleanup PCC backend on /mnt/lustre
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d34.sanity-pcc is idle now
PASS 34 (182s)

== sanity-pcc test 35: mmap fault test =================== 04:45:45 (1743497145)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.30781 s, 170 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d35.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 1ebf559f-80af-400c-82e9-ae4650d67fa6
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f35.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=1ebf559f-80af-400c-82e9-ae4650d67fa6 (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d35.sanity-pcc/d35.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d35.sanity-pcc is idle now
PASS 35 (20s)

== sanity-pcc test 36a: Stale RW-PCC copy should be deleted after remove the PCC backend ========================================================== 04:46:05 (1743497165)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.266575 s, 197 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d36a.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 1f12a2ba-b3b2-4d36-b746-9f66c892a70a
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f36a.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=1f12a2ba-b3b2-4d36-b746-9f66c892a70a (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d36a.sanity-pcc/d36a.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
check file 0:'4a52' under directory '/mnt/pcc.d36a.sanity-pcc/d36a.sanity-pcc'
check file 1:'0x200004a51:0x3:0x0' under directory '/mnt/pcc.d36a.sanity-pcc/d36a.sanity-pcc/4a52'
Handle the file: 0x200004a51:0x3:0x0
Remove non-cached file: /mnt/pcc.d36a.sanity-pcc/d36a.sanity-pcc/4a52/0x200004a51:0x3:0x0 flags: 1
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d36a.sanity-pcc is idle now
PASS 36a (18s)

== sanity-pcc test 36b: Stale RO-PCC copy should be deleted after remove the PCC backend ========================================================== 04:46:23 (1743497183)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.204712 s, 256 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d36b.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 2ec67541-06fc-4616-ac7b-7db44a2fe52a
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f36b.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=2ec67541-06fc-4616-ac7b-7db44a2fe52a (extents) (64bit) (large files) (huge files)
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d36b.sanity-pcc/d36b.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
check file 0:'4a54' under directory '/mnt/pcc.d36b.sanity-pcc/d36b.sanity-pcc'
check file 1:'0x200004a51:0x5:0x0' under directory '/mnt/pcc.d36b.sanity-pcc/d36b.sanity-pcc/4a54'
Handle the file: 0x200004a51:0x5:0x0
Remove non-cached file: /mnt/pcc.d36b.sanity-pcc/d36b.sanity-pcc/4a54/0x200004a51:0x5:0x0 flags: 1
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d36b.sanity-pcc is idle now
PASS 36b (16s)

== sanity-pcc test 37: Multiple readers on a shared file with PCC-RO mode ========================================================== 04:46:40 (1743497200)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.160088 s, 327 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d37.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 52d2f7a2-9268-49c8-aeba-90634cac473f
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f37.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=52d2f7a2-9268-49c8-aeba-90634cac473f (extents) (64bit) (large files) (huge files)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.276388 s, 190 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
/tmp/f37.sanity-pcc on /mnt/pcc.d37.sanity-pcc type ext4 (rw,relatime,quota,usrquota,grpquota)
umount: /mnt/pcc.d37.sanity-pcc.2: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
/tmp/f37.sanity-pcc on /mnt/pcc.d37.sanity-pcc type ext4 (rw,relatime,quota,usrquota,grpquota)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 6a3515c3-5807-4001-a9e7-4a8c8203c514
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f37.sanity-pcc.2: Linux rev 1.0 ext4 filesystem data, UUID=6a3515c3-5807-4001-a9e7-4a8c8203c514 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d37.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: a0
    autocache: projid={2}
pcc:
  -
    pccpath: /mnt/pcc.d37.sanity-pcc.2
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: a0
    autocache: projid={2}
file: /mnt/lustre/d37.sanity-pcc/f37.sanity-pcc, type: readonly, PCC_file: /4a56/0x200004a51:0x7:0x0, open_count: 0, flags: 0
file: /mnt/lustre2/d37.sanity-pcc/f37.sanity-pcc, type: readonly, PCC_file: /4a56/0x200004a51:0x7:0x0, open_count: 0, flags: 0
/mnt/pcc.d37.sanity-pcc.2 is idle now
/mnt/pcc.d37.sanity-pcc is idle now
PASS 37 (22s)

== sanity-pcc test 38: Verify LFS pcc state does not trigger prefetch for auto PCC-RO ========================================================== 04:47:02 (1743497222)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg635-client.virtnet /mnt/lustre (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre opts:
Stopping clients: oleg635-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg635-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg635-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg635-server'
oleg635-server: oleg635-server.virtnet: executing load_modules_local
oleg635-server: Loading modules from /home/green/git/lustre-release/lustre
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
oleg635-server: detected 4 online CPUs by sysfs
oleg635-server: MODOPTS_LIBCFS=
oleg635-server: Force libcfs to create 2 CPU partitions
Setup mgs, mdt, osts
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-MDT0000
Starting ost1: -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0000
Starting ost2: -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff8ab3d1bc9000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff8ab3d370c000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3d1bc9000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3d370c000.idle_timeout=debug
disable quota as required
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.127352 s, 412 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d38.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 9397702a-615b-4455-bd69-d57a1bfdd1e7
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f38.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=9397702a-615b-4455-bd69-d57a1bfdd1e7 (extents) (64bit) (large files) (huge files)
file: /mnt/lustre/d38.sanity-pcc/f38.sanity-pcc, type: none
QQQQQ
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d38.sanity-pcc is idle now
PASS 38 (176s)

== sanity-pcc test 39: Test Project quota on loop PCC device ========================================================== 04:49:59 (1743497399)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg635-client.virtnet /mnt/lustre (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre opts:
Stopping clients: oleg635-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg635-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg635-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg635-server'
oleg635-server: oleg635-server.virtnet: executing load_modules_local
oleg635-server: Loading modules from /home/green/git/lustre-release/lustre
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
oleg635-server: detected 4 online CPUs by sysfs
oleg635-server: MODOPTS_LIBCFS=
oleg635-server: Force libcfs to create 2 CPU partitions
Setup mgs, mdt, osts
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-MDT0000
Starting ost1: -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0000
Starting ost2: -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff8ab3c9de4000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff8ab3cbdfc000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3c9de4000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3cbdfc000.idle_timeout=debug
disable quota as required
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.128511 s, 408 MB/s
umount: /mnt/pcc.d39.sanity-pcc: not mounted.
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: ce3802d8-f7fa-40b8-861f-1dba53dd5323
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f39.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=ce3802d8-f7fa-40b8-861f-1dba53dd5323 (extents) (64bit) (large files) (huge files)
/tmp/f39.sanity-pcc on /mnt/pcc.d39.sanity-pcc type ext4 (rw,relatime,prjquota)
project quota on /mnt/pcc.d39.sanity-pcc (/dev/loop0) is on (enforced)
*** Report for project quotas on device /dev/loop0
Block grace time: 7days; Inode grace time: 7days
                        Space limits                File limits
Project         used    soft    hard  grace    used  soft  hard  grace
----------------------------------------------------------------------
#0        --     13K      0K      0K              2     0     0       
#100      --      0K      0K   4096K              0     0     0       


pcc:
  -
    pccpath: /mnt/pcc.d39.sanity-pcc/d39.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={100}
2+0 records in
2+0 records out
2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0683911 s, 30.7 MB/s
  100 - /mnt/lustre/d39.sanity-pcc/f39.sanity-pcc
2+0 records in
2+0 records out
2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0191606 s, 109 MB/s
file: /mnt/lustre/d39.sanity-pcc/f39.sanity-pcc, type: readonly, PCC_file: /d39.sanity-pcc/59f3/0x2000059f1:0x2:0x0, open_count: 0, flags: 0
*** Report for project quotas on device /dev/loop0
Block grace time: 7days; Inode grace time: 7days
                        Space limits                File limits
Project         used    soft    hard  grace    used  soft  hard  grace
----------------------------------------------------------------------
#0        --     15K      0K      0K              4     0     0       
#100      --   2048K      0K   4096K              1     0     0       


5+0 records in
5+0 records out
5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.179632 s, 29.2 MB/s
5+0 records in
5+0 records out
5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0225415 s, 233 MB/s
*** Report for project quotas on device /dev/loop0
Block grace time: 7days; Inode grace time: 7days
                        Space limits                File limits
Project         used    soft    hard  grace    used  soft  hard  grace
----------------------------------------------------------------------
#0        --     15K      0K      0K              4     0     0       
#100      --      0K      0K   4096K              0     0     0       


file: /mnt/lustre/d39.sanity-pcc/f39.sanity-pcc, type: none
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d39.sanity-pcc is idle now
PASS 39 (164s)

== sanity-pcc test 40: Test async open attach in the background for PCC-RO file ========================================================== 04:52:42 (1743497562)
using SAVE_PROJECT_SUPPORTED=0
Stopping clients: oleg635-client.virtnet /mnt/lustre (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre opts:
Stopping clients: oleg635-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre2 opts:
Stopping /mnt/lustre-mds1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost1 (opts:-f) on oleg635-server
Stopping /mnt/lustre-ost2 (opts:-f) on oleg635-server
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
Checking servers environments
Checking clients oleg635-client.virtnet environments
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
/home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
Loading modules from /home/green/git/lustre-release/lustre
detected 4 online CPUs by sysfs
MODOPTS_LIBCFS=
Force libcfs to create 2 CPU partitions
loading modules on: 'oleg635-server'
oleg635-server: oleg635-server.virtnet: executing load_modules_local
oleg635-server: Loading modules from /home/green/git/lustre-release/lustre
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1001: echo: write error: Device or resource busy
oleg635-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 1002: echo: write error: Device or resource busy
oleg635-server: detected 4 online CPUs by sysfs
oleg635-server: MODOPTS_LIBCFS=
oleg635-server: Force libcfs to create 2 CPU partitions
Setup mgs, mdt, osts
Starting mds1: -o localrecov  lustre-mdt1/mdt1 /mnt/lustre-mds1
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-MDT0000
Starting ost1: -o localrecov  lustre-ost1/ost1 /mnt/lustre-ost1
seq.cli-lustre-OST0000-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0000
Starting ost2: -o localrecov  lustre-ost2/ost2 /mnt/lustre-ost2
seq.cli-lustre-OST0001-super.width=65536
oleg635-server: oleg635-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all
pdsh@oleg635-client: oleg635-server: ssh exited with exit code 1
Started lustre-OST0001
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Starting client: oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Starting client oleg635-client.virtnet:  -o user_xattr,flock 192.168.206.135@tcp:/lustre /mnt/lustre2
Started clients oleg635-client.virtnet: 
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
Using TIMEOUT=20
osc.lustre-OST0000-osc-ffff8ab3c6ce1000.idle_timeout=debug
osc.lustre-OST0000-osc-ffff8ab3f65c1000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3c6ce1000.idle_timeout=debug
osc.lustre-OST0001-osc-ffff8ab3f65c1000.idle_timeout=debug
disable quota as required
200+0 records in
200+0 records out
209715200 bytes (210 MB, 200 MiB) copied, 0.926678 s, 226 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d40.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:   8192/204800             done                            
Creating filesystem with 204800 1k blocks and 51200 inodes
Filesystem UUID: 66ef0270-536d-44c3-a224-9b8abcb06574
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345, 73729

Allocating group tables:  0/25     done                            
Writing inode tables:  0/25     done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information:  0/25     done

/tmp/f40.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=66ef0270-536d-44c3-a224-9b8abcb06574 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d40.sanity-pcc/d40.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={100}
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.39664 s, 37.5 MB/s
  100 - /mnt/lustre/d40.sanity-pcc/f40.sanity-pcc
file: /mnt/lustre/d40.sanity-pcc/f40.sanity-pcc, type: none
ldlm.namespaces.lustre-OST0000-osc-ffff8ab3c6ce1000.lru_size=clear
ldlm.namespaces.lustre-OST0000-osc-ffff8ab3f65c1000.lru_size=clear
ldlm.namespaces.lustre-OST0001-osc-ffff8ab3c6ce1000.lru_size=clear
ldlm.namespaces.lustre-OST0001-osc-ffff8ab3f65c1000.lru_size=clear
osc.lustre-OST0000-osc-ffff8ab3c6ce1000.stats=clear
osc.lustre-OST0000-osc-ffff8ab3f65c1000.stats=clear
osc.lustre-OST0001-osc-ffff8ab3c6ce1000.stats=clear
osc.lustre-OST0001-osc-ffff8ab3f65c1000.stats=clear
fail_val=1
fail_loc=0x214
llite.lustre-ffff8ab3c6ce1000.pcc_async_threshold=5MB
llite.lustre-ffff8ab3f65c1000.pcc_async_threshold=5MB
Test open attach with pcc_async_threshold=5MB
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 1.96574 s, 533 kB/s
Before: 0 After: 3
file: /mnt/lustre/d40.sanity-pcc/f40.sanity-pcc, type: none, flags: attaching
/home/green/git/lustre-release/lustre/utils/lfs pcc state /mnt/lustre/d40.sanity-pcc/f40.sanity-pcc | grep -E -c 'type: readonly'
Waiting 50s for '1'
Updated after 9s: want '1' got '1'
file: /mnt/lustre/d40.sanity-pcc/f40.sanity-pcc, type: none
llite.lustre-ffff8ab3c6ce1000.pcc_async_threshold=1G
llite.lustre-ffff8ab3f65c1000.pcc_async_threshold=1G
ldlm.namespaces.lustre-OST0000-osc-ffff8ab3c6ce1000.lru_size=clear
ldlm.namespaces.lustre-OST0000-osc-ffff8ab3f65c1000.lru_size=clear
ldlm.namespaces.lustre-OST0001-osc-ffff8ab3c6ce1000.lru_size=clear
ldlm.namespaces.lustre-OST0001-osc-ffff8ab3f65c1000.lru_size=clear
osc.lustre-OST0000-osc-ffff8ab3c6ce1000.stats=clear
osc.lustre-OST0000-osc-ffff8ab3f65c1000.stats=clear
osc.lustre-OST0001-osc-ffff8ab3c6ce1000.stats=clear
osc.lustre-OST0001-osc-ffff8ab3f65c1000.stats=clear
Test open attach with async_threshold=1G
file: /mnt/lustre/d40.sanity-pcc/f40.sanity-pcc, type: readonly, PCC_file: /d40.sanity-pcc/61c3/0x2000061c1:0x2:0x0, open_count: 0, flags: 0
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242527 s, 43.2 MB/s
Before: 50 After: 50
Time1: 2 Time2: 12
file: /mnt/lustre/d40.sanity-pcc/f40.sanity-pcc, type: none
llite.lustre-ffff8ab3c6ce1000.pcc_async_threshold=5MB
llite.lustre-ffff8ab3f65c1000.pcc_async_threshold=5MB
ldlm.namespaces.lustre-OST0000-osc-ffff8ab3c6ce1000.lru_size=clear
ldlm.namespaces.lustre-OST0000-osc-ffff8ab3f65c1000.lru_size=clear
ldlm.namespaces.lustre-OST0001-osc-ffff8ab3c6ce1000.lru_size=clear
ldlm.namespaces.lustre-OST0001-osc-ffff8ab3f65c1000.lru_size=clear
Read 1MB data with async_threshold=5MB
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 1.11166 s, 943 kB/s
/home/green/git/lustre-release/lustre/utils/lfs pcc state /mnt/lustre/d40.sanity-pcc/f40.sanity-pcc | grep -E -c 'type: readonly'
Waiting 50s for '1'
Updated after 10s: want '1' got '1'
file: /mnt/lustre/d40.sanity-pcc/f40.sanity-pcc, type: none
llite.lustre-ffff8ab3c6ce1000.pcc_async_threshold=1G
llite.lustre-ffff8ab3f65c1000.pcc_async_threshold=1G
ldlm.namespaces.lustre-OST0000-osc-ffff8ab3c6ce1000.lru_size=clear
ldlm.namespaces.lustre-OST0000-osc-ffff8ab3f65c1000.lru_size=clear
ldlm.namespaces.lustre-OST0001-osc-ffff8ab3c6ce1000.lru_size=clear
ldlm.namespaces.lustre-OST0001-osc-ffff8ab3f65c1000.lru_size=clear
Read 1MB data with async_threshold=1G
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147942 s, 70.9 MB/s
Time1: 1 Time2: 11
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d40.sanity-pcc is idle now
PASS 40 (222s)

== sanity-pcc test 41: Test mtime rule for PCC-RO open attach with O_RDONLY mode ========================================================== 04:56:24 (1743497784)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.165911 s, 316 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d41.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: f962a247-4348-420d-857c-512ea08be2a8
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f41.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=f962a247-4348-420d-857c-512ea08be2a8 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d41.sanity-pcc/d41.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: mtime>{1m}
pcc_ro_data
pcc_ro_data
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d41.sanity-pcc is idle now
PASS 41 (14s)

== sanity-pcc test 42: PCC attach without attach ID specified ========================================================== 04:56:38 (1743497798)
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.135765 s, 463 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d42.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: 31ad5765-acde-4b38-becc-6dc8d2fbf2f9
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f42.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=31ad5765-acde-4b38-becc-6dc8d2fbf2f9 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d42.sanity-pcc/d42.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={100}
file: /mnt/lustre/f42.sanity-pcc, type: readonly, PCC_file: /d42.sanity-pcc/61c5/0x2000061c1:0x4:0x0, open_count: 0, flags: 0
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d42.sanity-pcc is idle now
PASS 42 (13s)

== sanity-pcc test 43: Auto attach at open() should add capacity owner check ========================================================== 04:56:51 (1743497811)
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.13764 s, 457 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d43.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: a5488f03-3896-47f2-8b8e-9129f6026af1
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f43.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=a5488f03-3896-47f2-8b8e-9129f6026af1 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d43.sanity-pcc/d43.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: size<{100M}
file: /mnt/lustre/f43.sanity-pcc, type: none
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-r] [/mnt/lustre/f43.sanity-pcc]
lfs pcc pcc: cannot attach the file to PCC with ID 0 failed: Operation not permitted (1)
attach: cannot attach '/mnt/lustre/f43.sanity-pcc' to PCC with attach ID '0': Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/f43.sanity-pcc]
file: /mnt/lustre/f43.sanity-pcc, type: none
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d43.sanity-pcc is idle now
PASS 43 (13s)

== sanity-pcc test 44: Verify valid auto attach without re-fetching the whole files ========================================================== 04:57:04 (1743497824)
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.208419 s, 302 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d44.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: 7f38255e-99f3-43bf-bbc3-29cfd8bb4a04
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f44.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=7f38255e-99f3-43bf-bbc3-29cfd8bb4a04 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d44.sanity-pcc/d44.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
llite.lustre-ffff8ab3c6ce1000.pcc_async_threshold=0
llite.lustre-ffff8ab3f65c1000.pcc_async_threshold=0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.2395 s, 42.3 MB/s
/mnt/lustre/f44.sanity-pcc
lmm_magic:         0x0BD10BD0
lmm_seq:           0x2000061c1
lmm_object_id:     0x6
lmm_fid:           [0x2000061c1:0x6:0x0]
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    0
lmm_stripe_offset: 0
	obdidx		 objid		 objid		 group
	     0	           452	        0x1c4	   0x240000400

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0519829 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.20299 s, 258 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146789 s, 357 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.172629 s, 304 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.646306 s, 81.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.799855 s, 65.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.797074 s, 65.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.809151 s, 64.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.827176 s, 63.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.08998 s, 48.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.855222 s, 61.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.906928 s, 57.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.936798 s, 56.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.938123 s, 55.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.936836 s, 56.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.04205 s, 50.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.08978 s, 48.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0750059 s, 699 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.872281 s, 60.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.576901 s, 90.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0420375 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.1983 s, 43.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0777195 s, 675 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.52057 s, 34.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.131824 s, 398 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0872092 s, 601 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.185601 s, 282 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.2457 s, 213 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.213413 s, 246 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.178061 s, 294 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0890176 s, 589 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.247834 s, 212 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0666735 s, 786 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.312889 s, 168 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0604273 s, 868 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.341701 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.163503 s, 321 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126628 s, 414 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.133149 s, 394 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.522863 s, 100 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103953 s, 504 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.210975 s, 249 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.189092 s, 277 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113206 s, 463 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.137278 s, 382 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0717664 s, 731 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0657822 s, 797 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110508 s, 474 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.150054 s, 349 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0607919 s, 862 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.246101 s, 213 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.346561 s, 151 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217831 s, 241 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.210146 s, 249 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.198418 s, 264 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0964753 s, 543 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.236835 s, 221 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0578761 s, 906 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0563124 s, 931 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0624821 s, 839 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0728714 s, 719 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0925385 s, 567 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.117925 s, 445 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0766446 s, 684 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.185863 s, 282 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.160495 s, 327 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100422 s, 522 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.142876 s, 367 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0557178 s, 941 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0761091 s, 689 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0547988 s, 957 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.16566 s, 316 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.152159 s, 345 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0920175 s, 570 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.246326 s, 213 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113385 s, 462 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.181721 s, 289 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.440458 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.227596 s, 230 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0587553 s, 892 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.233567 s, 224 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.274073 s, 191 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.271197 s, 193 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0693792 s, 756 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.53916 s, 97.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0612349 s, 856 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.101644 s, 516 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0895233 s, 586 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.137281 s, 382 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.594455 s, 88.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0523193 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0621224 s, 844 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.162969 s, 322 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.169245 s, 310 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0850373 s, 617 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.191665 s, 274 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.139492 s, 376 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0816789 s, 642 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.157504 s, 333 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.130164 s, 403 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.17749 s, 295 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0298365 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0436085 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0197791 s, 2.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.082802 s, 633 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0378376 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0418193 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.10439 s, 502 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0986674 s, 531 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0377745 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114016 s, 460 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.141366 s, 371 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120157 s, 436 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.187032 s, 280 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.248979 s, 211 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.179292 s, 292 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.1037 s, 506 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.08637 s, 607 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.206838 s, 253 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0543506 s, 965 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0636631 s, 824 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.318818 s, 164 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0560313 s, 936 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.383494 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0387011 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.512623 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.544882 s, 96.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.122239 s, 429 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.561702 s, 93.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.208525 s, 251 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0602528 s, 870 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.257946 s, 203 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0700091 s, 749 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0791485 s, 662 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0555322 s, 944 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0568884 s, 922 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113898 s, 460 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0524736 s, 999 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0536901 s, 977 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0990009 s, 530 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.040659 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.088645 s, 591 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.093571 s, 560 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.144731 s, 362 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0635076 s, 826 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.137166 s, 382 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.156805 s, 334 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0576156 s, 910 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0594338 s, 882 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0851715 s, 616 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.186752 s, 281 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.175997 s, 298 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114365 s, 458 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.297411 s, 176 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.134701 s, 389 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.178412 s, 294 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.125061 s, 419 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.316414 s, 166 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.166377 s, 315 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0898999 s, 583 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.269208 s, 195 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.250812 s, 209 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0785318 s, 668 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126827 s, 413 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.343098 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.299225 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0725603 s, 723 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0851925 s, 615 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.269066 s, 195 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.290953 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.400768 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0543324 s, 965 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.134227 s, 391 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.207757 s, 252 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.182151 s, 288 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.191451 s, 274 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0737099 s, 711 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.229505 s, 228 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.156635 s, 335 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.138756 s, 378 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0885072 s, 592 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0995003 s, 527 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0832891 s, 629 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.175778 s, 298 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.128875 s, 407 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.172857 s, 303 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0800164 s, 655 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.119912 s, 437 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0904726 s, 579 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.186036 s, 282 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.206454 s, 254 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0781443 s, 671 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0542477 s, 966 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.207869 s, 252 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.147214 s, 356 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0636711 s, 823 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0705254 s, 743 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.181204 s, 289 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0632611 s, 829 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107815 s, 486 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.14488 s, 362 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.181677 s, 289 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.143983 s, 364 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.402403 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0623433 s, 841 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0689087 s, 761 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.288817 s, 182 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.234638 s, 223 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.34003 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.104902 s, 500 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0983433 s, 533 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.102248 s, 513 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.140511 s, 373 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.14908 s, 352 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.154132 s, 340 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.129426 s, 405 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.134947 s, 389 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.1688 s, 311 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.165457 s, 317 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.335436 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217381 s, 241 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118127 s, 444 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12309 s, 426 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146584 s, 358 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.161757 s, 324 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.229055 s, 229 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.204642 s, 256 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0720341 s, 728 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0617727 s, 849 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0778784 s, 673 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0222339 s, 2.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0784601 s, 668 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.101355 s, 517 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0942572 s, 556 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111315 s, 471 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.306568 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111743 s, 469 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0644803 s, 813 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0505714 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12133 s, 432 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.187578 s, 280 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.208187 s, 252 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.223956 s, 234 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.196942 s, 266 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0752382 s, 697 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.198808 s, 264 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.159245 s, 329 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.269594 s, 194 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.324471 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0608618 s, 861 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.344312 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.115681 s, 453 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0438746 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.173316 s, 303 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0767372 s, 683 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0666544 s, 787 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0983545 s, 533 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0645223 s, 813 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.156043 s, 336 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217729 s, 241 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0917403 s, 571 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0913666 s, 574 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.179591 s, 292 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.195047 s, 269 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.173795 s, 302 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0969368 s, 541 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153136 s, 342 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.189774 s, 276 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.02744 s, 1.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.20902 s, 251 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.231294 s, 227 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0664959 s, 788 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.11114 s, 472 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0988553 s, 530 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0239889 s, 2.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.36863 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0655837 s, 799 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.115523 s, 454 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0717628 s, 731 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.177866 s, 295 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.201395 s, 260 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.258352 s, 203 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120675 s, 434 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.341696 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.128033 s, 409 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.151977 s, 345 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.370356 s, 142 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.260331 s, 201 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.219165 s, 239 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.210445 s, 249 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.332729 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.170035 s, 308 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.148404 s, 353 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0605311 s, 866 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.200024 s, 262 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0299823 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0711755 s, 737 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.27477 s, 191 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.377296 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.175162 s, 299 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.222589 s, 236 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.187062 s, 280 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111845 s, 469 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.14554 s, 360 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.209916 s, 250 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.261527 s, 200 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.295622 s, 177 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217207 s, 241 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.214297 s, 245 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114775 s, 457 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.128336 s, 409 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120649 s, 435 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153613 s, 341 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.163955 s, 320 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0887716 s, 591 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.144971 s, 362 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.190502 s, 275 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113799 s, 461 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.184735 s, 284 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.296105 s, 177 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0387617 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217808 s, 241 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0686129 s, 764 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.333103 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0849154 s, 617 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0650565 s, 806 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0717091 s, 731 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.394361 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.141934 s, 369 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.169212 s, 310 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0602789 s, 870 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.266597 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0578507 s, 906 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0504704 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0759974 s, 690 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.144156 s, 364 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0925118 s, 567 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.263091 s, 199 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0594036 s, 883 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.285086 s, 184 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106594 s, 492 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0947717 s, 553 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0988611 s, 530 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.141615 s, 370 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0857075 s, 612 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.125843 s, 417 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.182253 s, 288 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.263984 s, 199 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126018 s, 416 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.254323 s, 206 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.128713 s, 407 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.186158 s, 282 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.135086 s, 388 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.179396 s, 292 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.155625 s, 337 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0795091 s, 659 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.200364 s, 262 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.339363 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0584234 s, 897 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0931573 s, 563 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.086319 s, 607 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0776285 s, 675 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0901433 s, 582 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.130774 s, 401 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.179595 s, 292 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107755 s, 487 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0955591 s, 549 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.256414 s, 204 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.173611 s, 302 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.180991 s, 290 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.170333 s, 308 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0531219 s, 987 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0847237 s, 619 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0405626 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107105 s, 490 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.166262 s, 315 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.179849 s, 292 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.228346 s, 230 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.566272 s, 92.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0808457 s, 649 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.083905 s, 625 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0922962 s, 568 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0702218 s, 747 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0382084 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0481458 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0998346 s, 525 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0659638 s, 795 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0596755 s, 879 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.199265 s, 263 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0790367 s, 663 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.247561 s, 212 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.173298 s, 303 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.374646 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.101104 s, 519 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.183847 s, 285 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.300379 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.112341 s, 467 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.140896 s, 372 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.131003 s, 400 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.431584 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.502387 s, 104 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.141358 s, 371 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0518447 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.101597 s, 516 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.26229 s, 200 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126377 s, 415 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.094771 s, 553 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.131431 s, 399 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.716046 s, 73.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0517581 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0704989 s, 744 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0740433 s, 708 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0759496 s, 690 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0908912 s, 577 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.101263 s, 518 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0735819 s, 713 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0809653 s, 648 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.230772 s, 227 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0740698 s, 708 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.13027 s, 402 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.1059 s, 495 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.05615 s, 934 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121217 s, 433 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0618751 s, 847 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.162863 s, 322 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.180645 s, 290 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.135312 s, 387 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.187327 s, 280 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108033 s, 485 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.281088 s, 187 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113393 s, 462 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.207546 s, 253 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0449909 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0617115 s, 850 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0542964 s, 966 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.147129 s, 356 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.156488 s, 335 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0512867 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0908735 s, 577 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0962545 s, 545 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0953931 s, 550 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.16603 s, 316 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.13302 s, 394 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.115658 s, 453 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.198867 s, 264 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.241236 s, 217 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.115818 s, 453 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.298096 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.215556 s, 243 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.149672 s, 350 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.149016 s, 352 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.163242 s, 321 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.175019 s, 300 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.195828 s, 268 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0964902 s, 543 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.143255 s, 366 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.115906 s, 452 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.238474 s, 220 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.122324 s, 429 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0625818 s, 838 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0853976 s, 614 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.377947 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.263036 s, 199 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0690214 s, 760 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.06776 s, 774 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0918733 s, 571 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0775812 s, 676 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123163 s, 426 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107141 s, 489 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.183189 s, 286 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.204508 s, 256 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.174622 s, 300 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.134163 s, 391 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0711504 s, 737 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.235995 s, 222 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.204612 s, 256 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0672481 s, 780 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.430469 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.400226 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0705086 s, 744 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0799371 s, 656 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0769139 s, 682 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.307153 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.440851 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100642 s, 521 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0587892 s, 892 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.196026 s, 267 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0889239 s, 590 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0415124 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105373 s, 498 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.233929 s, 224 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0459532 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0579386 s, 905 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0588322 s, 891 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.102873 s, 510 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0872666 s, 601 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0887742 s, 591 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.089007 s, 589 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0731159 s, 717 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.127267 s, 412 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.205509 s, 255 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.244586 s, 214 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.239564 s, 219 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106384 s, 493 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.265363 s, 198 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.142731 s, 367 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.095272 s, 550 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0867671 s, 604 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.215331 s, 243 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110603 s, 474 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.422828 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.203321 s, 258 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.184767 s, 284 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.167679 s, 313 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.245374 s, 214 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0899188 s, 583 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0641256 s, 818 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0750499 s, 699 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0708595 s, 740 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105456 s, 497 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0728233 s, 720 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0637493 s, 822 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.122844 s, 427 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0769211 s, 682 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0858729 s, 611 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0677429 s, 774 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105679 s, 496 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0492483 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0703741 s, 745 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0707658 s, 741 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.047696 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.179816 s, 292 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100223 s, 523 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217658 s, 241 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123013 s, 426 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153463 s, 342 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0784525 s, 668 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.14429 s, 363 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146865 s, 357 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.170277 s, 308 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.208031 s, 252 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0754663 s, 695 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.104165 s, 503 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0994477 s, 527 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.195343 s, 268 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.205136 s, 256 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0613706 s, 854 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0816819 s, 642 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0642032 s, 817 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.139685 s, 375 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0324069 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.191095 s, 274 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.163765 s, 320 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.122154 s, 429 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.124423 s, 421 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.17022 s, 308 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.160266 s, 327 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.175583 s, 299 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0884991 s, 592 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.173581 s, 302 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.182932 s, 287 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0853531 s, 614 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.170467 s, 308 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.161828 s, 324 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.258704 s, 203 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0304303 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.082472 s, 636 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0877603 s, 597 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.104766 s, 500 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0643679 s, 815 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0739304 s, 709 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.135943 s, 386 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0816682 s, 642 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0989898 s, 530 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0860008 s, 610 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0493573 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.169846 s, 309 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0436431 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.248196 s, 211 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118038 s, 444 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100183 s, 523 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0642843 s, 816 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.169409 s, 309 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103432 s, 507 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0750067 s, 699 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0609097 s, 861 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0665853 s, 787 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126619 s, 414 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.133045 s, 394 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0930576 s, 563 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0915723 s, 573 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0726237 s, 722 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0527176 s, 995 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.180151 s, 291 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0487448 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.213935 s, 245 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.330578 s, 159 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.376894 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.154351 s, 340 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.228339 s, 230 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.208452 s, 252 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.188294 s, 278 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136151 s, 385 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.202474 s, 259 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.183978 s, 285 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.138355 s, 379 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.139923 s, 375 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.181865 s, 288 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0848301 s, 618 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.252957 s, 207 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100805 s, 520 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0972951 s, 539 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.112995 s, 464 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.147376 s, 356 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0396379 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0879024 s, 596 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0948067 s, 553 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.193895 s, 270 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.133436 s, 393 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0836432 s, 627 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.193652 s, 271 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.238706 s, 220 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0868138 s, 604 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.358029 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.109744 s, 478 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.342005 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.194473 s, 270 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.194683 s, 269 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.240072 s, 218 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.214005 s, 245 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.209145 s, 251 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0973881 s, 538 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.209637 s, 250 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.1077 s, 487 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.155218 s, 338 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0563961 s, 930 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.101102 s, 519 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.119701 s, 438 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153931 s, 341 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.168594 s, 311 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.155585 s, 337 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0697487 s, 752 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.215821 s, 243 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.224547 s, 233 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.214616 s, 244 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.167079 s, 314 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.254669 s, 206 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.129908 s, 404 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.1394 s, 376 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.170124 s, 308 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.064376 s, 814 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12935 s, 405 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0968352 s, 541 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.147122 s, 356 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0787551 s, 666 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0814639 s, 644 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114388 s, 458 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0766919 s, 684 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0352145 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123525 s, 424 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0837181 s, 626 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0820625 s, 639 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0597081 s, 878 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.125562 s, 418 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0744136 s, 705 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.129919 s, 404 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.231954 s, 226 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.13062 s, 401 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0674414 s, 777 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0609099 s, 861 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.219861 s, 238 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0928235 s, 565 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0597117 s, 878 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.148872 s, 352 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.178223 s, 294 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153161 s, 342 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0328622 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0554019 s, 946 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0944598 s, 555 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0612113 s, 857 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0431741 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.109883 s, 477 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.180466 s, 291 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0928928 s, 564 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.124956 s, 420 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.144218 s, 364 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.062522 s, 839 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0931789 s, 563 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123067 s, 426 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.191498 s, 274 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0513073 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0769163 s, 682 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0445725 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0918046 s, 571 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0865106 s, 606 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12598 s, 416 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.14266 s, 368 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.133285 s, 393 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.099513 s, 527 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0509949 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.167928 s, 312 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.084561 s, 620 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0315919 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0250467 s, 2.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111554 s, 470 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107254 s, 489 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.099071 s, 529 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0353589 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.034331 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0621258 s, 844 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.069133 s, 758 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118341 s, 443 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0946537 s, 554 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.102036 s, 514 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.208648 s, 251 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.201821 s, 260 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.164601 s, 319 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.221775 s, 236 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.041454 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0609046 s, 861 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.263495 s, 199 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0536114 s, 978 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.346771 s, 151 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.473766 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0589225 s, 890 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.134063 s, 391 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.493547 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0818861 s, 640 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0405127 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0340096 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.13466 s, 389 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0795793 s, 659 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.169714 s, 309 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0927871 s, 565 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106991 s, 490 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.124695 s, 420 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0722835 s, 725 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.101563 s, 516 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0432373 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.054638 s, 960 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0341222 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.160301 s, 327 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.193137 s, 271 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.205056 s, 256 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.173315 s, 303 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.226797 s, 231 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.250112 s, 210 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.203244 s, 258 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.178841 s, 293 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.238569 s, 220 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.266549 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.33522 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.065554 s, 800 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0626834 s, 836 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0373251 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.04757 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.117175 s, 447 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0572597 s, 916 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.286631 s, 183 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.1492 s, 351 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120945 s, 433 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.27969 s, 187 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.143412 s, 366 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.200318 s, 262 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.187574 s, 280 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.160353 s, 327 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.210532 s, 249 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.223833 s, 234 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113972 s, 460 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.212414 s, 247 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.208393 s, 252 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.251665 s, 208 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0776503 s, 675 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106941 s, 490 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0543233 s, 965 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146962 s, 357 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106005 s, 495 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.218195 s, 240 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.200218 s, 262 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0659609 s, 795 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.150957 s, 347 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.15409 s, 340 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.18471 s, 284 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.168809 s, 311 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.109325 s, 480 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0975433 s, 537 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.208354 s, 252 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.301309 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.16867 s, 311 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.139511 s, 376 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.144266 s, 363 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0432097 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0507631 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0822889 s, 637 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0690435 s, 759 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0751113 s, 698 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0976022 s, 537 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103688 s, 506 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.147753 s, 355 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.112414 s, 466 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.230928 s, 227 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.142194 s, 369 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.222524 s, 236 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.139253 s, 377 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.15659 s, 335 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.230276 s, 228 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0913551 s, 574 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.320216 s, 164 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.116324 s, 451 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.119732 s, 438 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.13214 s, 397 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.164833 s, 318 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.143285 s, 366 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.288968 s, 181 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.381644 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0441526 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.289128 s, 181 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.174762 s, 300 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.156495 s, 335 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.291427 s, 180 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0830419 s, 631 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0801152 s, 654 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.144012 s, 364 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.159493 s, 329 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.395896 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.345482 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110523 s, 474 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.117429 s, 446 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111599 s, 470 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0515584 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.131233 s, 400 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.169785 s, 309 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.101087 s, 519 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.128626 s, 408 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.195942 s, 268 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0560155 s, 936 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.290798 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.13806 s, 380 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.401219 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.102715 s, 510 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.150167 s, 349 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0959925 s, 546 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.145208 s, 361 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.355838 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.076586 s, 685 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.206697 s, 254 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.124347 s, 422 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0894296 s, 586 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.117753 s, 445 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123879 s, 423 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.156547 s, 335 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.410727 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.42115 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.174438 s, 301 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.162313 s, 323 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.063732 s, 823 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0430851 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0756015 s, 693 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.079315 s, 661 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.134429 s, 390 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106186 s, 494 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.2059 s, 255 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.21205 s, 247 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110521 s, 474 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.143635 s, 365 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.140382 s, 373 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.194266 s, 270 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0674743 s, 777 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0760207 s, 690 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.344441 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.316972 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.115835 s, 453 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.308053 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0694098 s, 755 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0829303 s, 632 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0817295 s, 641 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0707204 s, 741 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103214 s, 508 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0859744 s, 610 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12103 s, 433 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.140586 s, 373 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.221161 s, 237 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.274909 s, 191 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.173488 s, 302 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.213424 s, 246 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.205493 s, 255 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.115162 s, 455 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114682 s, 457 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0959266 s, 547 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120931 s, 434 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.161992 s, 324 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.29185 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118844 s, 441 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.141629 s, 370 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.186874 s, 281 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.200759 s, 261 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.204659 s, 256 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.201433 s, 260 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.150131 s, 349 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0609978 s, 860 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.196136 s, 267 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0440184 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.239102 s, 219 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0828296 s, 633 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0322264 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.117514 s, 446 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.257795 s, 203 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.345853 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.055794 s, 940 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.34381 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100331 s, 523 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0609059 s, 861 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.185328 s, 283 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.16969 s, 309 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0985138 s, 532 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.229356 s, 229 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.14435 s, 363 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.173745 s, 302 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.222289 s, 236 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.200815 s, 261 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.180843 s, 290 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.166823 s, 314 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.30464 s, 172 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.296268 s, 177 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0824672 s, 636 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0959623 s, 546 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.112323 s, 467 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126753 s, 414 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.278549 s, 188 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.155302 s, 338 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.1072 s, 489 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.238719 s, 220 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.088321 s, 594 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.21167 s, 248 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114837 s, 457 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.340957 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.232327 s, 226 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.211258 s, 248 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.195007 s, 269 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105906 s, 495 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.101215 s, 518 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.144907 s, 362 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0671181 s, 781 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.16089 s, 326 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0973312 s, 539 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0822275 s, 638 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.276271 s, 190 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.150163 s, 349 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.07347 s, 714 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.232405 s, 226 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.147619 s, 355 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123033 s, 426 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.155994 s, 336 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0679434 s, 772 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153979 s, 340 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105188 s, 498 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.215504 s, 243 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.168896 s, 310 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0875341 s, 599 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.097553 s, 537 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.127585 s, 411 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.194091 s, 270 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.139178 s, 377 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0783022 s, 670 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153074 s, 343 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0345431 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.179278 s, 292 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.27704 s, 189 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0755884 s, 694 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0775145 s, 676 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.08767 s, 598 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0683269 s, 767 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120279 s, 436 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0826145 s, 635 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0644054 s, 814 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0791286 s, 663 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.132332 s, 396 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.231934 s, 226 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.138684 s, 378 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.170802 s, 307 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.181247 s, 289 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.179292 s, 292 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.133309 s, 393 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0748756 s, 700 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.19916 s, 263 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.20083 s, 261 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0506739 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110602 s, 474 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.148009 s, 354 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.281952 s, 186 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0891884 s, 588 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0914905 s, 573 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.214837 s, 244 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.133579 s, 392 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.11282 s, 465 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.173288 s, 303 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.199557 s, 263 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.167498 s, 313 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.144648 s, 362 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.152227 s, 344 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.213001 s, 246 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0599583 s, 874 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.151065 s, 347 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.150163 s, 349 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.090589 s, 579 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.08787 s, 597 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217806 s, 241 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.073784 s, 711 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0570124 s, 920 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103011 s, 509 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0503998 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0690411 s, 759 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.214512 s, 244 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.514787 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.049416 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0949896 s, 552 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111761 s, 469 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0924026 s, 567 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.259203 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0746275 s, 703 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.147997 s, 354 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.143713 s, 365 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12062 s, 435 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0536645 s, 977 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.214423 s, 245 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.300443 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.101447 s, 517 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100734 s, 520 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.116304 s, 451 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.344349 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0732478 s, 716 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.162735 s, 322 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.104857 s, 500 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0912895 s, 574 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.17327 s, 303 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.157849 s, 332 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118748 s, 442 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0460616 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.064012 s, 819 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0260571 s, 2.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0593195 s, 884 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.135388 s, 387 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.054529 s, 961 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.130936 s, 400 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0558276 s, 939 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0701347 s, 748 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0886133 s, 592 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103511 s, 507 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111256 s, 471 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118168 s, 444 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.156558 s, 335 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.198466 s, 264 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.135271 s, 388 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.156748 s, 334 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.127514 s, 411 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.130172 s, 403 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.150949 s, 347 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.206445 s, 254 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.092717 s, 565 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0492122 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0274161 s, 1.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.156379 s, 335 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.177658 s, 295 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0786899 s, 666 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.131023 s, 400 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0560643 s, 935 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.119532 s, 439 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.202245 s, 259 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.137086 s, 382 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.233738 s, 224 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.179664 s, 292 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.21368 s, 245 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.163972 s, 320 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0406024 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.056401 s, 930 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0967759 s, 542 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0760615 s, 689 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0558971 s, 938 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0399048 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0411418 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0408369 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0248938 s, 2.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0539631 s, 972 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0676434 s, 775 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0840169 s, 624 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.055902 s, 938 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0773498 s, 678 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0520992 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0870169 s, 603 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.061088 s, 858 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0515279 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0619598 s, 846 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0966129 s, 543 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0800377 s, 655 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0771257 s, 680 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.170186 s, 308 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0640826 s, 818 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0846041 s, 620 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.196708 s, 267 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.242671 s, 216 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0379242 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.161722 s, 324 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.212607 s, 247 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0561396 s, 934 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0705118 s, 744 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.249295 s, 210 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.421536 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.185824 s, 282 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.238684 s, 220 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123006 s, 426 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.38693 s, 135 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.123183 s, 426 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0786504 s, 667 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.189737 s, 276 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120547 s, 435 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.18389 s, 285 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.372191 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.228837 s, 229 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.407826 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.464739 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.104585 s, 501 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.178996 s, 293 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.199174 s, 263 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0802412 s, 653 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111555 s, 470 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.134408 s, 390 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.191491 s, 274 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.154207 s, 340 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.298341 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.225355 s, 233 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.057821 s, 907 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.122636 s, 428 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.154086 s, 340 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.165897 s, 316 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.319408 s, 164 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.408965 s, 128 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.214314 s, 245 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.155311 s, 338 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.162324 s, 323 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.563412 s, 93.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123582 s, 424 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.358482 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.273252 s, 192 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0843983 s, 621 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0697223 s, 752 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0739775 s, 709 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.125349 s, 418 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0474646 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0811379 s, 646 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0953812 s, 550 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.077766 s, 674 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.128757 s, 407 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0759836 s, 690 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0743698 s, 705 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.229186 s, 229 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.166644 s, 315 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.283854 s, 185 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.19388 s, 270 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.264123 s, 199 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146983 s, 357 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.17506 s, 299 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.050438 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0868714 s, 604 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.355867 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.288253 s, 182 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0698352 s, 751 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0508217 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.299489 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0944102 s, 555 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0905618 s, 579 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0280778 s, 1.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.210567 s, 249 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.179273 s, 292 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0743837 s, 705 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.135961 s, 386 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.10926 s, 480 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.129298 s, 405 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.235268 s, 223 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.273458 s, 192 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0733452 s, 715 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0924294 s, 567 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.101169 s, 518 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153981 s, 340 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0512426 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.203653 s, 257 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120372 s, 436 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0931276 s, 563 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.232862 s, 225 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0910134 s, 576 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.193449 s, 271 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.281971 s, 186 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.209963 s, 250 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0667864 s, 785 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103149 s, 508 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0825038 s, 635 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0792293 s, 662 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.15696 s, 334 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.143025 s, 367 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.244456 s, 214 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.178142 s, 294 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.134372 s, 390 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.307357 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0569766 s, 920 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0650171 s, 806 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0977254 s, 536 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0337682 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0675521 s, 776 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.342087 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105945 s, 495 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0492133 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120583 s, 435 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0795769 s, 659 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.178356 s, 294 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12081 s, 434 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0901544 s, 582 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.140391 s, 373 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0314437 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.229189 s, 229 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.262566 s, 200 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146204 s, 359 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.119573 s, 438 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121563 s, 431 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.169816 s, 309 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.151274 s, 347 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.15365 s, 341 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0753528 s, 696 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.208607 s, 251 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.140188 s, 374 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0729143 s, 719 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0939991 s, 558 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106272 s, 493 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.099452 s, 527 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105764 s, 496 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0957188 s, 548 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.112664 s, 465 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110431 s, 475 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.263033 s, 199 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.10558 s, 497 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0916043 s, 572 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.149071 s, 352 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12848 s, 408 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0944677 s, 555 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.119184 s, 440 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.101936 s, 514 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.138936 s, 377 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.158703 s, 330 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.17641 s, 297 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.190421 s, 275 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0532392 s, 985 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0959363 s, 546 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111309 s, 471 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.140969 s, 372 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.249676 s, 210 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.122143 s, 429 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.14163 s, 370 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.246826 s, 212 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.328916 s, 159 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0539512 s, 972 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0955287 s, 549 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0689576 s, 760 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0782087 s, 670 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121493 s, 432 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0922689 s, 568 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.165359 s, 317 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.116422 s, 450 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.145437 s, 360 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.274503 s, 191 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.233243 s, 225 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.117741 s, 445 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.135198 s, 388 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.144296 s, 363 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106452 s, 493 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0650676 s, 806 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.164092 s, 320 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0437372 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.102667 s, 511 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0894696 s, 586 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.124399 s, 421 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110616 s, 474 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.160248 s, 327 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.162436 s, 323 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.14491 s, 362 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.162004 s, 324 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.214779 s, 244 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0730516 s, 718 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.1192 s, 440 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.142342 s, 368 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.202806 s, 259 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0676987 s, 774 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0833733 s, 629 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.256819 s, 204 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.10518 s, 498 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0771741 s, 679 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114647 s, 457 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0547585 s, 957 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.22007 s, 238 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.145346 s, 361 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.128883 s, 407 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.182569 s, 287 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.283073 s, 185 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.191809 s, 273 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.203053 s, 258 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0703642 s, 745 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0572322 s, 916 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0761181 s, 689 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.320501 s, 164 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0610742 s, 858 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.132338 s, 396 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.35267 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.421291 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.368589 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.143036 s, 367 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.249637 s, 210 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.163827 s, 320 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0605872 s, 865 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0767927 s, 683 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0919281 s, 570 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0972239 s, 539 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105349 s, 498 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0858158 s, 611 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.138124 s, 380 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103677 s, 506 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0574931 s, 912 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.16133 s, 325 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.104336 s, 502 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.176431 s, 297 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0748605 s, 700 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.115083 s, 456 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111617 s, 470 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.145039 s, 361 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.194802 s, 269 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.168284 s, 312 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121378 s, 432 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0964754 s, 543 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.184478 s, 284 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.276473 s, 190 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0497404 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.160248 s, 327 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126018 s, 416 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0668701 s, 784 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.132545 s, 396 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.127587 s, 411 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.214505 s, 244 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.17736 s, 296 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0632545 s, 829 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.171017 s, 307 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.193063 s, 272 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.179427 s, 292 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0452536 s, 1.2 GB/s52428800 bytes (52 MB, 50 MiB) copied, 0.174362 s, 301 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0761947 s, 688 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.226335 s, 232 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0648279 s, 809 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.14311 s, 366 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146692 s, 357 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.16613 s, 316 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.1599 s, 328 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121884 s, 430 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0803421 s, 653 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0742005 s, 707 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0620456 s, 845 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0880385 s, 596 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0853246 s, 614 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.149752 s, 350 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.053359 s, 983 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0582879 s, 899 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136535 s, 384 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.140316 s, 374 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0650588 s, 806 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.15027 s, 349 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0684346 s, 766 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0436788 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0570663 s, 919 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120418 s, 435 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0379955 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0255434 s, 2.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108262 s, 484 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0328615 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.121818 s, 430 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.115921 s, 452 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.130934 s, 400 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0467723 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.335951 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.177644 s, 295 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.068331 s, 767 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.212263 s, 247 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.079303 s, 661 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0725706 s, 722 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.167183 s, 314 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136208 s, 385 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.151953 s, 345 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.128225 s, 409 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.26441 s, 198 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.152909 s, 343 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.133152 s, 394 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0953178 s, 550 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0609269 s, 861 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0668214 s, 785 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0700068 s, 749 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.216923 s, 242 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0695454 s, 754 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.140686 s, 373 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.166238 s, 315 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.112824 s, 465 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.23387 s, 224 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.297625 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136012 s, 385 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.161014 s, 326 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.2708 s, 194 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.216238 s, 242 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103716 s, 506 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.299053 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0759492 s, 690 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.241461 s, 217 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.333918 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0771856 s, 679 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.070479 s, 744 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.277711 s, 189 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.134269 s, 390 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.150338 s, 349 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0253713 s, 2.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0715898 s, 732 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.305199 s, 172 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0574773 s, 912 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.124556 s, 421 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136639 s, 384 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.403761 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.203449 s, 258 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111662 s, 470 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.30536 s, 172 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0576681 s, 909 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118542 s, 442 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.125343 s, 418 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.152444 s, 344 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.175419 s, 299 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.116104 s, 452 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.195251 s, 269 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.23446 s, 224 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.132326 s, 396 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.104916 s, 500 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.10287 s, 510 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0527587 s, 994 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0640194 s, 819 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0660008 s, 794 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114146 s, 459 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.099755 s, 526 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0649549 s, 807 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0899976 s, 583 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.200851 s, 261 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.15257 s, 344 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.150531 s, 348 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0785561 s, 667 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.245037 s, 214 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.141962 s, 369 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.23056 s, 227 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.204999 s, 256 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.176197 s, 298 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.265254 s, 198 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.341161 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.28495 s, 184 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113153 s, 463 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126791 s, 414 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.468192 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.215153 s, 244 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.205278 s, 255 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110889 s, 473 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0927999 s, 565 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.17864 s, 293 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.125535 s, 418 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.27453 s, 191 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0610834 s, 858 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120513 s, 435 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.290818 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113878 s, 460 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136393 s, 384 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.129293 s, 406 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.37076 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.344935 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.26753 s, 196 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.207286 s, 253 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0596903 s, 878 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.162053 s, 324 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0755116 s, 694 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0842687 s, 622 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.137685 s, 381 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.55151 s, 95.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.427209 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0426096 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.452132 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114366 s, 458 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0891869 s, 588 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.135947 s, 386 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0894716 s, 586 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123865 s, 423 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.133941 s, 391 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108257 s, 484 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.160556 s, 327 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.210457 s, 249 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0982273 s, 534 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.139882 s, 375 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0596822 s, 878 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.215689 s, 243 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.251342 s, 209 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.292296 s, 179 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105179 s, 498 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0978231 s, 536 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0532561 s, 984 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0547505 s, 958 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.130692 s, 401 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.259228 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.201435 s, 260 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.188815 s, 278 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0711628 s, 737 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0938072 s, 559 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0430165 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.097393 s, 538 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0408053 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0770109 s, 681 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.158453 s, 331 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.11065 s, 474 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.223948 s, 234 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.104671 s, 501 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0843708 s, 621 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.26087 s, 201 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.158823 s, 330 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.167771 s, 313 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.190055 s, 276 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0316498 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.109457 s, 479 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0567949 s, 923 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.145525 s, 360 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0876913 s, 598 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.124138 s, 422 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.297931 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0613873 s, 854 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.07121 s, 736 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.135071 s, 388 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.195289 s, 268 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.101429 s, 517 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0884045 s, 593 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.180679 s, 290 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.167008 s, 314 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.156812 s, 334 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.162018 s, 324 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.181148 s, 289 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.150295 s, 349 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0508468 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0425022 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.03123 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.160521 s, 327 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.190929 s, 275 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105262 s, 498 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.269277 s, 195 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.156794 s, 334 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.281139 s, 186 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0748183 s, 701 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106762 s, 491 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123186 s, 426 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0756933 s, 693 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.218472 s, 240 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136266 s, 385 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.400263 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.5126 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.43064 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.196595 s, 267 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106719 s, 491 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0695695 s, 754 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126665 s, 414 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0687997 s, 762 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.148124 s, 354 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.129329 s, 405 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114423 s, 458 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.212771 s, 246 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.250005 s, 210 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.23481 s, 223 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.315873 s, 166 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.186324 s, 281 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111759 s, 469 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0953398 s, 550 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.167439 s, 313 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.239934 s, 219 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.159791 s, 328 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.265566 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126607 s, 414 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.362576 s, 145 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.38502 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0837025 s, 626 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0910669 s, 576 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118633 s, 442 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113381 s, 462 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.15528 s, 338 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.128308 s, 409 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.218886 s, 240 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0658434 s, 796 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114161 s, 459 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0293069 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.279013 s, 188 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0716004 s, 732 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.181865 s, 288 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0642905 s, 815 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.074714 s, 702 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.328571 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.031102 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.301157 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.211584 s, 248 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.299752 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0678462 s, 773 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0637324 s, 823 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.052579 s, 997 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.219234 s, 239 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0942993 s, 556 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0234794 s, 2.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.319575 s, 164 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.552233 s, 94.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0667426 s, 786 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0808108 s, 649 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0743717 s, 705 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.195837 s, 268 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.147429 s, 356 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.185965 s, 282 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.248188 s, 211 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.268734 s, 195 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.357178 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.147483 s, 355 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.164176 s, 319 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.156724 s, 335 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.453423 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.315128 s, 166 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.178076 s, 294 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0813353 s, 645 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.421083 s, 125 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.188319 s, 278 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120478 s, 435 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.122428 s, 428 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.187558 s, 280 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0644277 s, 814 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.229743 s, 228 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.239867 s, 219 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.219885 s, 238 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.317531 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.109047 s, 481 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.161026 s, 326 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.200377 s, 262 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.284595 s, 184 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.216213 s, 242 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.147629 s, 355 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0727678 s, 720 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0674896 s, 777 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.119487 s, 439 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.122105 s, 429 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.173837 s, 302 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118214 s, 444 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.196675 s, 267 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108963 s, 481 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.149235 s, 351 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0906564 s, 578 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146271 s, 358 MB/s
Finish ========
/mnt/lustre/f44.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x2000061c1
      lmm_object_id:     0x6
      lmm_fid:           [0x2000061c1:0x6:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x1c4:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
llite.lustre-ffff8ab3c6ce1000.stats=
snapshot_time             1743497890.149235564 secs.nsecs
start_time                1743497829.152914263 secs.nsecs
elapsed_time              60.996321301 secs.nsecs
read_bytes                83568 samples [bytes] 1048576 1048576 87627399168 91883987709984768
read                      83568 samples [usecs] 225 831991 258423254 19596378347868
ioctl                     1 samples [reqs]
open                      1771 samples [usecs] 12 251119 24165834 1875406618874
close                     1769 samples [usecs] 9 182974 4983090 371387639284
seek                      1657 samples [usecs] 3 54375 127390 3454599320
setattr                   1 samples [usecs] 201541 201541 201541 40618774681
getattr                   17 samples [usecs] 273 166327 777901 97086977649
mknod                     1 samples [usecs] 42504 42504 42504 1806590016
inode_permission          5150 samples [usecs] 2 129303 11739272 400378793972
opencount                 1772 samples [reqs] 1 1771 1569107 1853114187
openclosetime             1770 samples [usecs] 28 304848 63149281 4648417746759
llite.lustre-ffff8ab3f65c1000.stats=
snapshot_time             1743497890.153047674 secs.nsecs
start_time                1743497829.153022005 secs.nsecs
elapsed_time              61.000025669 secs.nsecs
attach 0 detach 0 auto_attach 0
llite.lustre-ffff8ab3c6ce1000.pcc_async_threshold=1073741824
llite.lustre-ffff8ab3f65c1000.pcc_async_threshold=1073741824
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d44.sanity-pcc is idle now
PASS 44 (77s)

== sanity-pcc test 45: Concurrent read access from two mount points ========================================================== 04:58:21 (1743497901)
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 0.241124 s, 435 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d45.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:   8192/102400             done                            
Creating filesystem with 102400 1k blocks and 25584 inodes
Filesystem UUID: 92d6e31a-fb14-4bd6-9711-721c7ed6e2ac
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345, 73729

Allocating group tables:  0/13     done                            
Writing inode tables:  0/13     done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information:  0/13     done

/tmp/f45.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=92d6e31a-fb14-4bd6-9711-721c7ed6e2ac (extents) (64bit) (large files) (huge files)
100+0 records in
100+0 records out
104857600 bytes (105 MB, 100 MiB) copied, 0.314823 s, 333 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
/tmp/f45.sanity-pcc on /mnt/pcc.d45.sanity-pcc type ext4 (rw,relatime,quota,usrquota,grpquota)
umount: /mnt/pcc.d45.sanity-pcc.2: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
/tmp/f45.sanity-pcc on /mnt/pcc.d45.sanity-pcc type ext4 (rw,relatime,quota,usrquota,grpquota)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:   8192/102400             done                            
Creating filesystem with 102400 1k blocks and 25584 inodes
Filesystem UUID: 9233fc8b-72b2-4104-8658-09b123f4cf0f
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345, 73729

Allocating group tables:  0/13     done                            
Writing inode tables:  0/13     done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information:  0/13     done

/tmp/f45.sanity-pcc.2: Linux rev 1.0 ext4 filesystem data, UUID=9233fc8b-72b2-4104-8658-09b123f4cf0f (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d45.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
pcc:
  -
    pccpath: /mnt/pcc.d45.sanity-pcc.2
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
llite.lustre-ffff8ab3c6ce1000.pcc_async_threshold=0
llite.lustre-ffff8ab3f65c1000.pcc_async_threshold=0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.37461 s, 38.1 MB/s
/mnt/lustre/f45.sanity-pcc
lmm_magic:         0x0BD10BD0
lmm_seq:           0x2000061c1
lmm_object_id:     0x8
lmm_fid:           [0x2000061c1:0x8:0x0]
lmm_stripe_count:  1
lmm_stripe_size:   4194304
lmm_pattern:       raid0
lmm_layout_gen:    0
lmm_stripe_offset: 0
	obdidx		 objid		 objid		 group
	     0	           453	        0x1c5	   0x240000400

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.052504 s, 999 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.219208 s, 239 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.201625 s, 260 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.279306 s, 188 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146046 s, 359 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.297757 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.171399 s, 306 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.243 s, 42.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.894328 s, 58.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.891923 s, 58.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.25162 s, 41.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.847508 s, 61.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.25495 s, 41.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.25351 s, 41.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.90815 s, 57.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.2647 s, 41.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.2658 s, 41.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.763248 s, 68.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.920662 s, 56.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.29232 s, 40.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.29528 s, 40.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.950211 s, 55.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.30556 s, 40.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0781776 s, 671 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0961306 s, 545 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100645 s, 521 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0369698 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.205924 s, 255 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.164994 s, 318 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.178287 s, 294 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146567 s, 358 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126945 s, 413 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0825971 s, 635 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.229131 s, 229 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.243828 s, 215 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.176211 s, 298 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.221733 s, 236 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0994819 s, 527 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.138068 s, 380 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.155588 s, 337 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0692504 s, 757 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0273388 s, 1.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.104405 s, 502 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0568376 s, 922 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0634029 s, 827 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12885 s, 407 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.23296 s, 225 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.231598 s, 226 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.370664 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.4324 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0616327 s, 851 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.235816 s, 222 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.712427 s, 73.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.299905 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.432554 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0620394 s, 845 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.603379 s, 86.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.076586 s, 685 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 3.18219 s, 16.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 3.18674 s, 16.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 3.19231 s, 16.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 3.17443 s, 16.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 3.19661 s, 16.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 3.20961 s, 16.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 3.18296 s, 16.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 3.22032 s, 16.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 3.22448 s, 16.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 3.22154 s, 16.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 3.22077 s, 16.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 3.13053 s, 16.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.691807 s, 75.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 3.16594 s, 16.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 3.2821 s, 16.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 3.28237 s, 16.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 3.25174 s, 16.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.184867 s, 284 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.616178 s, 85.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.469759 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.640676 s, 81.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.75432 s, 69.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.10763 s, 487 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.102869 s, 510 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0904853 s, 579 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.359559 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.278665 s, 188 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0737545 s, 711 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.473462 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.25752 s, 204 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.390473 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.251315 s, 209 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.474914 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.342722 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.340167 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.131764 s, 398 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.387577 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.24721 s, 212 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.306451 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.568481 s, 92.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.622897 s, 84.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.247972 s, 211 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.544677 s, 96.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.209483 s, 250 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.629986 s, 83.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.619639 s, 84.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.392666 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.26691 s, 196 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.640634 s, 81.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.509574 s, 103 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.298694 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.334736 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.536849 s, 97.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.495859 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.214564 s, 244 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.169048 s, 310 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.64422 s, 81.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.23115 s, 227 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.358166 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.252771 s, 207 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.335028 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.125543 s, 418 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.298962 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123996 s, 423 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.263115 s, 199 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.215181 s, 244 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.371348 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.36187 s, 145 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.517998 s, 101 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.335545 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.533413 s, 98.3 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.535678 s, 97.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.439569 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.43385 s, 121 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.230835 s, 227 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.517083 s, 101 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.652084 s, 80.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.389097 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.705887 s, 74.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.287124 s, 183 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.389042 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.628084 s, 83.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.808236 s, 64.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.615713 s, 85.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.447814 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.306954 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.524627 s, 99.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.604481 s, 86.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.531303 s, 98.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.304209 s, 172 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.229439 s, 229 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.294174 s, 178 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.245765 s, 213 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.462656 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.529083 s, 99.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.341228 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0670491 s, 782 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.225239 s, 233 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.588526 s, 89.1 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.255479 s, 205 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.232999 s, 225 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.164156 s, 319 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.157631 s, 333 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.281562 s, 186 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.256653 s, 204 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0675514 s, 776 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.349575 s, 150 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.150213 s, 349 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.260659 s, 201 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.349194 s, 150 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.370163 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.226485 s, 231 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.433045 s, 121 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.219541 s, 239 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.211213 s, 248 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.519325 s, 101 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.337253 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.438919 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.66435 s, 78.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.643915 s, 81.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.139303 s, 376 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.576959 s, 90.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.525155 s, 99.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.509524 s, 103 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.323345 s, 162 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.497274 s, 105 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.320972 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.708491 s, 74.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.264889 s, 198 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.343061 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.294133 s, 178 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.304301 s, 172 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.363447 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.301554 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.428345 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.412051 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.328283 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.253993 s, 206 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.195642 s, 268 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.283225 s, 185 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.292987 s, 179 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153 s, 343 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.21123 s, 248 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.523051 s, 100 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.391909 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.291782 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.368932 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.349528 s, 150 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.19886 s, 264 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.480897 s, 109 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.367565 s, 143 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.552283 s, 94.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.338487 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.44303 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.386136 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.502566 s, 104 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.538291 s, 97.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.396185 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.306104 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.390462 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.465892 s, 113 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.500394 s, 105 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.43849 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.481842 s, 109 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.521902 s, 100 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.59696 s, 87.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.636987 s, 82.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.259187 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.394894 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.178604 s, 294 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.504509 s, 104 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.442379 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.555823 s, 94.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.109999 s, 477 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.271847 s, 193 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.320214 s, 164 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.366734 s, 143 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.370959 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.403937 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.324459 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.203303 s, 258 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.400204 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.52941 s, 99.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.295453 s, 177 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.468852 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.441661 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.265493 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.467202 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.45751 s, 115 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.371034 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.562623 s, 93.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.512006 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.426864 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.411542 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.50837 s, 103 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.537151 s, 97.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.578198 s, 90.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.411093 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.441996 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.471647 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.650988 s, 80.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.425731 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.364857 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.352986 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.294707 s, 178 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.642389 s, 81.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.195622 s, 268 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.421475 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.156915 s, 334 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.447077 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.494462 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.420183 s, 125 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.211341 s, 248 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.317708 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.460187 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.534672 s, 98.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.312315 s, 168 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.176048 s, 298 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.261979 s, 200 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.383585 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.340617 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.354687 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0852791 s, 615 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.412872 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.317196 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.451596 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.42252 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.343998 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.473529 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.115962 s, 452 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.346873 s, 151 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.142963 s, 367 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.291699 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120379 s, 436 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.50225 s, 104 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.269196 s, 195 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.350895 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.494538 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.314574 s, 167 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217604 s, 241 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.3179 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.359752 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.343272 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.223869 s, 234 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.506017 s, 104 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.331355 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.35523 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.407774 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.256584 s, 204 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.424163 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.402982 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.447798 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.376753 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.492119 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.437034 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.48342 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.372792 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.304603 s, 172 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.18894 s, 277 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.186187 s, 282 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.466226 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.383936 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.428676 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.47672 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.507035 s, 103 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.418173 s, 125 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.467649 s, 112 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.104654 s, 501 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.425144 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136466 s, 384 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.245241 s, 214 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.417058 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.164268 s, 319 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.33091 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.337119 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.402484 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.295167 s, 178 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.462994 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.597257 s, 87.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.286695 s, 183 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.418209 s, 125 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.231748 s, 226 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.306503 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.337852 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.383457 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.495653 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.308234 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.174021 s, 301 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.453067 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.301104 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.401363 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.283238 s, 185 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103245 s, 508 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.415352 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0574576 s, 912 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.463232 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.392343 s, 134 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.278666 s, 188 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.374367 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.401927 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.357658 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.502918 s, 104 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.196648 s, 267 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0969385 s, 541 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.293564 s, 179 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.300167 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.181987 s, 288 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.291464 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.269078 s, 195 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.322378 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.36144 s, 145 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.262864 s, 199 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.228191 s, 230 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.268594 s, 195 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.320088 s, 164 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.254934 s, 206 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.355298 s, 148 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.358614 s, 146 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.313376 s, 167 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.315633 s, 166 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.249169 s, 210 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.508948 s, 103 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.514315 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.46309 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.510114 s, 103 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.393991 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.379097 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.246891 s, 212 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.301578 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.462142 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.429783 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.342492 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.426589 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.299348 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.167133 s, 314 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.483366 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.269212 s, 195 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.515052 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.333565 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.39497 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.324982 s, 161 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.393509 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.503578 s, 104 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.330231 s, 159 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.407607 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.445793 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.227425 s, 231 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.348012 s, 151 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.35261 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.425356 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.47529 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.325097 s, 161 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.351821 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.359407 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.118995 s, 441 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.171359 s, 306 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.226586 s, 231 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.247544 s, 212 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.13427 s, 390 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.41259 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.464444 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.357091 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.165 s, 318 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.38391 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.39055 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.387557 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.211439 s, 248 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.261322 s, 201 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.492266 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.488036 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.249938 s, 210 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.355483 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.321538 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.401369 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.450605 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.321292 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.360472 s, 145 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.322847 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.242042 s, 217 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.345574 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.353291 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.325652 s, 161 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.485039 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.491426 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.420619 s, 125 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.293981 s, 178 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.377596 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.42131 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.266188 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12469 s, 420 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0846561 s, 619 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.220835 s, 237 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.528133 s, 99.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.29329 s, 179 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.231688 s, 226 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.242096 s, 217 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.293541 s, 179 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.174335 s, 301 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.216902 s, 242 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.202347 s, 259 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.332642 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.549864 s, 95.3 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.445016 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.56182 s, 93.3 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.357371 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.556686 s, 94.2 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.463341 s, 113 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.3331 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.22861 s, 229 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.365179 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.614976 s, 85.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.453682 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.433129 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.356194 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.344398 s, 152 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.410567 s, 128 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.333574 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.544496 s, 96.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.382523 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.54082 s, 96.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.273241 s, 192 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.325779 s, 161 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.550206 s, 95.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.287624 s, 182 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.131893 s, 398 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.30436 s, 172 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.438795 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.28145 s, 186 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.059534 s, 881 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.340946 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.425907 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.288236 s, 182 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.319336 s, 164 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.229985 s, 228 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.233933 s, 224 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.290423 s, 181 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.207265 s, 253 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.214334 s, 245 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.226407 s, 232 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.343408 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.352392 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.244986 s, 214 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.353959 s, 148 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.119008 s, 441 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.483454 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.43784 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.17935 s, 292 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.425227 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.384729 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.351862 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.189486 s, 277 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.274463 s, 191 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.369716 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.42238 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.226047 s, 232 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.393678 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.476518 s, 110 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.265646 s, 197 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.0905055 s, 579 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.295056 s, 178 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.161277 s, 325 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.327246 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.602658 s, 87.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.381631 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.712419 s, 73.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.297132 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.324312 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.212797 s, 246 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.25626 s, 205 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.219353 s, 239 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.292158 s, 179 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.445877 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.406426 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.271275 s, 193 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.349829 s, 150 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.306736 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.384151 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.297764 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.255721 s, 205 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.286378 s, 183 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.201885 s, 260 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.306001 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.485106 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.214933 s, 244 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.478405 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.517011 s, 101 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.384644 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.317513 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.552329 s, 94.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.287386 s, 182 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.345023 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.381986 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.315666 s, 166 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.266888 s, 196 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.361966 s, 145 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.494693 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.362232 s, 145 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.543838 s, 96.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.163416 s, 321 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.240655 s, 218 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.315882 s, 166 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.456625 s, 115 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.391012 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.254209 s, 206 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.250743 s, 209 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.336772 s, 156 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.27875 s, 188 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.43436 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.511428 s, 103 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.496782 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.593347 s, 88.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.320855 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.14492 s, 362 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110751 s, 473 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0794763 s, 660 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.170761 s, 307 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.352681 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.490579 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.412679 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.395116 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.4517 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.417482 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.213013 s, 246 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.26023 s, 201 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.184743 s, 284 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0967271 s, 542 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.314529 s, 167 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.218008 s, 240 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.285041 s, 184 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.375318 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217089 s, 242 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.355017 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.270978 s, 193 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0547631 s, 957 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.498527 s, 105 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.393541 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.4024 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.440432 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.363226 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.516408 s, 102 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.369023 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.180257 s, 291 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.452091 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.399247 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.267649 s, 196 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.586915 s, 89.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.365589 s, 143 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.351489 s, 149 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.393938 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.214081 s, 245 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.367285 s, 143 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.302642 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.469694 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.305883 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.519257 s, 101 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.444211 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.309258 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.354439 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.405883 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.277735 s, 189 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.262834 s, 199 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.186894 s, 281 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.541979 s, 96.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.305774 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.411455 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0456424 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.327269 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12281 s, 427 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.423958 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.190242 s, 276 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.25913 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.237357 s, 221 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.163343 s, 321 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.193037 s, 272 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.124149 s, 422 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.199545 s, 263 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.220304 s, 238 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.298086 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0772914 s, 678 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.238998 s, 219 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.164701 s, 318 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.239606 s, 219 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.08372 s, 626 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.392961 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.073972 s, 709 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.46364 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.260303 s, 201 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.341314 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.120996 s, 433 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.262511 s, 200 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.561827 s, 93.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.181619 s, 289 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.453573 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.339943 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.210978 s, 249 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.673928 s, 77.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.718156 s, 73.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.40085 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.585115 s, 89.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.361687 s, 145 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.302594 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.497474 s, 105 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.466646 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.282588 s, 186 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.258727 s, 203 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.549898 s, 95.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.372685 s, 141 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.277881 s, 189 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.306657 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.205525 s, 255 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.404584 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.204266 s, 257 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.300456 s, 174 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.143203 s, 366 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.201875 s, 260 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.194537 s, 270 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.143446 s, 365 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.435467 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.374502 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.296738 s, 177 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.348814 s, 150 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.276139 s, 190 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.28886 s, 182 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.255436 s, 205 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.258873 s, 203 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.210491 s, 249 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.34613 s, 151 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.321298 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.351629 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.210854 s, 249 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.226744 s, 231 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.250681 s, 209 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.324857 s, 161 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.496787 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.265402 s, 198 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.292547 s, 179 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.33307 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.560249 s, 93.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.273354 s, 192 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.551721 s, 95.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.165791 s, 316 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.382019 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.298192 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.592772 s, 88.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.240351 s, 218 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.373331 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.176475 s, 297 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.372157 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.485954 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.35363 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.418315 s, 125 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.266585 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.392538 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.799501 s, 65.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.388672 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.393999 s, 133 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.469633 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.181807 s, 288 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.316135 s, 166 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.193318 s, 271 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.431825 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.478485 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.437554 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.541351 s, 96.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.536727 s, 97.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.244411 s, 215 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.45611 s, 115 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.503404 s, 104 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.459657 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.310608 s, 169 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.481502 s, 109 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.474234 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.26454 s, 198 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.59018 s, 88.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.184426 s, 284 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.456369 s, 115 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.430085 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.569681 s, 92.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.604359 s, 86.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.573827 s, 91.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.40131 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.476207 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.308157 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.287917 s, 182 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.477757 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.397924 s, 132 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.526647 s, 99.6 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.451352 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.294237 s, 178 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.291813 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.521524 s, 101 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.365737 s, 143 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.354929 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.648477 s, 80.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.52151 s, 101 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.715663 s, 73.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.387717 s, 135 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.493015 s, 106 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.221699 s, 236 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.424828 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.186647 s, 281 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.448038 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.207263 s, 253 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.323505 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.324877 s, 161 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.277019 s, 189 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110365 s, 475 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.27033 s, 194 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.138979 s, 377 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.434545 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.994254 s, 52.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.310927 s, 169 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.317017 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.175995 s, 298 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.427549 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.237366 s, 221 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.288724 s, 182 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.252406 s, 208 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.139395 s, 376 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.203476 s, 258 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.241262 s, 217 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.235222 s, 223 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.382402 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.126788 s, 414 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.294795 s, 178 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.343204 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.376784 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.565642 s, 92.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.371946 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.399202 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.206163 s, 254 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.262507 s, 200 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0714335 s, 734 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108662 s, 482 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0944907 s, 555 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.415727 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.302741 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.577359 s, 90.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.482173 s, 109 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.546418 s, 96.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.262639 s, 200 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.410082 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.476204 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.591339 s, 88.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.403933 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.392372 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.470598 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.544677 s, 96.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.314318 s, 167 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.401896 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.390073 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.575388 s, 91.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.475132 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.267334 s, 196 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.54821 s, 95.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.517159 s, 101 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.378801 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.266746 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.189452 s, 277 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.265756 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.356946 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.419452 s, 125 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.337332 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.162765 s, 322 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.406051 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.414159 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.380903 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.355602 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.249864 s, 210 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0869303 s, 603 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0460141 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.128645 s, 408 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.34595 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.249062 s, 211 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.254386 s, 206 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.547321 s, 95.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.243609 s, 215 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.167214 s, 314 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.198212 s, 265 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.224883 s, 233 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.266931 s, 196 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.403179 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.291422 s, 180 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.272411 s, 192 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.395149 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.140047 s, 374 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.379967 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.551644 s, 95.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.169613 s, 309 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.439231 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.354231 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.259915 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.462834 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.116488 s, 450 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.161931 s, 324 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.402454 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.674814 s, 77.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0569099 s, 921 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.449645 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.42031 s, 125 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.37073 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.421816 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.334618 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.201477 s, 260 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.448062 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.401539 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113789 s, 461 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.47566 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.58894 s, 89.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.481579 s, 109 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.482165 s, 109 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.178628 s, 294 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.41278 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.291976 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.302747 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.397232 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.236872 s, 221 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.195703 s, 268 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.138659 s, 378 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.180812 s, 290 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.43002 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.464098 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.179327 s, 292 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.410191 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.438801 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.321162 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.335539 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.399911 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.129866 s, 404 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.209548 s, 250 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.344034 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.225045 s, 233 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.291912 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.203449 s, 258 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.347392 s, 151 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.332679 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.350961 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.532958 s, 98.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.439296 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.430539 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.253757 s, 207 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.458674 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.276462 s, 190 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.444124 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.350106 s, 150 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.218227 s, 240 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.535999 s, 97.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.297263 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.214736 s, 244 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.495302 s, 106 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.298811 s, 175 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.369756 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.328672 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0783304 s, 669 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.478113 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217955 s, 241 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.196301 s, 267 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.321224 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.179936 s, 291 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.341099 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153502 s, 342 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.300856 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.238235 s, 220 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.294323 s, 178 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.299042 s, 175 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.142894 s, 367 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217077 s, 242 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.161548 s, 325 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.302222 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.29567 s, 177 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.444678 s, 118 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.241769 s, 217 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.373357 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.428469 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.296962 s, 177 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.274379 s, 191 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.283961 s, 185 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.337496 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.216554 s, 242 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.273498 s, 192 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.373679 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.438088 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.355541 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0481952 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.314679 s, 167 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.147901 s, 354 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.410424 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.552256 s, 94.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.373383 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.176486 s, 297 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113296 s, 463 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.38031 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.377629 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.291441 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.214353 s, 245 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.507269 s, 103 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.540893 s, 96.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.202682 s, 259 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.2896 s, 181 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.238162 s, 220 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.164227 s, 319 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.25059 s, 209 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.352642 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.349602 s, 150 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0400443 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.424131 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.433371 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.202386 s, 259 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.273294 s, 192 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0550259 s, 953 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.300074 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.230993 s, 227 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.403386 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.37192 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.303536 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.379418 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.42248 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.289073 s, 181 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.210101 s, 250 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.348305 s, 151 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.389096 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.248137 s, 211 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.374461 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.390336 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.281476 s, 186 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.358559 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.413182 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.435555 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.499353 s, 105 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.328926 s, 159 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.390871 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.336784 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.263382 s, 199 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.596943 s, 87.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.39067 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.277134 s, 189 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.20616 s, 254 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.516268 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.46491 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.411434 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.537585 s, 97.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.309022 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.321998 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.28909 s, 181 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.199696 s, 263 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.442786 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.215483 s, 243 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.338903 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.368632 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.365928 s, 143 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.314697 s, 167 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.372626 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.124161 s, 422 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.403565 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.251217 s, 209 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.491012 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.201065 s, 261 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.27827 s, 188 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.206862 s, 253 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.26926 s, 195 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123614 s, 424 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.383559 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.321692 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.314895 s, 166 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.324808 s, 161 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.37909 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.248391 s, 211 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.164811 s, 318 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.46795 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.542893 s, 96.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.363759 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.381302 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.234201 s, 224 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.320698 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.565808 s, 92.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.221653 s, 237 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.42542 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.522812 s, 100 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.294612 s, 178 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.4071 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.39056 s, 134 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.387265 s, 135 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.410891 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.354229 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.360697 s, 145 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.423545 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.386038 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.369932 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.355155 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.540278 s, 97.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.46156 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.504553 s, 104 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.328942 s, 159 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.523884 s, 100 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.403268 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.578277 s, 90.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.531366 s, 98.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.352639 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.2148 s, 244 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.302935 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.495744 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.401289 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.298799 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.765879 s, 68.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.175259 s, 299 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.4654 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.172625 s, 304 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.363946 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0978572 s, 536 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.248629 s, 211 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100329 s, 523 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.199188 s, 263 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.320088 s, 164 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.376636 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.151192 s, 347 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.262417 s, 200 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.15136 s, 346 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.283621 s, 185 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.370848 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.273273 s, 192 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.260421 s, 201 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.125231 s, 419 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.315751 s, 166 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.293718 s, 179 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.348977 s, 150 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.260935 s, 201 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.269268 s, 195 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.466284 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0715549 s, 733 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.352562 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.208302 s, 252 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.232987 s, 225 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.321381 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.2429 s, 216 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.213577 s, 245 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.197755 s, 265 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.314907 s, 166 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.170864 s, 307 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.465179 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.457489 s, 115 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.534453 s, 98.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.210451 s, 249 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.278491 s, 188 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.273848 s, 191 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.475825 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.353853 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.20229 s, 259 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.105293 s, 498 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.250052 s, 210 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.296222 s, 177 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.483504 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.393454 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.218616 s, 240 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.228983 s, 229 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.286183 s, 183 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.253485 s, 207 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.263198 s, 199 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.379005 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.251014 s, 209 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.29599 s, 177 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.370208 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.336611 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.365106 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.193636 s, 271 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.376264 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.276237 s, 190 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.365696 s, 143 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.428267 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.339522 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.235225 s, 223 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.202284 s, 259 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.341549 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0687065 s, 763 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.399884 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.467013 s, 112 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.287266 s, 183 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.386291 s, 136 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.219219 s, 239 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.343853 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.244957 s, 214 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.313887 s, 167 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.338609 s, 155 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.298414 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.334962 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.307696 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.322166 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.266372 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.39411 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.229912 s, 228 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.364644 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.33226 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.258218 s, 203 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.374218 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.35282 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.592811 s, 88.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114659 s, 457 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.289552 s, 181 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.290957 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.260467 s, 201 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.214681 s, 244 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.364069 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.542966 s, 96.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.273626 s, 192 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.365342 s, 144 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.29965 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.3006 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.335744 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.314909 s, 166 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.395247 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.361115 s, 145 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.468523 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.335168 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.382476 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.449231 s, 117 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.250536 s, 209 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.459279 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.307928 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.309683 s, 169 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.425356 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.510623 s, 103 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.465133 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.259257 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.179063 s, 293 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.358167 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.431152 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.260834 s, 201 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.718392 s, 73.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.289534 s, 181 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.178868 s, 293 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.237104 s, 221 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.248027 s, 211 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.269079 s, 195 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.672736 s, 77.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.173771 s, 302 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.417431 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.13839 s, 379 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.411061 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.162469 s, 323 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.277609 s, 189 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.416711 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.361655 s, 145 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.212487 s, 247 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.269115 s, 195 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.303369 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.311333 s, 168 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.35925 s, 146 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.493131 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.163974 s, 320 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.216671 s, 242 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.47514 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.246941 s, 212 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.472793 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.312771 s, 168 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.300742 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.318509 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.460644 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.331956 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.653143 s, 80.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.354462 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.49518 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.163822 s, 320 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.404381 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.364399 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.34907 s, 150 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.259493 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.350398 s, 150 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.320931 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.442925 s, 118 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.151046 s, 347 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.487504 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.436275 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.472816 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.637475 s, 82.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.407679 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.563544 s, 93.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.466758 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.367482 s, 143 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.4576 s, 115 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.383225 s, 137 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.323179 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.333599 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.4767 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.466862 s, 112 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0754406 s, 695 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.393009 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.342321 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.311294 s, 168 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.174946 s, 300 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.368371 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.369168 s, 142 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.540574 s, 97.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.262031 s, 200 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.127367 s, 412 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.226708 s, 231 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.265486 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.49353 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.336003 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.317847 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.612609 s, 85.6 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.418777 s, 125 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.241992 s, 217 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.45916 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.186141 s, 282 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.541104 s, 96.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.331546 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.851614 s, 61.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.463525 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.443525 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.461062 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.332864 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.509069 s, 103 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.253902 s, 206 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.502225 s, 104 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.188736 s, 278 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.269978 s, 194 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.514174 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.216662 s, 242 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0682159 s, 769 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.470301 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.42131 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.20217 s, 259 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.462187 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.261931 s, 200 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0997864 s, 525 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.158128 s, 332 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.259851 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.259115 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.411246 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.445478 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.314118 s, 167 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.352398 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.335537 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.254858 s, 206 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.435699 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.391733 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.309764 s, 169 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.355399 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.312261 s, 168 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.299571 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.274264 s, 191 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.390731 s, 134 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.385303 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.410354 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.33315 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.415814 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.402904 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.329441 s, 159 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.374374 s, 140 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.332592 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.62552 s, 83.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.181824 s, 288 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100212 s, 523 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108525 s, 483 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.112884 s, 464 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.806495 s, 65.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.522615 s, 100 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.113432 s, 462 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.894317 s, 58.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.65401 s, 80.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.15605 s, 336 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.311847 s, 168 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.575977 s, 91.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.332956 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.361615 s, 145 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.311499 s, 168 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.307499 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.376032 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.668311 s, 78.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.428897 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.384036 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.55303 s, 94.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.523888 s, 100 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.152067 s, 345 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.624281 s, 84.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0697831 s, 751 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.346427 s, 151 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.257884 s, 203 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.334326 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.54851 s, 95.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.461469 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.173732 s, 302 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.947957 s, 55.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.423082 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.388801 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.135472 s, 387 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.25802 s, 203 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.359312 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.241689 s, 217 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108237 s, 484 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.531343 s, 98.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.26361 s, 199 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.368843 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.315562 s, 166 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.413919 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.530833 s, 98.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.477751 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.403464 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.340015 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.384452 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.353501 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.266408 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.422315 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.303444 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.21447 s, 244 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.540815 s, 96.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.488539 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.340119 s, 154 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.299941 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.337885 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.463738 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.406236 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.434268 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.356328 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.416051 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.443632 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.4091 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.268163 s, 196 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.22469 s, 233 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.348757 s, 150 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.342521 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.214795 s, 244 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.252277 s, 208 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.414046 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.478256 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.287269 s, 183 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.476731 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.152349 s, 344 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.374819 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.354888 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.336796 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.41748 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106968 s, 490 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.315944 s, 166 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.48139 s, 109 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0754514 s, 695 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.22982 s, 228 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.584991 s, 89.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0296025 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.626788 s, 83.6 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.523272 s, 100 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0697501 s, 752 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.49381 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.462095 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.473914 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.455945 s, 115 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.144897 s, 362 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.077545 s, 676 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.19102 s, 274 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.201889 s, 260 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.328337 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.454886 s, 115 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.210595 s, 249 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.610554 s, 85.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.30105 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.375959 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.290172 s, 181 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.732126 s, 71.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.54383 s, 96.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.159144 s, 329 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.402142 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.202095 s, 259 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.129863 s, 404 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.264158 s, 198 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.426491 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.405851 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.511269 s, 103 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.412306 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.465576 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.484834 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.526269 s, 99.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.174485 s, 300 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.356339 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.506061 s, 104 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.370229 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.434336 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.472833 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.627157 s, 83.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.395946 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.225529 s, 232 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.344105 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.432222 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.328102 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.385718 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.432661 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0942825 s, 556 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.497748 s, 105 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.402125 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.502803 s, 104 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.435252 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.13382 s, 392 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.289054 s, 181 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.415572 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.290577 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.584231 s, 89.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136381 s, 384 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.236626 s, 222 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.522963 s, 100 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.459554 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.147401 s, 356 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0718794 s, 729 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.169641 s, 309 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0598056 s, 877 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.116525 s, 450 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.24452 s, 214 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.232289 s, 226 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.300885 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.411734 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.241782 s, 217 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.503313 s, 104 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.290533 s, 180 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.309473 s, 169 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.287012 s, 183 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.346021 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.548521 s, 95.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.455096 s, 115 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.37203 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.334448 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.359109 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.505092 s, 104 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.071819 s, 730 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.438643 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.36718 s, 143 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.545688 s, 96.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.338837 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.600196 s, 87.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.508906 s, 103 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.498864 s, 105 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.345135 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0187239 s, 2.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.130142 s, 403 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.285568 s, 184 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.488759 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.591048 s, 88.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.62387 s, 84.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.550467 s, 95.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.187382 s, 280 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.143221 s, 366 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.703567 s, 74.5 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.498372 s, 105 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.175928 s, 298 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.259482 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.297274 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.259074 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0985641 s, 532 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.258086 s, 203 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.140819 s, 372 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0308396 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0577063 s, 909 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.333394 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.347468 s, 151 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.201821 s, 260 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.368645 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.388666 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.224086 s, 234 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.482298 s, 109 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.301121 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.349272 s, 150 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.7498 s, 69.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.30733 s, 171 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.429019 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.429504 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.262183 s, 200 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.439407 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.558668 s, 93.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.394741 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.33087 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.345029 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.413821 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.356608 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.269529 s, 195 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.227588 s, 230 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.372715 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.172295 s, 304 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.223818 s, 234 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.365302 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.515744 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0721236 s, 727 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.125202 s, 419 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0814835 s, 643 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.309277 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.871174 s, 60.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.462762 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.722217 s, 72.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.393683 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.518018 s, 101 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.207686 s, 252 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.263638 s, 199 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0795863 s, 659 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111655 s, 470 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.258076 s, 203 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.784981 s, 66.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0547315 s, 958 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.440532 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.349598 s, 150 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.577709 s, 90.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0759018 s, 691 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.173916 s, 301 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.493259 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.477514 s, 110 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.694006 s, 75.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0572909 s, 915 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.811757 s, 64.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.273226 s, 192 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.236734 s, 221 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.400868 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0974024 s, 538 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.132446 s, 396 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0655799 s, 799 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0606524 s, 864 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.488836 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.130996 s, 400 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0736076 s, 712 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.441967 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.303185 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.35511 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0782121 s, 670 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.319924 s, 164 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.183449 s, 286 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.429287 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.222051 s, 236 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.556026 s, 94.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0616884 s, 850 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0483913 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.467031 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.740841 s, 70.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.168788 s, 311 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.598491 s, 87.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.143066 s, 366 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.796064 s, 65.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.305322 s, 172 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0837964 s, 626 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.214656 s, 244 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.207577 s, 253 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.276177 s, 190 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.111849 s, 469 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.288 s, 182 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.312952 s, 168 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.310284 s, 169 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0782292 s, 670 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.252758 s, 207 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.852343 s, 61.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.259273 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.237657 s, 221 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103958 s, 504 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.203941 s, 257 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.324232 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.31882 s, 39.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.02013 s, 51.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.562972 s, 93.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.524631 s, 99.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.489279 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.177511 s, 295 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.335535 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.449758 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.379923 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.418296 s, 125 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.339101 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.203623 s, 257 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.349164 s, 150 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.434945 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.401078 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.324023 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.343236 s, 153 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.308613 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.24556 s, 214 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.319924 s, 164 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.819599 s, 64.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.359391 s, 146 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.233947 s, 224 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.355605 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.311467 s, 168 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.191277 s, 274 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.484972 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.290436 s, 181 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.324204 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.179543 s, 292 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.230465 s, 227 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.231988 s, 226 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.274634 s, 191 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.271353 s, 193 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.234634 s, 223 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.292444 s, 179 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.203645 s, 257 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.308936 s, 170 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.265796 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.240694 s, 218 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.319192 s, 164 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.197841 s, 265 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.278679 s, 188 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.316026 s, 166 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.336612 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.281055 s, 187 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.351974 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.445892 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.367285 s, 143 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.192723 s, 272 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.327748 s, 160 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.2658 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.444438 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.446878 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.317184 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.330358 s, 159 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.255419 s, 205 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.418196 s, 125 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.584264 s, 89.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.608678 s, 86.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.351166 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.138646 s, 378 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.463982 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.723407 s, 72.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.116673 s, 449 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.462022 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.180808 s, 290 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.499166 s, 105 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.608435 s, 86.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.426812 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.364564 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.586269 s, 89.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0922076 s, 569 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.39117 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.801169 s, 65.4 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.517893 s, 101 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.240903 s, 218 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.312413 s, 168 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.557103 s, 94.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.466399 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.436512 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.460952 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.427166 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.565466 s, 92.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.324322 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.429488 s, 122 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.247259 s, 212 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.453645 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.265317 s, 198 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.463909 s, 113 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.28434 s, 184 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.413414 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.268387 s, 195 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.409945 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.252102 s, 208 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.382353 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.331532 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.184216 s, 285 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.321421 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.40312 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.147662 s, 355 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.248574 s, 211 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.367443 s, 143 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.459187 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.493351 s, 106 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.519124 s, 101 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.505553 s, 104 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.634306 s, 82.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.583143 s, 89.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.198798 s, 264 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.389533 s, 135 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.392892 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.440642 s, 119 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.26907 s, 195 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.300723 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.40527 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.301139 s, 174 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.283559 s, 185 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106574 s, 492 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.657292 s, 79.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.384243 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.134634 s, 389 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.370338 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.200817 s, 261 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.246741 s, 212 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.272288 s, 193 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.289112 s, 181 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0964108 s, 544 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.389514 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.344174 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.319246 s, 164 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.26597 s, 197 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.391693 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.433725 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.401652 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.39422 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.180967 s, 290 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.247497 s, 212 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.362041 s, 145 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.516241 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.612491 s, 85.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.238887 s, 219 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.470728 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.404095 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.327645 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.222985 s, 235 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.549567 s, 95.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.431988 s, 121 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.595168 s, 88.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.65747 s, 79.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.556514 s, 94.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.484247 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.561594 s, 93.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.401913 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.338257 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.352916 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.277844 s, 189 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.401846 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.13588 s, 386 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.502714 s, 104 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108402 s, 484 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.417782 s, 125 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.259222 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.410693 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.444668 s, 118 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.196207 s, 267 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.211242 s, 248 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.173967 s, 301 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.565082 s, 92.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.384631 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.127291 s, 412 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.241818 s, 217 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.394774 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.33188 s, 158 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0978631 s, 536 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.294738 s, 178 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.291305 s, 180 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.381732 s, 137 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.184234 s, 285 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.281795 s, 186 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.186454 s, 281 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.421875 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.22597 s, 232 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.252261 s, 208 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.274759 s, 191 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.418036 s, 125 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.39265 s, 134 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.369663 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.379637 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.325205 s, 161 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.030339 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.574612 s, 91.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.365016 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.512933 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.350967 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.415042 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.395262 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.371213 s, 141 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.398156 s, 132 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0581104 s, 902 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.143514 s, 365 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.255286 s, 205 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.614348 s, 85.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.587436 s, 89.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.491187 s, 107 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.473296 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.37968 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.449705 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.407305 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.473861 s, 111 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.385859 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.217699 s, 241 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.321818 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.170509 s, 307 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.313516 s, 167 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.365257 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.188945 s, 277 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.315764 s, 166 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.255597 s, 205 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.27922 s, 188 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.264148 s, 198 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.266107 s, 197 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.253828 s, 207 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.299431 s, 175 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107539 s, 488 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.277464 s, 189 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.398957 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.400241 s, 131 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0890444 s, 589 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0793132 s, 661 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.180386 s, 291 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.226138 s, 232 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.282295 s, 186 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.300253 s, 175 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.44995 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.411473 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.422261 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.334378 s, 157 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.187713 s, 279 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.297517 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.570162 s, 92.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.297474 s, 176 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.288471 s, 182 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.201371 s, 260 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.317738 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.192786 s, 272 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.288903 s, 181 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0194011 s, 2.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.236858 s, 221 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0295441 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.168674 s, 311 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0500109 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.522031 s, 100 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0203528 s, 2.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.52861 s, 99.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.386093 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.447602 s, 117 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.196882 s, 266 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.172132 s, 305 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.073278 s, 715 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.226194 s, 232 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0554292 s, 946 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.244262 s, 215 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.583295 s, 89.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.197551 s, 265 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.132901 s, 394 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.31409 s, 167 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.262684 s, 200 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.253762 s, 207 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.212334 s, 247 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.22576 s, 232 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.362937 s, 144 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.486779 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.374125 s, 140 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.407083 s, 129 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.493594 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.494663 s, 106 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.596828 s, 87.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.544361 s, 96.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.609546 s, 86.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.408602 s, 128 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.288419 s, 182 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.229087 s, 229 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.545311 s, 96.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.353171 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.895766 s, 58.5 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.564816 s, 92.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.404078 s, 130 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.279911 s, 187 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.511768 s, 102 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.458663 s, 114 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.582559 s, 90.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.655036 s, 80.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.39528 s, 133 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.45199 s, 116 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.424892 s, 123 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.410422 s, 128 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.442377 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.187827 s, 279 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.3764 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.255496 s, 205 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.265084 s, 198 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.182057 s, 288 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.2379 s, 220 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.387142 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.317183 s, 165 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.219876 s, 238 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.32801 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.328172 s, 160 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.324529 s, 162 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.260406 s, 201 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.353276 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.335246 s, 156 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.405283 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.304875 s, 172 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.416101 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.218442 s, 240 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.519985 s, 101 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.377861 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.321777 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.276191 s, 190 MB/s50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.283585 s, 185 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.558538 s, 93.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.255125 s, 206 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.344052 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.383282 s, 137 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.246705 s, 213 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.320933 s, 163 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.384166 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.439062 s, 119 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.534062 s, 98.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.200099 s, 262 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.466742 s, 112 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.369788 s, 142 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.271354 s, 193 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.343916 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.415145 s, 126 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.302866 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.277187 s, 189 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.434933 s, 121 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.193445 s, 271 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.389184 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12759 s, 411 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.259422 s, 202 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.239668 s, 219 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.270739 s, 194 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.209346 s, 250 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.26045 s, 201 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.255244 s, 205 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.253284 s, 207 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.256447 s, 204 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.25614 s, 205 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.236449 s, 222 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.249688 s, 210 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.216362 s, 242 MB/s
52428800 bytes (52 MB, 50 MiB) copied, 0.24473 s, 214 MB/s
50+0 records in
50+0 records out
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.201516 s, 260 MB/s52428800 bytes (52 MB, 50 MiB) copied, 0.278651 s, 188 MB/s

50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.293166 s, 179 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.368986 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.380774 s, 138 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.315105 s, 166 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.267635 s, 196 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.376787 s, 139 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.222904 s, 235 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.277511 s, 189 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.420177 s, 125 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.302295 s, 173 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.351443 s, 149 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.369525 s, 142 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.355714 s, 147 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.385965 s, 136 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.422305 s, 124 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.407121 s, 129 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.344645 s, 152 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.282984 s, 185 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.388773 s, 135 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.435746 s, 120 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.486184 s, 108 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.411397 s, 127 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.355151 s, 148 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.339201 s, 155 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.197304 s, 266 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.192868 s, 272 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.102699 s, 511 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0958136 s, 547 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0427086 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0933328 s, 562 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0816162 s, 642 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.225457 s, 233 MB/s
/mnt/lustre/f45.sanity-pcc
composite_header:
  lcm_magic:         0x0BD60BD0
  lcm_size:          256
  lcm_flags:         ro,pccro
  lcm_layout_gen:    2
  lcm_mirror_count:  2
  lcm_entry_count:   2
components:
  - lcme_id:             65537
    lcme_mirror_id:      1
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         128
    lcme_size:           56
    sub_layout:
      lmm_magic:         0x0BD10BD0
      lmm_seq:           0x2000061c1
      lmm_object_id:     0x8
      lmm_fid:           [0x2000061c1:0x8:0x0]
      lmm_stripe_count:  1
      lmm_stripe_size:   4194304
      lmm_pattern:       raid0
      lmm_layout_gen:    0
      lmm_stripe_offset: 0
      lmm_objects:
      -   0: { l_ost_idx:   0, l_fid: [0x240000400:0x1c5:0x0] }

  - lcme_id:             131074
    lcme_mirror_id:      2
    lcme_flags:          init
    lcme_extent.e_start: 0
    lcme_extent.e_end:   EOF
    lcme_offset:         184
    lcme_size:           72
    sub_layout:
      lhm_magic:         0x0BD70BD0
      lhm_pattern:       hsm
      lhm_length:        56
      lhm_type:          0x00000003 (pccro)
      lhm_flags:         exists,archived,pccro,0x109
      lhm_archive_id:    0
      lhm_archive_ver:   0
      lhm_archive_uuid:  ''
llite.lustre-ffff8ab3c6ce1000.stats=
snapshot_time             1743497969.448441184 secs.nsecs
start_time                1743497908.059891231 secs.nsecs
elapsed_time              61.388549953 secs.nsecs
read_bytes                6801 samples [bytes] 12288 1048576 7130316800 7476653601062912
read                      51300 samples [usecs] 219 891688 341316299 47695948540691
ioctl                     1 samples [reqs]
open                      1027 samples [usecs] 16 307149 4757879 821915017215
close                     1027 samples [usecs] 15 114439 1019231 73751769451
seek                      1025 samples [usecs] 4 3498 16026 20619894
setattr                   1 samples [usecs] 199039 199039 199039 39616523521
getattr                   32 samples [usecs] 244 136422 1638151 167950304245
mknod                     1 samples [usecs] 198577 198577 198577 39432824929
inode_permission          4081 samples [usecs] 2 230525 2897919 272231662087
opencount                 1028 samples [reqs] 1 1027 527879 361596431
openclosetime             1026 samples [usecs] 124 543002 66012294 8508656247062
pcc_attach                1 samples [reqs]
pcc_hit_bytes             890 samples [bytes] 52428800 52428800 46661632000 2446413371801600000
pcc_attach_bytes          1 samples [bytes] 52428800 52428800 52428800 2748779069440000
llite.lustre-ffff8ab3f65c1000.stats=
snapshot_time             1743497969.448959320 secs.nsecs
start_time                1743497908.059983619 secs.nsecs
elapsed_time              61.388975701 secs.nsecs
read_bytes                7300 samples [bytes] 1048576 1048576 7654604800 8026434882764800
read                      48500 samples [usecs] 235 1421968 367655034 85313742378646
open                      970 samples [usecs] 14 101050 303169 13235511739
close                     970 samples [usecs] 12 125740 418550 28949414040
seek                      969 samples [usecs] 4 2882 13357 11480745
inode_permission          1938 samples [usecs] 2 121212 933082 50715607714
opencount                 970 samples [reqs] 1 954 455551 289872121
openclosetime             953 samples [usecs] 64 445090 59614745 7417847691577
pcc_attach                1 samples [reqs]
pcc_hit_bytes             824 samples [bytes] 52428800 52428800 43201331200 2264993953218560000
pcc_attach_bytes          1 samples [bytes] 52428800 52428800 52428800 2748779069440000
attach 2 detach 0 auto_attach 0
llite.lustre-ffff8ab3c6ce1000.pcc_async_threshold=1073741824
llite.lustre-ffff8ab3f65c1000.pcc_async_threshold=1073741824
/mnt/pcc.d45.sanity-pcc.2 is idle now
/mnt/pcc.d45.sanity-pcc is idle now
PASS 45 (82s)

== sanity-pcc test 46: Verify PCC mode setting works correctly ========================================================== 04:59:43 (1743497983)
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.15742 s, 400 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d46.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: 18d31d3b-cc9c-4ae3-90be-505c34fe1c9c
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f46.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=18d31d3b-cc9c-4ae3-90be-505c34fe1c9c (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d46.sanity-pcc/d46.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [id]
uid=500(sanityusr) gid=500(sanityusr) groups=500(sanityusr),0(root)
Mode: 0400
llite.lustre-ffff8ab3c6ce1000.pcc_mode=0
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-r] [/mnt/lustre/f46.sanity-pcc]
lfs pcc pcc: cannot attach the file to PCC with ID 0 failed: Operation not permitted (1)
attach: cannot attach '/mnt/lustre/f46.sanity-pcc' to PCC with attach ID '0': Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [cat] [/mnt/lustre/f46.sanity-pcc]
QQQQQ
llite.lustre-ffff8ab3c6ce1000.pcc_mode=0400
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-r] [/mnt/lustre/f46.sanity-pcc]
lfs pcc pcc: cannot attach the file to PCC with ID 0 failed: Operation not permitted (1)
attach: cannot attach '/mnt/lustre/f46.sanity-pcc' to PCC with attach ID '0': Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [cat] [/mnt/lustre/f46.sanity-pcc]
QQQQQ
llite.lustre-ffff8ab3c6ce1000.pcc_mode=0004
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [cat] [/mnt/lustre/f46.sanity-pcc]
QQQQQ
file: /mnt/lustre/f46.sanity-pcc, type: readonly, PCC_file: /d46.sanity-pcc/61cb/0x2000061c1:0xa:0x0, open_count: 0, flags: 0
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/f46.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [stat] [/mnt/lustre/f46.sanity-pcc]
  File: /mnt/lustre/f46.sanity-pcc
  Size: 6         	Blocks: 1          IO Block: 4194304 regular file
Device: 2c54f966h/743766374d	Inode: 144115607925686282  Links: 1
Access: (0664/-rw-rw-r--)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2025-04-01 04:59:47.000000000 -0400
Modify: 2025-04-01 04:59:47.000000000 -0400
Change: 2025-04-01 04:59:47.000000000 -0400
 Birth: 2025-04-01 04:59:47.000000000 -0400
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/f46.sanity-pcc]
llite.lustre-ffff8ab3c6ce1000.pcc_mode=0040
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [cat] [/mnt/lustre/f46.sanity-pcc]
QQQQQ
file: /mnt/lustre/f46.sanity-pcc, type: readonly, PCC_file: /d46.sanity-pcc/61cb/0x2000061c1:0xa:0x0, open_count: 0, flags: 0
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/f46.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [attach] [-r] [/mnt/lustre/f46.sanity-pcc]
  File: /mnt/lustre/f46.sanity-pcc
  Size: 6         	Blocks: 2          IO Block: 4194304 regular file
Device: 2c54f966h/743766374d	Inode: 144115607925686282  Links: 1
Access: (0660/-rw-rw----)  Uid: (    0/    root)   Gid: (    0/    root)
Access: 2025-04-01 04:59:48.000000000 -0400
Modify: 2025-04-01 04:59:47.000000000 -0400
Change: 2025-04-01 04:59:48.000000000 -0400
 Birth: 2025-04-01 04:59:47.000000000 -0400
file: /mnt/lustre/f46.sanity-pcc, type: readonly, PCC_file: /d46.sanity-pcc/61cb/0x2000061c1:0xa:0x0, open_count: 0, flags: 0
running as uid/gid/euid/egid 500/500/500/500, groups: 0
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [detach] [/mnt/lustre/f46.sanity-pcc]
llite.lustre-ffff8ab3c6ce1000.pcc_mode=0400
llite.lustre-ffff8ab3c6ce1000.pcc_mode=0400
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d46.sanity-pcc is idle now
PASS 46 (14s)

== sanity-pcc test 47: mtime should be kept once file attached into PCC ========================================================== 04:59:58 (1743497998)
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.144725 s, 435 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d47.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: 1f5e7309-da83-42aa-b855-a262f75be6c4
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f47.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=1f5e7309-da83-42aa-b855-a262f75be6c4 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d47.sanity-pcc/d47.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
QQQQQ
/home/green/git/lustre-release/lustre/utils/lfs pcc state /mnt/lustre/f47.sanity-pcc | grep -E -c 'type: readonly'
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d47.sanity-pcc is idle now
PASS 47 (15s)

== sanity-pcc test 48: PCC state should check whether the file in local PCC cache ========================================================== 05:00:13 (1743498013)
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.203564 s, 309 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d48.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: 635aa4d5-c365-488f-a6a0-4eb34fc8907d
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f48.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=635aa4d5-c365-488f-a6a0-4eb34fc8907d (extents) (64bit) (large files) (huge files)
QQQQQ
file: /mnt/lustre/f48.sanity-pcc, type: readonly, PCC_file: /d48.sanity-pcc/61cd/0x2000061c1:0xc:0x0 (unlinked), open_count: 0, flags: 4
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d48.sanity-pcc is idle now
PASS 48 (12s)

== sanity-pcc test 96: Auto attach from multiple read process on a node ========================================================== 05:00:25 (1743498025)
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.254894 s, 247 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d96.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: 8af8a850-8dac-4844-ac94-bb39d40cc53b
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f96.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=8af8a850-8dac-4844-ac94-bb39d40cc53b (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d96.sanity-pcc/d96.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
llite.lustre-ffff8ab3c6ce1000.pcc_async_threshold=1G
llite.lustre-ffff8ab3f65c1000.pcc_async_threshold=1G
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.39204 s, 37.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.48031 s, 35.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.48128 s, 35.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.69083 s, 31.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.80587 s, 29.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.72294 s, 30.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0669579 s, 783 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0478499 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0808805 s, 648 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0413978 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.140253 s, 374 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.11793 s, 445 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0926228 s, 566 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0648244 s, 809 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.053902 s, 973 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0508839 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.056341 s, 931 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0772912 s, 678 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106876 s, 491 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0869978 s, 603 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0502672 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0931841 s, 563 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0300456 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0473159 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0631745 s, 830 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0371196 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0502294 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0492618 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.037634 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0322121 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0571404 s, 918 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.052286 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0369438 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0355816 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.044728 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0421631 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.034981 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0167278 s, 3.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0874604 s, 599 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0894858 s, 586 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0726216 s, 722 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0623133 s, 841 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0387906 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0611715 s, 857 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0627422 s, 836 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0274761 s, 1.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0641264 s, 818 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0256707 s, 2.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0730441 s, 718 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.123799 s, 423 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0514549 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0423791 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0597493 s, 877 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0893158 s, 587 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0482713 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0626644 s, 837 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0663047 s, 791 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0856338 s, 612 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.112752 s, 465 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0590439 s, 888 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0385196 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0399514 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0662386 s, 792 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.102381 s, 512 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.066648 s, 787 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0644347 s, 814 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0410221 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110661 s, 474 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100573 s, 521 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0299253 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.083392 s, 629 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.127457 s, 411 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0828301 s, 633 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106394 s, 493 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0469395 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.058207 s, 901 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0796349 s, 658 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0872798 s, 601 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0460086 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0422593 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0790015 s, 664 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.041656 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0616046 s, 851 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0423634 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0617286 s, 849 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0823133 s, 637 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0827501 s, 634 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0588053 s, 892 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0592631 s, 885 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0260974 s, 2.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0452431 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0500031 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0744717 s, 704 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0553573 s, 947 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0443352 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0330632 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0475129 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0566253 s, 926 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0614441 s, 853 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0856174 s, 612 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0526195 s, 996 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.15346 s, 342 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.109383 s, 479 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0487307 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.150897 s, 347 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0580805 s, 903 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.148758 s, 352 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.061783 s, 849 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0654354 s, 801 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0950913 s, 551 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0495212 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0710181 s, 738 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0912256 s, 575 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0388803 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0940572 s, 557 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0914478 s, 573 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.084296 s, 622 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0784993 s, 668 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0521363 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0269797 s, 1.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0709421 s, 739 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.162484 s, 323 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0450004 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0482272 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0436347 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.069 s, 760 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114433 s, 458 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0619352 s, 847 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0366333 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0853393 s, 614 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103846 s, 505 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0479976 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0287195 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0344909 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0743518 s, 705 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0896932 s, 585 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0553021 s, 948 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0358572 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0527281 s, 994 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0223931 s, 2.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0246123 s, 2.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0955478 s, 549 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103106 s, 508 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0873345 s, 600 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.052713 s, 995 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0701452 s, 747 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0739848 s, 709 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0657509 s, 797 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0616786 s, 850 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0502402 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0312347 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0772402 s, 679 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0831711 s, 630 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0607443 s, 863 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0353308 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.106779 s, 491 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0596004 s, 880 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0560905 s, 935 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0453095 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0326451 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0531363 s, 987 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0841147 s, 623 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0528839 s, 991 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100049 s, 524 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0852792 s, 615 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146373 s, 358 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0859055 s, 610 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0624978 s, 839 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0419009 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107038 s, 490 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0642767 s, 816 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0365288 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0528972 s, 991 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0669344 s, 783 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.162252 s, 323 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0945327 s, 555 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0469245 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0433458 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0308956 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0720733 s, 727 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.125281 s, 418 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0395293 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0623721 s, 841 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.043116 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0583075 s, 899 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0534386 s, 981 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0307789 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0977397 s, 536 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0641883 s, 817 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0478448 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0326476 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0684168 s, 766 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0702723 s, 746 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0279139 s, 1.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.130835 s, 401 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0467326 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.101577 s, 516 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0516597 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0590042 s, 889 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0577698 s, 908 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0574302 s, 913 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0402914 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0420469 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0735043 s, 713 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0444133 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.035767 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0507398 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0462902 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0400291 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0436285 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0363126 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0460937 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0327849 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0629861 s, 832 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0826271 s, 635 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0385914 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0524834 s, 999 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0441622 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0447073 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0472095 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.088403 s, 593 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0424283 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0254073 s, 2.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.05666 s, 925 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0960365 s, 546 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0448234 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.108901 s, 481 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0762644 s, 687 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0402077 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0416173 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0513611 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0765406 s, 685 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0341793 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0240072 s, 2.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0327158 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0249215 s, 2.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0494153 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0488917 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0540138 s, 971 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0554473 s, 946 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0547723 s, 957 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0398158 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.078167 s, 671 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.218627 s, 240 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0855302 s, 613 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.267305 s, 196 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.147432 s, 356 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0498702 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0395426 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0675686 s, 776 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0680561 s, 770 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0522092 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0630018 s, 832 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0364932 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0294666 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0368491 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0950875 s, 551 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0636046 s, 824 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0559675 s, 937 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0420426 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0428474 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0468383 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0683301 s, 767 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0193844 s, 2.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0463961 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0465537 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0475538 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0727076 s, 721 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0545912 s, 960 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0372404 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.03901 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0620687 s, 845 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0388424 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0439249 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0357276 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0801502 s, 654 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.056722 s, 924 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0509705 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.027186 s, 1.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0901351 s, 582 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.025486 s, 2.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0500429 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0676451 s, 775 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0456118 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0461305 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0520105 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0612097 s, 857 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0513814 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.136609 s, 384 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0773562 s, 678 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0726729 s, 721 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0572651 s, 916 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0286342 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0568904 s, 922 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0393584 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.037532 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0513673 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0788843 s, 665 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0407757 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0838964 s, 625 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0812512 s, 645 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0871525 s, 602 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0301824 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0539868 s, 971 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0799711 s, 656 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0722188 s, 726 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0572602 s, 916 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0493008 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.062744 s, 836 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0617796 s, 849 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0658897 s, 796 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0606756 s, 864 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.207945 s, 252 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.109849 s, 477 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0490174 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0577538 s, 908 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0299637 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0378701 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0331903 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0873874 s, 600 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0480719 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.054851 s, 956 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.161508 s, 325 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0375842 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0522383 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0532272 s, 985 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.042777 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0313001 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0463946 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0295452 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0578001 s, 907 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0334312 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0432348 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0554972 s, 945 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0581476 s, 902 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0718333 s, 730 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0574218 s, 913 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0465568 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0629349 s, 833 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.086632 s, 605 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0403199 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.039905 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0446638 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0667604 s, 785 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0581951 s, 901 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0261655 s, 2.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0545199 s, 962 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0746683 s, 702 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0371346 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.036484 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0328839 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0286806 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0625656 s, 838 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0356342 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146826 s, 357 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0533482 s, 983 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0468437 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0448673 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0364178 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.067948 s, 772 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.14683 s, 357 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.114278 s, 459 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.119663 s, 438 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.127127 s, 412 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0901772 s, 581 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0444365 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0619743 s, 846 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0377951 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0490644 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0381499 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0773175 s, 678 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0359033 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0277578 s, 1.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0480346 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0596516 s, 879 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0399494 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0691582 s, 758 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0499557 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0677058 s, 774 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0881007 s, 595 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0679376 s, 772 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0850859 s, 616 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0663204 s, 791 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0799179 s, 656 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.110336 s, 475 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107831 s, 486 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0540987 s, 969 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0627239 s, 836 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0523175 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.035448 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0308666 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0664275 s, 789 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0355535 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0348163 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.02678 s, 2.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0425409 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0383037 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0335679 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0334475 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.063528 s, 825 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0616504 s, 850 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0566434 s, 926 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0833 s, 629 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0442544 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0543493 s, 965 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0685617 s, 765 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0563524 s, 930 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0540587 s, 970 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0515333 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0302059 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0454113 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.103824 s, 505 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0850486 s, 616 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0859287 s, 610 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.109949 s, 477 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0584567 s, 897 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.100644 s, 521 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0430455 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0546752 s, 959 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0492132 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0862093 s, 608 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0942861 s, 556 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0297516 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0702597 s, 746 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0258322 s, 2.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0478899 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0571825 s, 917 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0433611 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0692763 s, 757 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0668892 s, 784 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0516573 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.059956 s, 874 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0357872 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0224414 s, 2.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0229452 s, 2.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0257008 s, 2.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0195349 s, 2.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0951692 s, 551 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0682921 s, 768 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0489411 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0397542 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0656235 s, 799 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107404 s, 488 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0810538 s, 647 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.042324 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.036444 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0264044 s, 2.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0273456 s, 1.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.107559 s, 487 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0582209 s, 901 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0699829 s, 749 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.047995 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0665133 s, 788 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0460703 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.043314 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0410238 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.048595 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0474995 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0584876 s, 896 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0706367 s, 742 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0725825 s, 722 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.104407 s, 502 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0258305 s, 2.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0537005 s, 976 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0564502 s, 929 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0285829 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0473444 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0402015 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0261692 s, 2.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0385217 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0835172 s, 628 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0464345 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0432265 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0376432 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0401173 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0364084 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0373892 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0385168 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0422031 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0636164 s, 824 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0575146 s, 912 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0292371 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0454396 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0464597 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.053305 s, 984 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.044434 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0755168 s, 694 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0409877 s, 1.3 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0895955 s, 585 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0940147 s, 558 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.137133 s, 382 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0380044 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0296631 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0638656 s, 821 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0267049 s, 2.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0420418 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0497623 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0875214 s, 599 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0275177 s, 1.9 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0566749 s, 925 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0653637 s, 802 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0950329 s, 552 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0368658 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.080132 s, 654 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0294544 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0611619 s, 857 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0289836 s, 1.8 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.071557 s, 733 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0332477 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0250061 s, 2.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0334423 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0366617 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0717817 s, 730 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0502783 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0485178 s, 1.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.062181 s, 843 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0341443 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0820363 s, 639 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.058105 s, 902 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0362796 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0372331 s, 1.4 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0244035 s, 2.1 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0541915 s, 967 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0589169 s, 890 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0334997 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.07721 s, 679 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.052352 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.030906 s, 1.7 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0447544 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0588912 s, 890 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0440027 s, 1.2 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0343703 s, 1.5 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0628229 s, 835 MB/s
Finish ========
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0499599 s, 1.0 GB/s
detach: must specify one or more FIDs
Detach given files from the Persistent Client Cache.
usage: lfs pcc detach [-k] FILE [...]

lfs commands used to interact with PCC features:
lfs pcc attach - attach given files to Persistent Client Cache
lfs pcc attach_fid - attach given files into PCC by FID(s)
lfs pcc state  - display the PCC state for given files
lfs pcc detach - detach given files from Persistent Client Cache
lfs pcc detach_fid - detach given files from PCC by FID(s)
lfs pcc delete - delete the PCC layout componenet for given files
lfs pcc pin - pin give files for PCC
lfs pcc unpin - unpin given files for PCC

llite.lustre-ffff8ab3c6ce1000.pcc_async_threshold=1073741824
llite.lustre-ffff8ab3f65c1000.pcc_async_threshold=1073741824
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d96.sanity-pcc is idle now
PASS 96 (77s)

== sanity-pcc test 97: two mmap I/O and layout lock cancel ========================================================== 05:01:42 (1743498102)
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.218925 s, 287 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d97.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: a5e9cadd-4ee3-434e-91d2-6cc0c62bda62
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f97.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=a5e9cadd-4ee3-434e-91d2-6cc0c62bda62 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d97.sanity-pcc/d97.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
llite.lustre-ffff8ab3c6ce1000.pcc_async_threshold=1G
llite.lustre-ffff8ab3f65c1000.pcc_async_threshold=1G
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.21011 s, 43.3 MB/s
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T2. mmap_cat /mnt/lustre/f97.sanity-pcc ...
T1. mmap_cat /mnt/lustre/f97.sanity-pcc ...
llite.lustre-ffff8ab3c6ce1000.pcc_async_threshold=1073741824
llite.lustre-ffff8ab3f65c1000.pcc_async_threshold=1073741824
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d97.sanity-pcc is idle now
PASS 97 (136s)

== sanity-pcc test 98: racer between auto attach and mmap I/O ========================================================== 05:03:58 (1743498238)
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.154377 s, 408 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d98.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: 0f5e2290-d2c7-4d0a-867b-61d61fb359a9
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f98.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=0f5e2290-d2c7-4d0a-867b-61d61fb359a9 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d98.sanity-pcc/d98.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
llite.lustre-ffff8ab3c6ce1000.pcc_async_threshold=0
llite.lustre-ffff8ab3f65c1000.pcc_async_threshold=0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.18028 s, 44.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0688511 s, 761 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.75415 s, 29.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.31359 s, 39.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.69497 s, 30.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.840945 s, 62.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.831829 s, 63.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.754385 s, 69.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.881139 s, 59.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.18192 s, 44.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.93691 s, 56.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 4.43772 s, 11.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 4.3847 s, 12.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 4.03176 s, 13.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.43698 s, 36.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.45444 s, 36.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.68967 s, 31.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.41807 s, 37.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.42122 s, 36.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.69521 s, 30.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.01311 s, 51.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.01949 s, 51.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.0227 s, 51.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.933129 s, 56.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.19133 s, 44.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.989957 s, 53.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.982149 s, 53.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.15603 s, 45.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.942111 s, 55.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.878089 s, 59.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.8414 s, 28.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.95757 s, 26.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.976086 s, 53.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.983192 s, 53.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.72659 s, 30.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.533467 s, 98.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.550385 s, 95.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.892283 s, 58.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.70962 s, 30.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.70927 s, 30.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.6972 s, 30.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.757023 s, 69.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.854291 s, 61.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.675882 s, 77.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.12029 s, 46.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.815946 s, 64.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.965349 s, 54.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.28556 s, 40.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.44385 s, 36.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.42203 s, 36.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.808905 s, 64.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.958047 s, 54.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.963401 s, 54.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.99725 s, 26.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.06178 s, 25.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.02524 s, 25.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.829664 s, 63.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.886557 s, 59.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.07937 s, 48.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.839781 s, 62.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.854026 s, 61.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.9258 s, 56.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.0196 s, 51.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.966263 s, 54.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.04235 s, 50.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.44011 s, 36.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.78596 s, 29.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.5616 s, 33.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.76034 s, 19.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.6177 s, 20.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.79242 s, 18.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.930407 s, 56.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.973331 s, 53.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.12559 s, 46.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.17528 s, 44.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.55382 s, 33.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.68524 s, 31.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.938629 s, 55.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.49532 s, 35.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.02167 s, 51.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.96287 s, 17.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 3.16683 s, 16.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 3.23893 s, 16.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.09424 s, 47.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.10083 s, 47.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.10095 s, 47.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.42942 s, 36.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.12742 s, 46.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.36975 s, 38.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.47035 s, 35.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.70023 s, 30.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.60248 s, 32.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.178817 s, 293 MB/s
llite.lustre-ffff8ab3c6ce1000.pcc_async_threshold=1073741824
llite.lustre-ffff8ab3f65c1000.pcc_async_threshold=1073741824
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d98.sanity-pcc is idle now
PASS 98 (76s)

== sanity-pcc test 99: race among unlink | mmap read | write | detach for PCC-RO file ========================================================== 05:05:14 (1743498314)
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.139514 s, 451 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d99.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: b1c535ce-7c9c-4293-9034-a3a00b404a6f
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f99.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=b1c535ce-7c9c-4293-9034-a3a00b404a6f (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.03787 s, 50.5 MB/s
Read /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.4483 s, 36.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.81454 s, 28.9 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Read /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0663325 s, 790 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.40536 s, 37.3 MB/s
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.47738 s, 35.5 MB/s
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.990465 s, 52.9 MB/s
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.16098 s, 45.2 MB/s
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.00795 s, 26.1 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Read /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.970818 s, 54.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.62073 s, 32.3 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Read /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.34458 s, 22.4 MB/s
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0476828 s, 1.1 GB/s
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.842444 s, 62.2 MB/s
Read /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.21164 s, 43.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.82034 s, 28.8 MB/s
Read /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.94573 s, 26.9 MB/s
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0995897 s, 526 MB/s
Read /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.51172 s, 34.7 MB/s
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.1953 s, 43.9 MB/s
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.94031 s, 55.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.84864 s, 28.4 MB/s
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Read /mnt/lustre/f99.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.42176 s, 36.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.10277 s, 24.9 MB/s
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Read /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0570196 s, 919 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.22024 s, 43.0 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.14112 s, 45.9 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.759268 s, 69.1 MB/s
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.13301 s, 46.3 MB/s
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.95318 s, 26.8 MB/s
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.01775 s, 51.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.85223 s, 28.3 MB/s
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.50811 s, 34.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.00225 s, 26.2 MB/s
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.12074 s, 434 MB/s
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.146949 s, 357 MB/s
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.3186 s, 39.8 MB/s
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.27787 s, 41.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.910833 s, 57.6 MB/s
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.68043 s, 31.2 MB/s
Detach /mnt/lustre/f99.sanity-pcc ...
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0701952 s, 747 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.864246 s, 60.7 MB/s
Unlink /mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0
Read /mnt/lustre/f99.sanity-pcc ...
Detach /mnt/lustre/f99.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d99.sanity-pcc/d99.sanity-pcc/61d2/0x2000061c1:0x13:0x0': No such file or directory
==== DONE ====
Detach /mnt/lustre/f99.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.34319 s, 22.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.29324 s, 22.9 MB/s
==== DONE WIAT ====
osc.lustre-OST0000-osc-ffff8ab3c6ce1000.rpc_stats=
snapshot_time:            1743498382.781137254 secs.nsecs
start_time:               1743497693.332933696 secs.nsecs
elapsed_time:             689.448203558 secs.nsecs
read RPCs in flight:  0
write RPCs in flight: 0
DIO RPCs in flight: 0
pending write pages:  0
pending read pages:   0

			read			write
pages per rpc         rpcs   % cum % |       rpcs   % cum %
1:		         3   0   0   |          3   1   1
2:		         0   0   0   |          0   0   1
4:		         0   0   0   |          0   0   1
8:		         0   0   0   |          0   0   1
16:		         0   0   0   |          0   0   1
32:		         0   0   0   |          0   0   1
64:		         0   0   0   |          0   0   1
128:		         0   0   0   |          0   0   1
256:		       352  99 100   |        150  98 100

			read			write
rpcs in flight        rpcs   % cum % |       rpcs   % cum %
1:		        41  11  11   |         51  33  33
2:		        27   7  19   |         61  39  73
3:		        19   5  24   |         21  13  86
4:		        19   5  29   |          6   3  90
5:		        14   3  33   |          6   3  94
6:		        14   3  37   |          2   1  96
7:		        13   3  41   |          1   0  96
8:		        20   5  47   |          1   0  97
9:		       188  52 100   |          4   2 100

			read			write
offset                rpcs   % cum % |       rpcs   % cum %
0:		        12   3   3   |          6   3   3
1:		         0   0   3   |          0   0   3
2:		         0   0   3   |          0   0   3
4:		         0   0   3   |          0   0   3
8:		         0   0   3   |          0   0   3
16:		         0   0   3   |          0   0   3
32:		         0   0   3   |          0   0   3
64:		         0   0   3   |          0   0   3
128:		         0   0   3   |          0   0   3
256:		         7   1   5   |          3   1   5
512:		        14   3   9   |          6   3   9
1024:		        28   7  17   |         12   7  17
2048:		        56  15  32   |         24  15  33
4096:		       112  31  64   |         48  31  64
8192:		       126  35 100   |         54  35 100
osc.lustre-OST0000-osc-ffff8ab3f65c1000.rpc_stats=
snapshot_time:            1743498382.781463467 secs.nsecs
start_time:               1743497696.242099162 secs.nsecs
elapsed_time:             686.539364305 secs.nsecs
read RPCs in flight:  0
write RPCs in flight: 0
DIO RPCs in flight: 0
pending write pages:  0
pending read pages:   0

			read			write
pages per rpc         rpcs   % cum % |       rpcs   % cum %
1:		         0   0   0   |          0   0   0
2:		         0   0   0   |          0   0   0
4:		         0   0   0   |          0   0   0
8:		         0   0   0   |          0   0   0
16:		         0   0   0   |          0   0   0
32:		         0   0   0   |          0   0   0
64:		         0   0   0   |          0   0   0
128:		         0   0   0   |          0   0   0
256:		        50 100 100   |          0   0   0

			read			write
rpcs in flight        rpcs   % cum % |       rpcs   % cum %
1:		         6  12  12   |          0   0   0
2:		         4   8  20   |          0   0   0
3:		         3   6  26   |          0   0   0
4:		         3   6  32   |          0   0   0
5:		         2   4  36   |          0   0   0
6:		         1   2  38   |          0   0   0
7:		         1   2  40   |          0   0   0
8:		         1   2  42   |          0   0   0
9:		        29  58 100   |          0   0   0

			read			write
offset                rpcs   % cum % |       rpcs   % cum %
0:		         1   2   2   |          0   0   0
1:		         0   0   2   |          0   0   0
2:		         0   0   2   |          0   0   0
4:		         0   0   2   |          0   0   0
8:		         0   0   2   |          0   0   0
16:		         0   0   2   |          0   0   0
32:		         0   0   2   |          0   0   0
64:		         0   0   2   |          0   0   0
128:		         0   0   2   |          0   0   0
256:		         1   2   4   |          0   0   0
512:		         2   4   8   |          0   0   0
1024:		         4   8  16   |          0   0   0
2048:		         8  16  32   |          0   0   0
4096:		        16  32  64   |          0   0   0
8192:		        18  36 100   |          0   0   0
osc.lustre-OST0001-osc-ffff8ab3c6ce1000.rpc_stats=
snapshot_time:            1743498382.781660150 secs.nsecs
start_time:               1743497693.344354410 secs.nsecs
elapsed_time:             689.437305740 secs.nsecs
read RPCs in flight:  0
write RPCs in flight: 0
DIO RPCs in flight: 0
pending write pages:  0
pending read pages:   0

			read			write
pages per rpc         rpcs   % cum % |       rpcs   % cum %
1:		       134   3   3   |          3   0   0
2:		         4   0   3   |          0   0   0
4:		         1   0   3   |          0   0   0
8:		         2   0   3   |          0   0   0
16:		       320   8  11   |          0   0   0
32:		        18   0  12   |          0   0   0
64:		        15   0  12   |          0   0   0
128:		        58   1  14   |          0   0   0
256:		      3338  85 100   |       1350  99 100

			read			write
rpcs in flight        rpcs   % cum % |       rpcs   % cum %
1:		       924  23  23   |        208  15  15
2:		       341   8  32   |        360  26  41
3:		       249   6  38   |        245  18  60
4:		       211   5  44   |        197  14  74
5:		       224   5  50   |        143  10  85
6:		       181   4  54   |         72   5  90
7:		       167   4  59   |         41   3  93
8:		       167   4  63   |         28   2  95
9:		      1256  32  95   |         59   4 100
10:		        14   0  95   |          0   0 100
11:		        10   0  96   |          0   0 100
12:		         8   0  96   |          0   0 100
13:		         7   0  96   |          0   0 100
14:		         7   0  96   |          0   0 100
15:		         7   0  96   |          0   0 100
16:		         7   0  97   |          0   0 100
17:		         7   0  97   |          0   0 100
18:		         8   0  97   |          0   0 100
19:		         6   0  97   |          0   0 100
20:		         6   0  97   |          0   0 100
21:		         6   0  98   |          0   0 100
22:		         5   0  98   |          0   0 100
23:		         5   0  98   |          0   0 100
24:		         5   0  98   |          0   0 100
25:		         5   0  98   |          0   0 100
26:		         5   0  98   |          0   0 100
27:		         5   0  98   |          0   0 100
28:		         5   0  98   |          0   0 100
29:		         4   0  99   |          0   0 100
30:		         3   0  99   |          0   0 100
31:		        35   0 100   |          0   0 100

			read			write
offset                rpcs   % cum % |       rpcs   % cum %
0:		        72   1   1   |         30   2   2
1:		        16   0   2   |          0   0   2
2:		        27   0   2   |          0   0   2
4:		         0   0   2   |          0   0   2
8:		         0   0   2   |          0   0   2
16:		        23   0   3   |          0   0   2
32:		        41   1   4   |          0   0   2
64:		        61   1   6   |          0   0   2
128:		        51   1   7   |          0   0   2
256:		        94   2   9   |         27   1   4
512:		       174   4  14   |         54   3   8
1024:		       302   7  22   |        108   7  16
2048:		       554  14  36   |        216  15  32
4096:		      1152  29  65   |        432  31  64
8192:		      1323  34 100   |        486  35 100
osc.lustre-OST0001-osc-ffff8ab3f65c1000.rpc_stats=
snapshot_time:            1743498382.784048161 secs.nsecs
start_time:               1743497696.244959933 secs.nsecs
elapsed_time:             686.539088228 secs.nsecs
read RPCs in flight:  0
write RPCs in flight: 0
DIO RPCs in flight: 0
pending write pages:  0
pending read pages:   0

			read			write
pages per rpc         rpcs   % cum % |       rpcs   % cum %
1:		         0   0   0   |          0   0   0
2:		         0   0   0   |          0   0   0
4:		         0   0   0   |          0   0   0
8:		         0   0   0   |          0   0   0
16:		         0   0   0   |          0   0   0
32:		         0   0   0   |          0   0   0
64:		         0   0   0   |          0   0   0
128:		         0   0   0   |          0   0   0
256:		        50 100 100   |          0   0   0

			read			write
rpcs in flight        rpcs   % cum % |       rpcs   % cum %
1:		         4   8   8   |          0   0   0
2:		         2   4  12   |          0   0   0
3:		         1   2  14   |          0   0   0
4:		         1   2  16   |          0   0   0
5:		         1   2  18   |          0   0   0
6:		         1   2  20   |          0   0   0
7:		         1   2  22   |          0   0   0
8:		         1   2  24   |          0   0   0
9:		        38  76 100   |          0   0   0

			read			write
offset                rpcs   % cum % |       rpcs   % cum %
0:		         1   2   2   |          0   0   0
1:		         0   0   2   |          0   0   0
2:		         0   0   2   |          0   0   0
4:		         0   0   2   |          0   0   0
8:		         0   0   2   |          0   0   0
16:		         0   0   2   |          0   0   0
32:		         0   0   2   |          0   0   0
64:		         0   0   2   |          0   0   0
128:		         0   0   2   |          0   0   0
256:		         1   2   4   |          0   0   0
512:		         2   4   8   |          0   0   0
1024:		         4   8  16   |          0   0   0
2048:		         8  16  32   |          0   0   0
4096:		        16  32  64   |          0   0   0
8192:		        18  36 100   |          0   0   0
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d99.sanity-pcc is idle now
PASS 99 (78s)

== sanity-pcc test 99b: race among unlink | two readers | write | detach for PCC-RO file ========================================================== 05:06:32 (1743498392)
200+0 records in
200+0 records out
209715200 bytes (210 MB, 200 MiB) copied, 0.541454 s, 387 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d99b.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:   8192/204800             done                            
Creating filesystem with 204800 1k blocks and 51200 inodes
Filesystem UUID: be06b982-b791-4dcb-bbe3-8d84f17b89e3
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345, 73729

Allocating group tables:  0/25     done                            
Writing inode tables:  0/25     done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information:  0/25     done

/tmp/f99b.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=be06b982-b791-4dcb-bbe3-8d84f17b89e3 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.12412 s, 46.6 MB/s
Read /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.13892 s, 24.5 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.38073 s, 22.0 MB/s
Read /mnt/lustre/f99b.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0877883 s, 597 MB/s
Read /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.2378 s, 42.4 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.829561 s, 63.2 MB/s
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.09115 s, 48.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.8486 s, 28.4 MB/s
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Read /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0521402 s, 1.0 GB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Read /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.79353 s, 29.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.959261 s, 54.7 MB/s
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0453153 s, 1.2 GB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.726671 s, 72.1 MB/s
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.22952 s, 42.6 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.54084 s, 34.0 MB/s
Read /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0437165 s, 1.2 GB/s
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
Read /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.11324 s, 47.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.48779 s, 35.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0818324 s, 641 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.974581 s, 53.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.70101 s, 30.8 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Read /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0404401 s, 1.3 GB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Read /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.11499 s, 47.0 MB/s
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.948353 s, 55.3 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.04187 s, 50.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.84697 s, 28.4 MB/s
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Read /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0398893 s, 1.3 GB/s
Read /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.901443 s, 58.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.57461 s, 33.3 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.806331 s, 65.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.6809 s, 31.2 MB/s
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Read /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0291477 s, 1.8 GB/s
Read /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.12255 s, 46.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.85783 s, 28.2 MB/s
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.13931 s, 46.0 MB/s
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.94107 s, 27.0 MB/s
Read /mnt/lustre/f99b.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0426244 s, 1.2 GB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Read /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.831272 s, 63.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.6545 s, 31.7 MB/s
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.982672 s, 53.4 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.96003 s, 26.7 MB/s
Read /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.40142 s, 37.4 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.65625 s, 31.7 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0471073 s, 1.1 GB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.860075 s, 61.0 MB/s
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Read /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.37501 s, 38.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0644497 s, 813 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.38063 s, 22.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.080449 s, 652 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.11395 s, 47.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.81633 s, 28.9 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Read /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.76745 s, 29.7 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.922841 s, 56.8 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0323207 s, 1.6 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.794389 s, 66.0 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0798032 s, 657 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.783491 s, 66.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.43475 s, 36.5 MB/s
Read /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.099948 s, 525 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Read /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.16062 s, 45.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.14901 s, 24.4 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.975322 s, 53.8 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.67741 s, 31.3 MB/s
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
Read /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0295304 s, 1.8 GB/s
Read /mnt/lustre/f99b.sanity-pcc ...
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.62081 s, 32.3 MB/s
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
Detach /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.329 s, 39.4 MB/s
Detach /mnt/lustre/f99b.sanity-pcc ...
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
unlink: cannot unlink '/mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0': No such file or directory
Detach /mnt/lustre/f99b.sanity-pcc ...
==== DONE ====
Unlink /mnt/pcc.d99b.sanity-pcc/d99b.sanity-pcc/61e4/0x2000061c1:0x25:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.936552 s, 56.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.87286 s, 28.0 MB/s
Read /mnt/lustre/f99b.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.895008 s, 58.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.53956 s, 34.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0330029 s, 1.6 GB/s
==== DONE WIAT ====
osc.lustre-OST0000-osc-ffff8ab3c6ce1000.rpc_stats=
snapshot_time:            1743498462.191689098 secs.nsecs
start_time:               1743497693.332933696 secs.nsecs
elapsed_time:             768.858755402 secs.nsecs
read RPCs in flight:  0
write RPCs in flight: 0
DIO RPCs in flight: 0
pending write pages:  0
pending read pages:   0

			read			write
pages per rpc         rpcs   % cum % |       rpcs   % cum %
1:		         3   0   0   |          3   1   1
2:		         0   0   0   |          0   0   1
4:		         0   0   0   |          0   0   1
8:		         0   0   0   |          0   0   1
16:		         0   0   0   |          0   0   1
32:		         0   0   0   |          0   0   1
64:		         0   0   0   |          0   0   1
128:		         0   0   0   |          0   0   1
256:		       352  99 100   |        150  98 100

			read			write
rpcs in flight        rpcs   % cum % |       rpcs   % cum %
1:		        41  11  11   |         51  33  33
2:		        27   7  19   |         61  39  73
3:		        19   5  24   |         21  13  86
4:		        19   5  29   |          6   3  90
5:		        14   3  33   |          6   3  94
6:		        14   3  37   |          2   1  96
7:		        13   3  41   |          1   0  96
8:		        20   5  47   |          1   0  97
9:		       188  52 100   |          4   2 100

			read			write
offset                rpcs   % cum % |       rpcs   % cum %
0:		        12   3   3   |          6   3   3
1:		         0   0   3   |          0   0   3
2:		         0   0   3   |          0   0   3
4:		         0   0   3   |          0   0   3
8:		         0   0   3   |          0   0   3
16:		         0   0   3   |          0   0   3
32:		         0   0   3   |          0   0   3
64:		         0   0   3   |          0   0   3
128:		         0   0   3   |          0   0   3
256:		         7   1   5   |          3   1   5
512:		        14   3   9   |          6   3   9
1024:		        28   7  17   |         12   7  17
2048:		        56  15  32   |         24  15  33
4096:		       112  31  64   |         48  31  64
8192:		       126  35 100   |         54  35 100
osc.lustre-OST0000-osc-ffff8ab3f65c1000.rpc_stats=
snapshot_time:            1743498462.191955795 secs.nsecs
start_time:               1743497696.242099162 secs.nsecs
elapsed_time:             765.949856633 secs.nsecs
read RPCs in flight:  0
write RPCs in flight: 0
DIO RPCs in flight: 0
pending write pages:  0
pending read pages:   0

			read			write
pages per rpc         rpcs   % cum % |       rpcs   % cum %
1:		         0   0   0   |          0   0   0
2:		         0   0   0   |          0   0   0
4:		         0   0   0   |          0   0   0
8:		         0   0   0   |          0   0   0
16:		         0   0   0   |          0   0   0
32:		         0   0   0   |          0   0   0
64:		         0   0   0   |          0   0   0
128:		         0   0   0   |          0   0   0
256:		        50 100 100   |          0   0   0

			read			write
rpcs in flight        rpcs   % cum % |       rpcs   % cum %
1:		         6  12  12   |          0   0   0
2:		         4   8  20   |          0   0   0
3:		         3   6  26   |          0   0   0
4:		         3   6  32   |          0   0   0
5:		         2   4  36   |          0   0   0
6:		         1   2  38   |          0   0   0
7:		         1   2  40   |          0   0   0
8:		         1   2  42   |          0   0   0
9:		        29  58 100   |          0   0   0

			read			write
offset                rpcs   % cum % |       rpcs   % cum %
0:		         1   2   2   |          0   0   0
1:		         0   0   2   |          0   0   0
2:		         0   0   2   |          0   0   0
4:		         0   0   2   |          0   0   0
8:		         0   0   2   |          0   0   0
16:		         0   0   2   |          0   0   0
32:		         0   0   2   |          0   0   0
64:		         0   0   2   |          0   0   0
128:		         0   0   2   |          0   0   0
256:		         1   2   4   |          0   0   0
512:		         2   4   8   |          0   0   0
1024:		         4   8  16   |          0   0   0
2048:		         8  16  32   |          0   0   0
4096:		        16  32  64   |          0   0   0
8192:		        18  36 100   |          0   0   0
osc.lustre-OST0001-osc-ffff8ab3c6ce1000.rpc_stats=
snapshot_time:            1743498462.192121525 secs.nsecs
start_time:               1743497693.344354410 secs.nsecs
elapsed_time:             768.847767115 secs.nsecs
read RPCs in flight:  0
write RPCs in flight: 0
DIO RPCs in flight: 0
pending write pages:  0
pending read pages:   0

			read			write
pages per rpc         rpcs   % cum % |       rpcs   % cum %
1:		       134   2   2   |          3   0   0
2:		         4   0   2   |          0   0   0
4:		         1   0   2   |          0   0   0
8:		         2   0   2   |          0   0   0
16:		       320   6   9   |          0   0   0
32:		        18   0   9   |          0   0   0
64:		        16   0  10   |          0   0   0
128:		        58   1  11   |          0   0   0
256:		      4258  88 100   |       2750  99 100

			read			write
rpcs in flight        rpcs   % cum % |       rpcs   % cum %
1:		      1123  23  23   |        396  14  14
2:		       470   9  33   |        753  27  41
3:		       340   7  40   |        585  21  62
4:		       297   6  46   |        441  16  79
5:		       290   6  52   |        270   9  88
6:		       250   5  57   |        126   4  93
7:		       235   4  62   |         69   2  95
8:		       228   4  67   |         45   1  97
9:		      1408  29  96   |         68   2 100
10:		        14   0  96   |          0   0 100
11:		        10   0  96   |          0   0 100
12:		         8   0  97   |          0   0 100
13:		         7   0  97   |          0   0 100
14:		         7   0  97   |          0   0 100
15:		         7   0  97   |          0   0 100
16:		         7   0  97   |          0   0 100
17:		         7   0  97   |          0   0 100
18:		         8   0  98   |          0   0 100
19:		         6   0  98   |          0   0 100
20:		         6   0  98   |          0   0 100
21:		         6   0  98   |          0   0 100
22:		         5   0  98   |          0   0 100
23:		         5   0  98   |          0   0 100
24:		         5   0  98   |          0   0 100
25:		         5   0  98   |          0   0 100
26:		         5   0  98   |          0   0 100
27:		         5   0  99   |          0   0 100
28:		         5   0  99   |          0   0 100
29:		         4   0  99   |          0   0 100
30:		         3   0  99   |          0   0 100
31:		        35   0 100   |          0   0 100

			read			write
offset                rpcs   % cum % |       rpcs   % cum %
0:		       112   2   2   |         58   2   2
1:		        16   0   2   |          0   0   2
2:		        27   0   3   |          0   0   2
4:		         0   0   3   |          0   0   2
8:		         0   0   3   |          0   0   2
16:		        23   0   3   |          0   0   2
32:		        41   0   4   |          0   0   2
64:		        61   1   5   |          0   0   2
128:		        52   1   6   |          0   0   2
256:		       114   2   9   |         55   1   4
512:		       209   4  13   |        110   3   8
1024:		       374   7  21   |        220   7  16
2048:		       685  14  35   |        440  15  32
4096:		      1424  29  65   |        880  31  64
8192:		      1673  34 100   |        990  35 100
osc.lustre-OST0001-osc-ffff8ab3f65c1000.rpc_stats=
snapshot_time:            1743498462.192316143 secs.nsecs
start_time:               1743497696.244959933 secs.nsecs
elapsed_time:             765.947356210 secs.nsecs
read RPCs in flight:  0
write RPCs in flight: 0
DIO RPCs in flight: 0
pending write pages:  0
pending read pages:   0

			read			write
pages per rpc         rpcs   % cum % |       rpcs   % cum %
1:		         0   0   0   |          0   0   0
2:		         0   0   0   |          0   0   0
4:		         0   0   0   |          0   0   0
8:		         0   0   0   |          0   0   0
16:		         0   0   0   |          0   0   0
32:		         0   0   0   |          0   0   0
64:		         0   0   0   |          0   0   0
128:		         0   0   0   |          0   0   0
256:		        50 100 100   |          0   0   0

			read			write
rpcs in flight        rpcs   % cum % |       rpcs   % cum %
1:		         4   8   8   |          0   0   0
2:		         2   4  12   |          0   0   0
3:		         1   2  14   |          0   0   0
4:		         1   2  16   |          0   0   0
5:		         1   2  18   |          0   0   0
6:		         1   2  20   |          0   0   0
7:		         1   2  22   |          0   0   0
8:		         1   2  24   |          0   0   0
9:		        38  76 100   |          0   0   0

			read			write
offset                rpcs   % cum % |       rpcs   % cum %
0:		         1   2   2   |          0   0   0
1:		         0   0   2   |          0   0   0
2:		         0   0   2   |          0   0   0
4:		         0   0   2   |          0   0   0
8:		         0   0   2   |          0   0   0
16:		         0   0   2   |          0   0   0
32:		         0   0   2   |          0   0   0
64:		         0   0   2   |          0   0   0
128:		         0   0   2   |          0   0   0
256:		         1   2   4   |          0   0   0
512:		         2   4   8   |          0   0   0
1024:		         4   8  16   |          0   0   0
2048:		         8  16  32   |          0   0   0
4096:		        16  32  64   |          0   0   0
8192:		        18  36 100   |          0   0   0
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d99b.sanity-pcc is idle now
PASS 99b (79s)

== sanity-pcc test 100: race among PCC unlink | read | write | detach for PCC-RO file ========================================================== 05:07:51 (1743498471)
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.140635 s, 447 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d100.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: 52dc453f-427e-41bf-bd99-1a76a79fe428
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f100.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=52dc453f-427e-41bf-bd99-1a76a79fe428 (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.14648 s, 45.7 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
4+0 records in
4+0 records out
4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.968681 s, 4.3 MB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206624 s, 50.7 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Detach /mnt/lustre/f100.sanity-pcc ...
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.33205 s, 39.4 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.925709 s, 56.6 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
11+0 records in
11+0 records out
11534336 bytes (12 MB, 11 MiB) copied, 0.0655345 s, 176 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
33+0 records in
33+0 records out
34603008 bytes (35 MB, 33 MiB) copied, 0.0579519 s, 597 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.46084 s, 35.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0444516 s, 1.2 GB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
0+0 records in
0+0 records out
0 bytes copied, 0.0215656 s, 0.0 kB/s
3+0 records in
3+0 records out
3145728 bytes (3.1 MB, 3.0 MiB) copied, 0.0358654 s, 87.7 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
48+0 records in
48+0 records out
50331648 bytes (50 MB, 48 MiB) copied, 0.696858 s, 72.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.44852 s, 36.2 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.153831 s, 341 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
0+0 records in
0+0 records out
0 bytes copied, 0.0325096 s, 0.0 kB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
2+0 records in
2+0 records out
2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0756024 s, 27.7 MB/s
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
Detach /mnt/lustre/f100.sanity-pcc ...
28+0 records in
28+0 records out
29360128 bytes (29 MB, 28 MiB) copied, 0.831366 s, 35.3 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
42+0 records in
42+0 records out
44040192 bytes (44 MB, 42 MiB) copied, 0.0428491 s, 1.0 GB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.02196 s, 25.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0289142 s, 1.8 GB/s
Detach /mnt/lustre/f100.sanity-pcc ...
0+0 records in
0+0 records out
0 bytes copied, 0.078675 s, 0.0 kB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
17+0 records in
17+0 records out
17825792 bytes (18 MB, 17 MiB) copied, 0.0349206 s, 510 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.695 s, 30.9 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.894911 s, 58.6 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0472315 s, 1.1 GB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
36+0 records in
36+0 records out
37748736 bytes (38 MB, 36 MiB) copied, 0.423813 s, 89.1 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0549229 s, 955 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.60657 s, 32.6 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0336348 s, 1.6 GB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
0+0 records in
0+0 records out
0 bytes copied, 0.000427769 s, 0.0 kB/s
4+0 records in
4+0 records out
4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.0220194 s, 190 MB/s
0+0 records in
0+0 records out
0 bytes copied, 0.0140744 s, 0.0 kB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
49+0 records in
49+0 records out
51380224 bytes (51 MB, 49 MiB) copied, 0.743161 s, 69.1 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.603 s, 32.7 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.125262 s, 419 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
0+0 records in
0+0 records out
0 bytes copied, 0.175815 s, 0.0 kB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
19+0 records in
19+0 records out
19922944 bytes (20 MB, 19 MiB) copied, 0.642757 s, 31.0 MB/s
33+0 records in
33+0 records out
34603008 bytes (35 MB, 33 MiB) copied, 0.0803677 s, 431 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
43+0 records in
43+0 records out
45088768 bytes (45 MB, 43 MiB) copied, 0.0727524 s, 620 MB/s
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.05437 s, 25.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0354217 s, 1.5 GB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
20+0 records in
20+0 records out
20971520 bytes (21 MB, 20 MiB) copied, 0.211057 s, 99.4 MB/s
dd: warning: partial read (602112 bytes); suggest iflag=fullblock
36+2 records in
36+2 records out
38797312 bytes (39 MB, 37 MiB) copied, 0.0915857 s, 424 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0657196 s, 798 MB/s
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.74802 s, 30.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0632882 s, 828 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
14+0 records in
14+0 records out
14680064 bytes (15 MB, 14 MiB) copied, 0.0472583 s, 311 MB/s
23+0 records in
23+0 records out
24117248 bytes (24 MB, 23 MiB) copied, 0.095966 s, 251 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
40+0 records in
40+0 records out
41943040 bytes (42 MB, 40 MiB) copied, 0.0442984 s, 947 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.68799 s, 31.1 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0900845 s, 582 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
0+0 records in
0+0 records out
0 bytes copied, 0.0167732 s, 0.0 kB/s
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
9+0 records in
9+0 records out
9437184 bytes (9.4 MB, 9.0 MiB) copied, 0.0476191 s, 198 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
42+0 records in
42+0 records out
44040192 bytes (44 MB, 42 MiB) copied, 0.709105 s, 62.1 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.61468 s, 32.5 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
0+0 records in
0+0 records out
0 bytes copied, 0.318128 s, 0.0 kB/s
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
15+0 records in
15+0 records out
15728640 bytes (16 MB, 15 MiB) copied, 0.0410996 s, 383 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
48+0 records in
48+0 records out
50331648 bytes (50 MB, 48 MiB) copied, 0.875851 s, 57.5 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.74696 s, 30.0 MB/s
0+0 records in
0+0 records out
0 bytes copied, 0.0461626 s, 0.0 kB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
34+0 records in
34+0 records out
35651584 bytes (36 MB, 34 MiB) copied, 0.764764 s, 46.6 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.73124 s, 30.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0960768 s, 546 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
0+0 records in
0+0 records out
0 bytes copied, 0.174937 s, 0.0 kB/s
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
34+0 records in
34+0 records out
35651584 bytes (36 MB, 34 MiB) copied, 0.845726 s, 42.2 MB/s
47+0 records in
47+0 records out
49283072 bytes (49 MB, 47 MiB) copied, 0.0988257 s, 499 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 2.02143 s, 25.9 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
43+1 records in
43+1 records out
45940736 bytes (46 MB, 44 MiB) copied, 0.249418 s, 184 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
dd: warning: partial read (405504 bytes); suggest iflag=fullblock
35+3 records in
35+3 records out
37748736 bytes (38 MB, 36 MiB) copied, 0.577791 s, 65.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.57514 s, 33.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0334574 s, 1.6 GB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
0+0 records in
0+0 records out
0 bytes copied, 0.0646745 s, 0.0 kB/s
Detach /mnt/lustre/f100.sanity-pcc ...
26+0 records in
26+0 records out
27262976 bytes (27 MB, 26 MiB) copied, 0.419042 s, 65.1 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
45+0 records in
45+0 records out
47185920 bytes (47 MB, 45 MiB) copied, 0.0847544 s, 557 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.60708 s, 32.6 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0454007 s, 1.2 GB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
0+0 records in
0+0 records out
0 bytes copied, 0.114911 s, 0.0 kB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.53235 s, 34.2 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.877307 s, 59.8 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
0+0 records in
0+0 records out
0 bytes copied, 0.121948 s, 0.0 kB/s
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
16+0 records in
16+0 records out
16777216 bytes (17 MB, 16 MiB) copied, 0.027777 s, 604 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
38+0 records in
38+0 records out
39845888 bytes (40 MB, 38 MiB) copied, 0.530187 s, 75.2 MB/s
48+0 records in
48+0 records out
50331648 bytes (50 MB, 48 MiB) copied, 0.204682 s, 246 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.94419 s, 27.0 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
42+1 records in
42+1 records out
44732416 bytes (45 MB, 43 MiB) copied, 0.226768 s, 197 MB/s
21+0 records in
21+0 records out
22020096 bytes (22 MB, 21 MiB) copied, 0.0678904 s, 324 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.33257 s, 39.3 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.561984 s, 93.3 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
2+0 records in
2+0 records out
2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.162709 s, 12.9 MB/s
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
Detach /mnt/lustre/f100.sanity-pcc ...
29+0 records in
29+0 records out
30408704 bytes (30 MB, 29 MiB) copied, 0.643 s, 47.3 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
49+0 records in
49+0 records out
51380224 bytes (51 MB, 49 MiB) copied, 0.126669 s, 406 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.71481 s, 30.6 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0601933 s, 871 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.190952 s, 5.5 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
35+0 records in
35+0 records out
36700160 bytes (37 MB, 35 MiB) copied, 0.615103 s, 59.7 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
47+0 records in
47+0 records out
49283072 bytes (49 MB, 47 MiB) copied, 0.0651249 s, 757 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.61969 s, 32.4 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
31+0 records in
31+0 records out
32505856 bytes (33 MB, 31 MiB) copied, 0.0143427 s, 2.3 GB/s
1+0 records in
1+0 records out
1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.215154 s, 4.9 MB/s
20+0 records in
20+0 records out
20971520 bytes (21 MB, 20 MiB) copied, 0.0384288 s, 546 MB/s
29+0 records in
29+0 records out
30408704 bytes (30 MB, 29 MiB) copied, 0.0148583 s, 2.0 GB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
31+0 records in
31+0 records out
32505856 bytes (33 MB, 31 MiB) copied, 0.0506572 s, 642 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
unlink: cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.86196 s, 28.2 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
Detach /mnt/lustre/f100.sanity-pcc ...
32+0 records in
32+0 records out
33554432 bytes (34 MB, 32 MiB) copied, 1.29392 s, 25.9 MB/s
Detach /mnt/lustre/f100.sanity-pcc ...
6+0 records in
6+0 records out
6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0539903 s, 117 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
unlink: Detach /mnt/lustre/f100.sanity-pcc ...
cannot unlink '/mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0': No such file or directory
Detach /mnt/lustre/f100.sanity-pcc ...
42+0 records in
42+0 records out
44040192 bytes (44 MB, 42 MiB) copied, 0.631653 s, 69.7 MB/s
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.6917 s, 31.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0321875 s, 1.6 GB/s
Detach /mnt/lustre/f100.sanity-pcc ...
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0484801 s, 1.1 GB/s
Detach /mnt/lustre/f100.sanity-pcc ...
Unlink /mnt/pcc.d100.sanity-pcc/d100.sanity-pcc/61fb/0x2000061c1:0x3a:0x0
17+0 records in
17+0 records out
17825792 bytes (18 MB, 17 MiB) copied, 0.124551 s, 143 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 1.58643 s, 33.0 MB/s
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.0723661 s, 724 MB/s
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d100.sanity-pcc is idle now
PASS 100 (76s)

== sanity-pcc test 101a: Test auto attach in mount namespace (simulated container) ========================================================== 05:09:08 (1743498548)
creating user namespace for 500
sanityu+  122038  1.0  0.0 217180   860 pts/0    S+   05:09   0:00 sleep 600
root      122040  0.0  0.0 224084  2100 pts/0    S+   05:09   0:00 grep sleep
Created NS: child (sleep) pid=122038 in 0 seconds
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [newuidmap] [122038] [0] [500] [1]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [newgidmap] [122038] [0] [500] [1]
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.192249 s, 273 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d101a.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 04190daf-af6c-49d2-97c3-154a4734a942
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f101a.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=04190daf-af6c-49d2-97c3-154a4734a942 (extents) (64bit) (large files) (huge files)
Check for temp file in PCC mount
Check for temp file in PCC mount from inside namespace
Starting copytool 'agt1' on 'oleg635-client.virtnet' with cmdline 'lhsmtool_posix --archive-format=v2 --hsm-root=/mnt/pcc.d101a.sanity-pcc/d101a.sanity-pcc --daemon --pid-file=/var/run/lhsmtool_posix.pid --archive 2  "/mnt/lustre"'
Verify open attach from inside mount namespace
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0128223 s, 79.9 kB/s
file: /mnt/lustre/d101a.sanity-pcc/f101a.sanity-pcc, type: readwrite, PCC_file: /d101a.sanity-pcc/618c/0x2000061c1:0x4d:0x0, open_count: 0, flags: 0
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/d101a.sanity-pcc/f101a.sanity-pcc]
ldlm.namespaces.lustre-MDT0000-mdc-ffff8ab3c6ce1000.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff8ab3f65c1000.lru_size=clear
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/d101a.sanity-pcc/f101a.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [multiop] [/mnt/lustre/d101a.sanity-pcc/f101a.sanity-pcc] [oc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/d101a.sanity-pcc/f101a.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/d101a.sanity-pcc/f101a.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [state] [/mnt/lustre/d101a.sanity-pcc/f101a.sanity-pcc]
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.000950376 s, 1.1 MB/s
Verify auto attach at open from inside NS for RW-PCC
ldlm.namespaces.lustre-MDT0000-mdc-ffff8ab3c6ce1000.lru_size=clear
ldlm.namespaces.lustre-MDT0000-mdc-ffff8ab3f65c1000.lru_size=clear
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d101a.sanity-pcc is idle now
PASS 101a (20s)

== sanity-pcc test 102: PCC-RO should not hange for io_uring I/O engine ========================================================== 05:09:28 (1743498568)
Your kernel does not support io_uring
 SKIP: sanity-pcc test_102 kernel does not support io_uring fully
SKIP 102 (4s)

== sanity-pcc test 203: Verify attach/hit bytes statistics data ========================================================== 05:09:32 (1743498572)
10+0 records in
10+0 records out
10485760 bytes (10 MB, 10 MiB) copied, 0.0320265 s, 327 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d203.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/10240           done                            
Creating filesystem with 10240 1k blocks and 2560 inodes
Filesystem UUID: 1e3c14e4-e5dd-4683-85c4-018bbecf2f4a
Superblock backups stored on blocks: 
	8193

Allocating group tables: 0/2   done                            
Writing inode tables: 0/2   done                            
Creating journal (2048 blocks): done
Writing superblocks and filesystem accounting information: 0/2   done

/tmp/f203.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=1e3c14e4-e5dd-4683-85c4-018bbecf2f4a (extents) (64bit) (large files) (huge files)
pcc:
  -
    pccpath: /mnt/pcc.d203.sanity-pcc/d203.sanity-pcc
    hsmtool: posix_v2
    rwid: 0
    roid: 2
    flags: ae
    autocache: projid={0}
1+0 records in
1+0 records out
1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0379795 s, 27.0 kB/s
==== stats ====
llite.lustre-ffff8ab3c6ce1000.stats=
snapshot_time             1743498576.259691851 secs.nsecs
start_time                1743498576.020711374 secs.nsecs
elapsed_time              0.238980477 secs.nsecs
read_bytes                1 samples [bytes] 1024 1024 1024 1048576
write_bytes               1 samples [bytes] 1024 1024 1024 1048576
read                      3 samples [usecs] 235 9296 9854 86575170
write                     1 samples [usecs] 11907 11907 11907 141776649
open                      3 samples [usecs] 61 41591 41719 1729819491
close                     3 samples [usecs] 9638 25606 46833 882863201
getattr                   2 samples [usecs] 97 10172 10269 103478993
mknod                     1 samples [usecs] 32478 32478 32478 1054820484
inode_permission          7 samples [usecs] 3 6351 6705 40378785
opencount                 3 samples [reqs] 1 3 6 14
openclosetime             2 samples [usecs] 45613 47034 92647 4292742925
pcc_attach                1 samples [reqs]
pcc_hit_bytes             2 samples [bytes] 1024 1024 2048 2097152
pcc_attach_bytes          1 samples [bytes] 1024 1024 1024 1048576
llite.lustre-ffff8ab3f65c1000.stats=
snapshot_time             1743498576.261910679 secs.nsecs
start_time                1743498576.020805974 secs.nsecs
elapsed_time              0.241104705 secs.nsecs
attach_num: 1, attach_bytes: 1024, hit_num: 2, hit_bytes: 2048
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d203.sanity-pcc is idle now
PASS 203 (12s)

== sanity-pcc test 204a: pin/unpin pcc flag ============== 05:09:45 (1743498585)
50+0 records in
50+0 records out
52428800 bytes (52 MB, 50 MiB) copied, 0.187939 s, 279 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d204a.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/51200           done                            
Creating filesystem with 51200 1k blocks and 12824 inodes
Filesystem UUID: 8bf1b297-063d-4211-b691-436cdebc8753
Superblock backups stored on blocks: 
	8193, 24577, 40961

Allocating group tables: 0/7   done                            
Writing inode tables: 0/7   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/7   done

/tmp/f204a.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=8bf1b297-063d-4211-b691-436cdebc8753 (extents) (64bit) (large files) (huge files)
getfattr: Removing leading '/' from absolute path names
# file: mnt/lustre/f204a.sanity-pcc.dat
trusted.pin="[hsm: 2]"

getfattr: Removing leading '/' from absolute path names
getfattr: Removing leading '/' from absolute path names
# file: mnt/lustre/f204a.sanity-pcc.dat
trusted.pin="[hsm: 2,hsm: 100]"

getfattr: Removing leading '/' from absolute path names
getfattr: Removing leading '/' from absolute path names
# file: mnt/lustre/f204a.sanity-pcc.dat
trusted.pin="[hsm: 2,hsm: 100]"

getfattr: Removing leading '/' from absolute path names
# file: mnt/lustre/f204a.sanity-pcc.dat
trusted.pin="[hsm: 2]"

getfattr: Removing leading '/' from absolute path names
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d204a.sanity-pcc is idle now
PASS 204a (15s)

== sanity-pcc test 204b: Permission check for the pin/unpin operation ========================================================== 05:10:00 (1743498600)
mdt.lustre-MDT0000.enable_pin_gid=0
/home/green/git/lustre-release/lustre/tests/sanity-pcc.sh: illegal option -- p
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [touch] [/mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [pin] [-i] [100] [/mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc]
pin: cannot pin '/mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc' for PCC: Operation not permitted
getfattr: Removing leading '/' from absolute path names
# file: mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc
trusted.pin="[hsm: 100]"

running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [unpin] [-i] [100] [/mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc]
unpin: cannot unpin '/mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc' for PCC: Operation not permitted
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [pin] [-i] [100] [/mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc]
pin: cannot pin '/mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc' for PCC: Operation not permitted
mdt.lustre-MDT0000.enable_pin_gid=-1
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [pin] [-i] [100] [/mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [unpin] [-i] [100] [/mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc]
mdt.lustre-MDT0000.enable_pin_gid=500
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [pin] [-i] [100] [/mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc]
running as uid/gid/euid/egid 500/500/500/500, groups: 500
 [/home/green/git/lustre-release/lustre/utils/lfs] [pcc] [unpin] [-i] [100] [/mnt/lustre/d204b.sanity-pcc/f204b.sanity-pcc]
mdt.lustre-MDT0000.enable_pin_gid=0
PASS 204b (17s)

== sanity-pcc test 204c: PCC pin/unpin without attach ID specified ========================================================== 05:10:17 (1743498617)
pin: failed to get id for '/mnt/lustre/f204c.sanity-pcc': No such file or directory
60+0 records in
60+0 records out
62914560 bytes (63 MB, 60 MiB) copied, 0.161348 s, 390 MB/s
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
umount: /mnt/pcc.d204c.sanity-pcc: not mounted.
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,mode=755)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,mode=755)
tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755)
cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer)
cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct)
cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio)
cgroup on /sys/fs/cgroup/memory type cgroup (rw,nosuid,nodev,noexec,relatime,memory)
cgroup on /sys/fs/cgroup/pids type cgroup (rw,nosuid,nodev,noexec,relatime,pids)
cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio)
cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices)
cgroup on /sys/fs/cgroup/misc type cgroup (rw,nosuid,nodev,noexec,relatime,misc)
cgroup on /sys/fs/cgroup/rdma type cgroup (rw,nosuid,nodev,noexec,relatime,rdma)
cgroup on /sys/fs/cgroup/hugetlb type cgroup (rw,nosuid,nodev,noexec,relatime,hugetlb)
cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event)
cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset)
none on /sys/kernel/tracing type tracefs (rw,relatime)
configfs on /sys/kernel/config type configfs (rw,relatime)
/dev/nbd0 on / type ext4 (ro,relatime,stripe=32)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
debugfs on /sys/kernel/debug type debugfs (rw,relatime)
mqueue on /dev/mqueue type mqueue (rw,relatime)
none on /mnt type ramfs (rw,relatime)
none on /var/lib/stateless/writable type tmpfs (rw,relatime)
/dev/vda on /home/green/git/lustre-release type squashfs (ro,relatime)
none on /var/cache/man type tmpfs (rw,relatime)
none on /var/log type tmpfs (rw,relatime)
none on /var/lib/dbus type tmpfs (rw,relatime)
none on /tmp type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
none on /var/tmp type tmpfs (rw,relatime)
none on /var/lib/NetworkManager type tmpfs (rw,relatime)
none on /var/lib/systemd/random-seed type tmpfs (rw,relatime)
none on /var/spool type tmpfs (rw,relatime)
none on /var/lib/nfs type tmpfs (rw,relatime)
none on /var/lib/gssproxy type tmpfs (rw,relatime)
none on /var/lib/logrotate type tmpfs (rw,relatime)
none on /etc type tmpfs (rw,relatime)
none on /var/lib/rsyslog type tmpfs (rw,relatime)
none on /root/.ssh type tmpfs (rw,relatime)
none on /var/lib/dhclient type tmpfs (rw,relatime)
192.168.200.253:/exports/state/oleg635-client.virtnet on /var/lib/stateless/state type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/boot on /boot type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
192.168.200.253:/exports/state/oleg635-client.virtnet/etc/kdump.conf on /etc/kdump.conf type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=376392k,mode=700)
192.168.200.253:/exports/testreports/rocky8/77/testresults/sanity-pcc-zfs-rocky8.10_x86_64-rocky8.10_x86_64 on /tmp/testlogs type nfs4 (rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.168.206.35,local_lock=none,addr=192.168.200.253)
/dev/vda on /usr/sbin/mount.lustre type squashfs (ro,relatime)
192.168.206.135@tcp:/lustre on /mnt/lustre type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
192.168.206.135@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt,statfs_project)
mke2fs 1.47.1-wc2 (08-Nov-2024)
Discarding device blocks:  8192/61440           done                            
Creating filesystem with 61440 1k blocks and 15360 inodes
Filesystem UUID: 678e0f13-2748-4df1-874c-35e6d189366b
Superblock backups stored on blocks: 
	8193, 24577, 40961, 57345

Allocating group tables: 0/8   done                            
Writing inode tables: 0/8   done                            
Creating journal (4096 blocks): done
Writing superblocks and filesystem accounting information: 0/8   done

/tmp/f204c.sanity-pcc: Linux rev 1.0 ext4 filesystem data, UUID=678e0f13-2748-4df1-874c-35e6d189366b (extents) (64bit) (large files) (huge files)
getfattr: Removing leading '/' from absolute path names
# file: mnt/lustre/f204c.sanity-pcc
trusted.pin="[hsm: 2]"

getfattr: Removing leading '/' from absolute path names
/mnt/lustre/f204c.sanity-pcc: trusted.pin: No such attribute
/mnt/lustre/f204c.sanity-pcc: trusted.pin: No such attribute
Cleanup PCC backend on /mnt/lustre
/mnt/pcc.d204c.sanity-pcc is idle now
PASS 204c (12s)
== sanity-pcc test complete, duration 5184 sec =========== 05:10:29 (1743498629)
sanity-pcc: FAIL: test_1c /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none
sanity-pcc: FAIL: test_1d /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none
=== sanity-pcc: start cleanup 05:10:32 (1743498632) ===
Stopping clients: oleg635-client.virtnet /mnt/lustre2 (opts:)
Stopping client oleg635-client.virtnet /mnt/lustre2 opts:
=== sanity-pcc: finish cleanup 05:10:44 (1743498644) ===