-----============= acceptance-small: sanityn ============----- Sun Dec 8 02:14:11 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 oleg417-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/sanityn.*ex: No such file or directory excepting tests: 27 28 102 skipping tests SLOW=no: 33a === sanityn: start setup 02:14:17 (1733642057) === Starting client oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 Started clients oleg417-client.virtnet: 192.168.204.117@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) oleg417-client.virtnet: executing check_config_client /mnt/lustre oleg417-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg417-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800ab26b800.idle_timeout=debug osc.lustre-OST0000-osc-ffff8800b341b800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800ab26b800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b341b800.idle_timeout=debug disable quota as required oleg417-server: oleg417-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanityn: finish setup 02:14:27 (1733642067) === 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00976238 s, 107 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6973] == sanityn test 0: do_node_vp() and do_facet_vp() do the right thing ========================================================== 02:14:27 (1733642067) PASS 0 (2s) == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 02:14:29 (1733642069) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (1s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 02:14:31 (1733642071) -rw-r--r-- 1 root root 0 Dec 8 02:14 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (2s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 02:14:32 (1733642072) -rw-r--r-- 1 root root 0 Dec 8 02:14 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (1s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 02:14:33 (1733642073) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (2s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 02:14:35 (1733642075) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (1s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 02:14:37 (1733642077) total 1 -rwxrwxrwx 1 root root 0 Dec 8 02:14 f2a -rwxrwxrwx 1 root root 0 Dec 8 02:14 f2b total 1 -rwxrwxrwx 1 root root 0 Dec 8 02:14 f2a -rwxrwxrwx 1 root root 0 Dec 8 02:14 f2b running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes (512 B) copied, 0.00228549 s, 224 kB/s PASS 2e (2s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 02:14:38 (1733642078) SKIP: sanityn test_2f needs >= 2 MDTs SKIP 2f (1s) == sanityn test 2g: check blocks update on sync write ==== 02:14:39 (1733642079) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0676449 s, 31.0 MB/s /mnt/lustre/f2g.sanityn has 4103 blocks /mnt/lustre2/f2g.sanityn has 4103 blocks PASS 2g (1s) == sanityn test 3: symlink on one mtpt, readlink on another ===================================================================== 02:14:40 (1733642080) PASS 3 (1s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 02:14:41 (1733642081) PASS 4 (3s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 02:14:44 (1733642084) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (1s) == sanityn test 6: remove of open file on other node ============================================================================ 02:14:45 (1733642085) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (1s) == sanityn test 7: remove of open directory on other node ======================================================================= 02:14:46 (1733642086) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (2s) == sanityn test 8: remove of open special file on other node ==================================================================== 02:14:48 (1733642088) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (1s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 02:14:49 (1733642089) PASS 9a (1s) == sanityn test 9b: append to striped sparse file ======== 02:14:50 (1733642090) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103794 s, 101 MB/s 3+0 records in 3+0 records out 3 bytes (3 B) copied, 0.00739839 s, 0.4 kB/s Data read (expecting 'foo'): foo PASS 9b (2s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 02:14:52 (1733642092) 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00122741 s, 0.8 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00189902 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00218819 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00209881 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00212385 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0021824 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00214671 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00218559 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00221608 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00209855 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00203024 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00198929 s, 0.5 kB/s PASS 10a (1s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 02:14:53 (1733642093) 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00241939 s, 1.3 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00532246 s, 770 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.000188102 s, 16.3 MB/s PASS 10b (2s) == sanityn test 11: execution of file opened for write should return error ============================================================== 02:14:55 (1733642095) multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.6973 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 301: /mnt/lustre2/d11/f: Text file busy PASS 11 (1s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 02:14:56 (1733642096) warning: '-runtime' deprecated, use '-t runtime' instead - link 3314 (time 1733642107.15 total 10.00 last 331.30) - link 6537 (time 1733642117.15 total 20.01 last 322.21) - link 9786 (time 1733642127.15 total 30.01 last 324.89) - link 13039 (time 1733642137.16 total 40.01 last 325.21) - link 16287 (time 1733642147.16 total 50.01 last 324.78) - link 19649 (time 1733642157.16 total 60.01 last 336.13) - link 22920 (time 1733642167.16 total 70.01 last 327.02) - link 26302 (time 1733642177.16 total 80.02 last 338.14) - link 29641 (time 1733642187.16 total 90.02 last 333.84) total: 32991 link in 100.00 seconds: 329.90 ops/second using seed 4143579189 running for 100 seconds - stat 10000 (time 1733642103 ; total 5 ; last 5) - stat 20000 (time 1733642107 ; total 9 ; last 4) - stat 30000 (time 1733642112 ; total 14 ; last 5) - stat 40000 (time 1733642117 ; total 19 ; last 5) - stat 50000 (time 1733642122 ; total 24 ; last 5) - stat 60000 (time 1733642127 ; total 29 ; last 5) - stat 70000 (time 1733642132 ; total 34 ; last 5) - stat 80000 (time 1733642137 ; total 39 ; last 5) - stat 90000 (time 1733642142 ; total 44 ; last 5) - stat 100000 (time 1733642146 ; total 48 ; last 4) - stat 110000 (time 1733642156 ; total 58 ; last 10) - stat 118450 (time 1733642167 ; total 69 ; last 11) - stat 120000 (time 1733642168 ; total 70 ; last 1) - stat 128718 (time 1733642179 ; total 81 ; last 11) - stat 130000 (time 1733642180 ; total 82 ; last 1) - stat 138615 (time 1733642191 ; total 93 ; last 11) - stat 140000 (time 1733642192 ; total 94 ; last 1) total: 146000 stats in 100 seconds: 1460.000000 stats/second - unlinked 0 (time 1733642148 ; total 0 ; last 0) - unlinked 10000 (time 1733642194 ; total 46 ; last 46) - unlinked 20000 (time 1733642220 ; total 72 ; last 26) - unlinked 30000 (time 1733642244 ; total 96 ; last 24) unlink(/mnt/lustre2/lockdir/lockfile32991) error: No such file or directory total: 32990 unlinks in 103 seconds: 320.291260 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (21970) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (21973) - No such process PASS 12 (156s) == sanityn test 13: test directory page revocation ======= 02:17:32 (1733642252) f13 f13 PASS 13 (1s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 02:17:33 (1733642253) multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.6973 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 336: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4858: 23372 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (2s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 02:17:35 (1733642255) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4858: 24006 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (1s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 02:17:36 (1733642256) truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 351: 24638 Terminated $DIR1/$tdir/sleep 60 PASS 14b (2s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 02:17:38 (1733642258) cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 363: 25272 Terminated $DIR1/$tdir/sleep 60 PASS 14c (1s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 02:17:39 (1733642259) chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 374: 25907 Terminated $DIR1/$tdir/sleep 60 PASS 14d (2s) == sanityn test 15: test out-of-space with multiple writers ===================================================================== 02:17:41 (1733642261) PATH=/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/opt/iozone/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin: mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_CODE=117440512 CLIENT_OS_VERSION_ID=7 STRIPECOUNT=2 ORIGFREE=7521280 MAXFREE=800000 SKIP: oos2 test_15 oos2.sh: 7521280kB free gt MAXFREE 800000kB, increase 800000 (or reduce test fs size) to proceed sleep 5 for ZFS MDS Waiting for MDT destroys to complete SKIP 15 (11s) == sanityn test 16a: 500 iterations of dual-mount fsx ==== 02:17:52 (1733642272) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.107166 s, 78.3 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.0950452 s, 88.3 MB/s Chance of close/open is 1 in 50 Seed set to 2273 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000004[1] 1733642273.326826 write 0x949930 thru 0x958454 (0xeb25 bytes) truncating to largest ever: 0x3ec54d 000006[1] 1733642273.340524 trunc from 0x958455 to 0x3ec54c (0x56bf08 bytes) 000008[1] 1733642273.353094 write 0x568bae thru 0x5745ff (0xba52 bytes) truncating to largest ever: 0x5cddd2 000009[1] 1733642273.357611 trunc from 0x574600 to 0x5cddd1 (0x597d2 bytes) 000012[1] 1733642273.366392 mapwrite 0x6a66c9 thru 0x6b0079 (0x99b1 bytes) 000013[1] 1733642273.393272 mapwrite 0x6ca673 thru 0x6cb1d1 (0xb5f bytes) 000014[1] 1733642273.412750 write 0x0cf6d7 thru 0x0d60bf (0x69e9 bytes) 000015[1] 1733642273.418872 mapread 0x11ba1a thru 0x125aed (0xa0d4 bytes) 000016[1] 1733642273.426178 read 0x446b8c thru 0x456427 (0xf89c bytes) 000017[0] 1733642273.429739 read 0x50a01a thru 0x511cd4 (0x7cbb bytes) 000018[1] 1733642273.435101 mapwrite 0x3cb39f thru 0x3d18c2 (0x6524 bytes) 000019[0] 1733642273.452981 write 0x3d6e73 thru 0x3e4997 (0xdb25 bytes) 000022[0] 1733642273.459174 trunc from 0x6cb1d2 to 0x04e985 (0x67c84c bytes) 000023[1] 1733642273.465330 write 0x2bcf9e thru 0x2cc224 (0xf287 bytes) 000025[1] 1733642273.476741 read 0x25627d thru 0x25be5d (0x5be1 bytes) 000026[1] 1733642273.492991 mapwrite 0x3f79d2 thru 0x3fd124 (0x5753 bytes) 000028[0] 1733642273.524550 write 0x05dd9f thru 0x062da4 (0x5006 bytes) 000029[0] 1733642273.535194 read 0x249b07 thru 0x250970 (0x6e6a bytes) 000031[0] 1733642273.561204 trunc from 0x3fd125 to 0x235013 (0x1c8111 bytes) 000033[1] 1733642273.573248 read 0x1a7cdc thru 0x1b7827 (0xfb4c bytes) 000034[1] 1733642273.596042 mapwrite 0x7a6c6e thru 0x7b19d5 (0xad68 bytes) 000035[0] 1733642273.633689 mapwrite 0x6b413d thru 0x6c39a8 (0xf86c bytes) 000036[1] 1733642273.675950 mapread 0x04e535 thru 0x05c791 (0xe25d bytes) 000037[1] 1733642273.697669 mapwrite 0x3badd4 thru 0x3c346d (0x869a bytes) 000041[0] 1733642273.724669 trunc from 0x7b19d6 to 0x3c3952 (0x3ee083 bytes) 000042[1] 1733642273.736158 read 0x387b94 thru 0x397337 (0xf7a4 bytes) 000045[1] 1733642273.769708 mapwrite 0x34a20b thru 0x350792 (0x6588 bytes) 000046[1] 1733642273.809883 mapwrite 0x8a150f thru 0x8a5dd3 (0x48c5 bytes) 000047[1] 1733642273.850194 mapwrite 0x8bf878 thru 0x8c613b (0x68c4 bytes) 000048[0] 1733642273.871992 read 0x2a6ea1 thru 0x2a732f (0x48f bytes) truncating to largest ever: 0x9f9417 000052[1] 1733642273.902090 trunc from 0x8c613c to 0x9f9416 (0x1332db bytes) 000054[1] 1733642273.916063 read 0x49c9e3 thru 0x4a867d (0xbc9b bytes) 000055[0] 1733642273.916468 read 0x2474ef thru 0x24c524 (0x5036 bytes) 000057[1] 1733642273.942655 read 0x641c4e thru 0x64b0bd (0x9470 bytes) 000059[0] 1733642273.943143 mapread 0x81dab9 thru 0x81f30d (0x1855 bytes) 000061[0] 1733642273.952132 write 0x3c6208 thru 0x3c756b (0x1364 bytes) 000064[0] 1733642273.970075 mapwrite 0x843073 thru 0x84e7d9 (0xb767 bytes) 000066[0] 1733642274.004048 mapwrite 0x691451 thru 0x697d11 (0x68c1 bytes) 000068[1] 1733642274.049015 read 0x089cc7 thru 0x08ef2b (0x5265 bytes) 000069[0] 1733642274.068925 read 0x3e5183 thru 0x3f3f3b (0xedb9 bytes) 000070[0] 1733642274.096642 read 0x06cea5 thru 0x076b7f (0x9cdb bytes) 000074[1] 1733642274.104907 mapwrite 0x312823 thru 0x31f6e1 (0xcebf bytes) 000076[1] 1733642274.157692 read 0x74b6fa thru 0x755d3e (0xa645 bytes) 000078[1] 1733642274.196075 write 0x574d02 thru 0x57db94 (0x8e93 bytes) 000080[1] 1733642274.208159 read 0x6c27a2 thru 0x6cccea (0xa549 bytes) 000081[0] 1733642274.225886 mapwrite 0x67300f thru 0x682703 (0xf6f5 bytes) 000085[1] 1733642274.281834 read 0x5591f7 thru 0x56888c (0xf696 bytes) 000087[0] 1733642274.293531 read 0x9685fa thru 0x975bf3 (0xd5fa bytes) 000092[1] 1733642274.332325 mapread 0x6d8625 thru 0x6e36ef (0xb0cb bytes) 000096[1] 1733642274.339498 write 0x948ae7 thru 0x94fe41 (0x735b bytes) 000097[0] 1733642274.351637 mapwrite 0x4d6cf4 thru 0x4de8ff (0x7c0c bytes) 000099[0] 1733642274.396101 mapread 0x2174bf thru 0x222eeb (0xba2d bytes) 000100[1] 1733642274.414309 mapwrite 0x058565 thru 0x05d4ce (0x4f6a bytes) 000101[0] 1733642274.435421 trunc from 0x9f9417 to 0x2d0cf0 (0x728726 bytes) 000102[0] 1733642274.441970 trunc from 0x2d0cf1 to 0x5f13de (0x3206ee bytes) 000110[0] 1733642274.461051 mapread 0x3710a5 thru 0x375cd2 (0x4c2e bytes) 000111[0] 1733642274.470241 trunc from 0x5f13df to 0x6f16b5 (0x1002d7 bytes) 000117[0] 1733642274.489849 mapwrite 0x9957c0 thru 0x9a2155 (0xc996 bytes) 000118[0] 1733642274.522108 mapwrite 0x9e3b1a thru 0x9e8f4e (0x5435 bytes) 000119[1] 1733642274.543447 trunc from 0x9e8f4f to 0x174ba9 (0x8743a5 bytes) 000121[0] 1733642274.554646 read 0x06a66f thru 0x0706fc (0x608e bytes) 000122[0] 1733642274.566028 mapread 0x00a432 thru 0x011ac5 (0x7694 bytes) 000123[1] 1733642274.571411 trunc from 0x174baa to 0x77e4fb (0x609952 bytes) 000124[1] 1733642274.579598 write 0x027783 thru 0x029a2f (0x22ad bytes) 000125[1] 1733642274.582127 read 0x6b85c5 thru 0x6c5e46 (0xd882 bytes) 000128[1] 1733642274.612521 mapread 0x09e160 thru 0x0ac146 (0xdfe7 bytes) 000129[0] 1733642274.613288 read 0x52de52 thru 0x53d02b (0xf1da bytes) 000130[1] 1733642274.636523 read 0x711c1a thru 0x720e00 (0xf1e7 bytes) 000131[1] 1733642274.657692 write 0x3cfcc5 thru 0x3dfc20 (0xff5c bytes) 000132[0] 1733642274.658441 read 0x226fbf thru 0x233f65 (0xcfa7 bytes) 000136[1] 1733642274.689118 mapwrite 0x9dc958 thru 0x9e074a (0x3df3 bytes) 000137[0] 1733642274.737880 write 0x43741c thru 0x43d3da (0x5fbf bytes) 000139[0] 1733642274.755292 write 0x87f3ba thru 0x889887 (0xa4ce bytes) 000142[1] 1733642274.781678 mapwrite 0x546dc9 thru 0x5485d3 (0x180b bytes) 000143[0] 1733642274.804159 trunc from 0x9e074b to 0x3e86b5 (0x5f8095 bytes) 000144[0] 1733642274.811151 write 0x30c833 thru 0x316aac (0xa27a bytes) 000149[1] 1733642274.825708 mapwrite 0x568a7c thru 0x56f845 (0x6dca bytes) 000151[1] 1733642274.863837 write 0x93c3eb thru 0x93f400 (0x3016 bytes) 000152[0] 1733642274.868507 mapread 0x0e8c6f thru 0x0eaeaf (0x2241 bytes) 000154[0] 1733642274.882648 read 0x65fc8f thru 0x6634c3 (0x3835 bytes) 000157[0] 1733642274.908369 trunc from 0x93f401 to 0x3d7bcf (0x567831 bytes) 000159[0] 1733642274.932091 mapread 0x1d5268 thru 0x1e4bdc (0xf975 bytes) 000160[0] 1733642274.951926 mapread 0x06f674 thru 0x071c6c (0x25f9 bytes) 000161[0] 1733642274.958997 read 0x054ee9 thru 0x05f7a0 (0xa8b8 bytes) 000163[0] 1733642274.978601 mapread 0x15f196 thru 0x1673f1 (0x825c bytes) 000166[1] 1733642274.982927 trunc from 0x3d7bd0 to 0x06b357 (0x36c878 bytes) 000170[1] 1733642274.999387 mapread 0x0160e8 thru 0x023bbd (0xdad6 bytes) 000172[0] 1733642275.006038 read 0x03396d thru 0x036723 (0x2db7 bytes) 000174[0] 1733642275.019549 read 0x04719a thru 0x0509e7 (0x984e bytes) 000175[1] 1733642275.020711 trunc from 0x06b358 to 0x2f5e2b (0x28aad4 bytes) 000177[1] 1733642275.027313 trunc from 0x2f5e2c to 0x4018e3 (0x10bab8 bytes) 000178[0] 1733642275.034660 write 0x3141a3 thru 0x3178f5 (0x3753 bytes) 000179[1] 1733642275.061350 trunc from 0x4018e4 to 0x6973bc (0x295ad9 bytes) 000180[0] 1733642275.075581 mapwrite 0x1d353a thru 0x1d3ac4 (0x58b bytes) 000181[0] 1733642275.094489 mapread 0x5bea8c thru 0x5c73ff (0x8974 bytes) 000183[1] 1733642275.115663 mapread 0x4f7992 thru 0x4fe291 (0x6900 bytes) 000184[0] 1733642275.126688 read 0x15f57b thru 0x16a2bf (0xad45 bytes) 000187[1] 1733642275.148460 mapread 0x24f51e thru 0x25e693 (0xf176 bytes) 000188[0] 1733642275.162823 read 0x0d9240 thru 0x0e72c8 (0xe089 bytes) 000190[0] 1733642275.179952 write 0x4c5f4c thru 0x4d2d05 (0xcdba bytes) 000191[1] 1733642275.190303 mapwrite 0x265024 thru 0x26d133 (0x8110 bytes) 000193[0] 1733642275.218883 mapread 0x294ae8 thru 0x29718e (0x26a7 bytes) 000196[1] 1733642275.227248 trunc from 0x6973bd to 0x983e76 (0x2ecaba bytes) 000198[0] 1733642275.241870 write 0x5db149 thru 0x5df8ae (0x4766 bytes) 000200[1] 1733642275.260726 write 0x59373d thru 0x596602 (0x2ec6 bytes) 000201[0] 1733642275.273496 mapread 0x4c536d thru 0x4ced76 (0x9a0a bytes) 000204[0] 1733642275.298046 write 0x302a23 thru 0x3108f3 (0xded1 bytes) 000205[0] 1733642275.309940 trunc from 0x983e77 to 0x0dfbc9 (0x8a42ad bytes) 000210[1] 1733642275.333822 read 0x0122ea thru 0x020d73 (0xea8a bytes) 000211[0] 1733642275.341717 mapread 0x037753 thru 0x038284 (0xb32 bytes) 000213[1] 1733642275.352799 write 0x0c12aa thru 0x0cdd88 (0xcadf bytes) 000214[0] 1733642275.361137 mapwrite 0x0bf38c thru 0x0cd9e9 (0xe65e bytes) 000217[1] 1733642275.395630 mapread 0x048aef thru 0x05356a (0xaa7c bytes) 000219[0] 1733642275.404609 write 0x36f609 thru 0x379ddf (0xa7d7 bytes) 000220[0] 1733642275.407536 trunc from 0x379de0 to 0x9314dc (0x5b76fd bytes) 000222[0] 1733642275.417510 mapread 0x379727 thru 0x37f89d (0x6177 bytes) 000223[1] 1733642275.424212 mapread 0x6182da thru 0x61a7b7 (0x24de bytes) 000224[0] 1733642275.438765 mapread 0x4b9aea thru 0x4c61bb (0xc6d2 bytes) 000225[1] 1733642275.457942 write 0x08bb54 thru 0x08d742 (0x1bef bytes) 000231[0] 1733642275.476440 mapwrite 0x894459 thru 0x89d7de (0x9386 bytes) 000232[1] 1733642275.510047 mapwrite 0x2001b4 thru 0x201806 (0x1653 bytes) 000235[1] 1733642275.530041 trunc from 0x9314dd to 0x744c17 (0x1ec8c5 bytes) 000237[0] 1733642275.536718 mapwrite 0x6edf89 thru 0x6eea40 (0xab8 bytes) 000240[0] 1733642275.564930 mapwrite 0x73f621 thru 0x74b934 (0xc314 bytes) 000243[0] 1733642275.607488 mapread 0x0bf342 thru 0x0c62cc (0x6f8b bytes) 000244[0] 1733642275.616967 read 0x1576d6 thru 0x15c045 (0x4970 bytes) 000245[0] 1733642275.641524 trunc from 0x74b935 to 0x6f03cc (0x5b568 bytes) 000248[1] 1733642275.655129 trunc from 0x6f03cd to 0x6bfbe2 (0x307ea bytes) 000249[1] 1733642275.671662 mapwrite 0x5b4df6 thru 0x5c0d02 (0xbf0d bytes) 000250[1] 1733642275.695072 mapwrite 0x6a1be2 thru 0x6a6619 (0x4a38 bytes) 000251[1] 1733642275.708724 write 0x8e966c thru 0x8f8571 (0xef06 bytes) 000253[1] 1733642275.713461 mapread 0x7aa59c thru 0x7ad52b (0x2f90 bytes) 000258[1] 1733642275.730192 trunc from 0x8f8572 to 0x8defc3 (0x195ae bytes) 000260[0] 1733642275.739862 mapread 0x598853 thru 0x5a04fa (0x7ca8 bytes) 000261[1] 1733642275.759560 mapread 0x156fc1 thru 0x166e67 (0xfea7 bytes) 000263[0] 1733642275.766319 write 0x5065fe thru 0x507cf1 (0x16f4 bytes) 000264[0] 1733642275.775055 mapread 0x6cbeac thru 0x6ce385 (0x24da bytes) 000267[0] 1733642275.794130 mapread 0x172ed0 thru 0x17d228 (0xa359 bytes) 000268[1] 1733642275.821743 trunc from 0x8defc4 to 0x2d0a66 (0x60e55d bytes) 000271[0] 1733642275.836254 write 0x1dff05 thru 0x1e970e (0x980a bytes) 000276[1] 1733642275.858744 write 0x5174c7 thru 0x517684 (0x1be bytes) 000277[0] 1733642275.863119 write 0x5da9e7 thru 0x5e5fc4 (0xb5de bytes) 000280[0] 1733642275.874528 trunc from 0x5e5fc5 to 0x465dfb (0x1801c9 bytes) 000283[0] 1733642275.884459 read 0x2a8827 thru 0x2b3ccb (0xb4a5 bytes) 000284[0] 1733642275.905987 trunc from 0x465dfc to 0x255ea8 (0x20ff53 bytes) 000287[1] 1733642275.923511 read 0x244da0 thru 0x253e62 (0xf0c3 bytes) 000290[1] 1733642275.952689 trunc from 0x255ea9 to 0x52359f (0x2cd6f7 bytes) 000292[1] 1733642275.968626 mapwrite 0x199814 thru 0x19d725 (0x3f12 bytes) 000293[0] 1733642276.000105 write 0x73b706 thru 0x748d9f (0xd69a bytes) 000296[0] 1733642276.014890 mapwrite 0x6b66f5 thru 0x6c0235 (0x9b41 bytes) 000297[1] 1733642276.045389 mapwrite 0x4bed15 thru 0x4c6992 (0x7c7e bytes) 000299[0] 1733642276.088057 read 0x376919 thru 0x37ebfb (0x82e3 bytes) 000300[0] 1733642276.108869 trunc from 0x748da0 to 0x63017c (0x118c23 bytes) 000303[1] 1733642276.129459 write 0x344972 thru 0x3465f2 (0x1c81 bytes) 000306[1] 1733642276.143215 trunc from 0x63017d to 0x0f5f55 (0x53a227 bytes) 000311[1] 1733642276.153550 read 0x0ac735 thru 0x0b9cb0 (0xd57c bytes) 000314[1] 1733642276.165056 read 0x06d114 thru 0x079349 (0xc236 bytes) 000316[1] 1733642276.171887 trunc from 0x0f5f56 to 0x49e349 (0x3a83f4 bytes) 000319[1] 1733642276.177403 read 0x14d751 thru 0x15c4a5 (0xed55 bytes) 000321[1] 1733642276.201142 trunc from 0x49e34a to 0x05b9ef (0x44295a bytes) 000323[0] 1733642276.208912 mapread 0x04043f thru 0x045c83 (0x5845 bytes) 000324[0] 1733642276.223822 trunc from 0x05b9f0 to 0x48585b (0x429e6c bytes) 000327[0] 1733642276.240073 trunc from 0x48585c to 0x55a52f (0xd4cd4 bytes) 000328[1] 1733642276.247761 write 0x280584 thru 0x283a84 (0x3501 bytes) 000329[0] 1733642276.255675 mapwrite 0x92ed1c thru 0x92f1b5 (0x49a bytes) 000331[0] 1733642276.298447 write 0x547e3b thru 0x55300d (0xb1d3 bytes) 000332[1] 1733642276.300368 trunc from 0x92f1b6 to 0x4f415c (0x43b059 bytes) 000336[1] 1733642276.323066 mapread 0x0e38c6 thru 0x0e9932 (0x606d bytes) 000337[1] 1733642276.334668 read 0x4e98d9 thru 0x4ee102 (0x482a bytes) 000338[1] 1733642276.338716 read 0x05d080 thru 0x06c347 (0xf2c8 bytes) 000343[1] 1733642276.367187 mapwrite 0x5d7618 thru 0x5e1f2c (0xa915 bytes) 000346[0] 1733642276.396823 write 0x00a72b thru 0x0157cb (0xb0a1 bytes) 000347[0] 1733642276.408160 trunc from 0x5e1f2d to 0x65b3cc (0x794a0 bytes) 000348[1] 1733642276.416081 write 0x310a73 thru 0x31264c (0x1bda bytes) 000349[1] 1733642276.427032 mapread 0x0cf790 thru 0x0d6115 (0x6986 bytes) 000351[0] 1733642276.444769 mapwrite 0x726c5a thru 0x73068c (0x9a33 bytes) 000353[1] 1733642276.479052 mapwrite 0x7ff312 thru 0x803c61 (0x4950 bytes) 000354[0] 1733642276.514139 mapread 0x0d7013 thru 0x0e5aef (0xeadd bytes) 000355[1] 1733642276.534298 mapwrite 0x4769b4 thru 0x480d94 (0xa3e1 bytes) 000356[0] 1733642276.559131 write 0x4d5d41 thru 0x4e09af (0xac6f bytes) 000357[1] 1733642276.566729 trunc from 0x803c62 to 0x0f544f (0x70e812 bytes) 000358[0] 1733642276.579563 mapread 0x063789 thru 0x0704ba (0xcd32 bytes) 000359[1] 1733642276.599517 trunc from 0x0f5450 to 0x30ea12 (0x2195c3 bytes) 000360[1] 1733642276.605692 trunc from 0x30ea13 to 0x396815 (0x87e03 bytes) 000363[1] 1733642276.617561 trunc from 0x396816 to 0x6156a1 (0x27ee8c bytes) 000364[0] 1733642276.622292 mapwrite 0x4cbb39 thru 0x4cc660 (0xb28 bytes) 000365[1] 1733642276.642089 trunc from 0x6156a2 to 0x379d91 (0x29b910 bytes) 000366[0] 1733642276.651671 read 0x0aeb4b thru 0x0b4fc8 (0x647e bytes) 000367[1] 1733642276.674343 trunc from 0x379d92 to 0x5611b5 (0x1e7424 bytes) 000368[1] 1733642276.684556 read 0x3a79e1 thru 0x3a9444 (0x1a64 bytes) 000371[1] 1733642276.722549 mapread 0x08fd69 thru 0x09e478 (0xe710 bytes) 000377[1] 1733642276.731690 read 0x4628cd thru 0x47107a (0xe7ae bytes) 000378[1] 1733642276.735608 write 0x966f6d thru 0x969ac1 (0x2b55 bytes) 000379[0] 1733642276.740510 mapread 0x270216 thru 0x272bad (0x2998 bytes) 000381[0] 1733642276.765132 read 0x105387 thru 0x107ba1 (0x281b bytes) 000382[1] 1733642276.788401 mapwrite 0x86fc31 thru 0x8780bc (0x848c bytes) 000383[0] 1733642276.837252 mapwrite 0x106314 thru 0x112994 (0xc681 bytes) 000385[1] 1733642276.875124 write 0x35ffae thru 0x36e755 (0xe7a8 bytes) 000387[0] 1733642276.883015 mapread 0x2c1fad thru 0x2cab72 (0x8bc6 bytes) 000389[0] 1733642276.899878 mapread 0x468a96 thru 0x46cfe8 (0x4553 bytes) 000392[1] 1733642276.914839 mapread 0x8b2d4b thru 0x8b667b (0x3931 bytes) 000394[0] 1733642276.921103 read 0x69635c thru 0x69653a (0x1df bytes) 000396[1] 1733642276.926327 mapread 0x76520d thru 0x76e5bf (0x93b3 bytes) 000397[0] 1733642276.941331 write 0x0c9a07 thru 0x0d95e2 (0xfbdc bytes) 000401[1] 1733642276.956794 mapread 0x51d9ca thru 0x52b16b (0xd7a2 bytes) 000404[0] 1733642276.984685 read 0x8a97cf thru 0x8aca8c (0x32be bytes) 000406[0] 1733642277.011409 trunc from 0x969ac2 to 0x752830 (0x217291 bytes) 000407[0] 1733642277.022829 mapwrite 0x6e3415 thru 0x6eda70 (0xa65c bytes) 000408[0] 1733642277.049585 mapread 0x21bd59 thru 0x2221b2 (0x645a bytes) 000411[1] 1733642277.061502 read 0x573f9d thru 0x5780ac (0x4110 bytes) 000413[1] 1733642277.076893 write 0x51630e thru 0x522ad9 (0xc7cc bytes) 000415[0] 1733642277.088576 mapread 0x5f5dc2 thru 0x5fdcf8 (0x7f37 bytes) 000416[1] 1733642277.104336 mapwrite 0x497387 thru 0x49aa24 (0x369e bytes) 000417[1] 1733642277.125801 mapread 0x657a85 thru 0x65a7c1 (0x2d3d bytes) 000420[1] 1733642277.142401 read 0x6ffdc2 thru 0x703854 (0x3a93 bytes) 000422[0] 1733642277.154059 write 0x605dea thru 0x6066ed (0x904 bytes) 000425[1] 1733642277.165380 trunc from 0x752831 to 0x3f01de (0x362652 bytes) 000427[0] 1733642277.185800 trunc from 0x3f01df to 0x037e61 (0x3b837d bytes) 000430[1] 1733642277.200032 trunc from 0x037e62 to 0x461766 (0x429905 bytes) 000431[1] 1733642277.208062 write 0x7b9bb2 thru 0x7c3514 (0x9963 bytes) 000434[1] 1733642277.214340 trunc from 0x7c3515 to 0x9bce08 (0x1f98f4 bytes) 000439[0] 1733642277.228354 trunc from 0x9bce09 to 0x2557fe (0x76760a bytes) 000440[1] 1733642277.241502 mapread 0x042eb6 thru 0x04bf98 (0x90e3 bytes) 000443[0] 1733642277.264125 trunc from 0x2557ff to 0x834a86 (0x5df288 bytes) 000446[0] 1733642277.278064 read 0x672ab7 thru 0x6772f8 (0x4842 bytes) 000450[0] 1733642277.314616 mapread 0x6c523b thru 0x6c7789 (0x254f bytes) 000451[1] 1733642277.318217 mapread 0x611135 thru 0x61e5c4 (0xd490 bytes) 000452[0] 1733642277.341298 trunc from 0x834a87 to 0x1c98f0 (0x66b196 bytes) 000453[0] 1733642277.352627 read 0x02562e thru 0x03317a (0xdb4d bytes) 000457[0] 1733642277.364591 write 0x900646 thru 0x904c80 (0x463b bytes) 000459[1] 1733642277.370099 mapwrite 0x49daf6 thru 0x4ab3ae (0xd8b9 bytes) 000462[0] 1733642277.464028 trunc from 0x904c81 to 0x8080be (0xfcbc2 bytes) 000466[1] 1733642277.475588 read 0x6e2d24 thru 0x6e6264 (0x3541 bytes) 000468[1] 1733642277.483877 read 0x394b59 thru 0x399720 (0x4bc8 bytes) 000469[0] 1733642277.513588 mapread 0x17a8e8 thru 0x17e2a8 (0x39c1 bytes) 000471[0] 1733642277.532328 read 0x3ccea1 thru 0x3d906a (0xc1ca bytes) 000472[1] 1733642277.532701 write 0x1ed5bb thru 0x1f6d58 (0x979e bytes) 000475[0] 1733642277.546806 write 0x0186ef thru 0x01f3a4 (0x6cb6 bytes) 000478[1] 1733642277.573605 mapread 0x217605 thru 0x21e171 (0x6b6d bytes) 000480[0] 1733642277.592958 trunc from 0x8080bf to 0x4f6bff (0x3114bf bytes) 000483[0] 1733642277.608320 read 0x12bbd4 thru 0x12d446 (0x1873 bytes) 000487[1] 1733642277.636040 mapread 0x0c4f4a thru 0x0cf1f4 (0xa2ab bytes) 000489[0] 1733642277.659895 read 0x12f581 thru 0x13e105 (0xeb85 bytes) 000490[0] 1733642277.678267 read 0x3ba4fa thru 0x3c8308 (0xde0f bytes) 000491[1] 1733642277.678580 write 0x6260a6 thru 0x6328c5 (0xc820 bytes) 000492[1] 1733642277.682668 mapwrite 0x4ba4d0 thru 0x4c504e (0xab7f bytes) 000493[1] 1733642277.711141 read 0x5e63df thru 0x5f2e35 (0xca57 bytes) 000496[1] 1733642277.734262 read 0x35d99c thru 0x36aa64 (0xd0c9 bytes) 000497[0] 1733642277.734549 trunc from 0x6328c6 to 0x866668 (0x233da3 bytes) 000499[0] 1733642277.746864 trunc from 0x866669 to 0x6c4999 (0x1a1ccf bytes) 000500[0] 1733642277.749833 mapread 0x007a11 thru 0x00d81d (0x5e0d bytes) All operations completed A-OK! Chance of close/open is 1 in 50 Seed set to 2277 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x27e0da 000003[0] 1733642277.965094 trunc from 00000000 to 0x27e0d9 (0x27e0da bytes) 000004[1] 1733642277.973545 write_OD 0x741000 thru 0x74cfff (0xc000 bytes) truncating to largest ever: 0x43b885 000008[1] 1733642277.988844 trunc from 0x74d000 to 0x43b884 (0x31177b bytes) truncating to largest ever: 0x90265e 000009[0] 1733642277.994745 trunc from 0x43b885 to 0x90265d (0x4c6dd9 bytes) 000011[0] 1733642278.005959 mapread 0x7b6000 thru 0x7c3057 (0xd058 bytes) 000014[1] 1733642278.016405 write_OD 0x6e9000 thru 0x6f5fff (0xd000 bytes) 000015[1] 1733642278.027369 mapread 0x213000 thru 0x21c943 (0x9944 bytes) 000016[1] 1733642278.032852 mapread 0x0ac000 thru 0x0aef58 (0x2f59 bytes) 000017[1] 1733642278.037181 mapread 0x617000 thru 0x61db63 (0x6b64 bytes) 000020[0] 1733642278.041877 mapread 0x13d000 thru 0x146f43 (0x9f44 bytes) 000024[0] 1733642278.046843 mapread 0x2b9000 thru 0x2c89c1 (0xf9c2 bytes) 000027[1] 1733642278.053648 mapwrite 0x10b000 thru 0x113abf (0x8ac0 bytes) 000028[1] 1733642278.078766 write_OD 0x970000 thru 0x977fff (0x8000 bytes) truncating to largest ever: 0x99977e 000030[1] 1733642278.090504 trunc from 0x978000 to 0x99977d (0x2177e bytes) 000031[0] 1733642278.096211 write_OD 0x0d2000 thru 0x0e0fff (0xf000 bytes) 000036[0] 1733642278.109656 mapwrite 0x173000 thru 0x17fdb7 (0xcdb8 bytes) 000043[1] 1733642278.139915 mapread 0x1df000 thru 0x1e6085 (0x7086 bytes) 000045[0] 1733642278.146880 write_OD 0x178000 thru 0x17bfff (0x4000 bytes) 000048[0] 1733642278.157236 mapread 0x4f8000 thru 0x4fa394 (0x2395 bytes) 000049[0] 1733642278.161480 mapwrite 0x888000 thru 0x890d92 (0x8d93 bytes) 000051[1] 1733642278.184741 mapread 0x168000 thru 0x176e4a (0xee4b bytes) 000052[1] 1733642278.193002 mapread 0x316000 thru 0x31f2c3 (0x92c4 bytes) 000053[0] 1733642278.202272 trunc from 0x99977e to 0x35fb57 (0x639c26 bytes) 000055[0] 1733642278.215852 write_OD 0x40d000 thru 0x410fff (0x4000 bytes) 000057[1] 1733642278.227994 mapread 0x0f2000 thru 0x0fb6f3 (0x96f4 bytes) 000059[0] 1733642278.233197 trunc from 0x411000 to 0x22de5f (0x1e31a0 bytes) 000060[1] 1733642278.238740 write_OD 0x6aa000 thru 0x6b5fff (0xc000 bytes) 000061[0] 1733642278.250632 trunc from 0x6b6000 to 0x324703 (0x3918fc bytes) 000063[1] 1733642278.261035 trunc from 0x324704 to 0x082e5e (0x2a18a5 bytes) 000067[0] 1733642278.275022 mapread 0x029000 thru 0x032ef9 (0x9efa bytes) 000068[0] 1733642278.282632 mapwrite 0x4f8000 thru 0x4f9445 (0x1446 bytes) 000071[0] 1733642278.310374 read_OD 0x09e000 thru 0x0a3fff (0x6000 bytes) 000073[1] 1733642278.314847 trunc from 0x4f9446 to 0x013f9f (0x4e54a6 bytes) 000074[0] 1733642278.323081 trunc from 0x013fa0 to 0x6f2573 (0x6de5d4 bytes) 000075[0] 1733642278.328278 mapread 0x662000 thru 0x6662e5 (0x42e6 bytes) 000076[1] 1733642278.336120 trunc from 0x6f2574 to 0x5c40f7 (0x12e47c bytes) 000079[0] 1733642278.345146 write_OD 0x457000 thru 0x45bfff (0x5000 bytes) 000080[1] 1733642278.356124 write_OD 0x478000 thru 0x478fff (0x1000 bytes) 000082[0] 1733642278.365056 mapread 0x0b1000 thru 0x0bcc38 (0xbc39 bytes) 000084[1] 1733642278.370761 mapwrite 0x77a000 thru 0x787005 (0xd006 bytes) 000088[1] 1733642278.401703 trunc from 0x787006 to 0x6b4e34 (0xd21d1 bytes) 000089[0] 1733642278.409095 read_OD 0x3e4000 thru 0x3f0fff (0xd000 bytes) 000091[1] 1733642278.415746 mapwrite 0x31b000 thru 0x328f16 (0xdf17 bytes) 000092[1] 1733642278.433464 mapwrite 0x6cd000 thru 0x6ce9fa (0x19fb bytes) 000093[1] 1733642278.452252 write_OD 0x296000 thru 0x2a4fff (0xf000 bytes) 000096[1] 1733642278.465239 trunc from 0x6ce9fb to 0x827898 (0x158e9e bytes) 000098[1] 1733642278.478020 mapwrite 0x696000 thru 0x6a5beb (0xfbec bytes) 000103[1] 1733642278.507198 trunc from 0x827899 to 0x2cd427 (0x55a471 bytes) 000104[1] 1733642278.514655 read_OD 0x00e000 thru 0x013fff (0x6000 bytes) 000105[0] 1733642278.518217 trunc from 0x2cd428 to 0x8c0b1c (0x5f36f5 bytes) 000108[1] 1733642278.523829 write_OD 0x86f000 thru 0x874fff (0x6000 bytes) 000110[1] 1733642278.536035 write_OD 0x209000 thru 0x20efff (0x6000 bytes) 000114[0] 1733642278.546569 mapread 0x2c3000 thru 0x2c642e (0x342f bytes) 000115[0] 1733642278.582285 mapwrite 0x8eb000 thru 0x8f887b (0xd87c bytes) 000117[1] 1733642278.616717 mapwrite 0x80a000 thru 0x811a67 (0x7a68 bytes) 000119[0] 1733642278.643540 write_OD 0x361000 thru 0x367fff (0x7000 bytes) 000123[0] 1733642278.657747 read_OD 0x0b4000 thru 0x0bcfff (0x9000 bytes) 000125[1] 1733642278.659901 mapwrite 0x2e1000 thru 0x2e345e (0x245f bytes) 000127[1] 1733642278.679170 mapread 0x719000 thru 0x7264b4 (0xd4b5 bytes) 000128[0] 1733642278.689707 read_OD 0x02f000 thru 0x03cfff (0xe000 bytes) 000130[0] 1733642278.695765 mapwrite 0x5fa000 thru 0x5fd96f (0x3970 bytes) 000131[0] 1733642278.742722 mapwrite 0x5ae000 thru 0x5b90b9 (0xb0ba bytes) 000132[0] 1733642278.757746 read_OD 0x82d000 thru 0x82dfff (0x1000 bytes) 000134[1] 1733642278.770432 mapwrite 0x053000 thru 0x062dab (0xfdac bytes) 000135[0] 1733642278.792215 mapwrite 0x54f000 thru 0x556731 (0x7732 bytes) 000136[0] 1733642278.842210 read_OD 0x223000 thru 0x223fff (0x1000 bytes) 000138[0] 1733642278.854745 mapread 0x2b1000 thru 0x2bf1ee (0xe1ef bytes) 000139[0] 1733642278.884410 trunc from 0x8f887c to 0x4ecfff (0x40b87c bytes) 000146[0] 1733642278.909806 mapread 0x45e000 thru 0x462b8a (0x4b8b bytes) 000147[1] 1733642278.915193 mapread 0x082000 thru 0x087160 (0x5161 bytes) 000148[1] 1733642278.921477 mapread 0x2df000 thru 0x2e3a1d (0x4a1e bytes) 000149[1] 1733642278.926769 read_OD 0x0ca000 thru 0x0cafff (0x1000 bytes) 000150[0] 1733642278.928244 write_OD 0x5e4000 thru 0x5ebfff (0x8000 bytes) 000151[0] 1733642278.941031 read_OD 0x155000 thru 0x162fff (0xe000 bytes) 000152[0] 1733642278.944412 read_OD 0x06c000 thru 0x079fff (0xe000 bytes) 000157[1] 1733642278.947369 mapread 0x0ca000 thru 0x0cd0c4 (0x30c5 bytes) 000160[0] 1733642278.971709 mapread 0x24c000 thru 0x25af46 (0xef47 bytes) 000162[1] 1733642278.992862 write_OD 0x20d000 thru 0x21afff (0xe000 bytes) 000163[0] 1733642279.011021 trunc from 0x5ec000 to 0x1c544a (0x426bb5 bytes) 000164[0] 1733642279.017375 mapwrite 0x30c000 thru 0x31b9e3 (0xf9e4 bytes) 000165[0] 1733642279.052796 read_OD 0x22b000 thru 0x22ffff (0x5000 bytes) 000166[1] 1733642279.057378 read_OD 0x275000 thru 0x276fff (0x2000 bytes) 000170[0] 1733642279.060172 mapwrite 0x6aa000 thru 0x6b96ac (0xf6ad bytes) 000171[0] 1733642279.104973 trunc from 0x6b96ad to 0x296ed7 (0x4227d5 bytes) 000172[1] 1733642279.112465 mapread 0x03f000 thru 0x04c57e (0xd57f bytes) 000173[1] 1733642279.131906 write_OD 0x05a000 thru 0x067fff (0xe000 bytes) 000177[0] 1733642279.147996 mapread 0x236000 thru 0x23dff4 (0x7ff5 bytes) 000178[0] 1733642279.156440 write_OD 0x906000 thru 0x913fff (0xe000 bytes) 000180[0] 1733642279.168695 write_OD 0x374000 thru 0x374fff (0x1000 bytes) 000183[0] 1733642279.180046 mapread 0x230000 thru 0x232671 (0x2672 bytes) 000185[1] 1733642279.194381 write_OD 0x663000 thru 0x669fff (0x7000 bytes) 000186[0] 1733642279.207760 mapread 0x0da000 thru 0x0dc993 (0x2994 bytes) 000188[0] 1733642279.212253 write_OD 0x2b1000 thru 0x2bffff (0xf000 bytes) 000191[0] 1733642279.223446 mapread 0x260000 thru 0x26836b (0x836c bytes) 000192[0] 1733642279.234078 mapread 0x84e000 thru 0x8520e8 (0x40e9 bytes) 000193[0] 1733642279.239575 trunc from 0x914000 to 0x27b6d4 (0x69892b bytes) 000196[1] 1733642279.250359 mapread 0x0ed000 thru 0x0eec1b (0x1c1c bytes) 000197[1] 1733642279.256215 mapwrite 0x77a000 thru 0x786ed3 (0xced4 bytes) 000198[0] 1733642279.296874 mapread 0x273000 thru 0x276dfa (0x3dfb bytes) 000200[0] 1733642279.309696 mapread 0x2ea000 thru 0x2ef6e1 (0x56e2 bytes) 000201[0] 1733642279.315877 write_OD 0x277000 thru 0x280fff (0xa000 bytes) 000202[0] 1733642279.329545 mapread 0x0fe000 thru 0x100808 (0x2809 bytes) 000203[0] 1733642279.333093 mapwrite 0x9c9000 thru 0x9c906d (0x6e bytes) 000204[0] 1733642279.356733 trunc from 0x9c906e to 0x635ea0 (0x3931cd bytes) 000205[0] 1733642279.361044 mapwrite 0x3f3000 thru 0x3fc65c (0x965d bytes) 000206[1] 1733642279.383734 write_OD 0x013000 thru 0x020fff (0xe000 bytes) 000209[0] 1733642279.396653 read_OD 0x545000 thru 0x547fff (0x3000 bytes) 000212[1] 1733642279.398173 mapread 0x1d8000 thru 0x1e1e20 (0x9e21 bytes) 000213[0] 1733642279.407998 trunc from 0x635ea1 to 0x5b6269 (0x7fc37 bytes) 000219[1] 1733642279.425252 write_OD 0x5df000 thru 0x5e0fff (0x2000 bytes) 000220[0] 1733642279.435966 write_OD 0x5ea000 thru 0x5f1fff (0x8000 bytes) 000221[0] 1733642279.446925 write_OD 0x4d5000 thru 0x4dbfff (0x7000 bytes) 000222[1] 1733642279.456742 write_OD 0x134000 thru 0x13cfff (0x9000 bytes) 000223[0] 1733642279.466755 mapwrite 0x471000 thru 0x4716e0 (0x6e1 bytes) 000227[0] 1733642279.506189 trunc from 0x5f2000 to 0x30cb0e (0x2e54f1 bytes) 000229[0] 1733642279.513457 mapread 0x19d000 thru 0x1ab4dc (0xe4dd bytes) 000230[1] 1733642279.513799 mapwrite 0x500000 thru 0x5026a7 (0x26a8 bytes) 000231[0] 1733642279.536115 write_OD 0x2cf000 thru 0x2d3fff (0x5000 bytes) 000233[1] 1733642279.546928 trunc from 0x5026a8 to 0x68b9d4 (0x18932d bytes) 000234[1] 1733642279.552103 write_OD 0x17a000 thru 0x182fff (0x9000 bytes) 000235[1] 1733642279.562623 mapwrite 0x80b000 thru 0x81655a (0xb55b bytes) 000237[1] 1733642279.585257 write_OD 0x537000 thru 0x53afff (0x4000 bytes) 000238[0] 1733642279.597811 mapread 0x5d8000 thru 0x5e3080 (0xb081 bytes) 000240[0] 1733642279.621807 trunc from 0x81655b to 0x8cb82f (0xb52d5 bytes) 000241[1] 1733642279.630163 mapwrite 0x5be000 thru 0x5bfa94 (0x1a95 bytes) 000245[1] 1733642279.656396 read_OD 0x6ae000 thru 0x6bafff (0xd000 bytes) 000246[1] 1733642279.661399 mapread 0x661000 thru 0x667079 (0x607a bytes) 000247[1] 1733642279.696390 write_OD 0x4d8000 thru 0x4d9fff (0x2000 bytes) 000248[0] 1733642279.712158 read_OD 0x016000 thru 0x021fff (0xc000 bytes) 000252[0] 1733642279.715496 mapread 0x732000 thru 0x73d54b (0xb54c bytes) 000253[0] 1733642279.744575 mapread 0x28e000 thru 0x2998ef (0xb8f0 bytes) 000254[0] 1733642279.744915 mapwrite 0x252000 thru 0x25aadf (0x8ae0 bytes) 000256[1] 1733642279.785520 mapwrite 0x753000 thru 0x75e995 (0xb996 bytes) 000258[1] 1733642279.819089 mapwrite 0x2ec000 thru 0x2f0588 (0x4589 bytes) 000259[1] 1733642279.835186 read_OD 0x2ad000 thru 0x2aefff (0x2000 bytes) 000260[0] 1733642279.838644 mapread 0x235000 thru 0x240640 (0xb641 bytes) 000261[0] 1733642279.852715 trunc from 0x8cb830 to 0x1044c3 (0x7c736c bytes) 000271[1] 1733642279.888292 write_OD 0x633000 thru 0x639fff (0x7000 bytes) 000274[0] 1733642279.901644 mapread 0x142000 thru 0x1480d3 (0x60d4 bytes) 000275[1] 1733642279.910537 write_OD 0x986000 thru 0x98ffff (0xa000 bytes) 000276[0] 1733642279.922462 mapread 0x65c000 thru 0x65eef2 (0x2ef3 bytes) 000277[1] 1733642279.931594 write_OD 0x9a1000 thru 0x9a5fff (0x5000 bytes) 000279[1] 1733642279.941838 trunc from 0x9a6000 to 0x65e2cd (0x347d32 bytes) 000281[1] 1733642279.950760 write_OD 0x414000 thru 0x41cfff (0x9000 bytes) 000283[1] 1733642279.962034 trunc from 0x65e2ce to 0x4b8aab (0x1a5822 bytes) 000286[0] 1733642279.974613 mapread 0x16a000 thru 0x16d685 (0x3686 bytes) 000287[0] 1733642279.982353 mapwrite 0x0f9000 thru 0x106bfe (0xdbff bytes) 000294[1] 1733642280.022446 mapread 0x227000 thru 0x232633 (0xb634 bytes) 000297[0] 1733642280.044647 read_OD 0x3a1000 thru 0x3aefff (0xe000 bytes) 000301[0] 1733642280.047361 mapread 0x212000 thru 0x21f9da (0xd9db bytes) 000303[1] 1733642280.064433 read_OD 0x21a000 thru 0x222fff (0x9000 bytes) 000306[1] 1733642280.066863 mapread 0x2d3000 thru 0x2d7982 (0x4983 bytes) 000307[0] 1733642280.067127 write_OD 0x950000 thru 0x95cfff (0xd000 bytes) 000311[1] 1733642280.084575 write_OD 0x91d000 thru 0x920fff (0x4000 bytes) 000315[0] 1733642280.095486 write_OD 0x18b000 thru 0x198fff (0xe000 bytes) 000317[1] 1733642280.107251 mapread 0x4e1000 thru 0x4e1d29 (0xd2a bytes) 000318[0] 1733642280.137641 mapread 0x625000 thru 0x62934c (0x434d bytes) 000319[1] 1733642280.157138 mapread 0x151000 thru 0x1525e5 (0x15e6 bytes) 000320[0] 1733642280.157485 read_OD 0x1f4000 thru 0x202fff (0xf000 bytes) 000321[1] 1733642280.159554 read_OD 0x7ed000 thru 0x7f4fff (0x8000 bytes) 000323[1] 1733642280.161562 trunc from 0x95d000 to 0x63746f (0x325b90 bytes) 000324[1] 1733642280.176767 mapwrite 0x582000 thru 0x588cca (0x6ccb bytes) 000326[0] 1733642280.216564 read_OD 0x621000 thru 0x623fff (0x3000 bytes) 000327[1] 1733642280.227192 trunc from 0x637470 to 0x4c12f5 (0x17617a bytes) 000328[0] 1733642280.232870 mapread 0x47a000 thru 0x47a65a (0x65b bytes) 000331[1] 1733642280.258586 write_OD 0x779000 thru 0x782fff (0xa000 bytes) 000332[0] 1733642280.276279 mapwrite 0x595000 thru 0x599536 (0x4537 bytes) 000333[0] 1733642280.304357 trunc from 0x783000 to 0x0d8c01 (0x6aa3fe bytes) 000334[0] 1733642280.311668 trunc from 0x0d8c02 to 0x474aa0 (0x39be9f bytes) 000338[1] 1733642280.322460 write_OD 0x0cc000 thru 0x0d0fff (0x5000 bytes) 000341[0] 1733642280.334011 write_OD 0x284000 thru 0x289fff (0x6000 bytes) 000345[1] 1733642280.348443 mapwrite 0x2ef000 thru 0x2f95c0 (0xa5c1 bytes) 000346[0] 1733642280.374762 write_OD 0x8a0000 thru 0x8a0fff (0x1000 bytes) 000347[1] 1733642280.386427 mapwrite 0x4ee000 thru 0x4f1f97 (0x3f98 bytes) 000348[0] 1733642280.414494 mapwrite 0x0c4000 thru 0x0cb109 (0x710a bytes) 000350[0] 1733642280.447303 trunc from 0x8a1000 to 0x8ab02d (0xa02e bytes) 000351[0] 1733642280.453944 mapread 0x2bb000 thru 0x2c3ad6 (0x8ad7 bytes) 000353[1] 1733642280.468764 read_OD 0x58a000 thru 0x590fff (0x7000 bytes) 000354[0] 1733642280.474835 trunc from 0x8ab02e to 0x3ec9ed (0x4be640 bytes) 000356[1] 1733642280.480299 write_OD 0x794000 thru 0x795fff (0x2000 bytes) 000357[1] 1733642280.491988 write_OD 0x37a000 thru 0x382fff (0x9000 bytes) 000360[1] 1733642280.504748 mapwrite 0x9b3000 thru 0x9c1a2c (0xea2d bytes) 000361[0] 1733642280.561650 write_OD 0x282000 thru 0x284fff (0x3000 bytes) 000363[1] 1733642280.582180 trunc from 0x9c1a2d to 0x58817e (0x4398ae bytes) 000364[0] 1733642280.591508 write_OD 0x06d000 thru 0x07bfff (0xf000 bytes) 000365[0] 1733642280.603062 mapread 0x26b000 thru 0x270d24 (0x5d25 bytes) 000367[0] 1733642280.609327 write_OD 0x175000 thru 0x181fff (0xd000 bytes) 000368[1] 1733642280.620096 trunc from 0x58817f to 0x1f9834 (0x38e94a bytes) 000371[1] 1733642280.630847 mapread 0x1d1000 thru 0x1d5c46 (0x4c47 bytes) 000373[0] 1733642280.639836 mapwrite 0x767000 thru 0x76d002 (0x6003 bytes) 000376[0] 1733642280.672424 write_OD 0x3ed000 thru 0x3edfff (0x1000 bytes) 000378[0] 1733642280.682498 write_OD 0x2dc000 thru 0x2e0fff (0x5000 bytes) 000379[0] 1733642280.692731 write_OD 0x39d000 thru 0x3a2fff (0x6000 bytes) 000382[0] 1733642280.703822 read_OD 0x130000 thru 0x13bfff (0xc000 bytes) 000383[0] 1733642280.705717 write_OD 0x3ba000 thru 0x3c1fff (0x8000 bytes) 000384[0] 1733642280.716187 mapwrite 0x464000 thru 0x46c4e9 (0x84ea bytes) 000386[1] 1733642280.760461 mapwrite 0x20d000 thru 0x217bb0 (0xabb1 bytes) 000391[0] 1733642280.805753 write_OD 0x034000 thru 0x041fff (0xe000 bytes) 000392[1] 1733642280.816277 read_OD 0x30c000 thru 0x30efff (0x3000 bytes) 000393[1] 1733642280.817733 mapread 0x69c000 thru 0x6a89f4 (0xc9f5 bytes) 000394[1] 1733642280.845535 mapread 0x3c0000 thru 0x3cd78c (0xd78d bytes) 000399[0] 1733642280.846745 write_OD 0x08a000 thru 0x092fff (0x9000 bytes) 000402[0] 1733642280.867466 read_OD 0x541000 thru 0x549fff (0x9000 bytes) 000404[1] 1733642280.869693 mapread 0x734000 thru 0x73434c (0x34d bytes) 000405[0] 1733642280.871146 trunc from 0x76d003 to 0x34f533 (0x41dacf bytes) 000406[1] 1733642280.877028 read_OD 0x291000 thru 0x295fff (0x5000 bytes) 000407[0] 1733642280.882927 trunc from 0x34f534 to 0x6c3919 (0x3743e6 bytes) 000410[0] 1733642280.896391 write_OD 0x5d3000 thru 0x5dffff (0xd000 bytes) 000413[0] 1733642280.909762 mapwrite 0x71b000 thru 0x729cdd (0xecde bytes) 000419[1] 1733642280.970061 mapread 0x3ba000 thru 0x3c189c (0x789d bytes) 000420[0] 1733642281.003882 mapread 0x62a000 thru 0x6301f3 (0x61f4 bytes) 000421[0] 1733642281.013486 read_OD 0x5ad000 thru 0x5b6fff (0xa000 bytes) 000422[0] 1733642281.015621 write_OD 0x857000 thru 0x857fff (0x1000 bytes) 000424[0] 1733642281.034595 write_OD 0x6a5000 thru 0x6a8fff (0x4000 bytes) 000426[0] 1733642281.045918 read_OD 0x5b7000 thru 0x5bbfff (0x5000 bytes) 000427[1] 1733642281.047864 read_OD 0x534000 thru 0x535fff (0x2000 bytes) 000429[1] 1733642281.049394 mapwrite 0x991000 thru 0x9953ae (0x43af bytes) 000430[1] 1733642281.106836 write_OD 0x8f0000 thru 0x8fdfff (0xe000 bytes) 000431[1] 1733642281.125114 mapread 0x334000 thru 0x34210c (0xe10d bytes) 000433[0] 1733642281.143760 mapread 0x0d7000 thru 0x0e153c (0xa53d bytes) 000436[1] 1733642281.175854 write_OD 0x5d5000 thru 0x5defff (0xa000 bytes) 000440[1] 1733642281.195242 write_OD 0x860000 thru 0x86afff (0xb000 bytes) 000442[1] 1733642281.206923 trunc from 0x9953af to 0x669d70 (0x32b63e bytes) truncating to largest ever: 0x9aa478 000443[1] 1733642281.212958 trunc from 0x669d71 to 0x9aa477 (0x340707 bytes) 000449[0] 1733642281.237478 mapwrite 0x94a000 thru 0x94a17b (0x17c bytes) 000452[1] 1733642281.263369 write_OD 0x05e000 thru 0x06cfff (0xf000 bytes) 000460[1] 1733642281.277968 mapread 0x8df000 thru 0x8eef54 (0xff55 bytes) 000462[0] 1733642281.284962 write_OD 0x48e000 thru 0x492fff (0x5000 bytes) 000463[0] 1733642281.296705 write_OD 0x66a000 thru 0x66efff (0x5000 bytes) 000464[0] 1733642281.307505 write_OD 0x9d0000 thru 0x9dcfff (0xd000 bytes) 000466[1] 1733642281.319141 mapread 0x726000 thru 0x73201f (0xc020 bytes) 000470[1] 1733642281.326900 read_OD 0x110000 thru 0x11afff (0xb000 bytes) 000472[0] 1733642281.329128 trunc from 0x9dd000 to 0x461d8a (0x57b275 bytes) 000474[1] 1733642281.339259 mapwrite 0x2e2000 thru 0x2ecd6c (0xad6d bytes) 000475[0] 1733642281.364403 mapwrite 0x20f000 thru 0x21097a (0x197b bytes) 000476[1] 1733642281.380477 mapread 0x2e4000 thru 0x2e840f (0x4410 bytes) 000477[0] 1733642281.386698 read_OD 0x250000 thru 0x251fff (0x2000 bytes) 000484[1] 1733642281.389299 mapread 0x11d000 thru 0x129dd5 (0xcdd6 bytes) 000487[0] 1733642281.395685 write_OD 0x6cf000 thru 0x6d2fff (0x4000 bytes) 000495[0] 1733642281.410433 read_OD 0x26f000 thru 0x274fff (0x6000 bytes) 000496[0] 1733642281.412414 write_OD 0x20c000 thru 0x215fff (0xa000 bytes) 000499[1] 1733642281.425665 mapread 0x58e000 thru 0x59863d (0xa63e bytes) All operations completed A-OK! PASS 16a (10s) == sanityn test 16b: 500 iterations of dual-mount fsx at small size ========================================================== 02:18:02 (1733642282) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.118119 s, 71.0 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.115864 s, 72.4 MB/s Chance of close/open is 1 in 50 Seed set to 2283 fd 0: /mnt/lustre/f16b.sanityn fd 1: /mnt/lustre2/f16b.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001[0] 1733642283.289801 mapwrite 0x5a4e35 thru 0x5a63d4 (0x15a0 bytes) 000002[1] 1733642283.327616 write 0x7ca83f thru 0x7cb197 (0x959 bytes) 000007[1] 1733642283.347885 mapwrite 0x120ea2 thru 0x122d3a (0x1e99 bytes) 000012[0] 1733642283.384207 read 0x0ec9b8 thru 0x0ed0e0 (0x729 bytes) truncating to largest ever: 0x955da4 000014[0] 1733642283.392327 trunc from 0x7cb198 to 0x955da3 (0x18ac0c bytes) 000016[0] 1733642283.403049 mapread 0x091ef9 thru 0x09262c (0x734 bytes) 000022[1] 1733642283.414271 mapread 0x94f3f9 thru 0x950b49 (0x1751 bytes) 000023[0] 1733642283.420807 trunc from 0x955da4 to 0x1c44db (0x7918c8 bytes) 000027[1] 1733642283.434170 trunc from 0x1c44dc to 0x8b5ae2 (0x6f1607 bytes) 000028[1] 1733642283.443087 mapwrite 0x2bd068 thru 0x2be277 (0x1210 bytes) 000029[0] 1733642283.456888 trunc from 0x8b5ae3 to 0x2033b0 (0x6b2732 bytes) 000035[1] 1733642283.472722 mapread 0x19a459 thru 0x19b2ea (0xe92 bytes) 000037[1] 1733642283.485210 trunc from 0x2033b1 to 0x32d90a (0x12a55a bytes) 000038[1] 1733642283.492900 write 0x74c233 thru 0x74dfd7 (0x1da5 bytes) 000039[1] 1733642283.494174 trunc from 0x74dfd8 to 0x57a87d (0x1d375a bytes) 000040[0] 1733642283.500328 mapread 0x3ba40a thru 0x3baba0 (0x797 bytes) 000041[0] 1733642283.506898 mapread 0x117e9d thru 0x119a0a (0x1b6e bytes) 000042[1] 1733642283.513395 mapwrite 0x628edb thru 0x629cda (0xe00 bytes) 000044[0] 1733642283.537838 mapread 0x2ab75a thru 0x2ad22d (0x1ad4 bytes) 000046[1] 1733642283.550118 trunc from 0x629cdb to 0x6ceaae (0xa4dd4 bytes) 000048[1] 1733642283.559939 write 0x7daffc thru 0x7dc429 (0x142e bytes) 000049[0] 1733642283.564086 trunc from 0x7dc42a to 0x12b733 (0x6b0cf6 bytes) 000050[1] 1733642283.575455 trunc from 0x12b734 to 0x1d4d2c (0xa95f9 bytes) 000052[1] 1733642283.585995 trunc from 0x1d4d2d to 0x2916a8 (0xbc97c bytes) 000054[1] 1733642283.594331 mapwrite 0x7f088f thru 0x7f1c8e (0x1400 bytes) 000057[1] 1733642283.617669 mapwrite 0x1cc041 thru 0x1cc07b (0x3b bytes) 000058[1] 1733642283.631715 mapwrite 0x262372 thru 0x263e69 (0x1af8 bytes) 000060[0] 1733642283.649009 trunc from 0x7f1c8f to 0x74007a (0xb1c14 bytes) 000062[0] 1733642283.662813 write 0x5361ef thru 0x5376c9 (0x14db bytes) 000063[1] 1733642283.665893 write 0x92240d thru 0x92307a (0xc6e bytes) 000070[0] 1733642283.692147 read 0x6003c6 thru 0x6022d1 (0x1f0c bytes) 000073[0] 1733642283.705084 mapread 0x9200cf thru 0x921143 (0x1075 bytes) 000076[0] 1733642283.739375 write 0x261784 thru 0x261b35 (0x3b2 bytes) 000077[1] 1733642283.748557 write 0x54ee83 thru 0x5509e0 (0x1b5e bytes) 000078[0] 1733642283.759196 write 0x056df7 thru 0x057e11 (0x101b bytes) 000080[1] 1733642283.768284 mapread 0x4f37ed thru 0x4f3904 (0x118 bytes) 000081[1] 1733642283.778813 trunc from 0x92307b to 0x5bf154 (0x363f26 bytes) 000085[0] 1733642283.797970 read 0x16e070 thru 0x16e9f9 (0x98a bytes) 000087[1] 1733642283.826058 mapread 0x44e63d thru 0x44f8fa (0x12be bytes) 000089[1] 1733642283.829604 read 0x3cd6e3 thru 0x3ce705 (0x1023 bytes) 000090[0] 1733642283.831148 trunc from 0x5bf155 to 0x27a872 (0x3448e2 bytes) 000091[0] 1733642283.843233 mapwrite 0x1a6d91 thru 0x1a8036 (0x12a6 bytes) 000097[1] 1733642283.865238 mapread 0x04ee7e thru 0x05098a (0x1b0d bytes) 000101[1] 1733642283.881174 write 0x5f1550 thru 0x5f22c0 (0xd71 bytes) 000102[1] 1733642283.887510 read 0x28a9ff thru 0x28bee5 (0x14e7 bytes) 000103[1] 1733642283.905554 trunc from 0x5f22c1 to 0x6a82dd (0xb601d bytes) 000104[1] 1733642283.916946 write 0x42c18d thru 0x42c358 (0x1cc bytes) 000105[1] 1733642283.921148 trunc from 0x6a82de to 0x628b32 (0x7f7ab bytes) 000107[0] 1733642283.926972 write 0x0599ee thru 0x05a597 (0xbaa bytes) 000108[1] 1733642283.936866 trunc from 0x628b33 to 0x8250ba (0x1fc588 bytes) 000111[1] 1733642283.951922 read 0x2fb455 thru 0x2fce83 (0x1a2f bytes) 000112[1] 1733642283.975985 read 0x5221f3 thru 0x523ace (0x18dc bytes) 000118[0] 1733642284.002357 read 0x408b91 thru 0x409478 (0x8e8 bytes) 000119[0] 1733642284.011311 mapwrite 0x2ae564 thru 0x2af1ad (0xc4a bytes) 000122[0] 1733642284.054456 mapwrite 0x557131 thru 0x5583cb (0x129b bytes) 000125[0] 1733642284.089390 write 0x7fb297 thru 0x7fc0d2 (0xe3c bytes) 000126[1] 1733642284.089800 write 0x60c72a thru 0x60d561 (0xe38 bytes) 000127[1] 1733642284.101167 trunc from 0x8250bb to 0x3fd0e7 (0x427fd3 bytes) 000128[0] 1733642284.110429 mapwrite 0x5a52cd thru 0x5a58b9 (0x5ed bytes) 000131[1] 1733642284.135061 trunc from 0x5a58ba to 0x7f3bd8 (0x24e31f bytes) 000133[0] 1733642284.149635 write 0x7a8fe7 thru 0x7aa69f (0x16b9 bytes) 000134[1] 1733642284.157921 write 0x1d1848 thru 0x1d2ae6 (0x129f bytes) 000135[0] 1733642284.178695 mapread 0x6281af thru 0x628c13 (0xa65 bytes) 000137[1] 1733642284.188523 trunc from 0x7f3bd9 to 0x8cd5c9 (0xd99f1 bytes) 000139[0] 1733642284.202063 write 0x22df47 thru 0x22e3be (0x478 bytes) 000140[1] 1733642284.220048 write 0x2c3eb3 thru 0x2c5a73 (0x1bc1 bytes) 000142[1] 1733642284.241715 mapwrite 0x1b96f1 thru 0x1baa40 (0x1350 bytes) 000144[0] 1733642284.259499 write 0x1b7795 thru 0x1b79ec (0x258 bytes) 000145[1] 1733642284.266609 trunc from 0x8cd5ca to 0x28790b (0x645cbe bytes) 000147[0] 1733642284.277111 read 0x1cf1e1 thru 0x1d0bbf (0x19df bytes) 000148[1] 1733642284.292529 trunc from 0x28790c to 0x6e73c0 (0x45fab5 bytes) 000150[0] 1733642284.300889 write 0x24da31 thru 0x24e405 (0x9d5 bytes) 000151[0] 1733642284.315392 mapwrite 0x874ed4 thru 0x876e41 (0x1f6e bytes) 000152[1] 1733642284.346186 mapwrite 0x5d8a8f thru 0x5da2aa (0x181c bytes) 000153[0] 1733642284.370411 write 0x717719 thru 0x71845e (0xd46 bytes) 000154[0] 1733642284.374557 mapwrite 0x7455bd thru 0x746a96 (0x14da bytes) 000156[1] 1733642284.393851 mapread 0x53d6d9 thru 0x53dd13 (0x63b bytes) 000158[0] 1733642284.399722 read 0x367f9b thru 0x36882f (0x895 bytes) truncating to largest ever: 0x9d0067 000161[1] 1733642284.406584 trunc from 0x876e42 to 0x9d0066 (0x159225 bytes) 000162[0] 1733642284.416122 read 0x3f3156 thru 0x3f4fb3 (0x1e5e bytes) 000164[1] 1733642284.437841 write 0x929f4f thru 0x92b51b (0x15cd bytes) 000165[1] 1733642284.451255 read 0x16cf50 thru 0x16db6c (0xc1d bytes) 000166[1] 1733642284.479231 read 0x934a54 thru 0x93651f (0x1acc bytes) 000167[0] 1733642284.482068 mapwrite 0x654153 thru 0x6554f5 (0x13a3 bytes) 000170[1] 1733642284.531551 read 0x8b2ecc thru 0x8b4a25 (0x1b5a bytes) 000173[0] 1733642284.544420 write 0x296047 thru 0x296c53 (0xc0d bytes) 000174[1] 1733642284.565820 trunc from 0x9d0067 to 0x7b4b8c (0x21b4da bytes) 000175[1] 1733642284.581576 mapwrite 0x76c37a thru 0x76db31 (0x17b8 bytes) 000176[0] 1733642284.612898 trunc from 0x7b4b8d to 0x2672a2 (0x54d8ea bytes) 000182[0] 1733642284.637862 read 0x1bf478 thru 0x1bff55 (0xade bytes) 000183[1] 1733642284.653648 write 0x707b5f thru 0x707c92 (0x134 bytes) 000185[0] 1733642284.663306 mapwrite 0x6b5abc thru 0x6b5fd6 (0x51b bytes) 000186[1] 1733642284.679698 trunc from 0x707c93 to 0x6b0775 (0x5751d bytes) 000187[0] 1733642284.688871 trunc from 0x6b0776 to 0x281f26 (0x42e84f bytes) 000188[0] 1733642284.698768 write 0x0ae439 thru 0x0af0fc (0xcc4 bytes) 000189[0] 1733642284.705994 mapwrite 0x83f2fb thru 0x84018e (0xe94 bytes) 000191[0] 1733642284.744836 write 0x79be70 thru 0x79d514 (0x16a5 bytes) 000194[1] 1733642284.745561 mapread 0x01714f thru 0x018e21 (0x1cd3 bytes) 000196[0] 1733642284.754909 write 0x89e466 thru 0x8a0361 (0x1efc bytes) 000197[0] 1733642284.760244 read 0x544f26 thru 0x54524d (0x328 bytes) 000199[1] 1733642284.763917 mapread 0x58eb8d thru 0x58f492 (0x906 bytes) 000200[0] 1733642284.779528 trunc from 0x8a0362 to 0x7aa2c9 (0xf6098 bytes) 000201[0] 1733642284.785563 trunc from 0x7aa2ca to 0x8b4d93 (0x10aaca bytes) 000202[1] 1733642284.788586 read 0x0a2de5 thru 0x0a45b8 (0x17d4 bytes) 000203[1] 1733642284.810979 mapwrite 0x5ff03d thru 0x600d2e (0x1cf2 bytes) 000204[1] 1733642284.843507 trunc from 0x8b4d94 to 0x5f35ba (0x2c17d9 bytes) 000208[1] 1733642284.867548 mapread 0x3a146f thru 0x3a2582 (0x1114 bytes) 000211[0] 1733642284.873812 mapread 0x53b3d0 thru 0x53d087 (0x1cb8 bytes) 000213[0] 1733642284.887115 read 0x450bab thru 0x4529c8 (0x1e1e bytes) 000214[0] 1733642284.890594 mapwrite 0x1417ff thru 0x142043 (0x845 bytes) 000219[1] 1733642284.936255 trunc from 0x5f35bb to 0x20fa49 (0x3e3b71 bytes) 000222[1] 1733642284.952916 mapread 0x01e1f7 thru 0x01f875 (0x167f bytes) 000223[1] 1733642284.958528 trunc from 0x20fa4a to 0x678f9e (0x469555 bytes) 000225[0] 1733642284.970557 read 0x5cdaf5 thru 0x5ce519 (0xa25 bytes) 000226[1] 1733642284.977335 trunc from 0x678f9f to 0x8ce8f6 (0x255958 bytes) 000227[0] 1733642284.986826 mapread 0x8a6dd1 thru 0x8a7c92 (0xec2 bytes) 000229[0] 1733642285.017717 read 0x8a3099 thru 0x8a3251 (0x1b9 bytes) 000230[0] 1733642285.022736 mapread 0x0249f1 thru 0x025961 (0xf71 bytes) 000231[1] 1733642285.026825 read 0x1fc32d thru 0x1fc49a (0x16e bytes) 000232[1] 1733642285.044162 mapread 0x73ddce thru 0x73faaa (0x1cdd bytes) 000233[1] 1733642285.067158 mapread 0x5c4a86 thru 0x5c527d (0x7f8 bytes) 000235[0] 1733642285.071029 mapwrite 0x95bba5 thru 0x95c31e (0x77a bytes) 000236[0] 1733642285.113685 trunc from 0x95c31f to 0x575581 (0x3e6d9d bytes) 000237[0] 1733642285.123040 read 0x3b90f2 thru 0x3ba61f (0x152e bytes) 000239[1] 1733642285.144882 trunc from 0x575582 to 0x2ac2ae (0x2c92d3 bytes) 000240[1] 1733642285.160127 write 0x42acd4 thru 0x42cbae (0x1edb bytes) 000243[0] 1733642285.168234 write 0x57b983 thru 0x57cbb7 (0x1235 bytes) 000247[0] 1733642285.184748 write 0x253449 thru 0x253d69 (0x921 bytes) 000249[1] 1733642285.191816 mapwrite 0x098321 thru 0x099258 (0xf38 bytes) 000250[1] 1733642285.211438 trunc from 0x57cbb8 to 0x138398 (0x44481f bytes) 000252[1] 1733642285.219551 mapwrite 0x40562e thru 0x406c5d (0x1630 bytes) 000253[0] 1733642285.238168 write 0x2b2d0e thru 0x2b2e64 (0x157 bytes) 000254[0] 1733642285.245356 mapread 0x353125 thru 0x353293 (0x16f bytes) 000255[1] 1733642285.251639 trunc from 0x406c5e to 0x367beb (0x9f072 bytes) 000256[1] 1733642285.258231 mapread 0x2c59c0 thru 0x2c6a5c (0x109d bytes) 000259[1] 1733642285.267943 mapread 0x15badc thru 0x15c2e5 (0x80a bytes) 000261[0] 1733642285.273326 read 0x1abbdc thru 0x1abc64 (0x89 bytes) 000265[1] 1733642285.293659 trunc from 0x367bec to 0x0188b6 (0x34f335 bytes) 000267[0] 1733642285.306813 mapread 0x01791c thru 0x0188b6 (0xf9b bytes) 000273[1] 1733642285.318855 read 0x011cd2 thru 0x0127ce (0xafd bytes) 000275[1] 1733642285.327507 read 0x0134fc thru 0x014636 (0x113b bytes) 000278[0] 1733642285.334002 mapwrite 0x6990ca thru 0x699c91 (0xbc8 bytes) 000282[0] 1733642285.364959 mapwrite 0x6062b7 thru 0x606808 (0x552 bytes) 000285[1] 1733642285.395941 mapread 0x6488e2 thru 0x64949d (0xbbc bytes) 000286[0] 1733642285.404578 trunc from 0x699c92 to 0x62134a (0x78947 bytes) 000289[0] 1733642285.417430 write 0x0538c5 thru 0x054b0d (0x1249 bytes) 000290[1] 1733642285.422861 read 0x3a4c55 thru 0x3a5f12 (0x12be bytes) 000291[1] 1733642285.448667 write 0x9869b7 thru 0x9875b9 (0xc03 bytes) 000292[1] 1733642285.458052 read 0x71a287 thru 0x71b3b7 (0x1131 bytes) 000293[0] 1733642285.482849 read 0x53bb2b thru 0x53d841 (0x1d17 bytes) 000294[1] 1733642285.485899 read 0x62f7ad thru 0x630a8a (0x12de bytes) 000295[1] 1733642285.488638 mapread 0x106252 thru 0x10655b (0x30a bytes) 000296[1] 1733642285.489229 mapwrite 0x230763 thru 0x2313f2 (0xc90 bytes) 000297[1] 1733642285.505343 trunc from 0x9875ba to 0x56eb10 (0x418aa9 bytes) 000298[0] 1733642285.513075 read 0x37fabb thru 0x37ff3c (0x482 bytes) 000301[1] 1733642285.546335 read 0x5034cb thru 0x503e1c (0x952 bytes) 000304[0] 1733642285.567873 read 0x4bad85 thru 0x4bafaf (0x22b bytes) 000306[0] 1733642285.584410 mapread 0x0570ce thru 0x05864b (0x157e bytes) 000312[1] 1733642285.585813 write 0x7ea18a thru 0x7ebef0 (0x1d67 bytes) 000313[1] 1733642285.590239 mapread 0x4c7a6f thru 0x4c95ba (0x1b4c bytes) 000314[1] 1733642285.604245 read 0x14dc62 thru 0x14e43f (0x7de bytes) 000315[0] 1733642285.607837 read 0x4bb316 thru 0x4bbe40 (0xb2b bytes) 000317[1] 1733642285.634038 mapread 0x334fe7 thru 0x336bfe (0x1c18 bytes) 000318[1] 1733642285.634498 mapread 0x4d59b3 thru 0x4d6063 (0x6b1 bytes) 000320[1] 1733642285.655656 read 0x206481 thru 0x206e7a (0x9fa bytes) 000322[0] 1733642285.656345 read 0x268813 thru 0x2691aa (0x998 bytes) 000324[1] 1733642285.656721 read 0x11375e thru 0x114578 (0xe1b bytes) 000325[0] 1733642285.657005 write 0x558048 thru 0x559a3f (0x19f8 bytes) 000328[0] 1733642285.688636 write 0x61012b thru 0x611563 (0x1439 bytes) 000330[0] 1733642285.692172 trunc from 0x7ebef1 to 0x428373 (0x3c3b7d bytes) 000332[1] 1733642285.708617 mapwrite 0x0ec9b5 thru 0x0ed99f (0xfeb bytes) 000334[0] 1733642285.749381 mapwrite 0x6bdfcb thru 0x6bfbae (0x1be4 bytes) 000335[0] 1733642285.774413 trunc from 0x6bfbaf to 0x931757 (0x271ba9 bytes) 000336[0] 1733642285.778160 mapread 0x5b58f4 thru 0x5b6411 (0xb1e bytes) 000337[1] 1733642285.783108 write 0x2c1368 thru 0x2c1f9b (0xc34 bytes) 000341[1] 1733642285.806449 mapread 0x474889 thru 0x474e2e (0x5a6 bytes) 000342[1] 1733642285.827220 write 0x7edab6 thru 0x7eef13 (0x145e bytes) 000343[0] 1733642285.840548 write 0x277be2 thru 0x279adf (0x1efe bytes) 000344[0] 1733642285.850364 mapread 0x57e350 thru 0x57e5d4 (0x285 bytes) 000346[0] 1733642285.863233 mapread 0x679165 thru 0x67a2f0 (0x118c bytes) 000347[0] 1733642285.869251 trunc from 0x931758 to 0x2d1d2a (0x65fa2d bytes) 000348[0] 1733642285.875362 mapread 0x14c995 thru 0x14cf5f (0x5cb bytes) 000350[1] 1733642285.877092 mapread 0x0a4dd3 thru 0x0a5f73 (0x11a1 bytes) 000352[1] 1733642285.891442 write 0x4056c3 thru 0x405f8b (0x8c9 bytes) 000354[0] 1733642285.897393 read 0x2fa5de thru 0x2fac39 (0x65c bytes) 000356[1] 1733642285.921850 write 0x2ce49d thru 0x2cfda7 (0x190b bytes) 000362[1] 1733642285.941786 trunc from 0x405f8c to 0x1d440e (0x231b7d bytes) 000364[0] 1733642285.950104 mapread 0x028060 thru 0x028a70 (0xa11 bytes) 000365[1] 1733642285.955904 mapread 0x19fad0 thru 0x19fb2c (0x5d bytes) 000367[0] 1733642285.957629 write 0x65d326 thru 0x65d44b (0x126 bytes) 000368[1] 1733642285.961021 mapread 0x5d7177 thru 0x5d83c2 (0x124c bytes) 000370[0] 1733642285.968505 trunc from 0x65d44c to 0x100bf9 (0x55c852 bytes) 000371[1] 1733642285.975335 mapwrite 0x2f1725 thru 0x2f2450 (0xd2c bytes) 000372[1] 1733642285.995179 write 0x5096c4 thru 0x50a712 (0x104f bytes) 000373[0] 1733642285.996164 mapread 0x24adcc thru 0x24b56e (0x7a3 bytes) 000374[0] 1733642286.008414 write 0x040f53 thru 0x042d6e (0x1e1c bytes) 000375[1] 1733642286.016235 mapwrite 0x3a17fc thru 0x3a2261 (0xa66 bytes) 000378[1] 1733642286.036045 read 0x3e4883 thru 0x3e6346 (0x1ac4 bytes) 000379[1] 1733642286.054430 trunc from 0x50a713 to 0x8d4137 (0x3c9a25 bytes) 000382[1] 1733642286.064162 write 0x5f7f10 thru 0x5f8712 (0x803 bytes) 000383[1] 1733642286.087982 trunc from 0x8d4138 to 0x127732 (0x7aca05 bytes) 000385[0] 1733642286.106025 trunc from 0x127733 to 0x65b194 (0x533a62 bytes) 000386[0] 1733642286.118200 read 0x30bf9c thru 0x30d2b1 (0x1316 bytes) 000388[0] 1733642286.149695 read 0x02e99f thru 0x02fdfe (0x1460 bytes) 000390[1] 1733642286.151515 write 0x36d0a5 thru 0x36d0b5 (0x11 bytes) 000392[1] 1733642286.164831 mapread 0x09f216 thru 0x09f8ef (0x6da bytes) 000393[1] 1733642286.171253 mapread 0x0c6c9a thru 0x0c7169 (0x4d0 bytes) 000396[0] 1733642286.185297 write 0x0283e9 thru 0x029f5d (0x1b75 bytes) 000398[1] 1733642286.211317 trunc from 0x65b195 to 0x4f4ead (0x1662e7 bytes) truncating to largest ever: 0x9e97db 000403[0] 1733642286.230716 trunc from 0x4f4eae to 0x9e97da (0x4f492d bytes) 000404[1] 1733642286.242435 mapread 0x256062 thru 0x25632b (0x2ca bytes) 000405[1] 1733642286.262165 write 0x8eddaf thru 0x8eeb60 (0xdb2 bytes) 000406[1] 1733642286.272884 mapwrite 0x91bcb4 thru 0x91cfe9 (0x1336 bytes) 000407[1] 1733642286.292122 mapread 0x3ec5b4 thru 0x3ee3a5 (0x1df2 bytes) 000408[0] 1733642286.300381 mapwrite 0x02e403 thru 0x02f65a (0x1258 bytes) 000409[1] 1733642286.333144 trunc from 0x9e97db to 0x40aab4 (0x5ded26 bytes) 000410[1] 1733642286.347211 mapread 0x3e5dd7 thru 0x3e6cd1 (0xefb bytes) 000411[0] 1733642286.350019 mapwrite 0x327a5e thru 0x329966 (0x1f09 bytes) 000413[1] 1733642286.375327 trunc from 0x40aab5 to 0x5c7023 (0x1bc56f bytes) 000416[0] 1733642286.389705 write 0x2f31b5 thru 0x2f41a3 (0xfef bytes) 000417[1] 1733642286.397137 read 0x5c1b8b thru 0x5c2ab6 (0xf2c bytes) 000418[1] 1733642286.402722 read 0x469893 thru 0x46a6ca (0xe38 bytes) 000419[1] 1733642286.408300 trunc from 0x5c7024 to 0x770202 (0x1a91df bytes) 000420[1] 1733642286.416081 mapread 0x689f33 thru 0x68bea7 (0x1f75 bytes) 000421[0] 1733642286.445976 read 0x41e20e thru 0x41f8b0 (0x16a3 bytes) 000425[0] 1733642286.459056 write 0x4de6da thru 0x4dfe57 (0x177e bytes) 000430[1] 1733642286.479977 mapwrite 0x6061ec thru 0x606a75 (0x88a bytes) 000431[0] 1733642286.500192 mapwrite 0x34eab6 thru 0x34f239 (0x784 bytes) 000432[0] 1733642286.538832 mapread 0x32de2c thru 0x32ee3b (0x1010 bytes) 000434[0] 1733642286.547561 mapread 0x6b2b5c thru 0x6b45bc (0x1a61 bytes) 000435[0] 1733642286.567147 trunc from 0x770203 to 0x4a8fe7 (0x2c721b bytes) 000437[1] 1733642286.576228 mapread 0x348ee4 thru 0x349f19 (0x1036 bytes) 000439[1] 1733642286.589983 mapread 0x394a15 thru 0x3964cb (0x1ab7 bytes) 000444[1] 1733642286.598558 trunc from 0x4a8fe8 to 0x6f9e6b (0x250e84 bytes) 000445[1] 1733642286.606019 write 0x4dfaa9 thru 0x4e194b (0x1ea3 bytes) 000446[1] 1733642286.612599 write 0x2e8959 thru 0x2ea4f9 (0x1ba1 bytes) 000450[1] 1733642286.619151 mapread 0x3fac97 thru 0x3fbdb4 (0x111e bytes) 000452[0] 1733642286.621616 mapread 0x38a38f thru 0x38c1c4 (0x1e36 bytes) 000453[0] 1733642286.630819 mapwrite 0x6687dd thru 0x669350 (0xb74 bytes) 000456[0] 1733642286.652277 mapread 0x66f52e thru 0x670469 (0xf3c bytes) 000460[1] 1733642286.658220 trunc from 0x6f9e6c to 0x8e822e (0x1ee3c3 bytes) 000462[1] 1733642286.672350 mapread 0x7bfc27 thru 0x7c0e3c (0x1216 bytes) 000466[1] 1733642286.685307 trunc from 0x8e822f to 0x164684 (0x783baa bytes) 000468[1] 1733642286.693799 mapread 0x1255c4 thru 0x12630d (0xd4a bytes) 000469[1] 1733642286.699640 read 0x0ec27f thru 0x0ed9da (0x175c bytes) 000470[1] 1733642286.708385 write 0x2b2bff thru 0x2b3305 (0x707 bytes) 000472[0] 1733642286.709584 mapread 0x054c63 thru 0x056b18 (0x1eb6 bytes) 000474[1] 1733642286.719556 mapread 0x063a75 thru 0x064375 (0x901 bytes) 000476[1] 1733642286.730158 write 0x342e66 thru 0x342eab (0x46 bytes) 000477[1] 1733642286.733992 read 0x13d30d thru 0x13d4cd (0x1c1 bytes) 000478[1] 1733642286.755909 read 0x044db8 thru 0x046936 (0x1b7f bytes) 000480[0] 1733642286.756607 write 0x7e7b5a thru 0x7e961c (0x1ac3 bytes) 000484[0] 1733642286.773334 read 0x0db95f thru 0x0dc09b (0x73d bytes) 000488[1] 1733642286.798247 write 0x96b2b9 thru 0x96c467 (0x11af bytes) 000489[1] 1733642286.807946 write 0x239c67 thru 0x23b882 (0x1c1c bytes) 000490[0] 1733642286.832694 read 0x8c377a thru 0x8c39ab (0x232 bytes) 000491[1] 1733642286.872219 mapread 0x94ad3b thru 0x94b5a4 (0x86a bytes) 000492[0] 1733642286.880798 trunc from 0x96c468 to 0x6d94ff (0x292f68 bytes) 000493[1] 1733642286.891699 trunc from 0x6d9500 to 0x9c3f51 (0x2eaa52 bytes) 000496[0] 1733642286.914218 write 0x35ba74 thru 0x35c9c8 (0xf55 bytes) 000500[1] 1733642286.938131 read 0x18b645 thru 0x18ce73 (0x182f bytes) All operations completed A-OK! PASS 16b (6s) == sanityn test 16c: verify data consistency on ldiskfs with cache disabled (b=17397) ========================================================== 02:18:08 (1733642288) SKIP: sanityn test_16c dio on ldiskfs only SKIP 16c (0s) == sanityn test 16d: Verify DIO and buffer IO with two clients ========================================================== 02:18:08 (1733642288) 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.13561 s, 61.9 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.115497 s, 72.6 MB/s ldlm.namespaces.MGC192.168.204.117@tcp.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8800ab26b800.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b341b800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8800ab26b800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8800b341b800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8800ab26b800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8800b341b800.lru_size=clear 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 2.28552 s, 45.9 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.578211 s, 181 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.514592 s, 204 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.09704 s, 95.6 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.48039 s, 70.8 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.813961 s, 129 MB/s PASS 16d (10s) == sanityn test 16e: Verify size consistency for O_DIRECT write ========================================================== 02:18:18 (1733642298) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0560624 s, 187 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0207734 s, 50.5 MB/s PASS 16e (2s) == sanityn test 16f: rw sequential consistency vs drop_caches ========================================================== 02:18:20 (1733642300) TIMEOUT PASS 16f (21s) == sanityn test 16g: mmap rw sequential consistency vs drop_caches ========================================================== 02:18:41 (1733642321) TIMEOUT PASS 16g (22s) == sanityn test 16h: mmap read after truncate file ======= 02:19:03 (1733642343) ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16h (1s) == sanityn test 16i: read after truncate file ============ 02:19:04 (1733642344) ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16i (2s) == sanityn test 16j: race dio with buffered i/o ========== 02:19:06 (1733642346) 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 0.344746 s, 76.0 MB/s bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.213087 s, 123 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.469156 s, 55.9 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.152335 s, 172 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.437116 s, 60.0 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.148682 s, 176 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.517764 s, 50.6 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.362104 s, 72.4 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.368791 s, 71.1 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.542682 s, 48.3 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.559173 s, 46.9 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.371499 s, 70.6 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.392435 s, 66.8 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.509724 s, 51.4 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.540844 s, 48.5 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.406982 s, 64.4 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.419664 s, 62.5 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.542319 s, 48.3 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.560295 s, 46.8 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK PASS 16j (7s) == sanityn test 16k: Parallel FSX and drop caches should not panic ========================================================== 02:19:13 (1733642353) + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.1 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.2 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.3 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.4 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.5 -l 67108864 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x1a7062c fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x232e1d3 skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x1a7062c truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x32cce75 truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab All operations completed A-OK! All operations completed A-OK! + fsx 1 done: rc=0 Sun Dec 8 02:19:32 EST 2024 All operations completed A-OK! All operations completed A-OK! + fsx 2 done: rc=0 Sun Dec 8 02:19:33 EST 2024 + fsx 3 done: rc=0 Sun Dec 8 02:19:33 EST 2024 + fsx 4 done: rc=0 Sun Dec 8 02:19:33 EST 2024 All operations completed A-OK! + fsx 5 done: rc=0 Sun Dec 8 02:19:33 EST 2024 PASS 16k (24s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 02:19:37 (1733642377) fail_loc=0x8000030a PASS 17 (4s) == sanityn test 18: mmap sanity check =========================================================================================== 02:19:41 (1733642381) mmap test1: basic mmap operation (PASS, 0.018445s) mmap test2: MAP_PRIVATE not write back (PASS, 0.014314s) mmap test3: concurrent mmap ops on two nodes (PASS, 10.592s) mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 4.0886s) mmap test5: read/write file to/from the buffer which mmapped to just this file (PASS, 0.025469s) mmap test6: check mmap write/read content on two nodes (PASS, 0.028463s) mmap test7: file i/o with an unmapped buffer (SKIPPED, 0s) mmap test8: SIGBUS for beyond file size (SKIPPED, 0s) mmap test9: SIGBUS for negative file offset (SKIPPED, 0s) mmap test10: multi-thread mmap access (PASS, 0.29513s) mmap test11: multi-thread shared mmap (PASS, 0.3014s) mmap test10: mtime not change for readonly mmap access (PASS, 1.0276s) PASS 18 (19s) == sanityn test 19: test concurrent uncached read races ========================================================================= 02:20:00 (1733642400) oleg417-server: error: get_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory pdsh@oleg417-client: oleg417-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (1s) == sanityn test 20: test extra readahead page left in cache ============================================================== 02:20:01 (1733642401) PASS 20 (1s) == sanityn test 21: Try to remove mountpoint on another dir ============================================================== 02:20:02 (1733642402) rmdir: removing directory, '/mnt/lustre/d21.sanityn' rmdir: failed to remove '/mnt/lustre/d21.sanityn': Device or resource busy rmdir: removing directory, '/mnt/lustre2/d21.sanityn' Removed mounted directory from another mountpoint, needs to be fixed PASS 21 (2s) == sanityn test 23: others should see updated atime while another read============================================================== 02:20:04 (1733642404) now is 1733642404 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.6973 new atime is 1733642465 PASS 23 (62s) == sanityn test 24a: lfs df [-ih] [path] test =================================================================================== 02:21:06 (1733642466) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 31744 3737600 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 39936 7498752 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 31744 3737600 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 39936 7498752 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.6K 387 490.2K 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 115.2K 400 114.8K 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 114.5K 401 114.1K 1% /mnt/lustre[OST:1] filesystem_summary: 229.3K 387 229.0K 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.6K 387 490.2K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.2K 400 114.8K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 114.5K 401 114.1K 1% /mnt/lustre2[OST:1] filesystem_summary: 229.3K 387 229.0K 1% /mnt/lustre2 UUID bytes Used Available Use% Mounted on lustre-MDT0000_UUID 2.1G 3.2M 2.1G 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3.6G 8.0M 3.6G 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3.6G 31.0M 3.6G 1% /mnt/lustre[OST:1] filesystem_summary: 7.2G 39.0M 7.2G 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502378 387 501991 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118000 400 117600 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 117265 401 116864 1% /mnt/lustre2[OST:1] filesystem_summary: 234851 387 234464 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 31744 3737600 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 39936 7498752 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.6K 387 490.2K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.2K 400 114.8K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 114.5K 401 114.1K 1% /mnt/lustre2[OST:1] filesystem_summary: 229.3K 387 229.0K 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502378 387 501991 1% /mnt/lustre[MDT:0] filesystem_summary: 502378 387 501991 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502378 387 501991 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118000 400 117600 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 117265 401 116864 1% /mnt/lustre2[OST:1] filesystem_summary: 234851 387 234464 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 31744 3737600 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 39936 7498752 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 31744 3737600 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 39936 7498752 1% /mnt/lustre2 PASS 24a (2s) == sanityn test 24b: lfs df should show both filesystems ========================================================================= 02:21:08 (1733642468) PASS 24b (1s) == sanityn test 25a: change ACL on one mountpoint be seen on another ============================================================= 02:21:09 (1733642469) running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] PASS 25a (2s) == sanityn test 25b: change ACL under remote dir on one mountpoint be seen on another ========================================================== 02:21:11 (1733642471) SKIP: sanityn test_25b needs >= 2 MDTs SKIP 25b (0s) == sanityn test 26a: allow mtime to get older ============ 02:21:11 (1733642471) utime: good mknod times 1733642471 <= 1733642472 <= 1733642472 for /mnt/lustre/f26a utime: good mknod times 1733642471 <= 1733642472 <= 1733642472 for /mnt/lustre2/f26a utime: good utime mtimes 100000, atime 200000 utime: updated times for /mnt/lustre2/f26a PASS 26a (3s) == sanityn test 26b: sync mtime between ost and mds ====== 02:21:14 (1733642474) PASS 26b (3s) == sanityn test 26c: set-in-past on open file is not lost on close ========================================================== 02:21:17 (1733642477) multiop /mnt/lustre/f26c.sanityn vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.6973 File: '/mnt/lustre/f26c.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205272502398 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2024-12-08 02:21:18.000000000 -0500 Birth: - File: '/mnt/lustre2/f26c.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205272502398 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2024-12-08 02:21:18.000000000 -0500 Birth: - PASS 26c (3s) SKIP: sanityn test_27 skipping excluded test 27 SKIP: sanityn test_28 skipping ALWAYS excluded test 28 == sanityn test 30: recreate file race =================== 02:21:20 (1733642480) 0 PASS 30 (4s) == sanityn test 31a: voluntary cancel / blocking ast race======================================================================== 02:21:24 (1733642484) fail_loc=0x314 PASS 31a (2s) == sanityn test 31b: voluntary OST cancel / blocking ast race======================================================================== 02:21:26 (1733642486) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg417-server mds-ost sync done. sleep 5 for ZFS MDS Waiting for MDT destroys to complete fail_loc=0x314 fail_loc=0x316 fail_loc=0 fail_loc=0 Filesystem 1K-blocks Used Available Use% Mounted on 192.168.204.117@tcp:/lustre 7542784 39936 7496704 1% /mnt/lustre2 PASS 31b (10s) == sanityn test 31r: open-rename(replace) race =========== 02:21:36 (1733642496) -rw-r--r-- 1 root root 0 Dec 8 02:21 /mnt/lustre/f31r.sanityn.target fail_loc=0x1419 fail_val=3 PASS 31r (4s) == sanityn test 31s: open should not revalidate invalid dentry ========================================================== 02:21:40 (1733642500) /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 1213: 13296 Terminated tail -f $tfile PASS 31s (2s) == sanityn test 31t: getattr should not revalidate invalid dentry ========================================================== 02:21:42 (1733642502) PASS 31t (2s) SKIP: sanityn test_33a skipping SLOW test 33a == sanityn test 33b: COS: cross create/delete, 2 clients, benchmark under remote dir ========================================================== 02:21:45 (1733642505) SKIP: sanityn test_33b Need two or more clients, have 1 SKIP 33b (0s) == sanityn test 33c: Cancel cross-MDT lock should trigger Sync-on-Lock-Cancel ========================================================== 02:21:45 (1733642505) SKIP: sanityn test_33c needs >= 2 MDTs SKIP 33c (1s) == sanityn test 33d: dependent transactions should trigger COS ========================================================== 02:21:46 (1733642506) SKIP: sanityn test_33d needs >= 2 MDTs SKIP 33d (1s) == sanityn test 33e: independent transactions shouldn't trigger COS ========================================================== 02:21:47 (1733642507) SKIP: sanityn test_33e needs >= 2 MDTs SKIP 33e (0s) == sanityn test 34: no lock timeout under IO ============= 02:21:47 (1733642507) fail_loc=0x512 fail_loc=0x512 lock should not expire writing on client1 reading on client2 success fail_loc=0x511 fail_loc=0x511 lock should expire writing on client1 reading on client2 success oleg417-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800ab26b800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800ab26b800.ost_server_uuid in IDLE state after 0 sec oleg417-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800ab26b800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800ab26b800.ost_server_uuid in FULL state after 0 sec oleg417-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800ab26b800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800ab26b800.ost_server_uuid in IDLE state after 0 sec oleg417-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800ab26b800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800ab26b800.ost_server_uuid in FULL state after 0 sec oleg417-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800ab26b800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800ab26b800.ost_server_uuid in IDLE state after 0 sec oleg417-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800ab26b800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800ab26b800.ost_server_uuid in FULL state after 0 sec PASS 34 (86s) == sanityn test 35: -EINTR cp_ast vs. bl_ast race does not evict client ========================================================== 02:23:13 (1733642593) fail_loc=0x80000317 Race attempt 0 Wait for 19884 20025 for 60 sec... total: 4000 open/close in 7.35 seconds: 543.88 ops/second fail_loc=0x0 Filesystem Size Used Avail Use% Mounted on 192.168.204.117@tcp:/lustre 7.2G 40M 7.2G 1% /mnt/lustre 192.168.204.117@tcp:/lustre 7.2G 40M 7.2G 1% /mnt/lustre2 PASS 35 (63s) == sanityn test 36: handle ESTALE/open-unlink correctly == 02:24:16 (1733642656) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg417-server mds-ost sync done. Waiting for MDT destroys to complete 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.233479 s, 225 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6973 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(0) *** before(7497728) after_dd(7446528) after(7497728) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.25467 s, 206 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6973 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(1) *** before(7497728) after_dd(7446528) after(7497728) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.224019 s, 234 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6973 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(2) *** before(7497728) after_dd(7444480) after(7495680) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.241335 s, 217 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6973 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(3) *** before(7495680) after_dd(7446528) after(7497728) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.250148 s, 210 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6973 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(4) *** before(7497728) after_dd(7442432) after(7493632) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.227784 s, 230 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6973 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(5) *** before(7493632) after_dd(7442432) after(7493632) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.248827 s, 211 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6973 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(6) *** before(7493632) after_dd(7446528) after(7497728) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.242659 s, 216 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6973 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(7) *** before(7497728) after_dd(7444480) after(7495680) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.301792 s, 174 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6973 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(8) *** before(7495680) after_dd(7442432) after(7493632) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.260318 s, 201 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6973 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(9) *** before(7493632) after_dd(7444480) after(7495680) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.286324 s, 183 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6973 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(10) *** before(7495680) after_dd(7444480) after(7495680) PASS 36 (225s) == sanityn test 37: check i_size is not updated for directory on close (bug 18695) ======================================================================== 02:28:01 (1733642881) multiop /mnt/lustre/d37.sanityn vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.6973 - create 7232 (time 1733642892.88 total 10.00 last 723.18) total: 10000 create in 14.31 seconds: 698.97 ops/second PASS 37 (18s) == sanityn test 39a: file mtime does not change after rename ========================================================== 02:28:19 (1733642899) repeat after cancel_lru_locks PASS 39a (2s) == sanityn test 39b: file mtime the same on clients with/out lock ========================================================== 02:28:22 (1733642902) repeat after cancel_lru_locks PASS 39b (4s) == sanityn test 39c: check truncate mtime update ================================================================================ 02:28:25 (1733642905) repeat after cancel_lru_locks PASS 39c (3s) == sanityn test 39d: sync write should update mtime ====== 02:28:28 (1733642908) fail_loc=0x411 fail_loc=0 PASS 39d (2s) == sanityn test 40a: pdirops: create vs others ======================================================================== 02:28:30 (1733642910) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40a (9s) == sanityn test 40b: pdirops: open|create and others ======================================================================== 02:28:39 (1733642919) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40b (8s) == sanityn test 40c: pdirops: link and others ======================================================================== 02:28:47 (1733642927) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40c (8s) == sanityn test 40d: pdirops: unlink and others ======================================================================== 02:28:55 (1733642935) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40d (9s) == sanityn test 40e: pdirops: rename and others ======================================================================== 02:29:04 (1733642944) No conflict No conflict No conflict No conflict No conflict No conflict PASS 40e (7s) == sanityn test 41a: pdirops: create vs mkdir ======================================================================== 02:29:11 (1733642951) mkdir: cannot create directory '/mnt/lustre2/f41a.sanityn': File exists Conflict PASS 41a (4s) == sanityn test 41b: pdirops: create vs create ======================================================================== 02:29:15 (1733642955) open: File exists Conflict PASS 41b (6s) == sanityn test 41c: pdirops: create vs link ======================================================================== 02:29:21 (1733642961) link: cannot create link '/mnt/lustre2/f41c.sanityn' to '/mnt/lustre2/f41c.sanityn-2': File exists Conflict PASS 41c (5s) == sanityn test 41d: pdirops: create vs unlink ======================================================================== 02:29:26 (1733642966) Conflict PASS 41d (6s) == sanityn test 41e: pdirops: create and rename (tgt) ======================================================================== 02:29:32 (1733642972) Conflict PASS 41e (6s) == sanityn test 41f: pdirops: create and rename (src) ======================================================================== 02:29:38 (1733642978) Conflict PASS 41f (5s) == sanityn test 41g: pdirops: create vs getattr ======================================================================== 02:29:43 (1733642983) Conflict PASS 41g (4s) == sanityn test 41h: pdirops: create vs readdir ======================================================================== 02:29:47 (1733642987) Conflict PASS 41h (5s) == sanityn test 41i: reint_open: create vs create ======== 02:29:52 (1733642992) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 41i (643s) == sanityn test 42a: pdirops: mkdir vs mkdir ======================================================================== 02:40:35 (1733643635) mkdir: cannot create directory '/mnt/lustre2/f42a.sanityn': File exists Conflict PASS 42a (4s) == sanityn test 42b: pdirops: mkdir vs create ======================================================================== 02:40:39 (1733643639) open: File exists Conflict PASS 42b (5s) == sanityn test 42c: pdirops: mkdir vs link ======================================================================== 02:40:44 (1733643644) link: cannot create link '/mnt/lustre2/f42c.sanityn' to '/mnt/lustre2/f42c.sanityn-2': File exists Conflict PASS 42c (4s) == sanityn test 42d: pdirops: mkdir vs unlink ======================================================================== 02:40:48 (1733643648) Conflict PASS 42d (4s) == sanityn test 42e: pdirops: mkdir and rename (tgt) ======================================================================== 02:40:52 (1733643652) mv: cannot overwrite directory '/mnt/lustre2/f42e.sanityn' with non-directory Conflict PASS 42e (4s) == sanityn test 42f: pdirops: mkdir and rename (src) ======================================================================== 02:40:56 (1733643656) Conflict PASS 42f (4s) == sanityn test 42g: pdirops: mkdir vs getattr ======================================================================== 02:41:00 (1733643660) Conflict PASS 42g (4s) == sanityn test 42h: pdirops: mkdir vs readdir ======================================================================== 02:41:04 (1733643664) Conflict PASS 42h (4s) == sanityn test 43a: rmdir,mkdir doesn't return -EEXIST ======================================================================== 02:41:08 (1733643668) PASS 43a (13s) == sanityn test 43b: pdirops: unlink vs create ======================================================================== 02:41:21 (1733643681) Conflict PASS 43b (4s) == sanityn test 43c: pdirops: unlink vs link ======================================================================== 02:41:25 (1733643685) Conflict PASS 43c (4s) == sanityn test 43d: pdirops: unlink vs unlink ======================================================================== 02:41:29 (1733643689) rm: cannot remove '/mnt/lustre2/f43d.sanityn': No such file or directory Conflict PASS 43d (4s) == sanityn test 43e: pdirops: unlink and rename (tgt) ======================================================================== 02:41:33 (1733643693) Conflict PASS 43e (4s) == sanityn test 43f: pdirops: unlink and rename (src) ======================================================================== 02:41:37 (1733643697) mv: cannot stat '/mnt/lustre2/f43f.sanityn': No such file or directory Conflict PASS 43f (5s) == sanityn test 43g: pdirops: unlink vs getattr ======================================================================== 02:41:42 (1733643702) stat: cannot stat '/mnt/lustre2/f43g.sanityn': No such file or directory Conflict PASS 43g (4s) == sanityn test 43h: pdirops: unlink vs readdir ======================================================================== 02:41:46 (1733643706) Conflict PASS 43h (4s) == sanityn test 43i: pdirops: unlink vs remote mkdir ===== 02:41:50 (1733643710) SKIP: sanityn test_43i needs >= 2 MDTs SKIP 43i (1s) == sanityn test 43j: racy mkdir return EEXIST ======================================================================== 02:41:51 (1733643711) mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists PASS 43j (32s) == sanityn test 43k: unlink vs create ==================== 02:42:23 (1733643743) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 43k (347s) == sanityn test 44a: pdirops: rename tgt vs mkdir ======================================================================== 02:48:10 (1733644090) mkdir: cannot create directory '/mnt/lustre2/f44a.sanityn': File exists Conflict Sun Dec 8 02:48:13 EST 2024 PASS 44a (4s) == sanityn test 44b: pdirops: rename tgt vs create ======================================================================== 02:48:14 (1733644094) open: File exists Conflict PASS 44b (4s) == sanityn test 44c: pdirops: rename tgt vs link ======================================================================== 02:48:18 (1733644098) link: cannot create link '/mnt/lustre2/f44c.sanityn' to '/mnt/lustre2/f44c.sanityn-3': File exists Conflict PASS 44c (5s) == sanityn test 44d: pdirops: rename tgt vs unlink ======================================================================== 02:48:23 (1733644103) Conflict PASS 44d (4s) == sanityn test 44e: pdirops: rename tgt and rename (tgt) ======================================================================== 02:48:27 (1733644107) Conflict PASS 44e (4s) == sanityn test 44f: pdirops: rename tgt and rename (src) ======================================================================== 02:48:31 (1733644111) Conflict PASS 44f (4s) == sanityn test 44g: pdirops: rename tgt vs getattr ======================================================================== 02:48:35 (1733644115) Conflict PASS 44g (4s) == sanityn test 44h: pdirops: rename tgt vs readdir ======================================================================== 02:48:39 (1733644119) Conflict PASS 44h (4s) == sanityn test 44i: pdirops: rename tgt vs remote mkdir ========================================================== 02:48:43 (1733644123) SKIP: sanityn test_44i needs >= 2 MDTs SKIP 44i (1s) == sanityn test 45a: rename,mkdir doesn't return -EEXIST ======================================================================== 02:48:44 (1733644124) PASS 45a (21s) == sanityn test 45b: pdirops: rename src vs create ======================================================================== 02:49:05 (1733644145) Conflict PASS 45b (4s) == sanityn test 45c: pdirops: rename src vs link ======================================================================== 02:49:09 (1733644149) Conflict PASS 45c (4s) == sanityn test 45d: pdirops: rename src vs unlink ======================================================================== 02:49:13 (1733644153) rm: cannot remove '/mnt/lustre2/f45d.sanityn': No such file or directory Conflict PASS 45d (5s) == sanityn test 45e: pdirops: rename src and rename (tgt) ======================================================================== 02:49:18 (1733644158) Conflict PASS 45e (4s) == sanityn test 45f: pdirops: rename src and rename (src) ======================================================================== 02:49:22 (1733644162) mv: cannot stat '/mnt/lustre2/f45f.sanityn': No such file or directory Conflict PASS 45f (4s) == sanityn test 45g: pdirops: rename src vs getattr ======================================================================== 02:49:26 (1733644166) stat: cannot stat '/mnt/lustre2/f45g.sanityn': No such file or directory Conflict PASS 45g (4s) == sanityn test 45h: pdirops: unlink vs readdir ======================================================================== 02:49:30 (1733644170) Conflict PASS 45h (4s) == sanityn test 45i: pdirops: rename src vs remote mkdir ========================================================== 02:49:34 (1733644174) SKIP: sanityn test_45i needs >= 2 MDTs SKIP 45i (1s) == sanityn test 45j: read vs rename ====================== 02:49:35 (1733644175) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 45j (374s) == sanityn test 46a: pdirops: link vs mkdir ======================================================================== 02:55:49 (1733644549) mkdir: cannot create directory '/mnt/lustre2/f46a.sanityn': File exists Conflict PASS 46a (5s) == sanityn test 46b: pdirops: link vs create ======================================================================== 02:55:54 (1733644554) open: File exists Conflict PASS 46b (5s) == sanityn test 46c: pdirops: link vs link ======================================================================== 02:55:59 (1733644559) link: cannot create link '/mnt/lustre2/f46c.sanityn' to '/mnt/lustre2/f46c.sanityn': File exists Conflict PASS 46c (4s) == sanityn test 46d: pdirops: link vs unlink ======================================================================== 02:56:03 (1733644563) Conflict PASS 46d (5s) == sanityn test 46e: pdirops: link and rename (tgt) ======================================================================== 02:56:08 (1733644568) Conflict PASS 46e (4s) == sanityn test 46f: pdirops: link and rename (src) ======================================================================== 02:56:13 (1733644573) Conflict PASS 46f (5s) == sanityn test 46g: pdirops: link vs getattr ======================================================================== 02:56:17 (1733644577) Conflict PASS 46g (5s) == sanityn test 46h: pdirops: link vs readdir ======================================================================== 02:56:22 (1733644582) Conflict PASS 46h (5s) == sanityn test 46i: pdirops: link vs remote mkdir ======= 02:56:27 (1733644587) SKIP: sanityn test_46i needs >= 2 MDTs SKIP 46i (1s) == sanityn test 47a: pdirops: remote mkdir vs mkdir ====== 02:56:28 (1733644588) SKIP: sanityn test_47a needs >= 2 MDTs SKIP 47a (1s) == sanityn test 47b: pdirops: remote mkdir vs create ===== 02:56:29 (1733644589) SKIP: sanityn test_47b needs >= 2 MDTs SKIP 47b (1s) == sanityn test 47c: pdirops: remote mkdir vs link ======= 02:56:30 (1733644590) SKIP: sanityn test_47c needs >= 2 MDTs SKIP 47c (0s) == sanityn test 47d: pdirops: remote mkdir vs unlink ===== 02:56:30 (1733644590) SKIP: sanityn test_47d needs >= 2 MDTs SKIP 47d (1s) == sanityn test 47e: pdirops: remote mkdir and rename (tgt) ========================================================== 02:56:31 (1733644591) SKIP: sanityn test_47e needs >= 2 MDTs SKIP 47e (1s) == sanityn test 47f: pdirops: remote mkdir and rename (src) ========================================================== 02:56:32 (1733644592) SKIP: sanityn test_47f needs >= 2 MDTs SKIP 47f (1s) == sanityn test 47g: pdirops: remote mkdir vs getattr ==== 02:56:33 (1733644593) SKIP: sanityn test_47g needs >= 2 MDTs SKIP 47g (1s) == sanityn test 50: osc lvb attrs: enqueue vs. CP AST ======================================================================== 02:56:34 (1733644594) 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.00426668 s, 2.4 MB/s fail_loc=0x410 fail_loc=0x0 PASS 50 (6s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 02:56:40 (1733644600) 0+1 records in 0+1 records out 159 bytes (159 B) copied, 0.00578248 s, 27.5 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3518: kill: (31599) - No such process PASS 51a (4s) == sanityn test 51b: layout lock: glimpse should be able to restart if layout changed ========================================================== 02:56:44 (1733644604) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.0027752 s, 369 kB/s fail_loc=0x1404 fail_val=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124311 s, 84.4 MB/s 3145728 PASS 51b (13s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 02:56:57 (1733644617) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.0037378 s, 274 kB/s PASS 51c (6s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 02:57:03 (1733644623) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00722552 s, 145 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (2s) == sanityn test 51e: lfs getstripe does not break leases, part 2 ========================================================== 02:57:06 (1733644626) /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2452 0x994 0x280000400 write lease(2) has applied. /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2452 0x994 0x280000400 read lease(1) has applied. PASS 51e (4s) == sanityn test 54: rename locking ======================= 02:57:09 (1733644629) llite.lustre-ffff8800ab26b800.xattr_cache=1 llite.lustre-ffff8800b341b800.xattr_cache=1 ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 512 Blocks: 1 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505012 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-12-08 02:57:09.000000000 -0500 Modify: 2024-12-08 02:57:09.000000000 -0500 Change: 2024-12-08 02:57:09.000000000 -0500 Birth: - ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000154 File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505015 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-12-08 02:57:15.000000000 -0500 Modify: 2024-12-08 02:57:15.000000000 -0500 Change: 2024-12-08 02:57:15.000000000 -0500 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 512 Blocks: 1 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505018 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-12-08 02:57:20.000000000 -0500 Modify: 2024-12-08 02:57:20.000000000 -0500 Change: 2024-12-08 02:57:20.000000000 -0500 Birth: - open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505017 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-12-08 02:57:20.000000000 -0500 Modify: 2024-12-08 02:57:20.000000000 -0500 Change: 2024-12-08 02:57:20.000000000 -0500 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000154 open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505021 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-12-08 02:57:25.000000000 -0500 Modify: 2024-12-08 02:57:26.000000000 -0500 Change: 2024-12-08 02:57:26.000000000 -0500 Birth: - File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505020 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-12-08 02:57:25.000000000 -0500 Modify: 2024-12-08 02:57:26.000000000 -0500 Change: 2024-12-08 02:57:26.000000000 -0500 Birth: - PASS 54 (23s) == sanityn test 55a: rename vs unlink target dir ========= 02:57:32 (1733644652) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55a.sanityn/d1/d2' to '/mnt/lustre/d55a.sanityn/d3/d2': No such file or directory PASS 55a (7s) == sanityn test 55b: rename vs unlink source dir ========= 02:57:39 (1733644659) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55b.sanityn/d1/d2' to '/mnt/lustre/d55b.sanityn/d3/d2': No such file or directory PASS 55b (6s) == sanityn test 55c: rename vs unlink orphan target dir == 02:57:45 (1733644665) fail_loc=0x156 mv: cannot move '/mnt/lustre/d55c.sanityn/d1/d2' to '/mnt/lustre/d55c.sanityn/d3/d2': No such file or directory PASS 55c (12s) == sanityn test 55d: rename file vs link ================= 02:57:57 (1733644677) fail_loc=0x155 mv: cannot move '/mnt/lustre/d55d.sanityn/f1' to '/mnt/lustre/d55d.sanityn/d55d.sanityn': Is a directory PASS 55d (10s) == sanityn test 56a: test llverdev with single large stripe ========================================================== 02:58:07 (1733644687) run_llverdev /mnt/lustre/f56a.sanityn -p -s 16000000 -c 4k llverdev: /mnt/lustre/f56a.sanityn is 16777216000000 bytes (15625 GB) in size timestamp: 1733644687 chunksize: 4096 size: 16777216000000 write offset: 16384000000kB 1.90747 MB/s read offset: 16384000000kB inf MB/s llverdev: data verified successfully PASS 56a (34s) == sanityn test 56b: test llverdev and partial verify of wide stripe file ========================================================== 02:58:41 (1733644721) run_llverdev /mnt/lustre/f56b.sanityn -p -s 32000000 -c 4k llverdev: read /mnt/lustre/f56b.sanityn@33554431995904+4096 no data: Success llverdev: read /mnt/lustre/f56b.sanityn@33554431995904+4096 no data: Success llverdev: /mnt/lustre/f56b.sanityn is 33554432000000 bytes (31250 GB) in size timestamp: 1733644722 chunksize: 4096 size: 33554432000000 write offset: 32768000000kB 4.88297 MB/s read offset: 32768000000kB -nan MB/s llverdev: data verified successfully PASS 56b (29s) == sanityn test 60: Verify data_version behaviour ======== 02:59:10 (1733644750) PASS 60 (1s) == sanityn test 70a: cd directory && rm directory ======== 02:59:11 (1733644751) PASS 70a (2s) == sanityn test 70b: remove files after calling rm_entry ========================================================== 02:59:13 (1733644753) PASS 70b (1s) == sanityn test 71a: correct file map just after write operation is finished ========================================================== 02:59:14 (1733644754) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00259812 s, 25.2 MB/s SKIP: sanityn test_71a ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71a (1s) == sanityn test 71b: check fiemap support for stripecount > 1 ========================================================== 02:59:15 (1733644755) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00341717 s, 19.2 MB/s SKIP: sanityn test_71b ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71b (1s) == sanityn test 71c: check FIEMAP_EXTENT_LAST flag with different extents number ========================================================== 02:59:16 (1733644756) SKIP: sanityn test_71c support only ldiskfs ost SKIP 71c (1s) == sanityn test 71d: fiemap corruption test with fm_extent_count=0 ========================================================== 02:59:17 (1733644757) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00489117 s, 13.4 MB/s SKIP: sanityn test_71d ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71d (1s) == sanityn test 72: getxattr/setxattr cache should be consistent between nodes ========================================================== 02:59:18 (1733644758) llite.lustre-ffff8800ab26b800.xattr_cache=1 llite.lustre-ffff8800b341b800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names user.attr1="value1" getfattr: Removing leading '/' from absolute path names user.attr1="value2" getfattr: Removing leading '/' from absolute path names getfattr: Removing leading '/' from absolute path names b362740ad371eae580e7f85452e8830b - 870e072da1ebfc20ea8c0cd3d6bdf3b6 - PASS 72 (1s) == sanityn test 73: getxattr should not cause xattr lock cancellation ========================================================== 02:59:19 (1733644759) llite.lustre-ffff8800ab26b800.xattr_cache=1 llite.lustre-ffff8800b341b800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" PASS 73 (2s) == sanityn test 74: flock deadlock: different mounts ======================================================================== 02:59:21 (1733644761) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00221351 s, 463 kB/s 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00194448 s, 527 kB/s 11637: get lock2 11638: get lock1 11637: done 11637: get lock1 11638: done 11638: get lock2 fcntl cmd 7 failed: Resource deadlock avoided 11637: cannot get lock1: Resource deadlock avoided fcntl cmd 7 failed: Resource deadlock avoided 11638: cannot get lock2: Resource deadlock avoided 11638: exit rc=0 11637: done 11637: exit rc=0 PASS 74 (5s) == sanityn test 75: osc: upcall after unuse lock============================================================================= 02:59:26 (1733644766) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0113991 s, 184 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00916007 s, 114 MB/s fail_loc=0x31d /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 4107: 12280 Killed stat -c %s $DIR1/$tfile fail_loc=0 PASS 75 (7s) == sanityn test 76: Verify MDT open_files listing ======== 02:59:33 (1733644773) opening files: ........ closing files: ........ PASS 76 (11s) == sanityn test 77a: check FIFO NRS policy =============== 02:59:45 (1733644785) ost.OSS.ost.nrs_policies=fifo ost.OSS.ost_create.nrs_policies=fifo ost.OSS.ost_io.nrs_policies=fifo ost.OSS.ost_out.nrs_policies=fifo ost.OSS.ost_seq.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0791536 s, 212 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00844529 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00943151 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122374 s, 85.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121829 s, 86.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0150267 s, 69.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01271 s, 82.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00899936 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0238062 s, 44.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131147 s, 80.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.032918 s, 31.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0167096 s, 62.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0337075 s, 31.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.02173 s, 48.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0180154 s, 58.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.02761 s, 38.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0198623 s, 52.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00630189 s, 166 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00613079 s, 171 MB/s , 0.00790873 s, 133 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00605265 s, 173 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106343 s, 98.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00716068 s, 146 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00419631 s, 250 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107022 s, 98.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00860206 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00885896 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00856199 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101118 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108356 s, 96.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103887 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107501 s, 97.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112335 s, 93.3 MB/s removed '/mnt/lustre/d77a.sanityn/nrs_w_oleg417-client.virtnet' removed '/mnt/lustre/d77a.sanityn/nrs_r_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77a.sanityn' PASS 77a (1s) == sanityn test 77b: check CRR-N NRS policy ============== 02:59:46 (1733644786) ost.OSS.ost.nrs_policies=crrn ost.OSS.ost_create.nrs_policies=crrn ost.OSS.ost_io.nrs_policies=crrn ost.OSS.ost_out.nrs_policies=crrn ost.OSS.ost_seq.nrs_policies=crrn ost.OSS.ost.nrs_crrn_quantum=1 ost.OSS.ost_create.nrs_crrn_quantum=1 ost.OSS.ost_io.nrs_crrn_quantum=1 ost.OSS.ost_out.nrs_crrn_quantum=1 ost.OSS.ost_seq.nrs_crrn_quantum=1 policy: crr-n, crrn_quantum 1 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0830051 s, 202 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00999749 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115663 s, 90.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00697456 s, 150 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00766389 s, 137 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0260038 s, 40.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.030897 s, 33.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0293012 s, 35.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0207856 s, 50.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0336533 s, 31.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0347283 s, 30.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0401874 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0382162 s, 27.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0320631 s, 32.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0386643 s, 27.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0407118 s, 25.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0463218 s, 22.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00635789 s, 165 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00881291 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00375443 s, 279 MB/s , 0.00777851 s, 135 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0047685 s, 220 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00611812 s, 171 MB/s 1048576 bytes (1.0 MB) copied, 0.00672302 s, 156 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00675428 s, 155 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00732362 s, 143 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00650763 s, 161 MB/s , 0.0066937 s, 157 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00720065 s, 146 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00820554 s, 128 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00831189 s, 126 MB/s , 0.00831142 s, 126 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00884718 s, 119 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg417-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost.nrs_crrn_quantum=64 ost.OSS.ost_create.nrs_crrn_quantum=64 ost.OSS.ost_io.nrs_crrn_quantum=64 ost.OSS.ost_out.nrs_crrn_quantum=64 ost.OSS.ost_seq.nrs_crrn_quantum=64 policy: crr-n, crrn_quantum 64 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.079638 s, 211 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00977294 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103192 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0149373 s, 70.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136648 s, 76.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0277565 s, 37.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0328079 s, 32.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0364925 s, 28.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.028141 s, 37.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0288373 s, 36.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0296001 s, 35.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0437036 s, 24.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0316035 s, 33.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0334922 s, 31.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0444709 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0412459 s, 25.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0368254 s, 28.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00654401 s, 160 MB/s 1048576 bytes (1.0 MB) copied, 0.00648392 s, 162 MB/s , 0.00789604 s, 133 MB/s , 0.00578388 s, 181 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00715623 s, 147 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00758781 s, 138 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00797373 s, 132 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00807083 s, 130 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0012358 s, 848 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00928121 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00187358 s, 560 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00906342 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00928358 s, 113 MB/s 1048576 bytes (1.0 MB) copied, 0.00837906 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00414782 s, 253 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00268446 s, 391 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg417-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77b (3s) == sanityn test 77c: check ORR NRS policy ================ 02:59:49 (1733644789) ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_orr_quantum=1 ost.OSS.ost_io.nrs_orr_offset_type=physical ost.OSS.ost_io.nrs_orr_supported=reads policy: orr, orr_quantum 1, orr_offset_type physical, orr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0807597 s, 208 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112783 s, 93.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0134029 s, 78.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0294806 s, 35.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0404502 s, 25.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0424666 s, 24.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0422385 s, 24.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0394707 s, 26.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0440265 s, 23.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0444332 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0388738 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0486462 s, 21.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0504848 s, 20.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0407187 s, 25.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0446637 s, 23.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0460219 s, 22.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0564064 s, 18.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00570641 s, 184 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00585954 s, 179 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00611071 s, 172 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0061649 s, 170 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00880304 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00768724 s, 136 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107799 s, 97.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00810254 s, 129 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00861319 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00881306 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00368662 s, 284 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00980648 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00945515 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00926118 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00972391 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111509 s, 94.0 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg417-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=writes ost.OSS.ost_io.nrs_orr_quantum=64 policy: orr, orr_quantum 64, orr_offset_type physical, orr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0751094 s, 223 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00963145 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115305 s, 90.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.027612 s, 38.0 MB/s , 0.0275603 s, 38.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0178014 s, 58.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0315076 s, 33.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.033649 s, 31.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.032832 s, 31.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0281624 s, 37.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0277258 s, 37.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0314749 s, 33.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0365587 s, 28.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0355986 s, 29.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0299708 s, 35.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0356085 s, 29.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0395352 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00570304 s, 184 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0047821 s, 219 MB/s , 0.00835671 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00656684 s, 160 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00887791 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00817172 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00694569 s, 151 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00869757 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00884022 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00910605 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00962731 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.009822 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00983597 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00975787 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107278 s, 97.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109414 s, 95.8 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg417-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=reads_and_writes ost.OSS.ost_io.nrs_orr_offset_type=logical policy: orr, orr_quantum 64, orr_offset_type logical, orr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0759378 s, 221 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00867573 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114881 s, 91.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0267153 s, 39.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.03763 s, 27.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0387897 s, 27.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0380252 s, 27.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0341619 s, 30.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0348865 s, 30.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0317987 s, 33.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0393203 s, 26.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0394359 s, 26.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0377691 s, 27.8 MB/s , 0.0421317 s, 24.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0332713 s, 31.5 MB/s , 0.0361595 s, 29.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0487232 s, 21.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00645346 s, 162 MB/s , 0.00639987 s, 164 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00676262 s, 155 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015251 s, 68.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00794435 s, 132 MB/s , 0.0150138 s, 69.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00820473 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0186151 s, 56.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00843611 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00915197 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00848255 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00993154 s, 106 MB/s 1+0 records in 1+0 records out , 0.0101489 s, 103 MB/s 1048576 bytes (1.0 MB) copied, 0.019471 s, 53.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00925556 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106819 s, 98.2 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg417-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77c (3s) == sanityn test 77d: check TRR nrs policy ================ 02:59:52 (1733644792) ost.OSS.ost_io.nrs_policies=trr ost.OSS.ost_io.nrs_trr_quantum=1 ost.OSS.ost_io.nrs_trr_offset_type=physical ost.OSS.ost_io.nrs_trr_supported=reads policy: trr, trr_quantum 1, trr_offset_type physical, trr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0779376 s, 215 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00885446 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010889 s, 96.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0236356 s, 44.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0261589 s, 40.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0249941 s, 42.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0298913 s, 35.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0235111 s, 44.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.022182 s, 47.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0250543 s, 41.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.036685 s, 28.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0361568 s, 29.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0360825 s, 29.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0297641 s, 35.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0369965 s, 28.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0309883 s, 33.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0400634 s, 26.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00436389 s, 240 MB/s , 0.0051318 s, 204 MB/s , 0.00649956 s, 161 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0153975 s, 68.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151068 s, 69.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00737371 s, 142 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0169981 s, 61.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0162215 s, 64.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00778437 s, 135 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0078293 s, 134 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00806837 s, 130 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0094111 s, 111 MB/s , 0.00936967 s, 112 MB/s , 0.00943222 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00955896 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108036 s, 97.1 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg417-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=writes ost.OSS.ost_io.nrs_trr_quantum=64 policy: trr, trr_quantum 64, trr_offset_type physical, trr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0792562 s, 212 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0071872 s, 146 MB/s 1048576 bytes (1.0 MB) copied, 0.00711465 s, 147 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0240804 s, 43.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0243604 s, 43.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151332 s, 69.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0261316 s, 40.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0326306 s, 32.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0238153 s, 44.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0280915 s, 37.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0349522 s, 30.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0337275 s, 31.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0313313 s, 33.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0335618 s, 31.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0384515 s, 27.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0400791 s, 26.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0403373 s, 26.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00536166 s, 196 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00560439 s, 187 MB/s , 0.0117736 s, 89.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00722304 s, 145 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00691413 s, 152 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0127581 s, 82.2 MB/s , 0.00697385 s, 150 MB/s , 0.00566834 s, 185 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00851183 s, 123 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00885052 s, 118 MB/s 1048576 bytes (1.0 MB) copied, 0.00891396 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00900702 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00994625 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104117 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00992265 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108157 s, 96.9 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg417-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=reads_and_writes ost.OSS.ost_io.nrs_trr_offset_type=logical policy: trr, trr_quantum 64, trr_offset_type logical, trr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0744656 s, 225 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00606235 s, 173 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00856268 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00739273 s, 142 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117748 s, 89.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0663703 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0688433 s, 15.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0689618 s, 15.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0645099 s, 16.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0696926 s, 15.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.067213 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0683845 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0681669 s, 15.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0679863 s, 15.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0789994 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0733368 s, 14.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0785646 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00646138 s, 162 MB/s 1048576 bytes (1.0 MB) copied, 0.00607763 s, 173 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00720862 s, 145 MB/s , 0.00808011 s, 130 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00771164 s, 136 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00815066 s, 129 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0032818 s, 320 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00929281 s, 113 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00135941 s, 771 MB/s , 0.0012169 s, 862 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0090071 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00934949 s, 112 MB/s 1048576 bytes (1.0 MB) copied, 0.00311671 s, 336 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00905046 s, 116 MB/s , 0.0105871 s, 99.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121204 s, 86.5 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg417-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77d (4s) == sanityn test 77e: check TBF NID nrs policy ============ 02:59:56 (1733644796) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_tbf_rule=start localhost nid={0@lo} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start clients nid={192.168.204.17@tcp} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start others nid={*.*.*.*@tcp} rate=50 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0775052 s, 216 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119907 s, 87.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00870436 s, 120 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0139422 s, 75.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0124176 s, 84.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.017496 s, 59.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0130489 s, 80.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00524548 s, 200 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0211134 s, 49.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00582601 s, 180 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0262104 s, 40.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0296332 s, 35.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0295004 s, 35.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0252926 s, 41.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0236084 s, 44.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0239247 s, 43.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.020132 s, 52.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00603602 s, 174 MB/s , 0.00828066 s, 127 MB/s , 0.00657795 s, 159 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00633564 s, 166 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00754411 s, 139 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00869244 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00796265 s, 132 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00887409 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00852368 s, 123 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0104078 s, 101 MB/s , 0.0106276 s, 98.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103201 s, 102 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115301 s, 90.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107641 s, 97.4 MB/s 1048576 bytes (1.0 MB) copied, 0.011626 s, 90.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119091 s, 88.0 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg417-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change localhost rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change clients rate=101 ost.OSS.ost_io.nrs_tbf_rule=change others rate=51 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0762706 s, 220 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0078319 s, 134 MB/s , 0.0121603 s, 86.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203334 s, 51.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0194368 s, 53.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0159774 s, 65.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114122 s, 91.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.024101 s, 43.5 MB/s , 0.00742501 s, 141 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120721 s, 86.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0367288 s, 28.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0177036 s, 59.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0324963 s, 32.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0400639 s, 26.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0331004 s, 31.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0406962 s, 25.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.039297 s, 26.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00722245 s, 145 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00747929 s, 140 MB/s , 0.00755447 s, 139 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00213878 s, 490 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109312 s, 95.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00992913 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00904474 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00925844 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0099811 s, 105 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0112921 s, 92.9 MB/s , 0.00908518 s, 115 MB/s , 0.00951351 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00725212 s, 145 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00965935 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114071 s, 91.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122351 s, 85.7 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg417-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop localhost ost.OSS.ost_io.nrs_tbf_rule=stop clients ost.OSS.ost_io.nrs_tbf_rule=stop others 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.103539 s, 162 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100861 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00921239 s, 114 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0220295 s, 47.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.029273 s, 35.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0297698 s, 35.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0355614 s, 29.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0344219 s, 30.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0359526 s, 29.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0396971 s, 26.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0402173 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0382833 s, 27.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0418488 s, 25.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0415189 s, 25.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0411123 s, 25.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0486648 s, 21.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0464881 s, 22.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00954586 s, 110 MB/s , 0.00658867 s, 159 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00819418 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00691136 s, 152 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0134044 s, 78.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126389 s, 83.0 MB/s 1048576 bytes (1.0 MB) copied, 0.00873337 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00870247 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00157933 s, 664 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111928 s, 93.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103791 s, 101 MB/s , 0.00968455 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113031 s, 92.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0118456 s, 88.5 MB/s , 0.0111688 s, 93.9 MB/s 1048576 bytes (1.0 MB) copied, 0.011536 s, 90.9 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg417-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0771129 s, 218 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143652 s, 73.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143384 s, 73.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146618 s, 71.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148687 s, 70.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0201808 s, 52.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011594 s, 90.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148409 s, 70.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0302261 s, 34.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0374026 s, 28.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0383369 s, 27.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0399369 s, 26.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128844 s, 81.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0277912 s, 37.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0189835 s, 55.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0216558 s, 48.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0663452 s, 15.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0075647 s, 139 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00640885 s, 164 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00914277 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00829095 s, 126 MB/s 1048576 bytes (1.0 MB) copied, 0.00732975 s, 143 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0075968 s, 138 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00866344 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00733094 s, 143 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00822563 s, 127 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00812981 s, 129 MB/s 1048576 bytes (1.0 MB) copied, 0.00875196 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00848468 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00874376 s, 120 MB/s 1048576 bytes (1.0 MB) copied, 0.00865989 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00320367 s, 327 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101715 s, 103 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg417-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' PASS 77e (5s) == sanityn test 77f: check TBF JobID nrs policy ========== 03:00:01 (1733644801) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start runas jobid={iozone.500 dd.500 tiotest.500} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start iozone_runas jobid={iozone.500} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg417-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0930321 s, 180 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00838943 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00934831 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00910464 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0147492 s, 71.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142942 s, 73.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.017358 s, 60.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0201423 s, 52.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0220307 s, 47.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114641 s, 91.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0279117 s, 37.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0277413 s, 37.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0377212 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206175 s, 50.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.043236 s, 24.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0281083 s, 37.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0491155 s, 21.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00784241 s, 134 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0082804 s, 127 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00859575 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00860076 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0181307 s, 57.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102342 s, 102 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104313 s, 101 MB/s 1048576 bytes (1.0 MB) copied, 0.0109524 s, 95.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0197015 s, 53.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128658 s, 81.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0150724 s, 69.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0153223 s, 68.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015655 s, 67.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0165896 s, 63.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0172106 s, 60.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0176279 s, 59.5 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg417-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change runas rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change iozone_runas rate=101 ost.OSS.ost_io.nrs_tbf_rule=change dd_runas rate=51 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg417-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0745276 s, 225 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00848647 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117402 s, 89.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0377478 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0324289 s, 32.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.03045 s, 34.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0411804 s, 25.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0432398 s, 24.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0459358 s, 22.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0475754 s, 22.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0359289 s, 29.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0466702 s, 22.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0485203 s, 21.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0510317 s, 20.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0479139 s, 21.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0469146 s, 22.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0517961 s, 20.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00796591 s, 132 MB/s , 0.00658409 s, 159 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0057667 s, 182 MB/s 1048576 bytes (1.0 MB) copied, 0.00926072 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111685 s, 93.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00804363 s, 130 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00743062 s, 141 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00740379 s, 142 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00950226 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00826469 s, 127 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00157093 s, 667 MB/s , 0.00828895 s, 127 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109433 s, 95.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00931378 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00844857 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115105 s, 91.1 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg417-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop runas ost.OSS.ost_io.nrs_tbf_rule=stop iozone_runas ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg417-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.074443 s, 225 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104656 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106711 s, 98.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00932954 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00977472 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142558 s, 73.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0411321 s, 25.5 MB/s , 0.0404669 s, 25.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0520692 s, 20.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0529929 s, 19.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0544054 s, 19.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0444402 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0542599 s, 19.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0615333 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0531762 s, 19.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0647269 s, 16.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0564159 s, 18.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00715698 s, 147 MB/s , 0.0105452 s, 99.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00735666 s, 143 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00806541 s, 130 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00963026 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0013024 s, 805 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115145 s, 91.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106168 s, 98.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0109841 s, 95.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00999383 s, 105 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0111143 s, 94.3 MB/s , 0.0103757 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104738 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117238 s, 89.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011202 s, 93.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114289 s, 91.7 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg417-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_policies=fifo running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg417-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0842857 s, 199 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00849053 s, 123 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00882901 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0295672 s, 35.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0368871 s, 28.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0391784 s, 26.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0332075 s, 31.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0402742 s, 26.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0406549 s, 25.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0446231 s, 23.5 MB/s , 0.0380138 s, 27.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0394994 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0444964 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0372536 s, 28.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.042452 s, 24.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0449777 s, 23.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0484131 s, 21.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00807602 s, 130 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00891168 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0076725 s, 137 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00238572 s, 440 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104348 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00944752 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00251068 s, 418 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00273227 s, 384 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00919351 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00955046 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00919425 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125375 s, 83.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0125545 s, 83.5 MB/s , 0.00967835 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010838 s, 96.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123608 s, 84.8 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg417-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' PASS 77f (5s) == sanityn test 77g: Change TBF type directly ============ 03:00:06 (1733644806) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 ost.OSS.ost_io.nrs_policies=fifo PASS 77g (3s) == sanityn test 77h: Wrong policy name should report error, not LBUG ========================================================== 03:00:09 (1733644809) oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=abc: No such file or directory oleg417-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='abc': No such file or directory pdsh@oleg417-client: oleg417-server: ssh exited with exit code 2 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc: Unknown error 524 oleg417-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf abc': Unknown error 524 pdsh@oleg417-client: oleg417-server: ssh exited with exit code 12 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf reg abc: Unknown error 524 oleg417-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf reg abc': Unknown error 524 pdsh@oleg417-client: oleg417-server: ssh exited with exit code 12 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc efg: Unknown error 524 oleg417-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf abc efg': Unknown error 524 pdsh@oleg417-client: oleg417-server: ssh exited with exit code 12 PASS 77h (2s) == sanityn test 77i: Change rank of TBF rule ============= 03:00:11 (1733644811) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start before jobid={jobid} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start after jobid={jobid} rate=1000 rank=default ost.OSS.ost_io.nrs_tbf_rule=start target jobid={jobid} rate=1000 rank=after Move before itself ost.OSS.ost_io.nrs_tbf_rule=change target rank=target Move to higher rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=before Move to lower rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=after Move before default ost.OSS.ost_io.nrs_tbf_rule=change target rank=default ost.OSS.ost_io.nrs_policies=fifo PASS 77i (6s) == sanityn test 77j: check TBF-OPCode NRS policy ========= 03:00:17 (1733644817) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf opcode ost.OSS.ost_io.nrs_tbf_rule=start ost_r opcode={ost_read} rate=5 ost.OSS.ost_io.nrs_tbf_rule=start ost_w opcode={ost_write} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0727015 s, 231 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00662395 s, 158 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0194021 s, 54.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0181363 s, 57.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0231015 s, 45.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104221 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212091 s, 49.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.018257 s, 57.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116298 s, 90.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0189164 s, 55.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.024273 s, 43.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.033066 s, 31.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.02606 s, 40.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0301309 s, 34.8 MB/s 1048576 bytes (1.0 MB) copied, 0.03614 s, 29.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0398074 s, 26.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0331607 s, 31.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00801261 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102473 s, 102 MB/s , 0.00720756 s, 145 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00745319 s, 141 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00883694 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104648 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123389 s, 85.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0019089 s, 549 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112304 s, 93.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114352 s, 91.7 MB/s , 0.0102133 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108192 s, 96.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105894 s, 99.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111129 s, 94.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117126 s, 89.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128687 s, 81.5 MB/s removed '/mnt/lustre/d77j.sanityn/nrs_r_oleg417-client.virtnet' removed '/mnt/lustre/d77j.sanityn/nrs_w_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77j.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 5 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.92662 s, 21.3 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.4271 s, 5.4 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77j.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_r ost.OSS.ost_io.nrs_tbf_rule=stop ost_w ost.OSS.ost_io.nrs_policies=fifo PASS 77j (49s) == sanityn test 77ja: check TBF-UID/GID NRS policy ======= 03:01:06 (1733644866) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg417-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg417-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [chmod] [777] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg417-client.virtnet] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg417-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg417-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.443577 s, 37.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00908045 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00855059 s, 123 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00829994 s, 126 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0171301 s, 61.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0198445 s, 52.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00875944 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00776561 s, 135 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120073 s, 87.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.150029 s, 7.0 MB/s , 0.140674 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.148393 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.148138 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.163352 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.152581 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.157048 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.150111 s, 7.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00835037 s, 126 MB/s 1048576 bytes (1.0 MB) copied, 0.00816578 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00803254 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00801384 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00923982 s, 113 MB/s , 0.0109032 s, 96.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00812084 s, 129 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00934981 s, 112 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00991618 s, 106 MB/s , 0.00998049 s, 105 MB/s , 0.00904772 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109271 s, 96.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105397 s, 99.5 MB/s , 0.00989275 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100486 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119893 s, 87.5 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg417-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d77ja.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 20.0245 s, 5.2 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9708 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg417-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg417-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [chmod] [777] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg417-client.virtnet] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg417-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg417-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.444509 s, 37.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109725 s, 95.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129122 s, 81.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133576 s, 78.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124958 s, 83.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123157 s, 85.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0171548 s, 61.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00592486 s, 177 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105016 s, 99.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.150573 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.151653 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.15209 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.151673 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.153023 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.166188 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.168453 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.15489 s, 6.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00805568 s, 130 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00801381 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00958703 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00876289 s, 120 MB/s 1048576 bytes (1.0 MB) copied, 0.00916536 s, 114 MB/s 1048576 bytes (1.0 MB) copied, 0.008154 s, 129 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0094838 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00986144 s, 106 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0102252 s, 103 MB/s , 0.00940792 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00181922 s, 576 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111336 s, 94.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0100719 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0093871 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101706 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115192 s, 91.0 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg417-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d77ja.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 20.0259 s, 5.2 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9642 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77ja (131s) == sanityn test 77jb: check TBF-UID/GID NRS policy on files that don't belong to us ========================================================== 03:03:17 (1733644997) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 0/500/0/500, groups: [touch] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg417-client.virtnet] running as uid/gid/euid/egid 0/500/0/500, groups: [touch] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg417-client.virtnet] running as uid/gid/euid/egid 0/500/0/500, groups: [chmod] [777] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg417-client.virtnet] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg417-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/nrs_r_oleg417-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.21696 s, 13.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.017072 s, 61.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0167559 s, 62.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0171689 s, 61.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0183338 s, 57.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0298379 s, 35.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123515 s, 84.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00975438 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0342691 s, 30.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.179157 s, 5.9 MB/s , 0.179142 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.184403 s, 5.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.185906 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.185477 s, 5.7 MB/s 1048576 bytes (1.0 MB) copied, 0.188752 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.191692 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.186102 s, 5.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00640928 s, 164 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00911426 s, 115 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00912026 s, 115 MB/s , 0.00895933 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100847 s, 104 MB/s , 0.00798666 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00963767 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00861257 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00885842 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00893328 s, 117 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00857175 s, 122 MB/s , 0.00930018 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00955048 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00963262 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00982611 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00997469 s, 105 MB/s removed '/mnt/lustre/d77jb.sanityn/nrs_w_oleg417-client.virtnet' removed '/mnt/lustre/d77jb.sanityn/nrs_r_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77jb.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 0/500/0/500, groups: [touch] [/mnt/lustre/d77jb.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 20.0252 s, 5.2 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77jb.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.966 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77jb.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/0/500/0, groups: [touch] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg417-client.virtnet] running as uid/gid/euid/egid 500/0/500/0, groups: [touch] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg417-client.virtnet] running as uid/gid/euid/egid 500/0/500/0, groups: [chmod] [777] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg417-client.virtnet] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg417-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/nrs_r_oleg417-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.2238 s, 13.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101245 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015429 s, 68.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.020372 s, 51.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0165561 s, 63.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0240307 s, 43.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0254971 s, 41.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0255167 s, 41.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0335463 s, 31.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.175391 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.185876 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.182169 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.191156 s, 5.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.192346 s, 5.5 MB/s , 0.183253 s, 5.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.190021 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.192687 s, 5.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123553 s, 84.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136738 s, 76.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0140582 s, 74.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012511 s, 83.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0139024 s, 75.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0147338 s, 71.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0150213 s, 69.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112386 s, 93.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156579 s, 67.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01647 s, 63.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144706 s, 72.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0132604 s, 79.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131129 s, 80.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152095 s, 68.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152986 s, 68.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0208057 s, 50.4 MB/s removed '/mnt/lustre/d77jb.sanityn/nrs_r_oleg417-client.virtnet' removed '/mnt/lustre/d77jb.sanityn/nrs_w_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77jb.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/0/500/0, groups: [touch] [/mnt/lustre/d77jb.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.8436 s, 5.3 MB/s Write runtime is 20 s, speed is 5.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77jb.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9363 s, 5.3 MB/s Read runtime is 20 s, speed is 5.000000 IOPS cleanup_tbf /mnt/lustre/d77jb.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77jb (132s) == sanityn test 77k: check TBF policy with UID/GID/JobID/OPCode expression ========================================================== 03:05:29 (1733645129) ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_tbf_rule=start ext_w jobid={dd.500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r jobid={dd.500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg417-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.250487 s, 67.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00694982 s, 151 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0180967 s, 57.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0216352 s, 48.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115932 s, 90.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0280562 s, 37.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0292849 s, 35.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0194334 s, 54.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0235761 s, 44.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0300655 s, 34.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0505674 s, 20.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0495967 s, 21.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0482215 s, 21.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0618853 s, 16.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0540122 s, 19.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0597233 s, 17.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0626745 s, 16.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00830801 s, 126 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00521464 s, 201 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00683578 s, 153 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00569781 s, 184 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00794485 s, 132 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112622 s, 93.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00959586 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00736605 s, 142 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00153002 s, 685 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00830603 s, 126 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00129886 s, 807 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00979327 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00273243 s, 384 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00951543 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0132065 s, 79.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00135569 s, 773 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg417-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.90458 s, 21.4 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.72548 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext_w nid={0@lo 192.168.204.17@tcp}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r nid={0@lo 192.168.204.17@tcp}&opcode={ost_read} rate=10 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.163949 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0161095 s, 65.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0214625 s, 48.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0345503 s, 30.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.031992 s, 32.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0390787 s, 26.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212476 s, 49.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0452102 s, 23.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0429835 s, 24.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0423388 s, 24.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.044146 s, 23.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0382013 s, 27.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.043383 s, 24.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.157091 s, 6.7 MB/s , 0.149484 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.20189 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.198702 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102954 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108404 s, 96.7 MB/s , 0.0167808 s, 62.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0134454 s, 78.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146573 s, 71.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00688241 s, 152 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0189214 s, 55.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105709 s, 99.2 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0181264 s, 57.8 MB/s , 0.0055835 s, 188 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0181266 s, 57.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0030902 s, 339 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01937 s, 54.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.020196 s, 51.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0188804 s, 55.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0202596 s, 51.8 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg417-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.02158 s, 20.9 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.73783 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext nid={0@lo 192.168.204.17@tcp}&jobid={dd.500} rate=20 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg417-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.147497 s, 114 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124494 s, 84.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124429 s, 84.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0171598 s, 61.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160064 s, 65.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0339822 s, 30.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.036266 s, 28.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0398365 s, 26.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0292942 s, 35.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.031794 s, 33.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0268783 s, 39.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0332444 s, 31.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0351765 s, 29.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0325346 s, 32.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.041519 s, 25.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.038552 s, 27.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0493816 s, 21.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00883068 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00165464 s, 634 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00913949 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00846608 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00894797 s, 117 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0094588 s, 111 MB/s , 0.00980349 s, 107 MB/s 1048576 bytes (1.0 MB) copied, 0.00989748 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109963 s, 95.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106604 s, 98.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010457 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103602 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101682 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104376 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108869 s, 96.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012396 s, 84.6 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg417-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.90817 s, 21.4 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.87251 s, 21.5 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext ost.OSS.ost_io.nrs_tbf_rule=start ext_a jobid={dd.500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b jobid={dd.500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg417-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0806649 s, 208 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00955996 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131009 s, 80.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125556 s, 83.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0221658 s, 47.3 MB/s , 0.0175341 s, 59.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.02324 s, 45.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0251691 s, 41.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0134868 s, 77.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0210964 s, 49.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0326917 s, 32.1 MB/s , 0.0309384 s, 33.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0297702 s, 35.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0288205 s, 36.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0272534 s, 38.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0251735 s, 41.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0303131 s, 34.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123752 s, 84.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0163656 s, 64.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151539 s, 69.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0161308 s, 65.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0165447 s, 63.4 MB/s , 0.0122369 s, 85.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0163781 s, 64.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0217578 s, 48.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101028 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0171237 s, 61.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0164091 s, 63.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0189277 s, 55.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0178742 s, 58.7 MB/s , 0.0191255 s, 54.8 MB/s , 0.0168973 s, 62.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0200838 s, 52.2 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg417-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.83231 s, 10.7 MB/s Write runtime is 10 s, speed is 10.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.73996 s, 10.8 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.93714 s, 21.2 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.73114 s, 10.8 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_tbf_rule=start ext_ug uid={500}&gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg417-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.84821 s, 19.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117471 s, 89.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.016909 s, 62.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0267498 s, 39.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0202589 s, 51.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0338737 s, 31.0 MB/s 1048576 bytes (1.0 MB) copied, 0.024462 s, 42.9 MB/s , 0.0312742 s, 33.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0310586 s, 33.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.175704 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.176851 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.186245 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.18121 s, 5.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.20266 s, 5.2 MB/s , 0.194468 s, 5.4 MB/s 1048576 bytes (1.0 MB) copied, 0.202791 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.19939 s, 5.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00678478 s, 155 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00758048 s, 138 MB/s 1048576 bytes (1.0 MB) copied, 0.00651776 s, 161 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0064428 s, 163 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00996082 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00939044 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114677 s, 91.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00840694 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103513 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00146161 s, 717 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00784308 s, 134 MB/s , 0.00159974 s, 655 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00878044 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00926756 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00892191 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100727 s, 104 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg417-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.8396 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.4399 s, 5.4 MB/s Read runtime is 20 s, speed is 5.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_ug ost.OSS.ost_io.nrs_tbf_rule=start ext_uw uid={500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_ur uid={500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg417-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.105215 s, 159 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00787297 s, 133 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00905488 s, 116 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0223354 s, 46.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0283265 s, 37.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0290647 s, 36.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0245708 s, 42.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0216053 s, 48.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0284028 s, 36.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0365934 s, 28.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0254237 s, 41.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0357529 s, 29.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0350545 s, 29.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0313123 s, 33.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0361104 s, 29.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0439176 s, 23.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0525841 s, 19.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00808123 s, 130 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0088575 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00938254 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00922535 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00926263 s, 113 MB/s , 0.00757302 s, 138 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00469693 s, 223 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00152169 s, 689 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00881559 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113136 s, 92.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00241635 s, 434 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00135383 s, 775 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116931 s, 89.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01208 s, 86.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129002 s, 81.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00366656 s, 286 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg417-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.97346 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.7398 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_uw ost.OSS.ost_io.nrs_tbf_rule=stop ext_ur ost.OSS.ost_io.nrs_tbf_rule=start ext_a uid={500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b uid={500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg417-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.166099 s, 101 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0166321 s, 63.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0165124 s, 63.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0367355 s, 28.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0275529 s, 38.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0455518 s, 23.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0401887 s, 26.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0320488 s, 32.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0451051 s, 23.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0444732 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0292933 s, 35.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0418901 s, 25.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0458237 s, 22.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.048061 s, 21.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0555059 s, 18.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0567651 s, 18.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0520163 s, 20.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151176 s, 69.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135523 s, 77.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.018273 s, 57.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0173682 s, 60.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212229 s, 49.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0162779 s, 64.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0176355 s, 59.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0182824 s, 57.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0193966 s, 54.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0216639 s, 48.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0210979 s, 49.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0222631 s, 47.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0201066 s, 52.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0209757 s, 50.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212762 s, 49.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0196737 s, 53.3 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg417-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.81369 s, 10.7 MB/s Write runtime is 10 s, speed is 10.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.741 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.80586 s, 10.7 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.73158 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_policies=fifo PASS 77k (346s) == sanityn test 77l: check the output of NRS policies for generic TBF ========================================================== 03:11:15 (1733645475) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_policies=fifo PASS 77l (4s) == sanityn test 77m: check NRS Delay slows write RPC processing ========================================================== 03:11:19 (1733645479) ost.OSS.ost_io.nrs_policies=delay ost.OSS.ost_io.nrs_delay_min=4 ost.OSS.ost_io.nrs_delay_max=4 ost.OSS.ost_io.nrs_delay_pct=100 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg417-client.virtnet] [bs=1M] [count=1] [oflag=direct] [conv=fdatasync] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 3.99976 s, 262 kB/s running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg417-client.virtnet] [bs=1M] [count=10] [oflag=direct] [conv=fdatasync] 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 40.0073 s, 262 kB/s ost.OSS.ost_io.nrs_policies=fifo PASS 77m (50s) == sanityn test 77n: check wildcard support for TBF JobID NRS policy ========================================================== 03:12:09 (1733645529) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={*.500} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0794117 s, 211 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00713476 s, 147 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117772 s, 89.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0248464 s, 42.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0329516 s, 31.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0337137 s, 31.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0343003 s, 30.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0241093 s, 43.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0264598 s, 39.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0370333 s, 28.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0329724 s, 31.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0334831 s, 31.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0433995 s, 24.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0407162 s, 25.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0374094 s, 28.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.03776 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0387724 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00780761 s, 134 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00545448 s, 192 MB/s , 0.0117196 s, 89.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00795359 s, 132 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00665742 s, 158 MB/s 1048576 bytes (1.0 MB) copied, 0.0101874 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0118809 s, 88.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00815218 s, 129 MB/s , 0.00825831 s, 127 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103034 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107454 s, 97.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0111133 s, 94.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114022 s, 92.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0118545 s, 88.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123665 s, 84.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129308 s, 81.1 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg417-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77n.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.96085 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77n.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.97158 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.*} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.22259 s, 75.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00923078 s, 114 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0193365 s, 54.2 MB/s , 0.0198709 s, 52.8 MB/s , 0.0198762 s, 52.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146553 s, 71.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0216094 s, 48.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0170427 s, 61.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0163976 s, 63.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0307863 s, 34.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0292563 s, 35.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0382718 s, 27.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0920836 s, 11.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0933174 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.082894 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0827202 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0929045 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0283773 s, 37.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0284913 s, 36.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.030089 s, 34.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.029655 s, 35.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0303294 s, 34.6 MB/s , 0.0292302 s, 35.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0294966 s, 35.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0293202 s, 35.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0299982 s, 35.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0299625 s, 35.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0304753 s, 34.4 MB/s , 0.0311305 s, 33.7 MB/s , 0.0313369 s, 33.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0307243 s, 34.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0315528 s, 33.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.032583 s, 32.2 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg417-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg417-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.89312 s, 21.4 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.96556 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_policies=fifo PASS 77n (64s) == sanityn test 77o: Changing rank should not panic ====== 03:13:13 (1733645593) mds.MDS.mdt.nrs_policies=tbf nid mds.MDS.mdt.nrs_tbf_rule=start name nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=start name1 nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=change name1 rank=name mds.MDS.mdt.nrs_tbf_rule=stop name mds.MDS.mdt.nrs_policies=fifo PASS 77o (3s) == sanityn test 77q: Parallel TBF rule definitions should not panic ========================================================== 03:13:16 (1733645596) mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_policies=fifo PASS 77q (34s) == sanityn test 77p: Check validity of rule names for TBF policies ========================================================== 03:13:50 (1733645630) mds.MDS.mdt.nrs_policies=tbf oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_overflo uid={500} rate=500: File name too long oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test_77p_overflo uid={500} rate=500': File name too long pdsh@oleg417-client: oleg417-server: ssh exited with exit code 36 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_empty: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test_77p_empty': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p@spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p@spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p.spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p.spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p~spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p~spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p#spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p#spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p/spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p/spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p^spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p^spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p%spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p%spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p*spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p*spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p;spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p;spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p,spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p,spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p?spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p?spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77pspec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p>spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p:spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p:spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p+spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p+spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p=spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p=spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p)spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p)spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p(spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p(spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p{spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p{spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p}spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p}spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p|spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p|spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p[spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p[spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p]spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p]spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p!spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p!spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p&spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p&spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p$spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p$spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p`spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p`spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p\spec uid={500} rate=500: Invalid argument oleg417-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p\spec uid={500} rate=500': Invalid argument pdsh@oleg417-client: oleg417-server: ssh exited with exit code 22 mds.MDS.mdt.nrs_policies=fifo PASS 77p (12s) == sanityn test 77r: Change type of tbf policy at run time ========================================================== 03:14:02 (1733645642) mds.MDS.mdt.nrs_policies=tbf uid mds.MDS.mdt.nrs_tbf_rule=start md_rule uid={500} rate=1 mds.MDS.mdt.nrs_policies=tbf gid mds.MDS.mdt.nrs_tbf_rule=start md_rule gid={500} rate=1 mds.MDS.mdt.nrs_policies=tbf jobid mds.MDS.mdt.nrs_tbf_rule=start md_rule jobid={*.500} rate=1 mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start md_rule uid={500} rate=1 mds.MDS.mdt.nrs_policies=fifo check the number of requests in queue: fifo: 0 crrn: 0 tbf: 0 delay: 0 fifo: 0 crrn: 0 tbf: 0 delay: 0 cleanup 77r 9306 kill md_thread xargs PASS 77r (37s) == sanityn test 78: Enable policy and specify tunings right away ========================================================== 03:14:39 (1733645679) oleg417-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_orr_quantum=1: No such device oleg417-server: error: set_param: setting 'ost/OSS/*/nrs_orr_quantum'='1': No such device pdsh@oleg417-client: oleg417-server: ssh exited with exit code 19 ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_policies=fifo PASS 78 (2s) == sanityn test 79: xattr: intent error ================== 03:14:41 (1733645681) File: '/mnt/lustre/d79.sanityn' Size: 512 Blocks: 1 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272506770 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-12-08 03:14:41.000000000 -0500 Modify: 2024-12-08 03:14:41.000000000 -0500 Change: 2024-12-08 03:14:41.000000000 -0500 Birth: - fail_val=0 fail_loc=0x80000160 fail_val=0 fail_loc=0x80000131 # file: mnt/lustre/d79.sanityn trusted.name1="value1" PASS 79 (11s) == sanityn test 80a: migrate directory when some children is being opened ========================================================== 03:14:52 (1733645692) SKIP: sanityn test_80a needs >= 2 MDTs SKIP 80a (1s) == sanityn test 80b: Accessing directory during migration ========================================================== 03:14:53 (1733645693) SKIP: sanityn test_80b needs >= 2 MDTs SKIP 80b (1s) == sanityn test 81a: rename and stat under striped directory ========================================================== 03:14:54 (1733645694) SKIP: sanityn test_81a needs >= 2 MDTs SKIP 81a (1s) == sanityn test 81b: rename under striped directory doesn't deadlock ========================================================== 03:14:55 (1733645695) SKIP: sanityn test_81b We need at least 2 MDTs for this test SKIP 81b (1s) == sanityn test 81c: rename revoke LOOKUP lock for remote object ========================================================== 03:14:56 (1733645696) SKIP: sanityn test_81c needs >= 4 MDTs SKIP 81c (0s) == sanityn test 81d: parallel rename file cross-dir on same MDT ========================================================== 03:14:56 (1733645696) total: 2500 open/close in 4.72 seconds: 529.50 ops/second snapshot_time 1733645720.832564233 secs.nsecs start_time 1733645698.420336465 secs.nsecs elapsed_time 22.412227768 secs.nsecs open 2505 samples [usecs] 70 1386 563308 132191688 close 2504 samples [usecs] 51 407 176619 12826097 mknod 2501 samples [usecs] 150 1359 494715 102798279 unlink 2500 samples [usecs] 290 26630 1987979 7108372043 mkdir 2 samples [usecs] 359 575 934 459506 rmdir 2 samples [usecs] 3546 5158 8704 39179080 rename 2500 samples [usecs] 208 17842 2647346 5373520878 getattr 3760 samples [usecs] 5 297 61808 1420186 parallel_rename_file 2500 samples [usecs] 208 17842 2647346 5373520878 crossdir_rename 2500 samples [usecs] 208 17842 2647346 5373520878 PASS 81d (25s) == sanityn test 82: fsetxattr and fgetxattr on orphan files ========================================================== 03:15:21 (1733645721) multiop /mnt/lustre/f82.sanityn vO_ac TMPPIPE=/tmp/multiop_open_wait_pipe.6973 multiop /mnt/lustre2/f82.sanityn vo_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.6973 PASS 82 (3s) == sanityn test 83: access striped directory while it is being created/unlinked ========================================================== 03:15:24 (1733645724) SKIP: sanityn test_83 needs >= 2 MDTs SKIP 83 (1s) == sanityn test 84: 0-nlink race in lu_object_find() ===== 03:15:25 (1733645725) fail_loc=0x8000060b PASS 84 (6s) == sanityn test 85: Lustre API root cache race =========== 03:15:31 (1733645731) Starting: llapi_root_test /mnt/lustre/f85.sanityn /mnt/lustre2/f85.sanityn Starting test test1 at 1733645732 Finishing test test1 at 1733645732 PASS 85 (2s) == sanityn test 90: open/create and unlink striped directory ========================================================== 03:15:33 (1733645733) SKIP: sanityn test_90 needs >= 2 MDTs SKIP 90 (1s) == sanityn test 91: chmod and unlink striped directory === 03:15:34 (1733645734) SKIP: sanityn test_91 needs >= 2 MDTs SKIP 91 (1s) == sanityn test 92: create remote directory under orphan directory ========================================================== 03:15:35 (1733645735) SKIP: sanityn test_92 needs >= 2 MDTs SKIP 92 (0s) == sanityn test 93: alloc_rr should not allocate on same ost ========================================================== 03:15:35 (1733645735) fail_loc=0x00000163 fail_loc=0x0 /mnt/lustre/f93.sanityn-1/file1 lmm_stripe_count: 2 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 6093 0x17cd 0x240000400 1 6079 0x17bf 0x280000400 /mnt/lustre2/f93.sanityn-2/file2 lmm_stripe_count: 2 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 6094 0x17ce 0x240000400 1 6080 0x17c0 0x280000400 rc1=0 and rc2=0 PASS 93 (9s) == sanityn test 94: signal vs CP callback race =========== 03:15:44 (1733645744) osc.lustre-OST0000-osc-ffff8800ab26b800.idle_timeout=0 osc.lustre-OST0000-osc-ffff8800b341b800.idle_timeout=0 osc.lustre-OST0001-osc-ffff8800ab26b800.idle_timeout=0 osc.lustre-OST0001-osc-ffff8800b341b800.idle_timeout=0 2+0 records in 2+0 records out 8192 bytes (8.2 kB) copied, 0.0430492 s, 190 kB/s fail_val=5 fail_loc=0x80000312 fail_val=6 fail_loc=0x80000329 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 2.99919 s, 1.4 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 5743: 30601 Alarm clock dd if=/dev/zero of=$DIR/$tfile conv=notrunc oflag=append bs=4k count=1 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.023326 s, 176 kB/s osc.lustre-OST0000-osc-ffff8800ab26b800.idle_timeout=debug osc.lustre-OST0000-osc-ffff8800b341b800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800ab26b800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b341b800.idle_timeout=debug PASS 94 (10s) == sanityn test 95a: Check readpage() on a page that was removed from page cache ========================================================== 03:15:54 (1733645754) llite.lustre-ffff8800ab26b800.fast_read=0 llite.lustre-ffff8800b341b800.fast_read=0 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0222914 s, 94.1 MB/s fail_loc=0x80001421 fail_val=7 fail_loc=0x80001422 fail_val=10 llite.lustre-ffff8800ab26b800.fast_read=1 llite.lustre-ffff8800b341b800.fast_read=1 PASS 95a (20s) == sanityn test 95b: Check readpage() on a page that is no longer uptodate ========================================================== 03:16:14 (1733645774) llite.lustre-ffff8800ab26b800.fast_read=0 llite.lustre-ffff8800b341b800.fast_read=0 1+0 records in 1+0 records out 12288 bytes (12 kB) copied, 0.00291295 s, 4.2 MB/s fail_loc=0x80001424 fail_val=5 fail_loc=0 llite.lustre-ffff8800ab26b800.fast_read=1 llite.lustre-ffff8800b341b800.fast_read=1 PASS 95b (8s) == sanityn test 100a: DoM: glimpse RPCs for stat without IO lock (DoM only file) ========================================================== 03:16:22 (1733645782) SKIP: sanityn test_100a Reserved for glimpse-ahead SKIP 100a (1s) == sanityn test 100b: DoM: no glimpse RPC for stat with IO lock (DoM only file) ========================================================== 03:16:23 (1733645783) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00241554 s, 1.7 MB/s /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK PASS 100b (3s) == sanityn test 100c: DoM: write vs stat without IO lock (combined file) ========================================================== 03:16:26 (1733645786) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0364908 s, 57.5 MB/s /mnt/lustre/d100c.sanityn/dom has type file OK /mnt/lustre/d100c.sanityn/dom has size 2097152 OK PASS 100c (2s) == sanityn test 100d: DoM: write+truncate vs stat without IO lock (combined file) ========================================================== 03:16:28 (1733645788) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0219141 s, 95.7 MB/s /mnt/lustre/d100d.sanityn/dom has type file OK /mnt/lustre/d100d.sanityn/dom has size 4096 OK PASS 100d (2s) == sanityn test 100e: DoM: read on open and file size ==== 03:16:30 (1733645790) 1+0 records in 1+0 records out 12000 bytes (12 kB) copied, 0.00204465 s, 5.9 MB/s PASS 100e (2s) == sanityn test 101a: Discard DoM data on unlink ========= 03:16:32 (1733645792) /mnt/lustre/f101a.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.000514834 s, 8.0 MB/s PASS 101a (2s) == sanityn test 101b: Discard DoM data on rename ========= 03:16:34 (1733645794) /mnt/lustre/f101b.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.000482135 s, 8.5 MB/s PASS 101b (1s) == sanityn test 101c: Discard DoM data on close-unlink === 03:16:35 (1733645795) /mnt/lustre/f101c.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00058779 s, 7.0 MB/s PASS 101c (4s) SKIP: sanityn test_102 skipping ALWAYS excluded test 102 == sanityn test 103: Test size correctness with lockahead ========================================================== 03:16:39 (1733645799) fail_loc=0x415 fail_loc=0x415 fail_val=2 Incorrect size expected (no glimpse fix): Starting test test23 at 1733645800 lockahead_test: lockahead_test.c:1191: test23: assertion 'sb.st_size == sb2.st_size' failed: size on /mnt/lustre/d103.sanityn/f103.sanityn and /mnt/lustre2/d103.sanityn/f103.sanityn differs: 0 vs 1048576 fail_loc=0 fail_loc=0x214 fail_val=2 Starting test test23 at 1733645802 Finishing test test23 at 1733645803 PASS 103 (7s) == sanityn test 104: Verify that MDS stores atime/mtime/ctime during close ========================================================== 03:16:46 (1733645806) SKIP: sanityn test_104 ldiskfs only test SKIP 104 (0s) == sanityn test 105: Glimpse and lock cancel race ======== 03:16:47 (1733645807) fail_loc=0x416 PASS 105 (21s) == sanityn test 106a: Verify the btime via statx() ======= 03:17:08 (1733645828) SKIP: sanityn test_106a Test only for ldiskfs and statx() supported SKIP 106a (1s) == sanityn test 106b: Glimpse RPCs test for statx ======== 03:17:09 (1733645829) SKIP: sanityn test_106b statx() only test SKIP 106b (1s) == sanityn test 106c: Verify statx attributes mask ======= 03:17:10 (1733645830) SKIP: sanityn test_106c statx() only test SKIP 106c (0s) == sanityn test 107a: Basic grouplock conflict =========== 03:17:10 (1733645830) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0493531 s, 212 MB/s /mnt/lustre/f107a.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 6085 0x17c5 0x280000400 multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.6973 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.6973 First grouplock blocks second one PASS 107a (4s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 03:17:15 (1733645835) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0793307 s, 132 MB/s /mnt/lustre/f107b.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 6102 0x17d6 0x240000400 multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.6973 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (8s) == sanityn test 108a: lseek: parallel updates ============ 03:17:22 (1733645842) 1+0 records in 1+0 records out 10000 bytes (10 kB) copied, 0.00257452 s, 3.9 MB/s fail_val=4 fail_loc=0x80000414 1+0 records in 1+0 records out 8388608 bytes (8.4 MB) copied, 4.14641 s, 2.0 MB/s PASS 108a (6s) == sanityn test 109: Race with several mount instances on 1 node ========================================================== 03:17:28 (1733645848) 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Starting race between client mount instances (50 iterations): Iteration 1 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 2 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 3 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions oleg417-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 4 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 5 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions oleg417-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 6 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 7 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions oleg417-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 8 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions oleg417-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 9 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 10 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions oleg417-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 11 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 12 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 13 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions oleg417-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 14 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions oleg417-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 15 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 16 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 17 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions oleg417-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg417-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 18 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions oleg417-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 19 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions oleg417-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 20 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 21 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 22 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 23 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 24 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions oleg417-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 25 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 26 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 27 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 28 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 29 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 30 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 31 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 32 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 33 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 34 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 35 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 36 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 37 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 38 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 39 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 40 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 41 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 42 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions oleg417-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 43 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 44 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 45 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 46 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 47 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 48 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions oleg417-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 49 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Iteration 50 Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 192.168.204.117@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.204.117@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg417-client.virtnet /mnt/lustre (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg417-server' oleg417-server: oleg417-server.virtnet: executing load_modules_local oleg417-server: Loading modules from /home/green/git/lustre-release/lustre oleg417-server: detected 4 online CPUs by sysfs oleg417-server: Force libcfs to create 2 CPU partitions Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre Starting client: oleg417-client.virtnet: -o user_xattr,flock 192.168.204.117@tcp:/lustre /mnt/lustre2 PASS 109 (425s) == sanityn test 110: do not grant another lock on resend ========================================================== 03:24:33 (1733646273) fail_loc=0x525 fail_val=3 fail_loc=0x534 File: '/mnt/lustre/f110.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205306056707 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-12-08 03:24:33.000000000 -0500 Modify: 2024-12-08 03:24:33.000000000 -0500 Change: 2024-12-08 03:24:33.000000000 -0500 Birth: - fail_loc=0 fail_val=0 Connected clients: oleg417-client.virtnet oleg417-client.virtnet PASS 110 (65s) == sanityn test 111: A racy rename/link an open file should not cause fs corruption ========================================================== 03:25:38 (1733646338) SKIP: sanityn test_111 needs >= 2 MDTs SKIP 111 (1s) == sanityn test 112: update max-inherit in default LMV === 03:25:39 (1733646339) SKIP: sanityn test_112 We need at least 2 MDTs for this test SKIP 112 (1s) == sanityn test 113: check servers of specified fs ======= 03:25:40 (1733646340) lustre-OST0000-osc-ffff8800a9ad8800 active. lustre-OST0001-osc-ffff8800a9ad8800 active. lustre-OST0000-osc-ffff8800a9ad8800 active. lustre-OST0001-osc-ffff8800a9ad8800 active. MGC192.168.204.117@tcp active. PASS 113 (3s) == sanityn test 114: implicit default LMV inherit ======== 03:25:43 (1733646343) SKIP: sanityn test_114 We need at least 2 MDTs for this test SKIP 114 (1s) == sanityn test 115: ldiskfs doesn't check direntry for uniqueness ========================================================== 03:25:44 (1733646344) SKIP: sanityn test_115 ldiskfs only test SKIP 115 (1s) == sanityn test 116: DNE: Set default LMV layout from a remote client ========================================================== 03:25:45 (1733646345) SKIP: sanityn test_116 needs >= 2 MDTs SKIP 116 (1s) == sanityn test 200: service remains healthy while able to process request ========================================================== 03:25:46 (1733646346) at_max=10 at_unhealthy_factor=3 ost.OSS.ost_io.threads_max=22 fail_loc=0x1e1 fail_val=20 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1296 s, 0.2 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied, 20.15 s, 0.2 kB/s , 20.1312 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.134 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.137 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.14 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1456 s, 0.2 kB/s , 20.1419 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1309 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.2084 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.2088 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied1+0 records in 1+0 records out , 40.2293 s, 0.1 kB/s 4096 bytes (4.1 kB) copied, 40.1741 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.2173 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.2032 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.2002 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.1854 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.2345 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.1488 s, 0.1 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied, 60.2093 s, 0.1 kB/s , 60.203 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.2313 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.2891 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.3295 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.3018 s, 0.1 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied1+0 records in 1+0 records out , 60.3022 s, 0.1 kB/s 4096 bytes (4.1 kB) copied, 60.2461 s, 0.1 kB/s , 60.3307 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.248 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.2919 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.2854 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.305 s, 0.1 kB/s , 80.2684 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.3557 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.3597 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.4576 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.4407 s, 0.1 kB/s , 80.4054 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 100.427 s, 0.0 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 100.384 s, 0.0 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 100.389 s, 0.0 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 100.417 s, 0.0 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 100.46 s, 0.0 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 100.488 s, 0.0 kB/s at_max=600 at_unhealthy_factor=3 ost.OSS.ost_io.threads_max=116 oleg417-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800a9ad8800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800a9ad8800.ost_server_uuid in FULL state after 0 sec PASS 200 (107s) cleanup: ====================================================== == sanityn test complete, duration 4403 sec ============== 03:27:34 (1733646454) === sanityn: start cleanup 03:27:34 (1733646454) === Stopping clients: oleg417-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg417-client.virtnet /mnt/lustre2 opts: === sanityn: finish cleanup 03:28:49 (1733646529) ===