-----============= acceptance-small: sanityn ============----- Sun Feb 2 02:01:53 EST 2025 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 oleg315-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/sanityn.*ex: No such file or directory excepting tests: 27 28 102 skipping tests SLOW=no: 33a === sanityn: start setup 02:01:58 (1738479718) === Starting client oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 Started clients oleg315-client.virtnet: 192.168.203.115@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) oleg315-client.virtnet: executing check_config_client /mnt/lustre oleg315-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg315-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6d11000.idle_timeout=debug osc.lustre-OST0000-osc-ffff88012a40f800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6d11000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a40f800.idle_timeout=debug disable quota as required oleg315-server: oleg315-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanityn: finish setup 02:02:05 (1738479725) === 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111977 s, 93.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f6984] == sanityn test 0: do_node_vp() and do_facet_vp() do the right thing ========================================================== 02:02:05 (1738479725) PASS 0 (2s) == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 02:02:07 (1738479727) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (1s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 02:02:08 (1738479728) -rw-r--r-- 1 root root 0 Feb 2 02:02 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (2s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 02:02:10 (1738479730) -rw-r--r-- 1 root root 0 Feb 2 02:02 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (1s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 02:02:11 (1738479731) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (2s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 02:02:13 (1738479733) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (1s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 02:02:14 (1738479734) total 1 -rwxrwxrwx 1 root root 0 Feb 2 02:02 f2a -rwxrwxrwx 1 root root 0 Feb 2 02:02 f2b total 1 -rwxrwxrwx 1 root root 0 Feb 2 02:02 f2a -rwxrwxrwx 1 root root 0 Feb 2 02:02 f2b running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes (512 B) copied, 0.00296323 s, 173 kB/s PASS 2e (2s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 02:02:16 (1738479736) SKIP: sanityn test_2f needs >= 2 MDTs SKIP 2f (1s) == sanityn test 2g: check blocks update on sync write ==== 02:02:17 (1738479737) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0639353 s, 32.8 MB/s /mnt/lustre/f2g.sanityn has 4103 blocks /mnt/lustre2/f2g.sanityn has 4103 blocks PASS 2g (1s) == sanityn test 3: symlink on one mtpt, readlink on another ===================================================================== 02:02:18 (1738479738) PASS 3 (2s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 02:02:20 (1738479740) PASS 4 (2s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 02:02:22 (1738479742) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (2s) == sanityn test 6: remove of open file on other node ============================================================================ 02:02:24 (1738479744) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (1s) == sanityn test 7: remove of open directory on other node ======================================================================= 02:02:25 (1738479745) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (2s) == sanityn test 8: remove of open special file on other node ==================================================================== 02:02:27 (1738479747) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (1s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 02:02:28 (1738479748) PASS 9a (2s) == sanityn test 9b: append to striped sparse file ======== 02:02:30 (1738479750) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117508 s, 89.2 MB/s 3+0 records in 3+0 records out 3 bytes (3 B) copied, 0.0089555 s, 0.3 kB/s Data read (expecting 'foo'): foo PASS 9b (1s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 02:02:31 (1738479751) 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00172878 s, 0.6 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00283348 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00248532 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00346512 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00318344 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00280933 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00229449 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00212008 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00232945 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00244287 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00303714 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00412322 s, 0.2 kB/s PASS 10a (2s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 02:02:33 (1738479753) 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00267181 s, 1.1 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00566 s, 724 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.000204983 s, 15.0 MB/s PASS 10b (1s) == sanityn test 11: execution of file opened for write should return error ============================================================== 02:02:34 (1738479754) multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.6984 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 301: /mnt/lustre2/d11/f: Text file busy PASS 11 (1s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 02:02:36 (1738479756) warning: '-runtime' deprecated, use '-t runtime' instead - link 2972 (time 1738479766.50 total 10.00 last 297.11) - link 6466 (time 1738479776.50 total 20.00 last 349.38) - link 9969 (time 1738479786.50 total 30.00 last 350.30) - link 13480 (time 1738479796.50 total 40.00 last 351.09) - link 16447 (time 1738479806.51 total 50.01 last 296.65) - link 19750 (time 1738479816.51 total 60.01 last 330.26) - link 23483 (time 1738479826.51 total 70.01 last 373.23) - link 27218 (time 1738479836.51 total 80.01 last 373.44) - link 30000 (time 1738479844.41 total 87.91 last 352.20) - link 33645 (time 1738479854.41 total 97.91 last 364.46) total: 34445 link in 100.00 seconds: 344.44 ops/second using seed 338903806 running for 100 seconds - stat 10000 (time 1738479762 ; total 5 ; last 5) - stat 20000 (time 1738479767 ; total 10 ; last 5) - stat 30000 (time 1738479771 ; total 14 ; last 4) - stat 40000 (time 1738479775 ; total 18 ; last 4) - stat 50000 (time 1738479779 ; total 22 ; last 4) - stat 60000 (time 1738479783 ; total 26 ; last 4) - stat 70000 (time 1738479788 ; total 31 ; last 5) - stat 80000 (time 1738479792 ; total 35 ; last 4) - stat 90000 (time 1738479796 ; total 39 ; last 4) - stat 100000 (time 1738479800 ; total 43 ; last 4) - stat 110000 (time 1738479805 ; total 48 ; last 5) - stat 120000 (time 1738479814 ; total 57 ; last 9) - stat 130000 (time 1738479824 ; total 67 ; last 10) - stat 140000 (time 1738479834 ; total 77 ; last 10) - stat 150000 (time 1738479844 ; total 87 ; last 10) - stat 160000 (time 1738479853 ; total 96 ; last 9) total: 164485 stats in 100 seconds: 1644.849976 stats/second - unlinked 0 (time 1738479807 ; total 0 ; last 0) - unlinked 10000 (time 1738479851 ; total 44 ; last 44) - unlinked 20000 (time 1738479875 ; total 68 ; last 24) - unlinked 30000 (time 1738479898 ; total 91 ; last 23) unlink(/mnt/lustre2/lockdir/lockfile34445) error: No such file or directory total: 34444 unlinks in 102 seconds: 337.686279 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (21989) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (21992) - No such process PASS 12 (154s) == sanityn test 13: test directory page revocation ======= 02:05:10 (1738479910) f13 f13 PASS 13 (2s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 02:05:12 (1738479912) multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.6984 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 336: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4859: 23390 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (1s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 02:05:13 (1738479913) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4859: 24024 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (1s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 02:05:14 (1738479914) truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 351: 24656 Terminated $DIR1/$tdir/sleep 60 PASS 14b (2s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 02:05:16 (1738479916) cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 363: 25290 Terminated $DIR1/$tdir/sleep 60 PASS 14c (1s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 02:05:17 (1738479917) chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 374: 25925 Terminated $DIR1/$tdir/sleep 60 PASS 14d (2s) == sanityn test 15: test out-of-space with multiple writers ===================================================================== 02:05:19 (1738479919) PATH=/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/opt/iozone/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin: mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_CODE=117440512 CLIENT_OS_VERSION_ID=7 STRIPECOUNT=2 ORIGFREE=7521280 MAXFREE=800000 SKIP: oos2 test_15 oos2.sh: 7521280kB free gt MAXFREE 800000kB, increase 800000 (or reduce test fs size) to proceed sleep 5 for ZFS MDS Waiting for MDT destroys to complete SKIP 15 (12s) == sanityn test 16a: 500 iterations of dual-mount fsx ==== 02:05:31 (1738479931) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.115459 s, 72.7 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.095172 s, 88.1 MB/s Chance of close/open is 1 in 50 Seed set to 9932 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x1b6ce7 000009[0] 1738479932.384399 trunc from 00000000 to 0x1b6ce6 (0x1b6ce7 bytes) 000010[1] 1738479932.390198 write 0x16e3ed thru 0x17a0e5 (0xbcf9 bytes) 000011[0] 1738479932.398853 write 0x45516b thru 0x45576e (0x604 bytes) truncating to largest ever: 0x1ee5c9 000012[1] 1738479932.403328 trunc from 0x45576f to 0x1ee5c8 (0x2671a6 bytes) 000013[1] 1738479932.414804 mapread 0x0b5104 thru 0x0bc263 (0x7160 bytes) 000014[1] 1738479932.421402 mapwrite 0x6c2e60 thru 0x6cdf9e (0xb13f bytes) 000015[0] 1738479932.461714 read 0x343cbb thru 0x34e84a (0xab90 bytes) 000020[1] 1738479932.478807 mapread 0x5b1bf1 thru 0x5b970d (0x7b1d bytes) 000022[1] 1738479932.484319 mapread 0x53f1d4 thru 0x5454a5 (0x62d2 bytes) 000027[0] 1738479932.491897 mapread 0x41809c thru 0x418eef (0xe54 bytes) 000030[1] 1738479932.504397 read 0x008531 thru 0x00ee37 (0x6907 bytes) 000031[1] 1738479932.507038 mapread 0x68bff6 thru 0x69a40d (0xe418 bytes) 000033[0] 1738479932.514978 read 0x168d20 thru 0x168ee9 (0x1ca bytes) truncating to largest ever: 0x72f944 000034[0] 1738479932.516557 trunc from 0x6cdf9f to 0x72f943 (0x619a5 bytes) 000035[0] 1738479932.525038 mapwrite 0x3e8896 thru 0x3ebe7d (0x35e8 bytes) 000036[0] 1738479932.545565 write 0x4927e4 thru 0x49b344 (0x8b61 bytes) 000038[0] 1738479932.555058 mapwrite 0x77e8b9 thru 0x789e44 (0xb58c bytes) 000040[1] 1738479932.585410 mapread 0x01dda1 thru 0x027184 (0x93e4 bytes) 000041[1] 1738479932.593575 trunc from 0x789e45 to 0x20af3f (0x57ef05 bytes) 000042[0] 1738479932.605857 mapread 0x0caf0a thru 0x0d12be (0x63b5 bytes) 000045[1] 1738479932.622722 mapwrite 0x5ac77c thru 0x5b6327 (0x9bac bytes) 000046[1] 1738479932.651334 write 0x0f65a0 thru 0x101afa (0xb55b bytes) 000047[0] 1738479932.654403 write 0x10574d thru 0x1142fd (0xebb1 bytes) 000052[1] 1738479932.678510 write 0x5f171a thru 0x5f4b06 (0x33ed bytes) 000053[1] 1738479932.682037 mapread 0x3b8809 thru 0x3c26b5 (0x9ead bytes) 000055[1] 1738479932.692236 write 0x9681c8 thru 0x976179 (0xdfb2 bytes) 000057[1] 1738479932.702259 read 0x5c1a27 thru 0x5c7ec4 (0x649e bytes) 000059[0] 1738479932.708141 read 0x3151bf thru 0x31e321 (0x9163 bytes) 000064[1] 1738479932.719364 write 0x689a50 thru 0x6938e3 (0x9e94 bytes) 000065[1] 1738479932.725031 mapwrite 0x0ccb1c thru 0x0d17c1 (0x4ca6 bytes) 000071[1] 1738479932.748676 mapwrite 0x8a7e1e thru 0x8b7a20 (0xfc03 bytes) 000077[1] 1738479932.776959 mapread 0x165832 thru 0x168ba5 (0x3374 bytes) 000078[0] 1738479932.781325 read 0x8fe7b5 thru 0x9066be (0x7f0a bytes) 000080[0] 1738479932.789890 write 0x1cb0d0 thru 0x1d569c (0xa5cd bytes) 000084[0] 1738479932.808077 read 0x219db6 thru 0x22774e (0xd999 bytes) 000086[0] 1738479932.817142 write 0x1547de thru 0x15abc8 (0x63eb bytes) 000088[1] 1738479932.827613 write 0x75e605 thru 0x762dd5 (0x47d1 bytes) 000092[0] 1738479932.840256 read 0x6b29c3 thru 0x6b8be6 (0x6224 bytes) 000093[1] 1738479932.850105 write 0x3542d3 thru 0x357350 (0x307e bytes) 000095[0] 1738479932.859986 read 0x67e00d thru 0x68c30c (0xe300 bytes) 000096[1] 1738479932.865441 read 0x667f38 thru 0x66ff9e (0x8067 bytes) 000097[0] 1738479932.870391 mapread 0x1bca6d thru 0x1c101b (0x45af bytes) 000099[1] 1738479932.882237 write 0x393e2e thru 0x395abb (0x1c8e bytes) 000100[0] 1738479932.889927 read 0x51390b thru 0x5178d0 (0x3fc6 bytes) 000101[1] 1738479932.895044 trunc from 0x97617a to 0x084f89 (0x8f11f0 bytes) 000102[1] 1738479932.902350 trunc from 0x084f8a to 0x2def3c (0x259fb3 bytes) 000103[1] 1738479932.906587 trunc from 0x2def3d to 0x32f18a (0x5024e bytes) 000104[0] 1738479932.909926 trunc from 0x32f18b to 0x2ac54d (0x82c3d bytes) 000106[0] 1738479932.921975 mapread 0x1bc6db thru 0x1c490e (0x8234 bytes) 000107[0] 1738479932.926520 read 0x102d29 thru 0x10714e (0x4426 bytes) 000108[1] 1738479932.942775 mapwrite 0x52449b thru 0x527044 (0x2baa bytes) 000110[0] 1738479932.969702 mapwrite 0x5c4847 thru 0x5cb64c (0x6e06 bytes) 000111[1] 1738479933.013044 mapread 0x0a2468 thru 0x0a8157 (0x5cf0 bytes) 000112[1] 1738479933.023611 write 0x9f420d thru 0x9fffff (0xbdf3 bytes) 000113[1] 1738479933.031251 read 0x1e6490 thru 0x1e6ecf (0xa40 bytes) 000115[1] 1738479933.039469 read 0x10ccc5 thru 0x1176a7 (0xa9e3 bytes) 000118[0] 1738479933.052207 mapread 0x02c90e thru 0x02db43 (0x1236 bytes) 000121[0] 1738479933.064906 mapwrite 0x57d565 thru 0x585717 (0x81b3 bytes) 000122[1] 1738479933.082486 write 0x8728d0 thru 0x875c09 (0x333a bytes) 000125[0] 1738479933.100042 mapread 0x9d19eb thru 0x9d8128 (0x673e bytes) 000131[0] 1738479933.132431 mapread 0x7f69a8 thru 0x7f9e7c (0x34d5 bytes) 000132[0] 1738479933.137598 write 0x4bfd85 thru 0x4cafe3 (0xb25f bytes) 000133[1] 1738479933.141478 mapread 0x60ff5f thru 0x614054 (0x40f6 bytes) 000136[1] 1738479933.157757 mapread 0x0ed286 thru 0x0f3b1c (0x6897 bytes) 000138[0] 1738479933.163603 mapwrite 0x1ef45d thru 0x1f5039 (0x5bdd bytes) 000139[1] 1738479933.189727 read 0x3ff574 thru 0x40ea57 (0xf4e4 bytes) 000140[0] 1738479933.195975 write 0x759931 thru 0x765189 (0xb859 bytes) 000143[1] 1738479933.201844 write 0x3e8444 thru 0x3f6d46 (0xe903 bytes) 000146[0] 1738479933.219992 trunc from 0xa00000 to 0x3b713b (0x648ec4 bytes) 000147[0] 1738479933.231335 write 0x172c96 thru 0x176ba6 (0x3f11 bytes) 000148[1] 1738479933.238757 write 0x7fbec2 thru 0x808924 (0xca63 bytes) 000149[0] 1738479933.250030 read 0x6cad46 thru 0x6d45df (0x989a bytes) 000150[1] 1738479933.257863 mapwrite 0x8c470c thru 0x8c7612 (0x2f07 bytes) 000152[0] 1738479933.288540 read 0x729464 thru 0x737769 (0xe306 bytes) 000159[0] 1738479933.304940 trunc from 0x8c7613 to 0x618b95 (0x2aea7d bytes) 000160[0] 1738479933.313113 trunc from 0x618b96 to 0x12a984 (0x4ee211 bytes) 000161[0] 1738479933.316138 trunc from 0x12a985 to 0x4aada3 (0x38041f bytes) 000162[0] 1738479933.323369 mapread 0x2015d0 thru 0x201b72 (0x5a3 bytes) 000163[0] 1738479933.328065 write 0x7e1eab thru 0x7f1a5f (0xfbb5 bytes) 000164[0] 1738479933.332432 write 0x04a956 thru 0x0570e7 (0xc792 bytes) 000167[0] 1738479933.339220 read 0x248722 thru 0x24a9a3 (0x2282 bytes) 000168[1] 1738479933.343774 read 0x70b322 thru 0x70ccf9 (0x19d8 bytes) 000169[0] 1738479933.350156 write 0x9a077d thru 0x9a71f7 (0x6a7b bytes) 000170[0] 1738479933.351145 mapread 0x69e408 thru 0x6ac06a (0xdc63 bytes) 000172[0] 1738479933.362066 write 0x1f8dcf thru 0x207554 (0xe786 bytes) 000175[0] 1738479933.371998 mapread 0x548fd4 thru 0x54e434 (0x5461 bytes) 000177[1] 1738479933.377880 mapwrite 0x2f9407 thru 0x302732 (0x932c bytes) 000178[1] 1738479933.408005 mapread 0x4111b6 thru 0x4160fb (0x4f46 bytes) 000180[1] 1738479933.413009 read 0x46722c thru 0x46d772 (0x6547 bytes) 000181[1] 1738479933.415299 write 0x6549d7 thru 0x660cd0 (0xc2fa bytes) 000184[1] 1738479933.427192 mapwrite 0x80d111 thru 0x80e322 (0x1212 bytes) 000185[0] 1738479933.444826 read 0x96f946 thru 0x971896 (0x1f51 bytes) 000189[1] 1738479933.456493 write 0x9a78b5 thru 0x9ac8d1 (0x501d bytes) 000191[1] 1738479933.463510 write 0x12e6f0 thru 0x1390f9 (0xaa0a bytes) 000193[1] 1738479933.469555 mapwrite 0x6b5898 thru 0x6c2d8d (0xd4f6 bytes) 000194[0] 1738479933.494175 read 0x7b57e1 thru 0x7bca88 (0x72a8 bytes) 000195[1] 1738479933.499242 read 0x55ea32 thru 0x5615a2 (0x2b71 bytes) 000196[0] 1738479933.503822 read 0x8d9335 thru 0x8e2a9e (0x976a bytes) 000197[1] 1738479933.512865 write 0x913e65 thru 0x91c976 (0x8b12 bytes) 000198[0] 1738479933.520186 mapwrite 0x5ea458 thru 0x5ec1cc (0x1d75 bytes) 000199[0] 1738479933.541978 mapread 0x2ea0db thru 0x2ec792 (0x26b8 bytes) 000204[1] 1738479933.555239 trunc from 0x9ac8d2 to 0x362ada (0x649df7 bytes) 000206[1] 1738479933.563417 trunc from 0x362adb to 0x377048 (0x1456e bytes) 000208[0] 1738479933.572617 mapread 0x20bee9 thru 0x215ff3 (0xa10b bytes) 000209[0] 1738479933.581987 trunc from 0x377049 to 0x2241d3 (0x152e75 bytes) 000210[1] 1738479933.591535 write 0x86ab34 thru 0x8791b5 (0xe682 bytes) 000212[0] 1738479933.602038 mapread 0x6b6cc5 thru 0x6ba63e (0x397a bytes) 000213[1] 1738479933.620873 mapread 0x190236 thru 0x19a909 (0xa6d4 bytes) 000216[1] 1738479933.639788 mapwrite 0x73637f thru 0x737ba0 (0x1822 bytes) 000217[0] 1738479933.661898 read 0x4bc88b thru 0x4c09a2 (0x4118 bytes) 000220[0] 1738479933.672799 write 0x611774 thru 0x611b42 (0x3cf bytes) 000221[0] 1738479933.679141 mapread 0x29254a thru 0x2a0d22 (0xe7d9 bytes) 000222[0] 1738479933.693602 write 0x3d6aba thru 0x3e0e80 (0xa3c7 bytes) 000223[0] 1738479933.701576 write 0x78444d thru 0x78e399 (0x9f4d bytes) 000226[1] 1738479933.708115 trunc from 0x8791b6 to 0x0d511c (0x7a4099 bytes) 000229[1] 1738479933.726771 mapwrite 0x3ae0e3 thru 0x3bdeea (0xfe08 bytes) 000230[1] 1738479933.758842 trunc from 0x3bdeeb to 0x12e81f (0x28f6cb bytes) 000232[1] 1738479933.770809 write 0x79d5f5 thru 0x79f44f (0x1e5b bytes) 000234[1] 1738479933.776903 mapwrite 0x568545 thru 0x56cdd2 (0x488e bytes) 000237[0] 1738479933.797499 write 0x6ffcf6 thru 0x70a0d2 (0xa3dd bytes) 000238[1] 1738479933.807190 read 0x339000 thru 0x339c75 (0xc76 bytes) 000239[0] 1738479933.814704 read 0x1aa3c7 thru 0x1ad709 (0x3343 bytes) 000240[1] 1738479933.820734 trunc from 0x79f450 to 0x102c43 (0x69c80c bytes) 000241[1] 1738479933.834275 mapwrite 0x1b1246 thru 0x1bb4f7 (0xa2b2 bytes) truncating to largest ever: 0x89ef03 000243[1] 1738479933.865461 trunc from 0x1bb4f8 to 0x89ef02 (0x6e3a0b bytes) 000246[1] 1738479933.883642 trunc from 0x89ef03 to 0x2c1306 (0x5ddbfc bytes) 000247[1] 1738479933.888354 read 0x1f6bfc thru 0x203f88 (0xd38d bytes) 000249[0] 1738479933.908521 mapwrite 0x151e0d thru 0x1584d0 (0x66c4 bytes) 000250[1] 1738479933.938526 mapwrite 0x4e89f3 thru 0x4f1677 (0x8c85 bytes) 000252[1] 1738479933.972445 mapread 0x3afb0b thru 0x3baafa (0xaff0 bytes) 000256[0] 1738479933.980941 trunc from 0x4f1678 to 0x4a496f (0x4cd08 bytes) 000257[1] 1738479933.995218 mapread 0x17340d thru 0x17426b (0xe5f bytes) 000258[0] 1738479934.004022 trunc from 0x4a4970 to 0x11e059 (0x386916 bytes) 000260[1] 1738479934.016787 mapread 0x030e3f thru 0x036aa5 (0x5c67 bytes) 000261[1] 1738479934.027707 write 0x75b884 thru 0x75f3d8 (0x3b55 bytes) 000262[1] 1738479934.034513 write 0x91d4f3 thru 0x92574c (0x825a bytes) 000263[1] 1738479934.037340 write 0x491a7a thru 0x494a10 (0x2f97 bytes) 000264[0] 1738479934.042212 mapread 0x6c1d60 thru 0x6d11f1 (0xf492 bytes) 000266[0] 1738479934.057563 read 0x08e6f6 thru 0x095fda (0x78e5 bytes) 000267[1] 1738479934.064634 read 0x7d870d thru 0x7e8555 (0xfe49 bytes) 000270[1] 1738479934.082340 write 0x2f9a50 thru 0x2fc942 (0x2ef3 bytes) 000274[1] 1738479934.099008 read 0x3282e3 thru 0x3355a8 (0xd2c6 bytes) 000275[0] 1738479934.102174 mapwrite 0x00e549 thru 0x01a5f8 (0xc0b0 bytes) 000277[1] 1738479934.131724 mapwrite 0x9f3a43 thru 0x9ff0dd (0xb69b bytes) 000278[1] 1738479934.162186 mapwrite 0x4f561b thru 0x4fa877 (0x525d bytes) 000279[0] 1738479934.181417 mapwrite 0x6f798a thru 0x6fab12 (0x3189 bytes) 000283[1] 1738479934.211296 mapwrite 0x305355 thru 0x3116ea (0xc396 bytes) 000284[1] 1738479934.237584 mapread 0x19c350 thru 0x19e862 (0x2513 bytes) 000287[0] 1738479934.253646 write 0x0b69cc thru 0x0bb540 (0x4b75 bytes) 000289[0] 1738479934.258897 read 0x467ec3 thru 0x473fdf (0xc11d bytes) 000290[1] 1738479934.261086 write 0x41fb3e thru 0x425ebe (0x6381 bytes) 000292[1] 1738479934.270735 mapwrite 0x8b0c4c thru 0x8b5b69 (0x4f1e bytes) 000293[0] 1738479934.290769 write 0x420659 thru 0x4301f9 (0xfba1 bytes) 000294[0] 1738479934.300358 read 0x5ac8ab thru 0x5bc78b (0xfee1 bytes) 000296[0] 1738479934.309974 trunc from 0x9ff0de to 0x13b9e4 (0x8c36f9 bytes) 000298[1] 1738479934.321564 trunc from 0x13b9e5 to 0x7f3252 (0x6b786e bytes) 000300[0] 1738479934.336262 mapwrite 0x5afed4 thru 0x5b09ed (0xb1a bytes) 000303[1] 1738479934.366748 read 0x3cfda7 thru 0x3d452d (0x4787 bytes) 000308[0] 1738479934.386400 write 0x92034e thru 0x9203a9 (0x5c bytes) 000309[0] 1738479934.389761 read 0x5e7f3a thru 0x5f58ca (0xd991 bytes) 000310[0] 1738479934.392653 write 0x17be36 thru 0x17e925 (0x2af0 bytes) 000312[1] 1738479934.399204 read 0x8212a0 thru 0x82f4c0 (0xe221 bytes) 000313[1] 1738479934.407179 write 0x39deee thru 0x3a510d (0x7220 bytes) 000316[0] 1738479934.420193 write 0x683074 thru 0x6902e2 (0xd26f bytes) 000318[1] 1738479934.429421 write 0x764471 thru 0x766116 (0x1ca6 bytes) 000321[1] 1738479934.442527 write 0x4ec849 thru 0x4ed2bb (0xa73 bytes) 000322[1] 1738479934.448763 mapread 0x4383a6 thru 0x43faf1 (0x774c bytes) 000325[0] 1738479934.455526 mapwrite 0x2482b9 thru 0x250f56 (0x8c9e bytes) 000327[1] 1738479934.487837 mapread 0x146bd1 thru 0x154adf (0xdf0f bytes) 000330[0] 1738479934.505168 mapwrite 0x33145a thru 0x3404ad (0xf054 bytes) 000332[0] 1738479934.536999 mapwrite 0x8cfa40 thru 0x8de60e (0xebcf bytes) 000334[1] 1738479934.570832 write 0x688230 thru 0x68b628 (0x33f9 bytes) 000335[0] 1738479934.577020 read 0x38ef65 thru 0x39bd52 (0xcdee bytes) 000338[0] 1738479934.590752 mapwrite 0x746f1d thru 0x747c8b (0xd6f bytes) 000339[0] 1738479934.617245 mapwrite 0x48804b thru 0x48b92a (0x38e0 bytes) 000342[0] 1738479934.644881 write 0x4e3819 thru 0x4eaa33 (0x721b bytes) 000343[0] 1738479934.648540 trunc from 0x9203aa to 0x1bb610 (0x764d99 bytes) 000344[1] 1738479934.655069 read 0x0fe75a thru 0x107480 (0x8d27 bytes) 000345[1] 1738479934.664402 trunc from 0x1bb611 to 0x78bc28 (0x5d0618 bytes) 000346[1] 1738479934.673913 read 0x6709ac thru 0x674e0c (0x4461 bytes) 000349[1] 1738479934.687410 mapread 0x1d92e2 thru 0x1d9b01 (0x820 bytes) 000350[0] 1738479934.689187 read 0x460fb4 thru 0x466c0a (0x5c57 bytes) 000353[0] 1738479934.698601 read 0x513526 thru 0x51a941 (0x741c bytes) 000357[1] 1738479934.710495 read 0x169b61 thru 0x16bf7e (0x241e bytes) 000361[0] 1738479934.724733 mapread 0x612f5a thru 0x615a89 (0x2b30 bytes) 000363[0] 1738479934.736482 mapwrite 0x52822b thru 0x535e78 (0xdc4e bytes) 000364[1] 1738479934.764556 mapread 0x1b655a thru 0x1bd540 (0x6fe7 bytes) 000365[0] 1738479934.774328 write 0x118641 thru 0x121618 (0x8fd8 bytes) 000366[0] 1738479934.783106 trunc from 0x78bc29 to 0x636930 (0x1552f8 bytes) 000368[1] 1738479934.792816 mapread 0x313253 thru 0x31e7f1 (0xb59f bytes) 000371[1] 1738479934.809551 read 0x1ba4d3 thru 0x1bf217 (0x4d45 bytes) 000372[0] 1738479934.811720 write 0x59e234 thru 0x5a2564 (0x4331 bytes) 000374[1] 1738479934.817492 read 0x145e6c thru 0x149dab (0x3f40 bytes) 000379[1] 1738479934.826955 mapwrite 0x37455c thru 0x377757 (0x31fc bytes) 000382[1] 1738479934.861414 mapread 0x28c4f2 thru 0x29adff (0xe90e bytes) 000383[1] 1738479934.871019 mapread 0x0169ab thru 0x020b6f (0xa1c5 bytes) 000385[1] 1738479934.889736 mapwrite 0x2903f2 thru 0x29fb8e (0xf79d bytes) 000390[1] 1738479934.924074 trunc from 0x636931 to 0x37bd84 (0x2babac bytes) 000391[1] 1738479934.933258 write 0x695e04 thru 0x69c584 (0x6781 bytes) 000392[0] 1738479934.938784 mapwrite 0x3c3327 thru 0x3ce5ee (0xb2c8 bytes) 000393[1] 1738479935.012917 mapread 0x373a4f thru 0x37e65b (0xac0d bytes) 000396[1] 1738479935.024748 mapread 0x078a80 thru 0x07a070 (0x15f1 bytes) 000400[1] 1738479935.042156 mapread 0x0e20d9 thru 0x0e7e78 (0x5da0 bytes) 000401[0] 1738479935.046600 read 0x20f04a thru 0x21510b (0x60c2 bytes) 000402[1] 1738479935.049106 trunc from 0x69c585 to 0x19be7f (0x500705 bytes) 000403[0] 1738479935.057586 write 0x6add57 thru 0x6b5210 (0x74ba bytes) 000409[1] 1738479935.084188 mapread 0x469a09 thru 0x4700fe (0x66f6 bytes) 000410[0] 1738479935.098851 write 0x5bb57d thru 0x5c0cfc (0x5780 bytes) 000415[1] 1738479935.120386 mapread 0x3b5ec3 thru 0x3bd9f1 (0x7b2f bytes) 000416[1] 1738479935.149028 write 0x5a7c2b thru 0x5ab0b7 (0x348d bytes) 000417[0] 1738479935.155414 read 0x017033 thru 0x024027 (0xcff5 bytes) 000418[1] 1738479935.163794 mapread 0x090437 thru 0x0978e7 (0x74b1 bytes) 000422[1] 1738479935.174311 write 0x8f47c3 thru 0x8fe4bb (0x9cf9 bytes) 000423[0] 1738479935.181141 mapread 0x1639ca thru 0x16c3fc (0x8a33 bytes) 000426[0] 1738479935.196796 mapwrite 0x0ed564 thru 0x0fc4ba (0xef57 bytes) 000429[1] 1738479935.229037 mapread 0x1072b9 thru 0x108ced (0x1a35 bytes) 000430[0] 1738479935.234963 mapread 0x7f85d8 thru 0x807752 (0xf17b bytes) 000433[1] 1738479935.258080 mapread 0x48e901 thru 0x49aede (0xc5de bytes) 000435[1] 1738479935.267234 write 0x3177f2 thru 0x31ab81 (0x3390 bytes) 000437[0] 1738479935.273252 trunc from 0x8fe4bc to 0x64b390 (0x2b312b bytes) 000439[1] 1738479935.289047 mapwrite 0x6585e9 thru 0x65c6ac (0x40c4 bytes) 000440[0] 1738479935.318939 write 0x4a646e thru 0x4ac294 (0x5e27 bytes) 000441[0] 1738479935.326866 mapread 0x0dcbc4 thru 0x0e60cf (0x950c bytes) 000442[1] 1738479935.339504 read 0x5d03f6 thru 0x5db6ba (0xb2c5 bytes) 000444[1] 1738479935.349438 mapwrite 0x9d8b35 thru 0x9e1612 (0x8ade bytes) 000445[0] 1738479935.380755 read 0x2efbdd thru 0x2f55a8 (0x59cc bytes) 000448[0] 1738479935.393528 read 0x0198de thru 0x02769c (0xddbf bytes) 000450[0] 1738479935.403276 mapread 0x695878 thru 0x69e77c (0x8f05 bytes) 000451[1] 1738479935.411862 trunc from 0x9e1613 to 0x828e07 (0x1b880b bytes) 000452[0] 1738479935.422832 trunc from 0x828e08 to 0x1b9126 (0x66fce1 bytes) 000454[1] 1738479935.436002 write 0x347cbb thru 0x3486e1 (0xa27 bytes) 000456[1] 1738479935.446038 write 0x6d35ce thru 0x6dacd3 (0x7706 bytes) 000457[0] 1738479935.449329 read 0x015223 thru 0x0169ea (0x17c8 bytes) 000459[0] 1738479935.470281 mapwrite 0x230a96 thru 0x2325ec (0x1b57 bytes) 000461[1] 1738479935.511591 mapread 0x323e7d thru 0x325f55 (0x20d9 bytes) 000463[1] 1738479935.525661 trunc from 0x6dacd4 to 0x58807c (0x152c57 bytes) 000464[0] 1738479935.535145 write 0x5cb2ff thru 0x5dab00 (0xf802 bytes) 000465[1] 1738479935.541952 mapwrite 0x8b6153 thru 0x8c22bf (0xc16d bytes) 000467[0] 1738479935.577225 write 0x61cc25 thru 0x626cb9 (0xa095 bytes) 000468[0] 1738479935.585030 mapwrite 0x754706 thru 0x75d5c1 (0x8ebc bytes) 000469[0] 1738479935.615845 write 0x8bde95 thru 0x8c853f (0xa6ab bytes) 000472[1] 1738479935.631582 trunc from 0x8c8540 to 0x229609 (0x69ef36 bytes) 000473[1] 1738479935.641833 write 0x02d4b7 thru 0x0372b9 (0x9e03 bytes) 000474[0] 1738479935.648330 read 0x038171 thru 0x03af64 (0x2df4 bytes) 000475[1] 1738479935.666172 mapwrite 0x428bb3 thru 0x433358 (0xa7a6 bytes) 000476[0] 1738479935.694104 write 0x0222a4 thru 0x02490a (0x2667 bytes) 000478[0] 1738479935.717681 mapread 0x046c63 thru 0x04ea37 (0x7dd5 bytes) 000479[1] 1738479935.731242 mapread 0x1541af thru 0x159ae7 (0x5939 bytes) 000483[0] 1738479935.745405 mapwrite 0x1032d3 thru 0x10b4e3 (0x8211 bytes) 000484[1] 1738479935.771445 write 0x4e283f thru 0x4f0d7f (0xe541 bytes) 000488[0] 1738479935.784731 mapwrite 0x648c27 thru 0x650a7d (0x7e57 bytes) 000490[0] 1738479935.823142 read 0x4fc7a3 thru 0x505944 (0x91a2 bytes) 000492[0] 1738479935.823853 mapwrite 0x09bf23 thru 0x0a7f29 (0xc007 bytes) 000493[0] 1738479935.844520 mapread 0x202cb0 thru 0x208788 (0x5ad9 bytes) 000499[1] 1738479935.860184 mapread 0x2f442f thru 0x2f80c4 (0x3c96 bytes) 000500[0] 1738479935.868329 mapread 0x3421af thru 0x345a9f (0x38f1 bytes) All operations completed A-OK! Chance of close/open is 1 in 50 Seed set to 9935 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000003[0] 1738479936.092878 write_OD 0x8aa000 thru 0x8acfff (0x3000 bytes) 000004[1] 1738479936.109085 mapread 0x4c6000 thru 0x4cfe84 (0x9e85 bytes) 000006[1] 1738479936.114579 write 0x912000 thru 0x913a37 (0x1a38 bytes) 000007[0] 1738479936.120475 mapwrite 0x406000 thru 0x40b6a8 (0x56a9 bytes) truncating to largest ever: 0x2ab9c8 000008[1] 1738479936.150874 trunc from 0x913a38 to 0x2ab9c7 (0x668070 bytes) 000012[0] 1738479936.164005 write_OD 0x40e000 thru 0x40efff (0x1000 bytes) 000014[1] 1738479936.178128 mapwrite 0x052000 thru 0x05b5e8 (0x95e9 bytes) 000016[1] 1738479936.197296 write 0x3a5000 thru 0x3a94d1 (0x44d2 bytes) 000021[1] 1738479936.199296 write 0x3bc000 thru 0x3ca820 (0xe821 bytes) 000022[0] 1738479936.200978 read_OD 0x237000 thru 0x23cfff (0x6000 bytes) 000023[1] 1738479936.208819 read 0x1e1000 thru 0x1e30ea (0x20eb bytes) 000027[0] 1738479936.211481 write_OD 0x294000 thru 0x29ffff (0xc000 bytes) 000031[0] 1738479936.226936 read_OD 0x2d5000 thru 0x2dffff (0xb000 bytes) 000032[0] 1738479936.228918 read_OD 0x158000 thru 0x15ffff (0x8000 bytes) 000033[1] 1738479936.230544 write 0x45c000 thru 0x46012d (0x412e bytes) 000038[0] 1738479936.243245 write_OD 0x78a000 thru 0x791fff (0x8000 bytes) truncating to largest ever: 0x375953 000040[1] 1738479936.260321 trunc from 0x792000 to 0x375952 (0x41c6ad bytes) 000042[0] 1738479936.272955 mapread 0x1f8000 thru 0x1f8711 (0x712 bytes) 000043[0] 1738479936.277824 mapwrite 0x422000 thru 0x422349 (0x34a bytes) 000044[0] 1738479936.298408 mapwrite 0x525000 thru 0x5326bb (0xd6bc bytes) truncating to largest ever: 0x728828 000045[0] 1738479936.328727 trunc from 0x5326bc to 0x728827 (0x1f616c bytes) 000049[1] 1738479936.341451 write 0x633000 thru 0x63b9a0 (0x89a1 bytes) 000050[0] 1738479936.349097 mapwrite 0x2a8000 thru 0x2b70ce (0xf0cf bytes) 000051[1] 1738479936.377389 write 0x87e000 thru 0x87fdf5 (0x1df6 bytes) 000055[1] 1738479936.383425 read 0x5c1000 thru 0x5c3a3d (0x2a3e bytes) 000056[1] 1738479936.385016 mapwrite 0x132000 thru 0x1341e3 (0x21e4 bytes) 000057[1] 1738479936.405746 read 0x011000 thru 0x016544 (0x5545 bytes) 000060[1] 1738479936.411427 trunc from 0x87fdf6 to 0x11f426 (0x7609cf bytes) 000062[1] 1738479936.422979 mapread 0x063000 thru 0x06a865 (0x7866 bytes) 000064[1] 1738479936.426816 write 0x89c000 thru 0x8a91ad (0xd1ae bytes) 000065[0] 1738479936.432788 mapwrite 0x991000 thru 0x99e9c0 (0xd9c1 bytes) 000066[1] 1738479936.460784 mapread 0x346000 thru 0x34a0eb (0x40ec bytes) 000067[0] 1738479936.475461 write_OD 0x49b000 thru 0x4a6fff (0xc000 bytes) 000069[1] 1738479936.492396 mapread 0x91c000 thru 0x92397f (0x7980 bytes) 000073[1] 1738479936.497106 trunc from 0x99e9c1 to 0x1124dd (0x88c4e3 bytes) 000074[0] 1738479936.507095 mapwrite 0x316000 thru 0x31db56 (0x7b57 bytes) 000076[1] 1738479936.533831 mapread 0x21f000 thru 0x22172d (0x272e bytes) 000077[1] 1738479936.542941 trunc from 0x31db57 to 0x25ce65 (0xc0cf1 bytes) 000078[0] 1738479936.553063 mapwrite 0x1f6000 thru 0x205f90 (0xff91 bytes) 000079[1] 1738479936.577170 mapread 0x132000 thru 0x13c11c (0xa11d bytes) 000080[0] 1738479936.585885 read_OD 0x1b7000 thru 0x1c0fff (0xa000 bytes) 000081[0] 1738479936.587707 trunc from 0x25ce66 to 0x47bb2c (0x21ecc7 bytes) 000082[1] 1738479936.592991 trunc from 0x47bb2d to 0x3c86ae (0xb347e bytes) 000083[0] 1738479936.598765 mapwrite 0x798000 thru 0x7a569a (0xd69b bytes) 000086[1] 1738479936.664663 mapwrite 0x8e4000 thru 0x8e605e (0x205f bytes) 000088[1] 1738479936.705299 read 0x4b5000 thru 0x4b8191 (0x3192 bytes) 000090[0] 1738479936.710424 mapread 0x161000 thru 0x16cd31 (0xbd32 bytes) 000100[1] 1738479936.728229 trunc from 0x8e605f to 0x5efb65 (0x2f64f9 bytes) truncating to largest ever: 0x760b51 000101[1] 1738479936.737292 trunc from 0x5efb66 to 0x760b50 (0x170feb bytes) 000103[0] 1738479936.741537 mapread 0x36d000 thru 0x378d8c (0xbd8d bytes) 000104[0] 1738479936.759002 write_OD 0x999000 thru 0x99ffff (0x7000 bytes) 000106[1] 1738479936.773580 read 0x055000 thru 0x05fa07 (0xaa08 bytes) 000109[1] 1738479936.777025 read 0x232000 thru 0x234343 (0x2344 bytes) 000110[0] 1738479936.778632 write_OD 0x2ff000 thru 0x303fff (0x5000 bytes) 000112[1] 1738479936.795438 read 0x62e000 thru 0x62fe85 (0x1e86 bytes) 000117[1] 1738479936.799268 mapread 0x5c0000 thru 0x5cbce2 (0xbce3 bytes) 000119[0] 1738479936.806930 mapwrite 0x552000 thru 0x559e47 (0x7e48 bytes) 000121[1] 1738479936.836297 trunc from 0x9a0000 to 0x5600e7 (0x43ff18 bytes) 000122[1] 1738479936.843062 mapread 0x42d000 thru 0x439b33 (0xcb34 bytes) 000125[0] 1738479936.853710 trunc from 0x5600e8 to 0x0f9379 (0x466d6e bytes) 000127[0] 1738479936.863728 mapread 0x084000 thru 0x093cd5 (0xfcd6 bytes) 000129[1] 1738479936.883721 write 0x6f6000 thru 0x6fd10c (0x710d bytes) 000130[0] 1738479936.888151 trunc from 0x6fd10d to 0x1b6258 (0x546eb4 bytes) 000133[1] 1738479936.903004 mapread 0x147000 thru 0x147ed8 (0xed9 bytes) 000134[1] 1738479936.908409 mapread 0x0bc000 thru 0x0c772f (0xb730 bytes) truncating to largest ever: 0x8a31c1 000135[1] 1738479936.914428 trunc from 0x1b6259 to 0x8a31c0 (0x6ecf68 bytes) 000136[0] 1738479936.925742 write_OD 0x720000 thru 0x720fff (0x1000 bytes) 000138[1] 1738479936.943207 trunc from 0x8a31c1 to 0x22d60e (0x675bb2 bytes) 000139[1] 1738479936.949201 mapwrite 0x242000 thru 0x24c4f0 (0xa4f1 bytes) 000140[1] 1738479936.972931 mapwrite 0x192000 thru 0x1a17a9 (0xf7aa bytes) 000142[1] 1738479937.001902 trunc from 0x24c4f1 to 0x384961 (0x138471 bytes) 000143[0] 1738479937.007325 write_OD 0x0c7000 thru 0x0d2fff (0xc000 bytes) 000145[0] 1738479937.025977 mapwrite 0x019000 thru 0x01e820 (0x5821 bytes) 000147[0] 1738479937.056928 mapread 0x126000 thru 0x126ef4 (0xef5 bytes) 000149[0] 1738479937.058638 read_OD 0x00f000 thru 0x013fff (0x5000 bytes) 000150[0] 1738479937.062548 mapwrite 0x14a000 thru 0x14b6c0 (0x16c1 bytes) 000151[1] 1738479937.097080 read 0x0d7000 thru 0x0e0d65 (0x9d66 bytes) 000152[0] 1738479937.121443 write_OD 0x821000 thru 0x823fff (0x3000 bytes) 000153[0] 1738479937.138190 write_OD 0x4b7000 thru 0x4bdfff (0x7000 bytes) 000155[1] 1738479937.153817 mapwrite 0x878000 thru 0x88002a (0x802b bytes) 000156[0] 1738479937.205033 read_OD 0x80e000 thru 0x816fff (0x9000 bytes) 000157[0] 1738479937.214461 mapwrite 0x92b000 thru 0x92fbfc (0x4bfd bytes) 000158[1] 1738479937.235659 read 0x038000 thru 0x0461c5 (0xe1c6 bytes) 000159[0] 1738479937.240782 read_OD 0x364000 thru 0x36bfff (0x8000 bytes) 000161[1] 1738479937.243868 mapread 0x466000 thru 0x469149 (0x314a bytes) 000164[1] 1738479937.252458 trunc from 0x92fbfd to 0x099b56 (0x8960a6 bytes) 000166[0] 1738479937.263972 write_OD 0x5c5000 thru 0x5cffff (0xb000 bytes) 000167[0] 1738479937.279503 mapread 0x52b000 thru 0x539d6b (0xed6c bytes) truncating to largest ever: 0x9697ac 000169[1] 1738479937.287058 trunc from 0x5d0000 to 0x9697ab (0x3997ac bytes) 000170[0] 1738479937.294089 mapread 0x3b6000 thru 0x3be854 (0x8855 bytes) 000171[1] 1738479937.303322 mapread 0x4e1000 thru 0x4e20b1 (0x10b2 bytes) 000172[1] 1738479937.311674 read 0x2e7000 thru 0x2f697e (0xf97f bytes) 000173[1] 1738479937.314036 read 0x327000 thru 0x3317f7 (0xa7f8 bytes) 000174[0] 1738479937.316235 read_OD 0x64c000 thru 0x655fff (0xa000 bytes) 000175[1] 1738479937.318154 trunc from 0x9697ac to 0x3d7925 (0x591e86 bytes) 000177[1] 1738479937.324985 write 0x10a000 thru 0x119e8a (0xfe8b bytes) 000178[0] 1738479937.326664 trunc from 0x3d7926 to 0x4440f8 (0x6c7d3 bytes) 000182[0] 1738479937.341885 read_OD 0x11a000 thru 0x11efff (0x5000 bytes) 000183[0] 1738479937.346268 write_OD 0x4d0000 thru 0x4d5fff (0x6000 bytes) 000185[1] 1738479937.361795 trunc from 0x4d6000 to 0x8790ff (0x3a3100 bytes) 000189[0] 1738479937.376253 write_OD 0x7ec000 thru 0x7f5fff (0xa000 bytes) 000190[0] 1738479937.391533 read_OD 0x33c000 thru 0x345fff (0xa000 bytes) 000192[1] 1738479937.395012 trunc from 0x879100 to 0x7d4ba5 (0xa455a bytes) 000194[1] 1738479937.408729 trunc from 0x7d4ba6 to 0x41087d (0x3c4328 bytes) 000198[0] 1738479937.425964 read_OD 0x0a8000 thru 0x0abfff (0x4000 bytes) 000202[0] 1738479937.432873 mapwrite 0x4ea000 thru 0x4ea12e (0x12f bytes) 000205[1] 1738479937.463566 write 0x432000 thru 0x43e77f (0xc780 bytes) 000211[0] 1738479937.477918 mapread 0x0ad000 thru 0x0b321e (0x621f bytes) 000213[0] 1738479937.488765 mapwrite 0x136000 thru 0x141140 (0xb141 bytes) 000215[1] 1738479937.514864 trunc from 0x4ea12f to 0x3418e0 (0x1a884e bytes) 000216[0] 1738479937.524238 write_OD 0x512000 thru 0x518fff (0x7000 bytes) 000217[0] 1738479937.538566 mapwrite 0x992000 thru 0x99fc9c (0xdc9d bytes) 000220[0] 1738479937.572766 mapwrite 0x3f4000 thru 0x3fd748 (0x9749 bytes) 000221[0] 1738479937.590279 read_OD 0x7f5000 thru 0x7fafff (0x6000 bytes) 000223[1] 1738479937.594781 mapread 0x6f8000 thru 0x6f9e6e (0x1e6f bytes) 000224[0] 1738479937.598135 trunc from 0x99fc9d to 0x91e331 (0x8196b bytes) 000231[1] 1738479937.609541 trunc from 0x91e332 to 0x0fc05a (0x8222d7 bytes) 000234[0] 1738479937.625247 write_OD 0x7cb000 thru 0x7d2fff (0x8000 bytes) 000236[0] 1738479937.640565 mapwrite 0x61c000 thru 0x61ce4d (0xe4e bytes) 000239[1] 1738479937.661901 trunc from 0x7d3000 to 0x207567 (0x5cba98 bytes) 000240[0] 1738479937.669248 mapwrite 0x181000 thru 0x18120a (0x20b bytes) 000242[1] 1738479937.687630 trunc from 0x207568 to 0x6603bc (0x458e55 bytes) 000244[0] 1738479937.701411 trunc from 0x6603bd to 0x15d474 (0x502f48 bytes) 000245[0] 1738479937.711055 read_OD 0x0d2000 thru 0x0d9fff (0x8000 bytes) 000247[0] 1738479937.722180 mapwrite 0x53b000 thru 0x54015e (0x515f bytes) 000248[1] 1738479937.776516 trunc from 0x54015f to 0x4bfb32 (0x8062c bytes) 000250[0] 1738479937.785272 write_OD 0x31f000 thru 0x325fff (0x7000 bytes) 000253[1] 1738479937.800054 trunc from 0x4bfb33 to 0x3f8567 (0xc75cb bytes) 000254[1] 1738479937.809430 trunc from 0x3f8568 to 0x76ffa3 (0x377a3c bytes) 000256[0] 1738479937.818070 trunc from 0x76ffa4 to 0x316157 (0x459e4c bytes) 000269[1] 1738479937.839403 trunc from 0x316158 to 0x338c1e (0x22ac7 bytes) 000270[0] 1738479937.845713 mapread 0x230000 thru 0x235e1b (0x5e1c bytes) 000272[0] 1738479937.858062 mapwrite 0x5e1000 thru 0x5e2e14 (0x1e15 bytes) 000275[0] 1738479937.891059 mapwrite 0x453000 thru 0x4573c3 (0x43c4 bytes) 000278[0] 1738479937.911991 mapread 0x560000 thru 0x5640f4 (0x40f5 bytes) truncating to largest ever: 0x97719a 000279[1] 1738479937.912295 trunc from 0x5e2e15 to 0x977199 (0x394385 bytes) 000280[0] 1738479937.922363 mapwrite 0x492000 thru 0x492530 (0x531 bytes) 000282[1] 1738479937.941368 write_OD 0x332000 thru 0x33afff (0x9000 bytes) 000283[1] 1738479937.954476 mapread 0x779000 thru 0x77d1b7 (0x41b8 bytes) 000285[0] 1738479937.959896 mapread 0x3e9000 thru 0x3ef87a (0x687b bytes) truncating to largest ever: 0x9ad625 000286[1] 1738479937.966866 trunc from 0x97719a to 0x9ad624 (0x3648b bytes) 000287[1] 1738479937.972991 mapwrite 0x4df000 thru 0x4e4b38 (0x5b39 bytes) 000291[0] 1738479937.998011 mapread 0x7fe000 thru 0x803029 (0x502a bytes) 000292[1] 1738479938.021155 read_OD 0x1fa000 thru 0x200fff (0x7000 bytes) truncating to largest ever: 0x9c68d5 000294[0] 1738479938.024286 trunc from 0x9ad625 to 0x9c68d4 (0x192b0 bytes) 000295[0] 1738479938.037198 write_OD 0x3e7000 thru 0x3e8fff (0x2000 bytes) 000298[1] 1738479938.050834 mapwrite 0x61e000 thru 0x622af1 (0x4af2 bytes) 000301[1] 1738479938.071348 trunc from 0x9c68d5 to 0x17d116 (0x8497be bytes) 000302[0] 1738479938.079877 write_OD 0x7c9000 thru 0x7c9fff (0x1000 bytes) 000305[1] 1738479938.097540 mapwrite 0x358000 thru 0x3632d3 (0xb2d4 bytes) 000306[0] 1738479938.119289 trunc from 0x7ca000 to 0x933ed7 (0x169ed8 bytes) 000309[1] 1738479938.132852 mapread 0x8cc000 thru 0x8d1bca (0x5bcb bytes) 000310[0] 1738479938.140761 mapread 0x695000 thru 0x69f6ee (0xa6ef bytes) 000313[0] 1738479938.151447 mapwrite 0x9ed000 thru 0x9f5152 (0x8153 bytes) 000314[1] 1738479938.174186 mapread 0x55f000 thru 0x56426d (0x526e bytes) 000318[0] 1738479938.185145 write_OD 0x49d000 thru 0x4a0fff (0x4000 bytes) 000319[1] 1738479938.199036 mapread 0x54c000 thru 0x55b133 (0xf134 bytes) 000320[0] 1738479938.204367 read_OD 0x659000 thru 0x667fff (0xf000 bytes) 000324[1] 1738479938.210728 read_OD 0x47f000 thru 0x48bfff (0xd000 bytes) 000325[1] 1738479938.213061 write_OD 0x013000 thru 0x020fff (0xe000 bytes) 000326[1] 1738479938.226326 read_OD 0x7fe000 thru 0x804fff (0x7000 bytes) 000328[0] 1738479938.229589 read_OD 0x7fd000 thru 0x80afff (0xe000 bytes) 000329[0] 1738479938.231799 write_OD 0x715000 thru 0x71ffff (0xb000 bytes) 000331[1] 1738479938.245706 mapread 0x07f000 thru 0x083e43 (0x4e44 bytes) 000332[0] 1738479938.251112 mapread 0x75d000 thru 0x76a590 (0xd591 bytes) 000333[0] 1738479938.256502 mapread 0x5b2000 thru 0x5c0d08 (0xed09 bytes) 000336[1] 1738479938.262585 trunc from 0x9f5153 to 0x8d4996 (0x1207bc bytes) 000339[1] 1738479938.273251 mapread 0x45f000 thru 0x464bfa (0x5bfb bytes) 000341[1] 1738479938.283914 mapread 0x539000 thru 0x53e708 (0x5709 bytes) 000342[1] 1738479938.289203 mapread 0x149000 thru 0x1526ca (0x96cb bytes) 000344[0] 1738479938.298925 trunc from 0x8d4997 to 0x2d43dd (0x6005b9 bytes) 000346[1] 1738479938.309933 read_OD 0x1ef000 thru 0x1f7fff (0x9000 bytes) 000347[1] 1738479938.315674 write_OD 0x617000 thru 0x621fff (0xb000 bytes) 000348[1] 1738479938.331041 mapwrite 0x1db000 thru 0x1e32cf (0x82d0 bytes) 000353[1] 1738479938.381984 mapread 0x100000 thru 0x10309a (0x309b bytes) 000355[1] 1738479938.385440 mapread 0x293000 thru 0x295500 (0x2501 bytes) 000362[0] 1738479938.397917 mapwrite 0x286000 thru 0x28caf1 (0x6af2 bytes) 000363[0] 1738479938.423548 trunc from 0x622000 to 0x4c9312 (0x158ced bytes) 000366[0] 1738479938.428361 trunc from 0x4c9313 to 0x780c7f (0x2b796d bytes) 000367[0] 1738479938.434993 mapwrite 0x62c000 thru 0x62dac0 (0x1ac1 bytes) 000372[0] 1738479938.454540 write_OD 0x009000 thru 0x012fff (0xa000 bytes) 000373[1] 1738479938.467504 mapread 0x2bc000 thru 0x2be22c (0x222d bytes) 000375[0] 1738479938.471862 mapwrite 0x6c3000 thru 0x6c3931 (0x932 bytes) 000376[1] 1738479938.487363 write_OD 0x1ae000 thru 0x1bcfff (0xf000 bytes) 000380[0] 1738479938.502774 mapwrite 0x165000 thru 0x173ec7 (0xeec8 bytes) 000381[1] 1738479938.528898 trunc from 0x780c80 to 0x810d5b (0x900dc bytes) 000383[1] 1738479938.535917 read_OD 0x2e2000 thru 0x2e6fff (0x5000 bytes) 000387[1] 1738479938.542318 mapwrite 0x158000 thru 0x1594e0 (0x14e1 bytes) 000388[1] 1738479938.559306 mapwrite 0x699000 thru 0x69e70f (0x5710 bytes) 000391[1] 1738479938.580426 write_OD 0x940000 thru 0x943fff (0x4000 bytes) 000394[1] 1738479938.595277 mapwrite 0x9b4000 thru 0x9c31fc (0xf1fd bytes) 000399[0] 1738479938.633317 write_OD 0x28a000 thru 0x295fff (0xc000 bytes) 000403[1] 1738479938.649443 mapread 0x24b000 thru 0x254b85 (0x9b86 bytes) 000406[0] 1738479938.654291 write_OD 0x5f2000 thru 0x5f9fff (0x8000 bytes) 000407[0] 1738479938.667088 read_OD 0x828000 thru 0x82cfff (0x5000 bytes) 000408[0] 1738479938.669893 write_OD 0x4bb000 thru 0x4c6fff (0xc000 bytes) 000409[0] 1738479938.683436 read_OD 0x17b000 thru 0x189fff (0xf000 bytes) 000410[1] 1738479938.686511 mapwrite 0x9d7000 thru 0x9dd734 (0x6735 bytes) 000413[0] 1738479938.718873 mapwrite 0x6e1000 thru 0x6e41c4 (0x31c5 bytes) 000415[1] 1738479938.736891 trunc from 0x9dd735 to 0x7adeed (0x22f847 bytes) 000419[1] 1738479938.755099 write_OD 0x458000 thru 0x459fff (0x2000 bytes) 000421[0] 1738479938.767418 mapread 0x485000 thru 0x48bf8f (0x6f90 bytes) 000424[1] 1738479938.773991 mapwrite 0x6d3000 thru 0x6dca5a (0x9a5b bytes) 000428[0] 1738479938.806145 trunc from 0x7adeee to 0x589870 (0x22467d bytes) 000429[1] 1738479938.816465 mapwrite 0x2e2000 thru 0x2ee427 (0xc428 bytes) 000430[0] 1738479938.845561 write_OD 0x6b6000 thru 0x6c4fff (0xf000 bytes) 000432[0] 1738479938.863861 read_OD 0x4c5000 thru 0x4cffff (0xb000 bytes) 000434[1] 1738479938.867360 mapread 0x00e000 thru 0x018774 (0xa775 bytes) 000437[0] 1738479938.874195 mapwrite 0x913000 thru 0x9215fe (0xe5ff bytes) 000439[0] 1738479938.906529 mapread 0x2f4000 thru 0x2fad19 (0x6d1a bytes) 000442[1] 1738479938.917205 mapwrite 0x50a000 thru 0x50fa61 (0x5a62 bytes) 000443[1] 1738479938.937621 mapread 0x0c8000 thru 0x0d4eba (0xcebb bytes) 000444[0] 1738479938.944096 trunc from 0x9215ff to 0x136be8 (0x7eaa16 bytes) 000445[1] 1738479938.951875 read_OD 0x08a000 thru 0x08ffff (0x6000 bytes) 000452[0] 1738479938.960095 write_OD 0x0bc000 thru 0x0c7fff (0xc000 bytes) 000454[1] 1738479938.976528 read_OD 0x128000 thru 0x12afff (0x3000 bytes) 000455[1] 1738479938.978140 write_OD 0x93c000 thru 0x93efff (0x3000 bytes) 000457[0] 1738479938.993778 write_OD 0x48b000 thru 0x48ffff (0x5000 bytes) 000459[1] 1738479939.007524 write_OD 0x6ae000 thru 0x6b8fff (0xb000 bytes) 000463[0] 1738479939.022848 trunc from 0x93f000 to 0x1c0266 (0x77ed99 bytes) 000465[0] 1738479939.034230 mapwrite 0x2a4000 thru 0x2a9f15 (0x5f16 bytes) 000466[1] 1738479939.058369 read_OD 0x04c000 thru 0x056fff (0xb000 bytes) 000467[0] 1738479939.065217 read_OD 0x01d000 thru 0x020fff (0x4000 bytes) 000468[0] 1738479939.066514 mapread 0x164000 thru 0x170cc0 (0xccc1 bytes) 000473[0] 1738479939.085177 read_OD 0x292000 thru 0x296fff (0x5000 bytes) 000475[1] 1738479939.087418 mapwrite 0x71d000 thru 0x71f015 (0x2016 bytes) 000476[0] 1738479939.148741 mapread 0x52d000 thru 0x538bcf (0xbbd0 bytes) 000480[0] 1738479939.198986 read_OD 0x486000 thru 0x491fff (0xc000 bytes) 000481[1] 1738479939.201398 trunc from 0x71f016 to 0x94d5cc (0x22e5b7 bytes) 000483[0] 1738479939.218163 write_OD 0x8e2000 thru 0x8e9fff (0x8000 bytes) 000484[1] 1738479939.232705 mapread 0x904000 thru 0x91396c (0xf96d bytes) 000485[0] 1738479939.246735 read_OD 0x5fc000 thru 0x601fff (0x6000 bytes) 000486[0] 1738479939.248717 mapread 0x7a6000 thru 0x7b3de3 (0xdde4 bytes) 000487[0] 1738479939.255339 trunc from 0x94d5cd to 0x82da54 (0x11fb78 bytes) 000489[1] 1738479939.266931 trunc from 0x82da55 to 0x6fff68 (0x12daec bytes) 000490[1] 1738479939.272758 mapread 0x429000 thru 0x430dc6 (0x7dc7 bytes) 000491[1] 1738479939.285124 read_OD 0x374000 thru 0x374fff (0x1000 bytes) 000493[1] 1738479939.288309 write_OD 0x437000 thru 0x43cfff (0x6000 bytes) 000495[0] 1738479939.301791 mapwrite 0x2c4000 thru 0x2cdb44 (0x9b45 bytes) 000496[0] 1738479939.323924 write_OD 0x692000 thru 0x699fff (0x8000 bytes) 000499[1] 1738479939.338025 trunc from 0x6fff69 to 0x245cfa (0x4ba26e bytes) All operations completed A-OK! PASS 16a (9s) == sanityn test 16b: 500 iterations of dual-mount fsx at small size ========================================================== 02:05:40 (1738479940) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.123191 s, 68.1 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.0983161 s, 85.3 MB/s Chance of close/open is 1 in 50 Seed set to 9941 fd 0: /mnt/lustre/f16b.sanityn fd 1: /mnt/lustre2/f16b.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read 000006[1] 1738479941.287027 mapwrite 0x9a762d thru 0x9a7b30 (0x504 bytes) 000009[1] 1738479941.329926 mapwrite 0x8f0a39 thru 0x8f138d (0x955 bytes) 000011[1] 1738479941.347374 mapwrite 0x937031 thru 0x938725 (0x16f5 bytes) 000012[0] 1738479941.362508 mapread 0x31ab49 thru 0x31ac79 (0x131 bytes) 000013[1] 1738479941.371048 write 0x665508 thru 0x6659e1 (0x4da bytes) 000015[1] 1738479941.376536 read 0x0afda0 thru 0x0b0d59 (0xfba bytes) 000018[0] 1738479941.384148 read 0x791c6d thru 0x7926f7 (0xa8b bytes) 000019[1] 1738479941.388361 write 0x30c09f thru 0x30d06e (0xfd0 bytes) 000022[1] 1738479941.399496 mapread 0x75bc66 thru 0x75d441 (0x17dc bytes) 000023[0] 1738479941.407362 mapread 0x138af7 thru 0x1394e1 (0x9eb bytes) 000024[1] 1738479941.414465 mapwrite 0x158a91 thru 0x15a63f (0x1baf bytes) truncating to largest ever: 0x900f99 000025[1] 1738479941.436222 trunc from 0x9a7b31 to 0x900f98 (0xa6b98 bytes) 000026[1] 1738479941.443431 mapwrite 0x580e74 thru 0x5821a4 (0x1331 bytes) 000028[1] 1738479941.471722 mapwrite 0x85e319 thru 0x85f757 (0x143f bytes) 000030[0] 1738479941.490657 trunc from 0x900f99 to 0x4920a6 (0x46eef2 bytes) 000031[1] 1738479941.499329 read 0x1f96ed thru 0x1fa66f (0xf83 bytes) 000032[1] 1738479941.503564 mapwrite 0x0d16b6 thru 0x0d25c9 (0xf14 bytes) 000034[1] 1738479941.527980 trunc from 0x4920a7 to 0x460518 (0x31b8e bytes) 000038[1] 1738479941.539043 write 0x6bba3b thru 0x6bbe58 (0x41e bytes) 000041[0] 1738479941.547395 write 0x0140b7 thru 0x0152e1 (0x122b bytes) 000046[0] 1738479941.567908 mapread 0x425877 thru 0x426d64 (0x14ee bytes) 000047[0] 1738479941.575147 mapwrite 0x0ea537 thru 0x0ebfc2 (0x1a8c bytes) 000048[0] 1738479941.593412 read 0x24ae2d thru 0x24b516 (0x6ea bytes) 000050[1] 1738479941.598510 read 0x070278 thru 0x07118f (0xf18 bytes) 000053[1] 1738479941.602284 mapread 0x0cd13e thru 0x0ce6c8 (0x158b bytes) 000055[0] 1738479941.605763 trunc from 0x6bbe59 to 0x61be45 (0xa0013 bytes) 000057[1] 1738479941.619128 mapread 0x615313 thru 0x616b13 (0x1801 bytes) 000063[0] 1738479941.642254 read 0x4e069d thru 0x4e25d5 (0x1f39 bytes) 000064[1] 1738479941.644096 read 0x05b6e2 thru 0x05d2f4 (0x1c13 bytes) 000068[1] 1738479941.649314 write 0x9c1fc2 thru 0x9c33b9 (0x13f8 bytes) 000074[1] 1738479941.669178 mapwrite 0x025dce thru 0x0268ee (0xb21 bytes) 000076[1] 1738479941.689192 mapread 0x5e0e3b thru 0x5e1436 (0x5fc bytes) 000078[1] 1738479941.697819 mapread 0x4d0700 thru 0x4d12fe (0xbff bytes) 000086[1] 1738479941.717815 read 0x59361a thru 0x595506 (0x1eed bytes) 000087[0] 1738479941.719502 read 0x15b7c9 thru 0x15b9ed (0x225 bytes) 000088[1] 1738479941.722899 mapwrite 0x1045c9 thru 0x105bfb (0x1633 bytes) 000089[1] 1738479941.738738 write 0x182942 thru 0x1843cd (0x1a8c bytes) 000091[1] 1738479941.744623 read 0x8f966c thru 0x8f983a (0x1cf bytes) 000092[1] 1738479941.749024 trunc from 0x9c33ba to 0x71b5a7 (0x2a7e12 bytes) 000093[1] 1738479941.755929 mapwrite 0x22ea76 thru 0x22f7bc (0xd47 bytes) 000095[1] 1738479941.776904 read 0x25ffad thru 0x2613dc (0x1430 bytes) 000097[0] 1738479941.785306 mapread 0x3f08fc thru 0x3f0efd (0x602 bytes) 000100[0] 1738479941.798127 mapwrite 0x975cd3 thru 0x9764e2 (0x810 bytes) 000102[1] 1738479941.824019 write 0x96dbde thru 0x96e321 (0x744 bytes) 000106[1] 1738479941.843312 write 0x44730b thru 0x44802c (0xd22 bytes) 000109[1] 1738479941.855642 trunc from 0x9764e3 to 0x7b4616 (0x1c1ecc bytes) 000113[0] 1738479941.872358 read 0x5fbb1a thru 0x5fc619 (0xb00 bytes) 000114[0] 1738479941.879885 mapwrite 0x494630 thru 0x495de1 (0x17b2 bytes) 000116[1] 1738479941.906407 trunc from 0x7b4617 to 0x593c31 (0x2209e5 bytes) 000117[1] 1738479941.914836 trunc from 0x593c32 to 0x12fdb2 (0x463e7f bytes) 000121[1] 1738479941.930839 write 0x8711a7 thru 0x871416 (0x270 bytes) 000122[1] 1738479941.932812 read 0x6122db thru 0x612a73 (0x799 bytes) 000126[1] 1738479941.947889 mapwrite 0x84b6b5 thru 0x84ba3a (0x386 bytes) 000127[1] 1738479941.967170 read 0x071d9a thru 0x0723f8 (0x65f bytes) 000129[0] 1738479941.968953 mapread 0x34d31b thru 0x34e89b (0x1581 bytes) 000130[1] 1738479941.979551 write 0x728d55 thru 0x72ad14 (0x1fc0 bytes) 000131[1] 1738479941.981236 write 0x98aad0 thru 0x98bf0a (0x143b bytes) 000132[0] 1738479941.984520 mapwrite 0x4b0717 thru 0x4b2233 (0x1b1d bytes) 000133[0] 1738479942.011870 write 0x6af9a8 thru 0x6b110b (0x1764 bytes) 000135[1] 1738479942.020678 write 0x7ed3f2 thru 0x7eebb7 (0x17c6 bytes) 000137[1] 1738479942.026466 read 0x33a334 thru 0x33a421 (0xee bytes) 000138[1] 1738479942.027810 mapread 0x314a49 thru 0x316091 (0x1649 bytes) 000139[1] 1738479942.035268 trunc from 0x98bf0b to 0x1e1653 (0x7aa8b7 bytes) 000140[0] 1738479942.040151 write 0x87d4aa thru 0x87d56c (0xc3 bytes) 000143[1] 1738479942.053284 write 0x886b54 thru 0x887042 (0x4ef bytes) 000145[0] 1738479942.060907 read 0x56b0c4 thru 0x56bf4a (0xe87 bytes) 000146[0] 1738479942.068348 write 0x6d7880 thru 0x6d8730 (0xeb1 bytes) 000147[0] 1738479942.073841 read 0x5c7d04 thru 0x5c99dd (0x1cda bytes) 000148[0] 1738479942.078220 trunc from 0x887043 to 0x52d914 (0x35972e bytes) 000153[0] 1738479942.102198 trunc from 0x52d915 to 0x0e6096 (0x44787e bytes) 000156[0] 1738479942.111392 mapwrite 0x063c1c thru 0x065321 (0x1706 bytes) 000157[0] 1738479942.128193 read 0x02f4ec thru 0x030731 (0x1246 bytes) 000159[1] 1738479942.142938 mapwrite 0x02fb3a thru 0x031286 (0x174d bytes) 000160[1] 1738479942.166750 mapwrite 0x7a8a4b thru 0x7a9b99 (0x114f bytes) 000162[0] 1738479942.193377 trunc from 0x7a9b9a to 0x3b8565 (0x3f1634 bytes) 000164[0] 1738479942.205977 write 0x39a9d8 thru 0x39b442 (0xa6b bytes) 000165[1] 1738479942.222380 trunc from 0x3b8566 to 0x107326 (0x2b123f bytes) 000166[0] 1738479942.237552 write 0x0b5481 thru 0x0b6172 (0xcf2 bytes) 000167[1] 1738479942.244498 mapread 0x00d4ac thru 0x00e357 (0xeac bytes) 000170[0] 1738479942.257922 read 0x0a810e thru 0x0a993a (0x182d bytes) 000172[0] 1738479942.269280 trunc from 0x107327 to 0x5058e2 (0x3fe5bc bytes) 000178[1] 1738479942.287772 mapread 0x4b6c6a thru 0x4b6f3d (0x2d4 bytes) 000180[0] 1738479942.296912 mapread 0x2b8969 thru 0x2ba3ab (0x1a43 bytes) 000181[0] 1738479942.316264 mapread 0x3ccde5 thru 0x3ce7dc (0x19f8 bytes) truncating to largest ever: 0x987df3 000182[1] 1738479942.316796 trunc from 0x5058e3 to 0x987df2 (0x482510 bytes) 000184[0] 1738479942.328484 read 0x495d4a thru 0x49748f (0x1746 bytes) 000185[0] 1738479942.336110 mapwrite 0x81fe8f thru 0x8214c2 (0x1634 bytes) 000189[0] 1738479942.359544 mapread 0x80d148 thru 0x80ded8 (0xd91 bytes) 000191[1] 1738479942.362232 mapread 0x5992f9 thru 0x59a3bc (0x10c4 bytes) 000193[0] 1738479942.367392 write 0x0f3253 thru 0x0f3c38 (0x9e6 bytes) 000195[0] 1738479942.375241 write 0x530c4d thru 0x531092 (0x446 bytes) 000197[1] 1738479942.382787 mapwrite 0x31b227 thru 0x31b7a9 (0x583 bytes) 000199[1] 1738479942.407377 mapread 0x4986c8 thru 0x499afb (0x1434 bytes) 000201[0] 1738479942.421139 trunc from 0x987df3 to 0x5530a0 (0x434d52 bytes) 000202[1] 1738479942.432180 mapread 0x204465 thru 0x20516a (0xd06 bytes) 000203[1] 1738479942.439985 read 0x515521 thru 0x515b4f (0x62f bytes) 000204[1] 1738479942.445553 mapwrite 0x46623a thru 0x466a3c (0x803 bytes) 000206[1] 1738479942.466131 write 0x38a94f thru 0x38b539 (0xbeb bytes) 000207[1] 1738479942.471259 read 0x4ba205 thru 0x4babe3 (0x9df bytes) 000208[1] 1738479942.472632 mapread 0x35e656 thru 0x35f027 (0x9d2 bytes) 000209[0] 1738479942.475136 mapwrite 0x9a525f thru 0x9a558a (0x32c bytes) 000210[1] 1738479942.497415 mapwrite 0x2ae508 thru 0x2ae635 (0x12e bytes) 000211[1] 1738479942.521643 mapwrite 0x18cf83 thru 0x18e47a (0x14f8 bytes) 000212[1] 1738479942.547222 write 0x8e9402 thru 0x8e96f7 (0x2f6 bytes) 000214[0] 1738479942.555408 trunc from 0x9a558b to 0x806c14 (0x19e976 bytes) 000218[0] 1738479942.575505 read 0x6d977d thru 0x6db12a (0x19ae bytes) 000219[1] 1738479942.582526 write 0x2fd608 thru 0x2ff43a (0x1e33 bytes) 000221[1] 1738479942.591886 mapwrite 0x31cc8e thru 0x31e5cc (0x193f bytes) 000223[1] 1738479942.614671 mapread 0x40db1b thru 0x40e1f8 (0x6de bytes) 000224[0] 1738479942.623223 trunc from 0x806c15 to 0x591de0 (0x274e34 bytes) 000229[1] 1738479942.631743 write 0x879665 thru 0x87afee (0x198a bytes) 000231[0] 1738479942.641886 trunc from 0x87afef to 0x691bbf (0x1e942f bytes) 000232[0] 1738479942.652516 trunc from 0x691bc0 to 0x375ff1 (0x31bbce bytes) 000234[0] 1738479942.663812 trunc from 0x375ff2 to 0x611686 (0x29b695 bytes) 000235[0] 1738479942.672041 read 0x38dbc5 thru 0x38decd (0x309 bytes) 000236[1] 1738479942.674354 trunc from 0x611687 to 0x16544e (0x4ac238 bytes) 000240[0] 1738479942.686150 mapread 0x050a3d thru 0x0519f0 (0xfb4 bytes) 000241[0] 1738479942.694399 write 0x606e36 thru 0x6076e1 (0x8ac bytes) truncating to largest ever: 0x99b737 000242[0] 1738479942.700578 trunc from 0x6076e2 to 0x99b736 (0x394055 bytes) 000243[0] 1738479942.710231 mapwrite 0x91f08a thru 0x920422 (0x1399 bytes) 000244[1] 1738479942.727583 write 0x433c6a thru 0x434ebd (0x1254 bytes) 000246[0] 1738479942.739779 write 0x3ec3bb thru 0x3eca3d (0x683 bytes) 000248[0] 1738479942.748585 mapread 0x754e03 thru 0x7561b1 (0x13af bytes) 000249[0] 1738479942.757966 write 0x0df331 thru 0x0e0ade (0x17ae bytes) 000250[0] 1738479942.763177 read 0x8acf3d thru 0x8ad52f (0x5f3 bytes) 000252[1] 1738479942.770607 trunc from 0x99b737 to 0x1c0160 (0x7db5d6 bytes) 000255[1] 1738479942.784655 mapwrite 0x52c429 thru 0x52d461 (0x1039 bytes) 000256[0] 1738479942.807379 mapread 0x1f7895 thru 0x1f8bf8 (0x1364 bytes) 000257[0] 1738479942.816105 mapwrite 0x55bac2 thru 0x55beea (0x429 bytes) 000261[1] 1738479942.846149 trunc from 0x55beeb to 0x8cc8ab (0x3709c1 bytes) 000265[1] 1738479942.864555 read 0x8174d5 thru 0x8182bb (0xde7 bytes) 000267[0] 1738479942.869481 write 0x964d30 thru 0x9659d5 (0xca6 bytes) 000269[0] 1738479942.878236 mapwrite 0x3abb3f thru 0x3ad7db (0x1c9d bytes) 000270[1] 1738479942.901055 mapwrite 0x234b34 thru 0x2363ab (0x1878 bytes) 000271[1] 1738479942.925656 mapwrite 0x7a57fb thru 0x7a5a50 (0x256 bytes) 000272[1] 1738479942.937601 trunc from 0x9659d6 to 0x907e34 (0x5dba1 bytes) 000273[1] 1738479942.945007 write 0x25a7a4 thru 0x25c57b (0x1dd8 bytes) 000275[0] 1738479942.951388 read 0x287c41 thru 0x289105 (0x14c5 bytes) 000278[1] 1738479942.959873 mapread 0x6f3a6b thru 0x6f3f01 (0x497 bytes) 000280[0] 1738479942.967450 read 0x342bb1 thru 0x34414e (0x159e bytes) 000281[1] 1738479942.968911 read 0x882deb thru 0x883528 (0x73e bytes) 000282[1] 1738479942.972947 trunc from 0x907e35 to 0x432389 (0x4d5aab bytes) 000283[1] 1738479942.978825 read 0x00d7e1 thru 0x00e796 (0xfb6 bytes) 000284[0] 1738479942.980456 trunc from 0x43238a to 0x4c748e (0x95105 bytes) 000285[0] 1738479942.988141 mapread 0x2b0494 thru 0x2b2218 (0x1d85 bytes) 000287[1] 1738479942.991195 write 0x2645e3 thru 0x2659d6 (0x13f4 bytes) 000288[0] 1738479942.998113 mapread 0x3a3785 thru 0x3a5727 (0x1fa3 bytes) 000290[0] 1738479943.005950 read 0x4971d4 thru 0x4978c5 (0x6f2 bytes) 000293[0] 1738479943.012533 mapread 0x32df2f thru 0x32e13a (0x20c bytes) 000295[1] 1738479943.021782 write 0x99ab48 thru 0x99b84c (0xd05 bytes) 000296[1] 1738479943.028539 read 0x659a26 thru 0x65a349 (0x924 bytes) 000297[1] 1738479943.032810 write 0x1371de thru 0x138249 (0x106c bytes) 000298[0] 1738479943.038235 write 0x42c7cf thru 0x42cd50 (0x582 bytes) 000299[1] 1738479943.044556 write 0x2f92fb thru 0x2f9a70 (0x776 bytes) 000302[0] 1738479943.056001 mapread 0x840c49 thru 0x841da6 (0x115e bytes) 000303[1] 1738479943.067580 trunc from 0x99b84d to 0x33b08c (0x6607c0 bytes) 000304[0] 1738479943.078246 write 0x5b7f9c thru 0x5b93f1 (0x1456 bytes) 000305[0] 1738479943.084625 mapread 0x46e20f thru 0x46e9ab (0x79d bytes) truncating to largest ever: 0x9c61d3 000308[0] 1738479943.098772 trunc from 0x5b93f2 to 0x9c61d2 (0x40cde1 bytes) 000310[0] 1738479943.106480 read 0x48ec81 thru 0x490253 (0x15d3 bytes) 000312[0] 1738479943.113162 read 0x1342a2 thru 0x13626a (0x1fc9 bytes) 000314[1] 1738479943.118714 trunc from 0x9c61d3 to 0x0a9f39 (0x91c299 bytes) 000318[0] 1738479943.140610 write 0x9d0b90 thru 0x9d15b4 (0xa25 bytes) 000319[0] 1738479943.148424 mapread 0x9385f3 thru 0x938785 (0x193 bytes) 000320[0] 1738479943.155261 read 0x189ed9 thru 0x18bb3d (0x1c65 bytes) 000321[1] 1738479943.159919 mapwrite 0x407087 thru 0x408eb6 (0x1e30 bytes) 000325[1] 1738479943.200797 mapread 0x4ae650 thru 0x4aefa6 (0x957 bytes) 000329[0] 1738479943.218108 mapwrite 0x0fa3bc thru 0x0faced (0x932 bytes) 000330[1] 1738479943.238531 mapwrite 0x36f6fd thru 0x3710c6 (0x19ca bytes) 000332[0] 1738479943.259139 trunc from 0x9d15b5 to 0x1b1298 (0x82031c bytes) 000333[1] 1738479943.268336 trunc from 0x1b1299 to 0x8b1e2e (0x700b96 bytes) 000334[0] 1738479943.278131 mapread 0x4a2657 thru 0x4a27a3 (0x14d bytes) 000335[1] 1738479943.284352 read 0x537a87 thru 0x537f83 (0x4fd bytes) 000337[0] 1738479943.293443 trunc from 0x8b1e2f to 0x813da0 (0x9e08e bytes) 000345[1] 1738479943.317780 mapwrite 0x761e92 thru 0x762313 (0x482 bytes) 000348[0] 1738479943.344680 trunc from 0x813da1 to 0x5a8e84 (0x26af1c bytes) 000349[1] 1738479943.356080 mapread 0x095198 thru 0x095885 (0x6ee bytes) 000351[1] 1738479943.363468 read 0x564289 thru 0x56534f (0x10c7 bytes) 000352[0] 1738479943.370098 write 0x460e96 thru 0x461ff7 (0x1162 bytes) 000353[0] 1738479943.379625 mapwrite 0x874301 thru 0x874647 (0x347 bytes) 000356[1] 1738479943.405435 mapwrite 0x1ea297 thru 0x1ea713 (0x47d bytes) 000358[0] 1738479943.429428 write 0x5748fe thru 0x5764b8 (0x1bbb bytes) 000359[1] 1738479943.435155 mapwrite 0x66103c thru 0x6617d9 (0x79e bytes) 000360[0] 1738479943.452600 read 0x70c489 thru 0x70cfbc (0xb34 bytes) 000363[0] 1738479943.465886 trunc from 0x874648 to 0x5a2b7b (0x2d1acc bytes) 000366[1] 1738479943.482867 mapread 0x42940e thru 0x42a475 (0x1068 bytes) 000369[0] 1738479943.494264 mapwrite 0x88bd26 thru 0x88d3de (0x16b9 bytes) 000370[1] 1738479943.522645 read 0x83f160 thru 0x83f5ea (0x48b bytes) 000374[1] 1738479943.535490 read 0x5c6f12 thru 0x5c7ef5 (0xfe4 bytes) 000376[0] 1738479943.540315 read 0x361f64 thru 0x363b9c (0x1c39 bytes) 000377[0] 1738479943.541906 mapwrite 0x41cf12 thru 0x41e1be (0x12ad bytes) 000378[0] 1738479943.559999 write 0x1bf3b4 thru 0x1bf85a (0x4a7 bytes) 000379[1] 1738479943.563744 write 0x9947e3 thru 0x9967d0 (0x1fee bytes) 000380[0] 1738479943.570304 write 0x8c205d thru 0x8c3c4f (0x1bf3 bytes) 000382[0] 1738479943.578439 mapwrite 0x80196e thru 0x802e8f (0x1522 bytes) 000383[0] 1738479943.593273 trunc from 0x9967d1 to 0x2a39ac (0x6f2e24 bytes) 000384[0] 1738479943.601119 trunc from 0x2a39ad to 0x3d57ef (0x131e43 bytes) 000387[0] 1738479943.609937 mapwrite 0x6bf0c2 thru 0x6bf219 (0x158 bytes) 000396[1] 1738479943.656539 mapwrite 0x0007ec thru 0x001864 (0x1079 bytes) 000397[0] 1738479943.677514 write 0x80353b thru 0x805327 (0x1ded bytes) 000398[1] 1738479943.681304 mapread 0x0b3a43 thru 0x0b45a6 (0xb64 bytes) 000399[1] 1738479943.692370 read 0x693f45 thru 0x695b2c (0x1be8 bytes) 000400[1] 1738479943.697358 read 0x1880cb thru 0x1882ff (0x235 bytes) 000401[1] 1738479943.699042 trunc from 0x805328 to 0x8a5000 (0x9fcd9 bytes) 000402[1] 1738479943.712417 write 0x52b907 thru 0x52ba29 (0x123 bytes) 000403[1] 1738479943.717285 mapread 0x38a87c thru 0x38c2eb (0x1a70 bytes) 000407[1] 1738479943.735218 trunc from 0x8a5001 to 0x6add45 (0x1f72bb bytes) 000409[0] 1738479943.745114 trunc from 0x6add46 to 0x781e74 (0xd412f bytes) 000412[1] 1738479943.760360 mapread 0x20fec6 thru 0x2115b4 (0x16ef bytes) 000414[0] 1738479943.770284 mapwrite 0x745d96 thru 0x747833 (0x1a9e bytes) 000415[0] 1738479943.790598 write 0x33de3e thru 0x33ed53 (0xf16 bytes) 000417[1] 1738479943.801986 trunc from 0x781e75 to 0x4f8fdf (0x288e95 bytes) 000418[0] 1738479943.812683 read 0x4ee812 thru 0x4ef441 (0xc30 bytes) 000420[0] 1738479943.820948 mapread 0x0b4ece thru 0x0b6922 (0x1a55 bytes) 000423[0] 1738479943.829605 mapread 0x27c4cd thru 0x27c813 (0x347 bytes) 000426[1] 1738479943.831310 mapread 0x303e90 thru 0x3049be (0xb2f bytes) 000427[1] 1738479943.833598 mapwrite 0x720a4f thru 0x7229f9 (0x1fab bytes) 000428[1] 1738479943.859880 trunc from 0x7229fa to 0x9761de (0x2537e5 bytes) 000430[1] 1738479943.863639 mapread 0x47ca4e thru 0x47d4be (0xa71 bytes) 000432[0] 1738479943.866470 mapread 0x8bee93 thru 0x8c01b8 (0x1326 bytes) 000434[0] 1738479943.875295 write 0x54dfb2 thru 0x54fe83 (0x1ed2 bytes) 000436[0] 1738479943.887388 mapread 0x60bfe9 thru 0x60c8e5 (0x8fd bytes) 000438[1] 1738479943.897547 mapwrite 0x36a46b thru 0x36a654 (0x1ea bytes) 000439[1] 1738479943.918280 read 0x8b1983 thru 0x8b2358 (0x9d6 bytes) 000440[0] 1738479943.924534 mapwrite 0x098a62 thru 0x09a99b (0x1f3a bytes) 000441[0] 1738479943.952140 write 0x7dab1e thru 0x7dca3b (0x1f1e bytes) 000442[1] 1738479943.954954 mapwrite 0x9987b0 thru 0x99a764 (0x1fb5 bytes) 000445[0] 1738479943.995346 mapwrite 0x63b9da thru 0x63c571 (0xb98 bytes) 000448[1] 1738479944.025418 write 0x83d1a1 thru 0x83e776 (0x15d6 bytes) 000452[1] 1738479944.041240 read 0x96f03f thru 0x970fcd (0x1f8f bytes) 000453[1] 1738479944.045975 trunc from 0x99a765 to 0x46fcc8 (0x52aa9c bytes) 000456[1] 1738479944.061039 write 0x268199 thru 0x268af6 (0x95e bytes) 000462[1] 1738479944.072614 read 0x28266c thru 0x2832fa (0xc8f bytes) 000463[1] 1738479944.074220 trunc from 0x46fcc9 to 0x60a889 (0x19abc1 bytes) 000466[0] 1738479944.088669 trunc from 0x60a88a to 0x7acabb (0x1a2232 bytes) 000468[1] 1738479944.100920 read 0x1db30b thru 0x1dc83f (0x1535 bytes) 000470[0] 1738479944.107989 mapread 0x13cee5 thru 0x13ecfd (0x1e19 bytes) 000475[0] 1738479944.122379 read 0x17b929 thru 0x17c9ea (0x10c2 bytes) 000476[0] 1738479944.123993 read 0x041cc8 thru 0x041da5 (0xde bytes) 000484[1] 1738479944.142854 trunc from 0x7acabc to 0x3de131 (0x3ce98a bytes) 000485[0] 1738479944.154758 write 0x0944ae thru 0x0955f2 (0x1145 bytes) 000487[0] 1738479944.166157 write 0x841e0a thru 0x843760 (0x1957 bytes) 000489[1] 1738479944.174072 write 0x8493d1 thru 0x84ab3d (0x176d bytes) 000492[1] 1738479944.182421 mapread 0x0db158 thru 0x0dbeb7 (0xd60 bytes) 000494[1] 1738479944.187943 mapread 0x5518ba thru 0x553614 (0x1d5b bytes) 000496[0] 1738479944.198865 trunc from 0x84ab3e to 0x6588f3 (0x1f224a bytes) All operations completed A-OK! PASS 16b (5s) == sanityn test 16c: verify data consistency on ldiskfs with cache disabled (b=17397) ========================================================== 02:05:45 (1738479945) SKIP: sanityn test_16c dio on ldiskfs only SKIP 16c (1s) == sanityn test 16d: Verify DIO and buffer IO with two clients ========================================================== 02:05:46 (1738479946) 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.116405 s, 72.1 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.0934704 s, 89.7 MB/s ldlm.namespaces.MGC192.168.203.115@tcp.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6d11000.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff88012a40f800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d11000.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff88012a40f800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d11000.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff88012a40f800.lru_size=clear 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 2.39464 s, 43.8 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.660129 s, 159 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.575099 s, 182 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.16865 s, 89.7 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.54081 s, 68.1 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.80181 s, 131 MB/s PASS 16d (10s) == sanityn test 16e: Verify size consistency for O_DIRECT write ========================================================== 02:05:56 (1738479956) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0616978 s, 170 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0250607 s, 41.8 MB/s PASS 16e (1s) == sanityn test 16f: rw sequential consistency vs drop_caches ========================================================== 02:05:57 (1738479957) TIMEOUT PASS 16f (22s) == sanityn test 16g: mmap rw sequential consistency vs drop_caches ========================================================== 02:06:19 (1738479979) TIMEOUT PASS 16g (21s) == sanityn test 16h: mmap read after truncate file ======= 02:06:41 (1738480001) ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16h (1s) == sanityn test 16i: read after truncate file ============ 02:06:42 (1738480002) ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16i (2s) == sanityn test 16j: race dio with buffered i/o ========== 02:06:44 (1738480004) 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 0.380572 s, 68.9 MB/s bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.255314 s, 103 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.541366 s, 48.4 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.155778 s, 168 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.482131 s, 54.4 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.168272 s, 156 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.549968 s, 47.7 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.413911 s, 63.3 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.438047 s, 59.8 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.600953 s, 43.6 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.64578 s, 40.6 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.378808 s, 69.2 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.390677 s, 67.1 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.608817 s, 43.1 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.645323 s, 40.6 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.202069 s, 130 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.295857 s, 88.6 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.656606 s, 39.9 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.743546 s, 35.3 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK PASS 16j (8s) == sanityn test 16k: Parallel FSX and drop caches should not panic ========================================================== 02:06:52 (1738480012) + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.1 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.2 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.3 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.4 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.5 -l 67108864 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: skipping zero size read Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x1a7062c truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x232e1d3 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x32cce75 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x1a7062c truncating to largest ever: 0x32cce75 truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x32cce75 truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab All operations completed A-OK! + fsx 1 done: rc=0 Sun Feb 2 02:06:59 EST 2025 All operations completed A-OK! All operations completed A-OK! All operations completed A-OK! + fsx 2 done: rc=0 Sun Feb 2 02:06:59 EST 2025 + fsx 3 done: rc=0 Sun Feb 2 02:06:59 EST 2025 All operations completed A-OK! + fsx 4 done: rc=0 Sun Feb 2 02:06:59 EST 2025 + fsx 5 done: rc=0 Sun Feb 2 02:06:59 EST 2025 PASS 16k (9s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 02:07:01 (1738480021) fail_loc=0x8000030a PASS 17 (4s) == sanityn test 18: mmap sanity check =========================================================================================== 02:07:05 (1738480025) mmap test1: basic mmap operation (PASS, 0.019286s) mmap test2: MAP_PRIVATE not write back (PASS, 0.013847s) mmap test3: concurrent mmap ops on two nodes (PASS, 11.346s) mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 4.0798s) mmap test5: read/write file to/from the buffer which mmapped to just this file (PASS, 0.028707s) mmap test6: check mmap write/read content on two nodes (PASS, 0.033024s) mmap test7: file i/o with an unmapped buffer (SKIPPED, 0s) mmap test8: SIGBUS for beyond file size (SKIPPED, 0s) mmap test9: SIGBUS for negative file offset (SKIPPED, 0s) mmap test10: multi-thread mmap access (PASS, 0.29855s) mmap test11: multi-thread shared mmap (PASS, 0.32956s) mmap test10: mtime not change for readonly mmap access (PASS, 1.0132s) PASS 18 (20s) == sanityn test 19: test concurrent uncached read races ========================================================================= 02:07:25 (1738480045) oleg315-server: error: get_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory pdsh@oleg315-client: oleg315-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (1s) == sanityn test 20: test extra readahead page left in cache ============================================================== 02:07:26 (1738480046) PASS 20 (1s) == sanityn test 21: Try to remove mountpoint on another dir ============================================================== 02:07:27 (1738480047) rmdir: removing directory, '/mnt/lustre/d21.sanityn' rmdir: failed to remove '/mnt/lustre/d21.sanityn': Device or resource busy rmdir: removing directory, '/mnt/lustre2/d21.sanityn' Removed mounted directory from another mountpoint, needs to be fixed PASS 21 (2s) == sanityn test 23: others should see updated atime while another read============================================================== 02:07:29 (1738480049) now is 1738480050 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.6984 new atime is 1738480111 PASS 23 (63s) == sanityn test 24a: lfs df [-ih] [path] test =================================================================================== 02:08:32 (1738480112) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 30720 3738624 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 38912 7499776 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 30720 3738624 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 38912 7499776 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.6K 387 490.2K 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 115.2K 400 114.8K 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 114.5K 401 114.2K 1% /mnt/lustre[OST:1] filesystem_summary: 229.4K 387 229.0K 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.6K 387 490.2K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.2K 400 114.8K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 114.5K 401 114.2K 1% /mnt/lustre2[OST:1] filesystem_summary: 229.4K 387 229.0K 1% /mnt/lustre2 UUID bytes Used Available Use% Mounted on lustre-MDT0000_UUID 2.1G 3.2M 2.1G 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3.6G 8.0M 3.6G 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3.6G 30.0M 3.6G 1% /mnt/lustre[OST:1] filesystem_summary: 7.2G 38.0M 7.2G 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502378 387 501991 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118000 400 117600 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 117297 401 116896 1% /mnt/lustre2[OST:1] filesystem_summary: 234883 387 234496 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 30720 3738624 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 38912 7499776 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.6K 387 490.2K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.2K 400 114.8K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 114.5K 401 114.2K 1% /mnt/lustre2[OST:1] filesystem_summary: 229.4K 387 229.0K 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502378 387 501991 1% /mnt/lustre[MDT:0] filesystem_summary: 502378 387 501991 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502378 387 501991 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118000 400 117600 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 117297 401 116896 1% /mnt/lustre2[OST:1] filesystem_summary: 234883 387 234496 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 30720 3738624 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 38912 7499776 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 30720 3738624 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 38912 7499776 1% /mnt/lustre2 PASS 24a (1s) == sanityn test 24b: lfs df should show both filesystems ========================================================================= 02:08:33 (1738480113) PASS 24b (2s) == sanityn test 25a: change ACL on one mountpoint be seen on another ============================================================= 02:08:35 (1738480115) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] PASS 25a (1s) == sanityn test 25b: change ACL under remote dir on one mountpoint be seen on another ========================================================== 02:08:36 (1738480116) SKIP: sanityn test_25b needs >= 2 MDTs SKIP 25b (1s) == sanityn test 26a: allow mtime to get older ============ 02:08:37 (1738480117) utime: good mknod times 1738480116 <= 1738480117 <= 1738480117 for /mnt/lustre/f26a utime: good mknod times 1738480116 <= 1738480117 <= 1738480117 for /mnt/lustre2/f26a utime: good utime mtimes 100000, atime 200000 utime: updated times for /mnt/lustre2/f26a PASS 26a (2s) == sanityn test 26b: sync mtime between ost and mds ====== 02:08:39 (1738480119) PASS 26b (4s) == sanityn test 26c: set-in-past on open file is not lost on close ========================================================== 02:08:43 (1738480123) multiop /mnt/lustre/f26c.sanityn vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.6984 File: '/mnt/lustre/f26c.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205272502398 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2025-02-02 02:08:43.000000000 -0500 Birth: - File: '/mnt/lustre2/f26c.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205272502398 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2025-02-02 02:08:43.000000000 -0500 Birth: - PASS 26c (2s) SKIP: sanityn test_27 skipping excluded test 27 SKIP: sanityn test_28 skipping ALWAYS excluded test 28 == sanityn test 30: recreate file race =================== 02:08:46 (1738480126) 0 PASS 30 (3s) == sanityn test 31a: voluntary cancel / blocking ast race======================================================================== 02:08:49 (1738480129) fail_loc=0x314 PASS 31a (3s) == sanityn test 31b: voluntary OST cancel / blocking ast race======================================================================== 02:08:52 (1738480132) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg315-server mds-ost sync done. sleep 5 for ZFS MDS Waiting for MDT destroys to complete fail_loc=0x314 fail_loc=0x316 fail_loc=0 fail_loc=0 Filesystem 1K-blocks Used Available Use% Mounted on 192.168.203.115@tcp:/lustre 7542784 38912 7499776 1% /mnt/lustre2 PASS 31b (10s) == sanityn test 31r: open-rename(replace) race =========== 02:09:02 (1738480142) -rw-r--r-- 1 root root 0 Feb 2 02:09 /mnt/lustre/f31r.sanityn.target fail_loc=0x1419 fail_val=3 mv: cannot stat '/mnt/lustre2/f31r.sanityn.source': Input/output error PASS 31r (5s) == sanityn test 31s: open should not revalidate invalid dentry ========================================================== 02:09:07 (1738480147) /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 1213: 13329 Terminated tail -f $tfile PASS 31s (2s) == sanityn test 31t: getattr should not revalidate invalid dentry ========================================================== 02:09:09 (1738480149) PASS 31t (2s) SKIP: sanityn test_33a skipping SLOW test 33a == sanityn test 33b: COS: cross create/delete, 2 clients, benchmark under remote dir ========================================================== 02:09:11 (1738480151) SKIP: sanityn test_33b Need two or more clients, have 1 SKIP 33b (1s) == sanityn test 33c: Cancel cross-MDT lock should trigger Sync-on-Lock-Cancel ========================================================== 02:09:12 (1738480152) SKIP: sanityn test_33c needs >= 2 MDTs SKIP 33c (1s) == sanityn test 33d: dependent transactions should trigger COS ========================================================== 02:09:13 (1738480153) SKIP: sanityn test_33d needs >= 2 MDTs SKIP 33d (1s) == sanityn test 33e: independent transactions shouldn't trigger COS ========================================================== 02:09:14 (1738480154) SKIP: sanityn test_33e needs >= 2 MDTs SKIP 33e (0s) == sanityn test 34: no lock timeout under IO ============= 02:09:14 (1738480154) fail_loc=0x512 fail_loc=0x512 lock should not expire writing on client1 reading on client2 success fail_loc=0x511 fail_loc=0x511 lock should expire writing on client1 reading on client2 success oleg315-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800b6d11000.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800b6d11000.ost_server_uuid in IDLE state after 0 sec oleg315-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800b6d11000.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800b6d11000.ost_server_uuid in FULL state after 0 sec oleg315-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800b6d11000.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800b6d11000.ost_server_uuid in IDLE state after 0 sec oleg315-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800b6d11000.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800b6d11000.ost_server_uuid in FULL state after 0 sec oleg315-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800b6d11000.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800b6d11000.ost_server_uuid in IDLE state after 0 sec oleg315-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800b6d11000.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800b6d11000.ost_server_uuid in FULL state after 0 sec PASS 34 (86s) == sanityn test 35: -EINTR cp_ast vs. bl_ast race does not evict client ========================================================== 02:10:40 (1738480240) fail_loc=0x80000317 Race attempt 0 Wait for 19961 20103 for 60 sec... total: 4000 open/close in 8.00 seconds: 500.02 ops/second fail_loc=0x0 Filesystem Size Used Avail Use% Mounted on 192.168.203.115@tcp:/lustre 7.2G 40M 7.2G 1% /mnt/lustre 192.168.203.115@tcp:/lustre 7.2G 40M 7.2G 1% /mnt/lustre2 PASS 35 (63s) == sanityn test 36: handle ESTALE/open-unlink correctly == 02:11:43 (1738480303) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg315-server mds-ost sync done. Waiting for MDT destroys to complete 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.26368 s, 199 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6984 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(0) *** before(7497728) after_dd(7446528) after(7497728) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.281474 s, 186 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6984 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(1) *** before(7497728) after_dd(7446528) after(7497728) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.252746 s, 207 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6984 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(2) *** before(7497728) after_dd(7446528) after(7497728) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.248769 s, 211 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6984 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(3) *** before(7497728) after_dd(7446528) after(7497728) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.2782 s, 188 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6984 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(4) *** before(7497728) after_dd(7446528) after(7497728) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.249072 s, 210 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6984 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(5) *** before(7497728) after_dd(7446528) after(7497728) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.242548 s, 216 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6984 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(6) *** before(7497728) after_dd(7446528) after(7497728) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.259921 s, 202 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6984 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(7) *** before(7497728) after_dd(7446528) after(7497728) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.274038 s, 191 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6984 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(8) *** before(7497728) after_dd(7446528) after(7497728) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.267418 s, 196 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6984 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(9) *** before(7497728) after_dd(7446528) after(7497728) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.262916 s, 199 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6984 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(10) *** before(7497728) after_dd(7446528) after(7497728) PASS 36 (225s) == sanityn test 37: check i_size is not updated for directory on close (bug 18695) ======================================================================== 02:15:28 (1738480528) multiop /mnt/lustre/d37.sanityn vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.6984 - create 9414 (time 1738480539.54 total 10.00 last 941.29) total: 10000 create in 10.79 seconds: 926.40 ops/second PASS 37 (14s) == sanityn test 39a: file mtime does not change after rename ========================================================== 02:15:42 (1738480542) repeat after cancel_lru_locks PASS 39a (2s) == sanityn test 39b: file mtime the same on clients with/out lock ========================================================== 02:15:44 (1738480544) repeat after cancel_lru_locks PASS 39b (2s) == sanityn test 39c: check truncate mtime update ================================================================================ 02:15:47 (1738480547) repeat after cancel_lru_locks PASS 39c (3s) == sanityn test 39d: sync write should update mtime ====== 02:15:49 (1738480549) fail_loc=0x411 fail_loc=0 PASS 39d (2s) == sanityn test 40a: pdirops: create vs others ======================================================================== 02:15:51 (1738480551) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40a (8s) == sanityn test 40b: pdirops: open|create and others ======================================================================== 02:15:59 (1738480559) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40b (7s) == sanityn test 40c: pdirops: link and others ======================================================================== 02:16:06 (1738480566) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40c (8s) == sanityn test 40d: pdirops: unlink and others ======================================================================== 02:16:14 (1738480574) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40d (7s) == sanityn test 40e: pdirops: rename and others ======================================================================== 02:16:21 (1738480581) No conflict No conflict No conflict No conflict No conflict No conflict PASS 40e (7s) == sanityn test 41a: pdirops: create vs mkdir ======================================================================== 02:16:28 (1738480588) mkdir: cannot create directory '/mnt/lustre2/f41a.sanityn': File exists Conflict PASS 41a (5s) == sanityn test 41b: pdirops: create vs create ======================================================================== 02:16:33 (1738480593) open: File exists Conflict PASS 41b (5s) == sanityn test 41c: pdirops: create vs link ======================================================================== 02:16:38 (1738480598) link: cannot create link '/mnt/lustre2/f41c.sanityn' to '/mnt/lustre2/f41c.sanityn-2': File exists Conflict PASS 41c (5s) == sanityn test 41d: pdirops: create vs unlink ======================================================================== 02:16:43 (1738480603) Conflict PASS 41d (4s) == sanityn test 41e: pdirops: create and rename (tgt) ======================================================================== 02:16:47 (1738480607) Conflict PASS 41e (6s) == sanityn test 41f: pdirops: create and rename (src) ======================================================================== 02:16:53 (1738480613) Conflict PASS 41f (5s) == sanityn test 41g: pdirops: create vs getattr ======================================================================== 02:16:58 (1738480618) Conflict PASS 41g (5s) == sanityn test 41h: pdirops: create vs readdir ======================================================================== 02:17:03 (1738480623) Conflict PASS 41h (4s) == sanityn test 41i: reint_open: create vs create ======== 02:17:07 (1738480627) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 41i (657s) == sanityn test 42a: pdirops: mkdir vs mkdir ======================================================================== 02:28:04 (1738481284) mkdir: cannot create directory '/mnt/lustre2/f42a.sanityn': File exists Conflict PASS 42a (4s) == sanityn test 42b: pdirops: mkdir vs create ======================================================================== 02:28:09 (1738481289) open: File exists Conflict PASS 42b (4s) == sanityn test 42c: pdirops: mkdir vs link ======================================================================== 02:28:13 (1738481293) link: cannot create link '/mnt/lustre2/f42c.sanityn' to '/mnt/lustre2/f42c.sanityn-2': File exists Conflict PASS 42c (4s) == sanityn test 42d: pdirops: mkdir vs unlink ======================================================================== 02:28:17 (1738481297) Conflict PASS 42d (4s) == sanityn test 42e: pdirops: mkdir and rename (tgt) ======================================================================== 02:28:21 (1738481301) mv: cannot overwrite directory '/mnt/lustre2/f42e.sanityn' with non-directory Conflict PASS 42e (4s) == sanityn test 42f: pdirops: mkdir and rename (src) ======================================================================== 02:28:25 (1738481305) Conflict PASS 42f (4s) == sanityn test 42g: pdirops: mkdir vs getattr ======================================================================== 02:28:29 (1738481309) Conflict PASS 42g (4s) == sanityn test 42h: pdirops: mkdir vs readdir ======================================================================== 02:28:33 (1738481313) Conflict PASS 42h (4s) == sanityn test 43a: rmdir,mkdir doesn't return -EEXIST ======================================================================== 02:28:37 (1738481317) PASS 43a (12s) == sanityn test 43b: pdirops: unlink vs create ======================================================================== 02:28:49 (1738481329) Conflict PASS 43b (4s) == sanityn test 43c: pdirops: unlink vs link ======================================================================== 02:28:53 (1738481333) Conflict PASS 43c (4s) == sanityn test 43d: pdirops: unlink vs unlink ======================================================================== 02:28:57 (1738481337) rm: cannot remove '/mnt/lustre2/f43d.sanityn': No such file or directory Conflict PASS 43d (5s) == sanityn test 43e: pdirops: unlink and rename (tgt) ======================================================================== 02:29:02 (1738481342) Conflict PASS 43e (4s) == sanityn test 43f: pdirops: unlink and rename (src) ======================================================================== 02:29:06 (1738481346) mv: cannot stat '/mnt/lustre2/f43f.sanityn': No such file or directory Conflict PASS 43f (4s) == sanityn test 43g: pdirops: unlink vs getattr ======================================================================== 02:29:10 (1738481350) stat: cannot stat '/mnt/lustre2/f43g.sanityn': No such file or directory Conflict PASS 43g (4s) == sanityn test 43h: pdirops: unlink vs readdir ======================================================================== 02:29:14 (1738481354) Conflict PASS 43h (4s) == sanityn test 43i: pdirops: unlink vs remote mkdir ===== 02:29:18 (1738481358) SKIP: sanityn test_43i needs >= 2 MDTs SKIP 43i (1s) == sanityn test 43j: racy mkdir return EEXIST ======================================================================== 02:29:19 (1738481359) mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists PASS 43j (32s) == sanityn test 43k: unlink vs create ==================== 02:29:51 (1738481391) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 43k (385s) == sanityn test 44a: pdirops: rename tgt vs mkdir ======================================================================== 02:36:16 (1738481776) mkdir: cannot create directory '/mnt/lustre2/f44a.sanityn': File exists Conflict Sun Feb 2 02:36:19 EST 2025 PASS 44a (4s) == sanityn test 44b: pdirops: rename tgt vs create ======================================================================== 02:36:20 (1738481780) open: File exists Conflict PASS 44b (4s) == sanityn test 44c: pdirops: rename tgt vs link ======================================================================== 02:36:24 (1738481784) link: cannot create link '/mnt/lustre2/f44c.sanityn' to '/mnt/lustre2/f44c.sanityn-3': File exists Conflict PASS 44c (4s) == sanityn test 44d: pdirops: rename tgt vs unlink ======================================================================== 02:36:28 (1738481788) Conflict PASS 44d (4s) == sanityn test 44e: pdirops: rename tgt and rename (tgt) ======================================================================== 02:36:33 (1738481793) Conflict PASS 44e (4s) == sanityn test 44f: pdirops: rename tgt and rename (src) ======================================================================== 02:36:37 (1738481797) Conflict PASS 44f (4s) == sanityn test 44g: pdirops: rename tgt vs getattr ======================================================================== 02:36:41 (1738481801) Conflict PASS 44g (4s) == sanityn test 44h: pdirops: rename tgt vs readdir ======================================================================== 02:36:45 (1738481805) Conflict PASS 44h (4s) == sanityn test 44i: pdirops: rename tgt vs remote mkdir ========================================================== 02:36:49 (1738481809) SKIP: sanityn test_44i needs >= 2 MDTs SKIP 44i (0s) == sanityn test 45a: rename,mkdir doesn't return -EEXIST ======================================================================== 02:36:50 (1738481810) PASS 45a (20s) == sanityn test 45b: pdirops: rename src vs create ======================================================================== 02:37:10 (1738481830) Conflict PASS 45b (4s) == sanityn test 45c: pdirops: rename src vs link ======================================================================== 02:37:14 (1738481834) Conflict PASS 45c (4s) == sanityn test 45d: pdirops: rename src vs unlink ======================================================================== 02:37:18 (1738481838) rm: cannot remove '/mnt/lustre2/f45d.sanityn': No such file or directory Conflict PASS 45d (4s) == sanityn test 45e: pdirops: rename src and rename (tgt) ======================================================================== 02:37:22 (1738481842) Conflict PASS 45e (4s) == sanityn test 45f: pdirops: rename src and rename (src) ======================================================================== 02:37:27 (1738481847) mv: cannot stat '/mnt/lustre2/f45f.sanityn': No such file or directory Conflict PASS 45f (4s) == sanityn test 45g: pdirops: rename src vs getattr ======================================================================== 02:37:31 (1738481851) stat: cannot stat '/mnt/lustre2/f45g.sanityn': No such file or directory Conflict PASS 45g (5s) == sanityn test 45h: pdirops: unlink vs readdir ======================================================================== 02:37:35 (1738481855) Conflict PASS 45h (3s) == sanityn test 45i: pdirops: rename src vs remote mkdir ========================================================== 02:37:38 (1738481858) SKIP: sanityn test_45i needs >= 2 MDTs SKIP 45i (1s) == sanityn test 45j: read vs rename ====================== 02:37:39 (1738481859) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 45j (350s) == sanityn test 46a: pdirops: link vs mkdir ======================================================================== 02:43:29 (1738482209) mkdir: cannot create directory '/mnt/lustre2/f46a.sanityn': File exists Conflict PASS 46a (4s) == sanityn test 46b: pdirops: link vs create ======================================================================== 02:43:33 (1738482213) open: File exists Conflict PASS 46b (4s) == sanityn test 46c: pdirops: link vs link ======================================================================== 02:43:37 (1738482217) link: cannot create link '/mnt/lustre2/f46c.sanityn' to '/mnt/lustre2/f46c.sanityn': File exists Conflict PASS 46c (4s) == sanityn test 46d: pdirops: link vs unlink ======================================================================== 02:43:41 (1738482221) Conflict PASS 46d (4s) == sanityn test 46e: pdirops: link and rename (tgt) ======================================================================== 02:43:45 (1738482225) Conflict PASS 46e (4s) == sanityn test 46f: pdirops: link and rename (src) ======================================================================== 02:43:49 (1738482229) Conflict PASS 46f (4s) == sanityn test 46g: pdirops: link vs getattr ======================================================================== 02:43:53 (1738482233) Conflict PASS 46g (4s) == sanityn test 46h: pdirops: link vs readdir ======================================================================== 02:43:57 (1738482237) Conflict PASS 46h (4s) == sanityn test 46i: pdirops: link vs remote mkdir ======= 02:44:01 (1738482241) SKIP: sanityn test_46i needs >= 2 MDTs SKIP 46i (1s) == sanityn test 47a: pdirops: remote mkdir vs mkdir ====== 02:44:02 (1738482242) SKIP: sanityn test_47a needs >= 2 MDTs SKIP 47a (1s) == sanityn test 47b: pdirops: remote mkdir vs create ===== 02:44:03 (1738482243) SKIP: sanityn test_47b needs >= 2 MDTs SKIP 47b (0s) == sanityn test 47c: pdirops: remote mkdir vs link ======= 02:44:04 (1738482244) SKIP: sanityn test_47c needs >= 2 MDTs SKIP 47c (0s) == sanityn test 47d: pdirops: remote mkdir vs unlink ===== 02:44:04 (1738482244) SKIP: sanityn test_47d needs >= 2 MDTs SKIP 47d (1s) == sanityn test 47e: pdirops: remote mkdir and rename (tgt) ========================================================== 02:44:05 (1738482245) SKIP: sanityn test_47e needs >= 2 MDTs SKIP 47e (1s) == sanityn test 47f: pdirops: remote mkdir and rename (src) ========================================================== 02:44:06 (1738482246) SKIP: sanityn test_47f needs >= 2 MDTs SKIP 47f (0s) == sanityn test 47g: pdirops: remote mkdir vs getattr ==== 02:44:06 (1738482246) SKIP: sanityn test_47g needs >= 2 MDTs SKIP 47g (1s) == sanityn test 50: osc lvb attrs: enqueue vs. CP AST ======================================================================== 02:44:07 (1738482247) 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.00462065 s, 2.2 MB/s fail_loc=0x410 fail_loc=0x0 PASS 50 (7s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 02:44:14 (1738482254) 0+1 records in 0+1 records out 159 bytes (159 B) copied, 0.00350794 s, 45.3 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3519: kill: (10858) - No such process PASS 51a (3s) == sanityn test 51b: layout lock: glimpse should be able to restart if layout changed ========================================================== 02:44:17 (1738482257) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00227129 s, 451 kB/s fail_loc=0x1404 fail_val=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114445 s, 91.6 MB/s 3145728 PASS 51b (13s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 02:44:30 (1738482270) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.0033605 s, 305 kB/s PASS 51c (6s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 02:44:36 (1738482276) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00800348 s, 131 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (3s) == sanityn test 51e: lfs getstripe does not break leases, part 2 ========================================================== 02:44:39 (1738482279) /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2451 0x993 0x280000400 write lease(2) has applied. /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2451 0x993 0x280000400 read lease(1) has applied. PASS 51e (3s) == sanityn test 54: rename locking ======================= 02:44:42 (1738482282) llite.lustre-ffff8800b6d11000.xattr_cache=1 llite.lustre-ffff88012a40f800.xattr_cache=1 ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 512 Blocks: 1 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505012 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-02-02 02:44:42.000000000 -0500 Modify: 2025-02-02 02:44:42.000000000 -0500 Change: 2025-02-02 02:44:42.000000000 -0500 Birth: - ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000154 File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505015 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-02-02 02:44:48.000000000 -0500 Modify: 2025-02-02 02:44:48.000000000 -0500 Change: 2025-02-02 02:44:48.000000000 -0500 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 512 Blocks: 1 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505018 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-02-02 02:44:53.000000000 -0500 Modify: 2025-02-02 02:44:53.000000000 -0500 Change: 2025-02-02 02:44:53.000000000 -0500 Birth: - open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505017 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-02-02 02:44:53.000000000 -0500 Modify: 2025-02-02 02:44:53.000000000 -0500 Change: 2025-02-02 02:44:53.000000000 -0500 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000154 open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505020 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-02-02 02:44:58.000000000 -0500 Modify: 2025-02-02 02:44:59.000000000 -0500 Change: 2025-02-02 02:44:59.000000000 -0500 Birth: - File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505021 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-02-02 02:44:58.000000000 -0500 Modify: 2025-02-02 02:44:59.000000000 -0500 Change: 2025-02-02 02:44:59.000000000 -0500 Birth: - PASS 54 (23s) == sanityn test 55a: rename vs unlink target dir ========= 02:45:05 (1738482305) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55a.sanityn/d1/d2' to '/mnt/lustre/d55a.sanityn/d3/d2': No such file or directory PASS 55a (7s) == sanityn test 55b: rename vs unlink source dir ========= 02:45:12 (1738482312) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55b.sanityn/d1/d2' to '/mnt/lustre/d55b.sanityn/d3/d2': No such file or directory PASS 55b (7s) == sanityn test 55c: rename vs unlink orphan target dir == 02:45:19 (1738482319) fail_loc=0x156 mv: cannot move '/mnt/lustre/d55c.sanityn/d1/d2' to '/mnt/lustre/d55c.sanityn/d3/d2': No such file or directory PASS 55c (12s) == sanityn test 55d: rename file vs link ================= 02:45:31 (1738482331) fail_loc=0x155 mv: cannot move '/mnt/lustre/d55d.sanityn/f1' to '/mnt/lustre/d55d.sanityn/d55d.sanityn': Is a directory PASS 55d (8s) == sanityn test 56a: test llverdev with single large stripe ========================================================== 02:45:39 (1738482339) run_llverdev /mnt/lustre/f56a.sanityn -p -s 16000000 -c 4k llverdev: /mnt/lustre/f56a.sanityn is 16777216000000 bytes (15625 GB) in size timestamp: 1738482340 chunksize: 4096 size: 16777216000000 write offset: 16384000000kB 3.39106 MB/s read offset: 16384000000kB inf MB/s llverdev: data verified successfully PASS 56a (21s) == sanityn test 56b: test llverdev and partial verify of wide stripe file ========================================================== 02:46:00 (1738482360) run_llverdev /mnt/lustre/f56b.sanityn -p -s 32000000 -c 4k llverdev: read /mnt/lustre/f56b.sanityn@33554431995904+4096 no data: Success llverdev: read /mnt/lustre/f56b.sanityn@33554431995904+4096 no data: Success llverdev: /mnt/lustre/f56b.sanityn is 33554432000000 bytes (31250 GB) in size timestamp: 1738482361 chunksize: 4096 size: 33554432000000 write offset: 32768000000kB 5.30757 MB/s read offset: 32768000000kB -nan MB/s llverdev: data verified successfully PASS 56b (27s) == sanityn test 60: Verify data_version behaviour ======== 02:46:27 (1738482387) PASS 60 (2s) == sanityn test 70a: cd directory && rm directory ======== 02:46:29 (1738482389) PASS 70a (1s) == sanityn test 70b: remove files after calling rm_entry ========================================================== 02:46:30 (1738482390) PASS 70b (2s) == sanityn test 71a: correct file map just after write operation is finished ========================================================== 02:46:32 (1738482392) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00272183 s, 24.1 MB/s SKIP: sanityn test_71a ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71a (1s) == sanityn test 71b: check fiemap support for stripecount > 1 ========================================================== 02:46:33 (1738482393) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00400477 s, 16.4 MB/s SKIP: sanityn test_71b ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71b (0s) == sanityn test 71c: check FIEMAP_EXTENT_LAST flag with different extents number ========================================================== 02:46:33 (1738482393) SKIP: sanityn test_71c support only ldiskfs ost SKIP 71c (1s) == sanityn test 71d: fiemap corruption test with fm_extent_count=0 ========================================================== 02:46:34 (1738482394) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00298942 s, 21.9 MB/s SKIP: sanityn test_71d ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71d (1s) == sanityn test 72: getxattr/setxattr cache should be consistent between nodes ========================================================== 02:46:35 (1738482395) llite.lustre-ffff8800b6d11000.xattr_cache=1 llite.lustre-ffff88012a40f800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names user.attr1="value1" getfattr: Removing leading '/' from absolute path names user.attr1="value2" getfattr: Removing leading '/' from absolute path names getfattr: Removing leading '/' from absolute path names b362740ad371eae580e7f85452e8830b - 870e072da1ebfc20ea8c0cd3d6bdf3b6 - PASS 72 (2s) == sanityn test 73: getxattr should not cause xattr lock cancellation ========================================================== 02:46:37 (1738482397) llite.lustre-ffff8800b6d11000.xattr_cache=1 llite.lustre-ffff88012a40f800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" PASS 73 (1s) == sanityn test 74: flock deadlock: different mounts ======================================================================== 02:46:38 (1738482398) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00220116 s, 465 kB/s 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00243275 s, 421 kB/s 23271: get lock2 23272: get lock1 23271: done 23271: get lock1 23272: done 23272: get lock2 fcntl cmd 7 failed: Resource deadlock avoided 23272: cannot get lock2: Resource deadlock avoided 23272: exit rc=0 fcntl cmd 7 failed: Resource deadlock avoided 23271: cannot get lock1: Resource deadlock avoided 23271: done 23271: exit rc=0 PASS 74 (6s) == sanityn test 75: osc: upcall after unuse lock============================================================================= 02:46:44 (1738482404) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0109252 s, 192 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00799781 s, 131 MB/s fail_loc=0x31d /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 4108: 23913 Killed stat -c %s $DIR1/$tfile fail_loc=0 PASS 75 (6s) == sanityn test 76: Verify MDT open_files listing ======== 02:46:50 (1738482410) opening files: ........ closing files: ........ PASS 76 (13s) == sanityn test 77a: check FIFO NRS policy =============== 02:47:03 (1738482423) ost.OSS.ost.nrs_policies=fifo ost.OSS.ost_create.nrs_policies=fifo ost.OSS.ost_io.nrs_policies=fifo ost.OSS.ost_out.nrs_policies=fifo ost.OSS.ost_seq.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0899002 s, 187 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0066679 s, 157 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00806496 s, 130 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155408 s, 67.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010163 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0170421 s, 61.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0224222 s, 46.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152149 s, 68.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160887 s, 65.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111181 s, 94.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0293069 s, 35.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0270378 s, 38.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0276441 s, 37.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00746702 s, 140 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0301103 s, 34.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0237665 s, 44.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0237257 s, 44.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00742331 s, 141 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0074809 s, 140 MB/s , 0.00841325 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00668111 s, 157 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00776504 s, 135 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113963 s, 92.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100852 s, 104 MB/s , 0.00836525 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00896435 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00923161 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00875226 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100035 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102648 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00983811 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109011 s, 96.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119165 s, 88.0 MB/s removed '/mnt/lustre/d77a.sanityn/nrs_w_oleg315-client.virtnet' removed '/mnt/lustre/d77a.sanityn/nrs_r_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77a.sanityn' PASS 77a (2s) == sanityn test 77b: check CRR-N NRS policy ============== 02:47:05 (1738482425) ost.OSS.ost.nrs_policies=crrn ost.OSS.ost_create.nrs_policies=crrn ost.OSS.ost_io.nrs_policies=crrn ost.OSS.ost_out.nrs_policies=crrn ost.OSS.ost_seq.nrs_policies=crrn ost.OSS.ost.nrs_crrn_quantum=1 ost.OSS.ost_create.nrs_crrn_quantum=1 ost.OSS.ost_io.nrs_crrn_quantum=1 ost.OSS.ost_out.nrs_crrn_quantum=1 ost.OSS.ost_seq.nrs_crrn_quantum=1 policy: crr-n, crrn_quantum 1 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.075061 s, 224 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00693681 s, 151 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00606269 s, 173 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117191 s, 89.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00574673 s, 182 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138958 s, 75.5 MB/s 1048576 bytes (1.0 MB) copied, 0.00857356 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0241791 s, 43.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0272538 s, 38.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0283527 s, 37.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0224345 s, 46.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0304972 s, 34.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0253293 s, 41.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0240594 s, 43.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0339852 s, 30.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126323 s, 83.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0297743 s, 35.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00757286 s, 138 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00797766 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00767111 s, 137 MB/s , 0.00709614 s, 148 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00951585 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00868083 s, 121 MB/s , 0.00974919 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0089558 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108367 s, 96.8 MB/s , 0.0103054 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100402 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105203 s, 99.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113024 s, 92.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119884 s, 87.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114391 s, 91.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108452 s, 96.7 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg315-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost.nrs_crrn_quantum=64 ost.OSS.ost_create.nrs_crrn_quantum=64 ost.OSS.ost_io.nrs_crrn_quantum=64 ost.OSS.ost_out.nrs_crrn_quantum=64 ost.OSS.ost_seq.nrs_crrn_quantum=64 policy: crr-n, crrn_quantum 64 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0815071 s, 206 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00565158 s, 186 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00730123 s, 144 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00919447 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0285873 s, 36.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0317071 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.025902 s, 40.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0358465 s, 29.3 MB/s , 0.0262306 s, 40.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0326415 s, 32.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0336099 s, 31.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0349861 s, 30.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0424501 s, 24.7 MB/s , 0.0405985 s, 25.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.04194 s, 25.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.044603 s, 23.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0434308 s, 24.1 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff88012a40f800.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff88012a40f800.lock_unused_count=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00149205 s, 703 MB/s , 0.00139473 s, 752 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00280669 s, 374 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00127652 s, 821 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00290411 s, 361 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00914588 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0088897 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00503108 s, 208 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00952844 s, 110 MB/s , 0.00114188 s, 918 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00112742 s, 930 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00133545 s, 785 MB/s , 0.00125235 s, 837 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00107426 s, 976 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00126885 s, 826 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00115876 s, 905 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg315-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77b (3s) == sanityn test 77c: check ORR NRS policy ================ 02:47:08 (1738482428) ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_orr_quantum=1 ost.OSS.ost_io.nrs_orr_offset_type=physical ost.OSS.ost_io.nrs_orr_supported=reads policy: orr, orr_quantum 1, orr_offset_type physical, orr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0776631 s, 216 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00994396 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124428 s, 84.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0315214 s, 33.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0293997 s, 35.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.030901 s, 33.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0343588 s, 30.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.033129 s, 31.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0363176 s, 28.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0389162 s, 26.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0390289 s, 26.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0415956 s, 25.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0404796 s, 25.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0487871 s, 21.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0449483 s, 23.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0481606 s, 21.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0615284 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00722248 s, 145 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00922419 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00747469 s, 140 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100015 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00880852 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00979185 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00903653 s, 116 MB/s , 0.00986749 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00929904 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00961146 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00948284 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00899734 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121252 s, 86.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0096255 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105886 s, 99.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100148 s, 105 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg315-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=writes ost.OSS.ost_io.nrs_orr_quantum=64 policy: orr, orr_quantum 64, orr_offset_type physical, orr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.077271 s, 217 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00677479 s, 155 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00718686 s, 146 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106775 s, 98.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0310812 s, 33.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0367452 s, 28.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0332298 s, 31.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0380604 s, 27.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0453673 s, 23.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0392853 s, 26.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.040153 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.047972 s, 21.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0514261 s, 20.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0428082 s, 24.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0505861 s, 20.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0440545 s, 23.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0459308 s, 22.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00727686 s, 144 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00763905 s, 137 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00786086 s, 133 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109951 s, 95.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00884086 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00867037 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0130501 s, 80.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00971879 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010344 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0097445 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00986734 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109345 s, 95.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103069 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104214 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104935 s, 99.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131422 s, 79.8 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg315-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=reads_and_writes ost.OSS.ost_io.nrs_orr_offset_type=logical policy: orr, orr_quantum 64, orr_offset_type logical, orr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0800623 s, 210 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00803815 s, 130 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00691415 s, 152 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0205322 s, 51.1 MB/s , 0.0195387 s, 53.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0216558 s, 48.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0219244 s, 47.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0198268 s, 52.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0339624 s, 30.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0275541 s, 38.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0336846 s, 31.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0317795 s, 33.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0409338 s, 25.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0308504 s, 34.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0381073 s, 27.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0323284 s, 32.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.04432 s, 23.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00629989 s, 166 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00601112 s, 174 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00774326 s, 135 MB/s 1048576 bytes (1.0 MB) copied, 0.00877717 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00717818 s, 146 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00774131 s, 135 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00417261 s, 251 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00929172 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00530083 s, 198 MB/s , 0.00917204 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00882483 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00899715 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00915985 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00900821 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00986541 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106062 s, 98.9 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg315-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77c (3s) == sanityn test 77d: check TRR nrs policy ================ 02:47:11 (1738482431) ost.OSS.ost_io.nrs_policies=trr ost.OSS.ost_io.nrs_trr_quantum=1 ost.OSS.ost_io.nrs_trr_offset_type=physical ost.OSS.ost_io.nrs_trr_supported=reads policy: trr, trr_quantum 1, trr_offset_type physical, trr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0692158 s, 242 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00940893 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00858386 s, 122 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0214443 s, 48.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0169643 s, 61.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0201717 s, 52.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0206863 s, 50.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0262562 s, 39.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0266117 s, 39.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0270939 s, 38.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.027521 s, 38.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0314201 s, 33.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0309385 s, 33.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0283925 s, 36.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0298898 s, 35.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0285016 s, 36.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0404696 s, 25.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00562136 s, 187 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00568692 s, 184 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0103112 s, 102 MB/s 1048576 bytes (1.0 MB) copied, 0.00931291 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00604845 s, 173 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102929 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112185 s, 93.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00677185 s, 155 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00729946 s, 144 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0077842 s, 135 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00741349 s, 141 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0076375 s, 137 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0075152 s, 140 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00767706 s, 137 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00778594 s, 135 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00935125 s, 112 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg315-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=writes ost.OSS.ost_io.nrs_trr_quantum=64 policy: trr, trr_quantum 64, trr_offset_type physical, trr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0894288 s, 188 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00743831 s, 141 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0072181 s, 145 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0065235 s, 161 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0313625 s, 33.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0342631 s, 30.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.035329 s, 29.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0350663 s, 29.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0366883 s, 28.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0376357 s, 27.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0335789 s, 31.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.038149 s, 27.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0341101 s, 30.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0368739 s, 28.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0367969 s, 28.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0393645 s, 26.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0411538 s, 25.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00631857 s, 166 MB/s 1048576 bytes (1.0 MB) copied, 0.0052053 s, 201 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00547581 s, 191 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00175761 s, 597 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00634191 s, 165 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00803431 s, 131 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00930725 s, 113 MB/s , 0.0101501 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00798803 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00113479 s, 924 MB/s , 0.00963086 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00961484 s, 109 MB/s , 0.00921866 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00912324 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102098 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104961 s, 99.9 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg315-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=reads_and_writes ost.OSS.ost_io.nrs_trr_offset_type=logical policy: trr, trr_quantum 64, trr_offset_type logical, trr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.070953 s, 236 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00690912 s, 152 MB/s , 0.00689067 s, 152 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.02188 s, 47.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0275281 s, 38.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.021346 s, 49.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0208113 s, 50.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0277926 s, 37.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0297731 s, 35.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0319793 s, 32.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0301975 s, 34.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0312088 s, 33.6 MB/s , 0.0384892 s, 27.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0323584 s, 32.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0415144 s, 25.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0409036 s, 25.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0389923 s, 26.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00660112 s, 159 MB/s , 0.0141268 s, 74.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00139207 s, 753 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00684273 s, 153 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144834 s, 72.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0166338 s, 63.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0142675 s, 73.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00852477 s, 123 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00875132 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00949543 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00907123 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101337 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00970517 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0094796 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101016 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102567 s, 102 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg315-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77d (4s) == sanityn test 77e: check TBF NID nrs policy ============ 02:47:15 (1738482435) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_tbf_rule=start localhost nid={0@lo} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start clients nid={192.168.203.15@tcp} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start others nid={*.*.*.*@tcp} rate=50 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0759031 s, 221 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00869743 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00737349 s, 142 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0344402 s, 30.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0332618 s, 31.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0363308 s, 28.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0324065 s, 32.4 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0371146 s, 28.3 MB/s , 0.0380049 s, 27.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0366554 s, 28.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0413295 s, 25.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0344737 s, 30.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0374793 s, 28.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0324324 s, 32.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0356849 s, 29.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0373194 s, 28.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.041111 s, 25.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00801382 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00924664 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00794703 s, 132 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00826965 s, 127 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00857035 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0089827 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00880752 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100039 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00255265 s, 411 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100232 s, 105 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0108831 s, 96.3 MB/s , 0.0101942 s, 103 MB/s 1048576 bytes (1.0 MB) copied, 0.0113312 s, 92.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110473 s, 94.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109441 s, 95.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121099 s, 86.6 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg315-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change localhost rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change clients rate=101 ost.OSS.ost_io.nrs_tbf_rule=change others rate=51 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.082279 s, 204 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00812507 s, 129 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108524 s, 96.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012896 s, 81.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115084 s, 91.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0276193 s, 38.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0263791 s, 39.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0240877 s, 43.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0213471 s, 49.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0292715 s, 35.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.022171 s, 47.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0249509 s, 42.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0483635 s, 21.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0580845 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0519576 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0519482 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0643874 s, 16.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00852443 s, 123 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00951855 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0082665 s, 127 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00748652 s, 140 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00896718 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00918276 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00875749 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0096658 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0091429 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010084 s, 104 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0105444 s, 99.4 MB/s , 0.00993508 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0097117 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00974376 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105769 s, 99.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124011 s, 84.6 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg315-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop localhost ost.OSS.ost_io.nrs_tbf_rule=stop clients ost.OSS.ost_io.nrs_tbf_rule=stop others 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0905394 s, 185 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00986652 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111264 s, 94.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0242498 s, 43.2 MB/s , 0.0318665 s, 32.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0313178 s, 33.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.031546 s, 33.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0352064 s, 29.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0337654 s, 31.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0314104 s, 33.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0385581 s, 27.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0336375 s, 31.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0364326 s, 28.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0416307 s, 25.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0447008 s, 23.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0451255 s, 23.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0509927 s, 20.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00728537 s, 144 MB/s 1048576 bytes (1.0 MB) copied, 0.00662795 s, 158 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103638 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00961315 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100129 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010073 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00860903 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109248 s, 96.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100531 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00721921 s, 145 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117232 s, 89.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011331 s, 92.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107334 s, 97.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106191 s, 98.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108087 s, 97.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123907 s, 84.6 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg315-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0791607 s, 212 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00659445 s, 159 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125767 s, 83.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113336 s, 92.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0295827 s, 35.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0286179 s, 36.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0373414 s, 28.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0387648 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0316761 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0346974 s, 30.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0392693 s, 26.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0461723 s, 22.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0410226 s, 25.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0435922 s, 24.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0420512 s, 24.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0515714 s, 20.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0565363 s, 18.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00616743 s, 170 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00750217 s, 140 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00583112 s, 180 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00685049 s, 153 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00395625 s, 265 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00820644 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00974255 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112118 s, 93.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00840006 s, 125 MB/s 1048576 bytes (1.0 MB) copied, 0.00958694 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00908118 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106227 s, 98.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00974128 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010337 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101625 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112691 s, 93.0 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg315-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' PASS 77e (5s) == sanityn test 77f: check TBF JobID nrs policy ========== 02:47:20 (1738482440) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start runas jobid={iozone.500 dd.500 tiotest.500} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start iozone_runas jobid={iozone.500} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg315-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0872778 s, 192 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133423 s, 78.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126984 s, 82.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0314736 s, 33.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0349806 s, 30.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.034732 s, 30.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0360248 s, 29.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0358927 s, 29.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0420043 s, 25.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0441988 s, 23.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0415427 s, 25.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0480292 s, 21.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0443841 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0469501 s, 22.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0431832 s, 24.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0460361 s, 22.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0487423 s, 21.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00789254 s, 133 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00803937 s, 130 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00810431 s, 129 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00892982 s, 117 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122579 s, 85.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00856863 s, 122 MB/s 1048576 bytes (1.0 MB) copied, 0.0111553 s, 94.0 MB/s 1048576 bytes (1.0 MB) copied, 0.00964446 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010322 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113785 s, 92.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115598 s, 90.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108849 s, 96.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100663 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123732 s, 84.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136328 s, 76.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120916 s, 86.7 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg315-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change runas rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change iozone_runas rate=101 ost.OSS.ost_io.nrs_tbf_rule=change dd_runas rate=51 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg315-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0750584 s, 224 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00673756 s, 156 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00823874 s, 127 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00928354 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114504 s, 91.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00637928 s, 164 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0241925 s, 43.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.024894 s, 42.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.021786 s, 48.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.031711 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0213552 s, 49.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0227141 s, 46.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0166183 s, 63.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.025291 s, 41.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0247964 s, 42.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0216679 s, 48.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0279165 s, 37.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00905952 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00752724 s, 139 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112432 s, 93.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00164624 s, 637 MB/s , 0.00384812 s, 272 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00974446 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125897 s, 83.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00441205 s, 238 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00318159 s, 330 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115487 s, 90.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00984467 s, 107 MB/s , 0.00170046 s, 617 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00939707 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00154606 s, 678 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136476 s, 76.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01268 s, 82.7 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg315-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop runas ost.OSS.ost_io.nrs_tbf_rule=stop iozone_runas ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg315-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0851323 s, 197 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012413 s, 84.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123945 s, 84.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0127402 s, 82.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00941969 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00816731 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00723417 s, 145 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151941 s, 69.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146024 s, 71.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0225528 s, 46.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0510503 s, 20.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0503085 s, 20.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0522944 s, 20.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0420029 s, 25.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0449534 s, 23.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0380055 s, 27.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0424163 s, 24.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00781287 s, 134 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00157507 s, 666 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00844954 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00886615 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00982738 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011106 s, 94.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00974078 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00194142 s, 540 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110594 s, 94.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104127 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100395 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00915865 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00996025 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109252 s, 96.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00976367 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115718 s, 90.6 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg315-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_policies=fifo running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg315-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0851594 s, 197 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00950761 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116 s, 90.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152912 s, 68.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0202149 s, 51.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0267915 s, 39.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0220134 s, 47.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.027208 s, 38.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.026893 s, 39.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0274295 s, 38.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0396247 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0412205 s, 25.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0435799 s, 24.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0422586 s, 24.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0411524 s, 25.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0449595 s, 23.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0464478 s, 22.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00677671 s, 155 MB/s 1+0 records in 1+0 records out , 0.00760585 s, 138 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00895052 s, 117 MB/s , 0.0069192 s, 152 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00868943 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00136703 s, 767 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00155562 s, 674 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101539 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00984623 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00736997 s, 142 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115032 s, 91.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00975492 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100023 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100875 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106649 s, 98.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125288 s, 83.7 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg315-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' PASS 77f (5s) == sanityn test 77g: Change TBF type directly ============ 02:47:25 (1738482445) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 ost.OSS.ost_io.nrs_policies=fifo PASS 77g (2s) == sanityn test 77h: Wrong policy name should report error, not LBUG ========================================================== 02:47:28 (1738482448) oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=abc: No such file or directory oleg315-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='abc': No such file or directory pdsh@oleg315-client: oleg315-server: ssh exited with exit code 2 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc: Unknown error 524 oleg315-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf abc': Unknown error 524 pdsh@oleg315-client: oleg315-server: ssh exited with exit code 12 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf reg abc: Unknown error 524 oleg315-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf reg abc': Unknown error 524 pdsh@oleg315-client: oleg315-server: ssh exited with exit code 12 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc efg: Unknown error 524 oleg315-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf abc efg': Unknown error 524 pdsh@oleg315-client: oleg315-server: ssh exited with exit code 12 PASS 77h (2s) == sanityn test 77i: Change rank of TBF rule ============= 02:47:30 (1738482450) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start before jobid={jobid} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start after jobid={jobid} rate=1000 rank=default ost.OSS.ost_io.nrs_tbf_rule=start target jobid={jobid} rate=1000 rank=after Move before itself ost.OSS.ost_io.nrs_tbf_rule=change target rank=target Move to higher rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=before Move to lower rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=after Move before default ost.OSS.ost_io.nrs_tbf_rule=change target rank=default ost.OSS.ost_io.nrs_policies=fifo PASS 77i (6s) == sanityn test 77j: check TBF-OPCode NRS policy ========= 02:47:36 (1738482456) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf opcode ost.OSS.ost_io.nrs_tbf_rule=start ost_r opcode={ost_read} rate=5 ost.OSS.ost_io.nrs_tbf_rule=start ost_w opcode={ost_write} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0796466 s, 211 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00727515 s, 144 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012018 s, 87.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0179214 s, 58.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126236 s, 83.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0194401 s, 53.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0229013 s, 45.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203251 s, 51.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0130129 s, 80.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0207607 s, 50.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0325456 s, 32.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0368696 s, 28.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0278796 s, 37.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0294706 s, 35.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0307579 s, 34.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0358046 s, 29.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0416831 s, 25.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00730546 s, 144 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00731794 s, 143 MB/s 1048576 bytes (1.0 MB) copied, 0.00674564 s, 155 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00983852 s, 107 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00847576 s, 124 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00826136 s, 127 MB/s 1048576 bytes (1.0 MB) copied, 0.0101321 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00871737 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0099543 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106251 s, 98.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010249 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108501 s, 96.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107112 s, 97.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119275 s, 87.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104707 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113672 s, 92.2 MB/s removed '/mnt/lustre/d77j.sanityn/nrs_w_oleg315-client.virtnet' removed '/mnt/lustre/d77j.sanityn/nrs_r_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77j.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 5 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.92223 s, 21.3 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.4293 s, 5.4 MB/s Read runtime is 20 s, speed is 5.000000 IOPS cleanup_tbf /mnt/lustre/d77j.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_r ost.OSS.ost_io.nrs_tbf_rule=stop ost_w ost.OSS.ost_io.nrs_policies=fifo PASS 77j (48s) == sanityn test 77ja: check TBF-UID/GID NRS policy ======= 02:48:24 (1738482504) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg315-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg315-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [777] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg315-client.virtnet] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg315-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg315-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.21862 s, 13.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00752104 s, 139 MB/s 1048576 bytes (1.0 MB) copied, 0.00878644 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0193205 s, 54.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0127103 s, 82.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.019022 s, 55.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0240255 s, 43.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0254347 s, 41.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0218651 s, 48.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.178753 s, 5.9 MB/s 1048576 bytes (1.0 MB) copied, 0.180355 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.188737 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.201699 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.194673 s, 5.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.204098 s, 5.1 MB/s , 0.201096 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.190816 s, 5.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00793614 s, 132 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00815934 s, 129 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00820864 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00842426 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102965 s, 102 MB/s , 0.0093172 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00976744 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00935232 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00927499 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00968348 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00931493 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114276 s, 91.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00915743 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011088 s, 94.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00960174 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115713 s, 90.6 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg315-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 20.021 s, 5.2 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9604 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg315-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg315-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [777] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg315-client.virtnet] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg315-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg315-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.22123 s, 13.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114073 s, 91.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0208554 s, 50.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0234963 s, 44.6 MB/s , 0.011483 s, 91.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0219609 s, 47.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0175881 s, 59.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0230434 s, 45.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0191976 s, 54.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.165446 s, 6.3 MB/s , 0.167552 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.178785 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.17658 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.169827 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.188069 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.192913 s, 5.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.195638 s, 5.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00845641 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00822126 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00632355 s, 166 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00952313 s, 110 MB/s , 0.00962774 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100951 s, 104 MB/s , 0.00865394 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00903356 s, 116 MB/s 1048576 bytes (1.0 MB) copied, 0.00141513 s, 741 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00723664 s, 145 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00156617 s, 670 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00994746 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0012994 s, 807 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00870067 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105171 s, 99.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116882 s, 89.7 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg315-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 20.0192 s, 5.2 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9674 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77ja (130s) == sanityn test 77jb: check TBF-UID/GID NRS policy on files that don't belong to us ========================================================== 02:50:34 (1738482634) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 0/500/0/500, groups: 500 [touch] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg315-client.virtnet] running as uid/gid/euid/egid 0/500/0/500, groups: 500 [touch] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg315-client.virtnet] running as uid/gid/euid/egid 0/500/0/500, groups: 500 [chmod] [777] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg315-client.virtnet] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg315-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/nrs_r_oleg315-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.21785 s, 13.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142358 s, 73.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0202717 s, 51.7 MB/s 1048576 bytes (1.0 MB) copied, 0.017099 s, 61.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0223777 s, 46.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0243247 s, 43.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0184252 s, 56.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.006343 s, 165 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113952 s, 92.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.177818 s, 5.9 MB/s , 0.177811 s, 5.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.16405 s, 6.4 MB/s , 0.180352 s, 5.8 MB/s , 0.188393 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.17559 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.181104 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.179425 s, 5.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00644729 s, 163 MB/s , 0.00848684 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00994873 s, 105 MB/s 1048576 bytes (1.0 MB) copied, 0.00839222 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00802032 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108615 s, 96.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00978606 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111153 s, 94.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00930529 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105766 s, 99.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0099373 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00938922 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00921346 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106471 s, 98.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00906181 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107931 s, 97.2 MB/s removed '/mnt/lustre/d77jb.sanityn/nrs_w_oleg315-client.virtnet' removed '/mnt/lustre/d77jb.sanityn/nrs_r_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77jb.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 0/500/0/500, groups: 500 [touch] [/mnt/lustre/d77jb.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 20.036 s, 5.2 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77jb.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9229 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77jb.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/0/500/0, groups: 0 [touch] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg315-client.virtnet] running as uid/gid/euid/egid 500/0/500/0, groups: 0 [touch] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg315-client.virtnet] running as uid/gid/euid/egid 500/0/500/0, groups: 0 [chmod] [777] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg315-client.virtnet] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg315-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/nrs_r_oleg315-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.21984 s, 13.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142913 s, 73.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160472 s, 65.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100517 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0185519 s, 56.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114467 s, 91.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0271759 s, 38.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0308068 s, 34.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0219329 s, 47.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.170212 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.170446 s, 6.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.176427 s, 5.9 MB/s 1048576 bytes (1.0 MB) copied, 0.162665 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.179337 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.168606 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.164855 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.185202 s, 5.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100366 s, 104 MB/s , 0.00979169 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010024 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113038 s, 92.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109126 s, 96.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119194 s, 88.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126629 s, 82.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109099 s, 96.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00595291 s, 176 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011103 s, 94.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0147741 s, 71.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116437 s, 90.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109936 s, 95.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0115199 s, 91.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125762 s, 83.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126903 s, 82.6 MB/s removed '/mnt/lustre/d77jb.sanityn/nrs_r_oleg315-client.virtnet' removed '/mnt/lustre/d77jb.sanityn/nrs_w_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77jb.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/0/500/0, groups: 0 [touch] [/mnt/lustre/d77jb.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 20.0238 s, 5.2 MB/s Write runtime is 22 s, speed is 4.545454 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77jb.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9724 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77jb.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77jb (131s) == sanityn test 77k: check TBF policy with UID/GID/JobID/OPCode expression ========================================================== 02:52:45 (1738482765) ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_tbf_rule=start ext_w jobid={dd.500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r jobid={dd.500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg315-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.281388 s, 59.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0168419 s, 62.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0200318 s, 52.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0469154 s, 22.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0346397 s, 30.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0543796 s, 19.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0525554 s, 20.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0541251 s, 19.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.054074 s, 19.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0485007 s, 21.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0451984 s, 23.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0444464 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0567471 s, 18.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0608749 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0526545 s, 19.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0689498 s, 15.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0676738 s, 15.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128201 s, 81.8 MB/s , 0.00430378 s, 244 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133515 s, 78.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0190689 s, 55.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0132526 s, 79.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0183332 s, 57.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141565 s, 74.1 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0172916 s, 60.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0209706 s, 50.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0202901 s, 51.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0140589 s, 74.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0172867 s, 60.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0027037 s, 388 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0162503 s, 64.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0168827 s, 62.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212743 s, 49.3 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg315-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.0021 s, 21.0 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.74517 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext_w nid={0@lo 192.168.203.15@tcp}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r nid={0@lo 192.168.203.15@tcp}&opcode={ost_read} rate=10 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.175681 s, 95.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0149265 s, 70.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.019709 s, 53.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0245865 s, 42.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.032042 s, 32.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00994005 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0341452 s, 30.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0304004 s, 34.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0385097 s, 27.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0219013 s, 47.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0326997 s, 32.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0359479 s, 29.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0698803 s, 15.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.07122 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.096259 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.100869 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.100102 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00972024 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00981863 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116134 s, 90.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010461 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136712 s, 76.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00993113 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100143 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00922651 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108888 s, 96.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101124 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102312 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109706 s, 95.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110573 s, 94.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0118306 s, 88.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121066 s, 86.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126656 s, 82.8 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg315-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.95999 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.74648 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext nid={0@lo 192.168.203.15@tcp}&jobid={dd.500} rate=20 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg315-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.147491 s, 114 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0159741 s, 65.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0153722 s, 68.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0528095 s, 19.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0426775 s, 24.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0496825 s, 21.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0413214 s, 25.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.054708 s, 19.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0613099 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0607751 s, 17.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0581172 s, 18.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0584635 s, 17.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0532926 s, 19.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0822994 s, 12.7 MB/s , 0.0778731 s, 13.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0743415 s, 14.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0820698 s, 12.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144848 s, 72.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0176434 s, 59.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.014654 s, 71.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.014657 s, 71.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119646 s, 87.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160096 s, 65.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0163113 s, 64.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0163114 s, 64.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0158293 s, 66.2 MB/s , 0.00228919 s, 458 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160331 s, 65.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152821 s, 68.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0171311 s, 61.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0152358 s, 68.8 MB/s , 0.0152409 s, 68.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0167674 s, 62.5 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg315-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.96497 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.89317 s, 21.4 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext ost.OSS.ost_io.nrs_tbf_rule=start ext_a jobid={dd.500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b jobid={dd.500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg315-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.166858 s, 101 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126563 s, 82.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0157351 s, 66.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0370846 s, 28.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0351893 s, 29.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.038022 s, 27.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0337553 s, 31.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.032376 s, 32.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0221083 s, 47.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0291632 s, 36.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0381971 s, 27.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0521841 s, 20.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0601751 s, 17.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.061903 s, 16.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0584518 s, 17.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0593386 s, 17.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0704037 s, 14.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00715369 s, 147 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00155172 s, 676 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0076744 s, 137 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00974478 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00862966 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00359028 s, 292 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00973845 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0092666 s, 113 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00922144 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00908028 s, 115 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0102742 s, 102 MB/s 1048576 bytes (1.0 MB) copied, 0.00963777 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00992317 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00974896 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107923 s, 97.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113758 s, 92.2 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg315-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.82982 s, 10.7 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.73245 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.94743 s, 21.2 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.74386 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_tbf_rule=start ext_ug uid={500}&gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg315-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.141556 s, 119 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108228 s, 96.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.031559 s, 33.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0215548 s, 48.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0351721 s, 29.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0339402 s, 30.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0311406 s, 33.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0357113 s, 29.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0344493 s, 30.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0905155 s, 11.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.109743 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.120786 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.120146 s, 8.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.133234 s, 7.9 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.133944 s, 7.8 MB/s , 0.145141 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.148081 s, 7.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0127248 s, 82.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0129162 s, 81.2 MB/s , 0.0143534 s, 73.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0145379 s, 72.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0188361 s, 55.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0168047 s, 62.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0151299 s, 69.3 MB/s 1048576 bytes (1.0 MB) copied, 0.015948 s, 65.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141265 s, 74.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0196377 s, 53.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0175497 s, 59.7 MB/s , 0.01573 s, 66.7 MB/s , 0.0156485 s, 67.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0179009 s, 58.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0180048 s, 58.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0208372 s, 50.3 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg315-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.7505 s, 5.3 MB/s Write runtime is 20 s, speed is 5.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.4422 s, 5.4 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_ug ost.OSS.ost_io.nrs_tbf_rule=start ext_uw uid={500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_ur uid={500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg315-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.151819 s, 111 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0175069 s, 59.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0270562 s, 38.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0339236 s, 30.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0459212 s, 22.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0459684 s, 22.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.053818 s, 19.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0491849 s, 21.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0344142 s, 30.5 MB/s 1048576 bytes (1.0 MB) copied, 0.040126 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0427565 s, 24.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0473438 s, 22.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0681141 s, 15.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0654442 s, 16.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0475357 s, 22.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0651103 s, 16.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0495295 s, 21.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106459 s, 98.5 MB/s , 0.00790825 s, 133 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109519 s, 95.7 MB/s , 0.0114885 s, 91.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0013374 s, 784 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0015053 s, 697 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102472 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010207 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.011608 s, 90.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0115384 s, 90.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116857 s, 89.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124029 s, 84.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104552 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111208 s, 94.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126502 s, 82.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136983 s, 76.5 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg315-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.98792 s, 21.0 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.74442 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_uw ost.OSS.ost_io.nrs_tbf_rule=stop ext_ur ost.OSS.ost_io.nrs_tbf_rule=start ext_a uid={500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b uid={500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg315-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.150554 s, 111 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.020305 s, 51.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0210954 s, 49.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0505181 s, 20.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0527222 s, 19.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0557423 s, 18.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0374791 s, 28.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0412094 s, 25.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0525084 s, 20.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0564768 s, 18.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0612692 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0573925 s, 18.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0603139 s, 17.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0511808 s, 20.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0559299 s, 18.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0574735 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0551754 s, 19.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108502 s, 96.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113357 s, 92.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0153419 s, 68.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00256959 s, 408 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.018777 s, 55.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0199514 s, 52.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00248867 s, 421 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143107 s, 73.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0153657 s, 68.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146776 s, 71.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0149101 s, 70.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0173106 s, 60.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0057035 s, 184 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156189 s, 67.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0158422 s, 66.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0178162 s, 58.9 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg315-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.71979 s, 10.8 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.74579 s, 10.8 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.80291 s, 10.7 MB/s Write runtime is 10 s, speed is 10.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.74256 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_policies=fifo PASS 77k (352s) == sanityn test 77l: check the output of NRS policies for generic TBF ========================================================== 02:58:37 (1738483117) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_policies=fifo PASS 77l (3s) == sanityn test 77m: check NRS Delay slows write RPC processing ========================================================== 02:58:41 (1738483121) ost.OSS.ost_io.nrs_policies=delay ost.OSS.ost_io.nrs_delay_min=4 ost.OSS.ost_io.nrs_delay_max=4 ost.OSS.ost_io.nrs_delay_pct=100 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg315-client.virtnet] [bs=1M] [count=1] [oflag=direct] [conv=fdatasync] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 3.22046 s, 326 kB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg315-client.virtnet] [bs=1M] [count=10] [oflag=direct] [conv=fdatasync] 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 40.0554 s, 262 kB/s ost.OSS.ost_io.nrs_policies=fifo PASS 77m (50s) == sanityn test 77n: check wildcard support for TBF JobID NRS policy ========================================================== 02:59:30 (1738483170) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={*.500} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0752684 s, 223 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00925264 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00836525 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0292243 s, 35.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0301809 s, 34.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0336468 s, 31.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0356338 s, 29.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0385901 s, 27.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0361911 s, 29.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0377781 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0372316 s, 28.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0430593 s, 24.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0443537 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0448974 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.041434 s, 25.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0467967 s, 22.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0480869 s, 21.8 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff88012a40f800.lock_unused_count=4 ldlm.namespaces.lustre-OST0001-osc-ffff88012a40f800.lock_unused_count=2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00776851 s, 135 MB/s , 0.00917187 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00825346 s, 127 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00704035 s, 149 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00973047 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00904789 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00920672 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00981289 s, 107 MB/s 1048576 bytes (1.0 MB) copied, 0.00935547 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00889304 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00953409 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102563 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103392 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119298 s, 87.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115257 s, 91.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0134918 s, 77.7 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg315-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77n.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.99188 s, 21.0 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77n.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.97282 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.*} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.251891 s, 66.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0164482 s, 63.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0150068 s, 69.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0436443 s, 24.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0381361 s, 27.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.045506 s, 23.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0327124 s, 32.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.052813 s, 19.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.049375 s, 21.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0394804 s, 26.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0387597 s, 27.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0490562 s, 21.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0454104 s, 23.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.262202 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.261407 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.304552 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.306178 s, 3.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00926951 s, 113 MB/s , 0.00715384 s, 147 MB/s 1048576 bytes (1.0 MB) copied, 0.0109849 s, 95.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107413 s, 97.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00435186 s, 241 MB/s , 0.00851446 s, 123 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00841275 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00874393 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00984986 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0101311 s, 104 MB/s 1048576 bytes (1.0 MB) copied, 0.0103542 s, 101 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108679 s, 96.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0116364 s, 90.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121458 s, 86.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121233 s, 86.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0127445 s, 82.3 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg315-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg315-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.00469 s, 21.0 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.97411 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_policies=fifo PASS 77n (66s) == sanityn test 77o: Changing rank should not panic ====== 03:00:37 (1738483237) mds.MDS.mdt.nrs_policies=tbf nid mds.MDS.mdt.nrs_tbf_rule=start name nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=start name1 nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=change name1 rank=name mds.MDS.mdt.nrs_tbf_rule=stop name mds.MDS.mdt.nrs_policies=fifo PASS 77o (4s) == sanityn test 77q: Parallel TBF rule definitions should not panic ========================================================== 03:00:41 (1738483241) mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_policies=fifo PASS 77q (35s) == sanityn test 77p: Check validity of rule names for TBF policies ========================================================== 03:01:16 (1738483276) mds.MDS.mdt.nrs_policies=tbf oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_overflo uid={500} rate=500: File name too long oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test_77p_overflo uid={500} rate=500': File name too long pdsh@oleg315-client: oleg315-server: ssh exited with exit code 36 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_empty: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test_77p_empty': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p@spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p@spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p.spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p.spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p~spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p~spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p#spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p#spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p/spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p/spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p^spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p^spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p%spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p%spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p*spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p*spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p;spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p;spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p,spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p,spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p?spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p?spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77pspec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p>spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p:spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p:spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p+spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p+spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p=spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p=spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p)spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p)spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p(spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p(spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p{spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p{spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p}spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p}spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p|spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p|spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p[spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p[spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p]spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p]spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p!spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p!spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p&spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p&spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p$spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p$spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p`spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p`spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p\spec uid={500} rate=500: Invalid argument oleg315-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p\spec uid={500} rate=500': Invalid argument pdsh@oleg315-client: oleg315-server: ssh exited with exit code 22 mds.MDS.mdt.nrs_policies=fifo PASS 77p (13s) == sanityn test 77r: Change type of tbf policy at run time ========================================================== 03:01:29 (1738483289) mds.MDS.mdt.nrs_policies=tbf uid mds.MDS.mdt.nrs_tbf_rule=start md_rule uid={500} rate=1 mds.MDS.mdt.nrs_policies=tbf gid mds.MDS.mdt.nrs_tbf_rule=start md_rule gid={500} rate=1 mds.MDS.mdt.nrs_policies=tbf jobid mds.MDS.mdt.nrs_tbf_rule=start md_rule jobid={*.500} rate=1 mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start md_rule uid={500} rate=1 mds.MDS.mdt.nrs_policies=fifo check the number of requests in queue: fifo: 0 crrn: 0 tbf: 0 delay: 0 fifo: 0 crrn: 0 tbf: 0 delay: 0 cleanup 77r 21032 kill md_thread xargs PASS 77r (37s) == sanityn test 78: Enable policy and specify tunings right away ========================================================== 03:02:06 (1738483326) oleg315-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_orr_quantum=1: No such device oleg315-server: error: set_param: setting 'ost/OSS/*/nrs_orr_quantum'='1': No such device pdsh@oleg315-client: oleg315-server: ssh exited with exit code 19 ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_policies=fifo PASS 78 (3s) == sanityn test 79: xattr: intent error ================== 03:02:09 (1738483329) File: '/mnt/lustre/d79.sanityn' Size: 512 Blocks: 1 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272506610 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-02-02 03:02:10.000000000 -0500 Modify: 2025-02-02 03:02:10.000000000 -0500 Change: 2025-02-02 03:02:10.000000000 -0500 Birth: - fail_val=0 fail_loc=0x80000160 fail_val=0 fail_loc=0x80000131 # file: mnt/lustre/d79.sanityn trusted.name1="value1" PASS 79 (13s) == sanityn test 80a: migrate directory when some children is being opened ========================================================== 03:02:22 (1738483342) SKIP: sanityn test_80a needs >= 2 MDTs SKIP 80a (1s) == sanityn test 80b: Accessing directory during migration ========================================================== 03:02:23 (1738483343) SKIP: sanityn test_80b needs >= 2 MDTs SKIP 80b (1s) == sanityn test 81a: rename and stat under striped directory ========================================================== 03:02:24 (1738483344) SKIP: sanityn test_81a needs >= 2 MDTs SKIP 81a (1s) == sanityn test 81b: rename under striped directory doesn't deadlock ========================================================== 03:02:26 (1738483346) SKIP: sanityn test_81b We need at least 2 MDTs for this test SKIP 81b (1s) == sanityn test 81c: rename revoke LOOKUP lock for remote object ========================================================== 03:02:27 (1738483347) SKIP: sanityn test_81c needs >= 4 MDTs SKIP 81c (1s) == sanityn test 81d: parallel rename file cross-dir on same MDT ========================================================== 03:02:28 (1738483348) - open/close 2328 (time 1738483360.38 total 10.00 last 232.76) total: 2500 open/close in 10.73 seconds: 233.06 ops/second snapshot_time 1738483383.034740112 secs.nsecs start_time 1738483349.412633723 secs.nsecs elapsed_time 33.622106389 secs.nsecs open 2505 samples [usecs] 101 4693 1182292 639003414 close 2504 samples [usecs] 60 1554 367866 62404728 mknod 2501 samples [usecs] 172 4602 1042803 510155949 unlink 2500 samples [usecs] 271 18149 1823427 3653459953 mkdir 2 samples [usecs] 780 1476 2256 2786976 rmdir 2 samples [usecs] 3607 5321 8928 41323490 rename 2500 samples [usecs] 229 10090 3815552 8593569312 getattr 3761 samples [usecs] 5 1523 88612 8529326 parallel_rename_file 2500 samples [usecs] 229 10090 3815552 8593569312 crossdir_rename 2500 samples [usecs] 229 10090 3815552 8593569312 PASS 81d (36s) == sanityn test 82: fsetxattr and fgetxattr on orphan files ========================================================== 03:03:04 (1738483384) multiop /mnt/lustre/f82.sanityn vO_ac TMPPIPE=/tmp/multiop_open_wait_pipe.6984 multiop /mnt/lustre2/f82.sanityn vo_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.6984 PASS 82 (2s) == sanityn test 83: access striped directory while it is being created/unlinked ========================================================== 03:03:06 (1738483386) SKIP: sanityn test_83 needs >= 2 MDTs SKIP 83 (2s) == sanityn test 84: 0-nlink race in lu_object_find() ===== 03:03:08 (1738483388) fail_loc=0x8000060b PASS 84 (7s) == sanityn test 85: Lustre API root cache race =========== 03:03:15 (1738483395) Starting: llapi_root_test /mnt/lustre/f85.sanityn /mnt/lustre2/f85.sanityn Starting test test1 at 1738483396 Finishing test test1 at 1738483397 PASS 85 (4s) == sanityn test 90: open/create and unlink striped directory ========================================================== 03:03:19 (1738483399) SKIP: sanityn test_90 needs >= 2 MDTs SKIP 90 (1s) == sanityn test 91: chmod and unlink striped directory === 03:03:20 (1738483400) SKIP: sanityn test_91 needs >= 2 MDTs SKIP 91 (1s) == sanityn test 92: create remote directory under orphan directory ========================================================== 03:03:21 (1738483401) SKIP: sanityn test_92 needs >= 2 MDTs SKIP 92 (1s) == sanityn test 93: alloc_rr should not allocate on same ost ========================================================== 03:03:22 (1738483402) fail_loc=0x00000163 fail_loc=0x0 /mnt/lustre/f93.sanityn-1/file1 lmm_stripe_count: 2 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 5931 0x172b 0x280000400 0 5947 0x173b 0x240000400 /mnt/lustre2/f93.sanityn-2/file2 lmm_stripe_count: 2 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 5948 0x173c 0x240000400 1 5932 0x172c 0x280000400 rc1=0 and rc2=0 PASS 93 (9s) == sanityn test 94: signal vs CP callback race =========== 03:03:31 (1738483411) osc.lustre-OST0000-osc-ffff8800b6d11000.idle_timeout=0 osc.lustre-OST0000-osc-ffff88012a40f800.idle_timeout=0 osc.lustre-OST0001-osc-ffff8800b6d11000.idle_timeout=0 osc.lustre-OST0001-osc-ffff88012a40f800.idle_timeout=0 2+0 records in 2+0 records out 8192 bytes (8.2 kB) copied, 0.0715141 s, 115 kB/s fail_val=5 fail_loc=0x80000312 fail_val=6 fail_loc=0x80000329 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 3.00117 s, 1.4 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 5744: 8955 Alarm clock dd if=/dev/zero of=$DIR/$tfile conv=notrunc oflag=append bs=4k count=1 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0202467 s, 202 kB/s osc.lustre-OST0000-osc-ffff8800b6d11000.idle_timeout=debug osc.lustre-OST0000-osc-ffff88012a40f800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6d11000.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a40f800.idle_timeout=debug PASS 94 (11s) == sanityn test 95a: Check readpage() on a page that was removed from page cache ========================================================== 03:03:42 (1738483422) llite.lustre-ffff8800b6d11000.fast_read=0 llite.lustre-ffff88012a40f800.fast_read=0 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0211475 s, 99.2 MB/s fail_loc=0x80001421 fail_val=7 fail_loc=0x80001422 fail_val=10 llite.lustre-ffff8800b6d11000.fast_read=1 llite.lustre-ffff88012a40f800.fast_read=1 PASS 95a (19s) == sanityn test 95b: Check readpage() on a page that is no longer uptodate ========================================================== 03:04:01 (1738483441) llite.lustre-ffff8800b6d11000.fast_read=0 llite.lustre-ffff88012a40f800.fast_read=0 1+0 records in 1+0 records out 12288 bytes (12 kB) copied, 0.00285072 s, 4.3 MB/s fail_loc=0x80001424 fail_val=5 fail_loc=0 llite.lustre-ffff8800b6d11000.fast_read=1 llite.lustre-ffff88012a40f800.fast_read=1 PASS 95b (9s) == sanityn test 100a: DoM: glimpse RPCs for stat without IO lock (DoM only file) ========================================================== 03:04:10 (1738483450) SKIP: sanityn test_100a Reserved for glimpse-ahead SKIP 100a (1s) == sanityn test 100b: DoM: no glimpse RPC for stat with IO lock (DoM only file) ========================================================== 03:04:11 (1738483451) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00294764 s, 1.4 MB/s /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK PASS 100b (2s) == sanityn test 100c: DoM: write vs stat without IO lock (combined file) ========================================================== 03:04:13 (1738483453) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0322702 s, 65.0 MB/s /mnt/lustre/d100c.sanityn/dom has type file OK /mnt/lustre/d100c.sanityn/dom has size 2097152 OK PASS 100c (3s) == sanityn test 100d: DoM: write+truncate vs stat without IO lock (combined file) ========================================================== 03:04:16 (1738483456) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0331637 s, 63.2 MB/s /mnt/lustre/d100d.sanityn/dom has type file OK /mnt/lustre/d100d.sanityn/dom has size 4096 OK PASS 100d (2s) == sanityn test 100e: DoM: read on open and file size ==== 03:04:18 (1738483458) 1+0 records in 1+0 records out 12000 bytes (12 kB) copied, 0.00279739 s, 4.3 MB/s PASS 100e (3s) == sanityn test 101a: Discard DoM data on unlink ========= 03:04:21 (1738483461) /mnt/lustre/f101a.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00113452 s, 3.6 MB/s PASS 101a (2s) == sanityn test 101b: Discard DoM data on rename ========= 03:04:23 (1738483463) /mnt/lustre/f101b.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00102967 s, 4.0 MB/s PASS 101b (3s) == sanityn test 101c: Discard DoM data on close-unlink === 03:04:26 (1738483466) /mnt/lustre/f101c.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.000972724 s, 4.2 MB/s PASS 101c (3s) SKIP: sanityn test_102 skipping ALWAYS excluded test 102 == sanityn test 103: Test size correctness with lockahead ========================================================== 03:04:30 (1738483470) fail_loc=0x415 fail_loc=0x415 fail_val=2 Incorrect size expected (no glimpse fix): Starting test test23 at 1738483471 lockahead_test: lockahead_test.c:1191: test23: assertion 'sb.st_size == sb2.st_size' failed: size on /mnt/lustre/d103.sanityn/f103.sanityn and /mnt/lustre2/d103.sanityn/f103.sanityn differs: 0 vs 1048576 fail_loc=0 fail_loc=0x214 fail_val=2 Starting test test23 at 1738483474 Finishing test test23 at 1738483474 PASS 103 (8s) == sanityn test 104: Verify that MDS stores atime/mtime/ctime during close ========================================================== 03:04:38 (1738483478) SKIP: sanityn test_104 ldiskfs only test SKIP 104 (1s) == sanityn test 105: Glimpse and lock cancel race ======== 03:04:39 (1738483479) fail_loc=0x416 PASS 105 (23s) == sanityn test 106a: Verify the btime via statx() ======= 03:05:02 (1738483502) SKIP: sanityn test_106a Test only for ldiskfs and statx() supported SKIP 106a (1s) == sanityn test 106b: Glimpse RPCs test for statx ======== 03:05:03 (1738483503) SKIP: sanityn test_106b statx() only test SKIP 106b (1s) == sanityn test 106c: Verify statx attributes mask ======= 03:05:04 (1738483504) SKIP: sanityn test_106c statx() only test SKIP 106c (1s) == sanityn test 107a: Basic grouplock conflict =========== 03:05:05 (1738483505) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0829034 s, 126 MB/s /mnt/lustre/f107a.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 5937 0x1731 0x280000400 multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.6984 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.6984 First grouplock blocks second one PASS 107a (5s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 03:05:10 (1738483510) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0798604 s, 131 MB/s /mnt/lustre/f107b.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 5956 0x1744 0x240000400 multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.6984 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (9s) == sanityn test 108a: lseek: parallel updates ============ 03:05:19 (1738483519) 1+0 records in 1+0 records out 10000 bytes (10 kB) copied, 0.00211085 s, 4.7 MB/s fail_val=4 fail_loc=0x80000414 1+0 records in 1+0 records out 8388608 bytes (8.4 MB) copied, 4.15121 s, 2.0 MB/s PASS 108a (6s) == sanityn test 109: Race with several mount instances on 1 node ========================================================== 03:05:25 (1738483525) 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Starting race between client mount instances (50 iterations): Iteration 1 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions oleg315-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 2 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 3 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 4 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 5 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 6 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 7 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 8 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 9 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 10 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 11 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 12 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions oleg315-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 13 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 14 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions oleg315-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 15 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 16 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 17 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 18 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions oleg315-server: libkmod: kmod_module_get_refcnt: could not read integer from '/sys/module/intel_rapl/refcnt': 'No such device' oleg315-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 19 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions oleg315-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 20 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 21 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 22 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 23 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 24 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions oleg315-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 25 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 26 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions oleg315-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 27 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 28 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 29 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 30 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 31 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions oleg315-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 32 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 33 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 34 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 35 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 36 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 37 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 38 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 39 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 40 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions oleg315-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 41 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 42 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 43 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 44 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 45 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 46 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 47 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 48 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Iteration 49 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions oleg315-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 50 Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 192.168.203.115@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.203.115@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg315-client.virtnet /mnt/lustre (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg315-server' oleg315-server: oleg315-server.virtnet: executing load_modules_local oleg315-server: Loading modules from /home/green/git/lustre-release/lustre oleg315-server: detected 4 online CPUs by sysfs oleg315-server: MODOPTS_LIBCFS= oleg315-server: Force libcfs to create 2 CPU partitions Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre Starting client: oleg315-client.virtnet: -o user_xattr,flock 192.168.203.115@tcp:/lustre /mnt/lustre2 PASS 109 (467s) == sanityn test 110: do not grant another lock on resend ========================================================== 03:13:12 (1738483992) fail_loc=0x525 fail_val=3 fail_loc=0x534 File: '/mnt/lustre/f110.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205306056707 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-02-02 03:13:13.000000000 -0500 Modify: 2025-02-02 03:13:13.000000000 -0500 Change: 2025-02-02 03:13:13.000000000 -0500 Birth: - fail_loc=0 fail_val=0 Connected clients: oleg315-client.virtnet oleg315-client.virtnet PASS 110 (65s) == sanityn test 111: A racy rename/link an open file should not cause fs corruption ========================================================== 03:14:17 (1738484057) SKIP: sanityn test_111 needs >= 2 MDTs SKIP 111 (2s) == sanityn test 112: update max-inherit in default LMV === 03:14:19 (1738484059) SKIP: sanityn test_112 We need at least 2 MDTs for this test SKIP 112 (1s) == sanityn test 113: check servers of specified fs ======= 03:14:20 (1738484060) lustre-OST0000-osc-ffff880094286000 active. lustre-OST0001-osc-ffff880094286000 active. lustre-OST0000-osc-ffff880094286000 active. lustre-OST0001-osc-ffff880094286000 active. MGC192.168.203.115@tcp active. PASS 113 (2s) == sanityn test 114: implicit default LMV inherit ======== 03:14:22 (1738484062) SKIP: sanityn test_114 We need at least 2 MDTs for this test SKIP 114 (1s) == sanityn test 115: ldiskfs doesn't check direntry for uniqueness ========================================================== 03:14:23 (1738484063) SKIP: sanityn test_115 ldiskfs only test SKIP 115 (1s) == sanityn test 116: DNE: Set default LMV layout from a remote client ========================================================== 03:14:24 (1738484064) SKIP: sanityn test_116 needs >= 2 MDTs SKIP 116 (1s) == sanityn test 200: service remains healthy while able to process request ========================================================== 03:14:25 (1738484065) at_max=10 at_unhealthy_factor=3 ost.OSS.ost_io.threads_max=21 fail_loc=0x1e1 fail_val=20 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied, 20.0144 s, 0.2 kB/s , 20.0161 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.0263 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1167 s, 0.2 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1251 s, 0.2 kB/s , 20.1299 s, 0.2 kB/s , 20.1338 s, 0.2 kB/s , 20.1317 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.129 s, 0.2 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied, 40.1067 s, 0.1 kB/s , 40.087 s, 0.1 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied, 40.0913 s, 0.1 kB/s , 40.112 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.1271 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.2032 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied1+0 records in 1+0 records out , 40.2062 s, 0.1 kB/s 4096 bytes (4.1 kB) copied, 40.2042 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.2309 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.2268 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.1981 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.1854 s, 0.1 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied, 60.2485 s, 0.1 kB/s , 60.2539 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.2268 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.2614 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.2933 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.3084 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.2337 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.263 s, 0.1 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied, 80.3177 s, 0.1 kB/s , 80.3243 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied1+0 records in 1+0 records out , 80.32 s, 0.1 kB/s 4096 bytes (4.1 kB) copied, 80.345 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.383 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.4025 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.4014 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied1+0 records in 1+0 records out , 100.333 s, 0.0 kB/s 4096 bytes (4.1 kB) copied1+0 records in 1+0 records out , 100.329 s, 0.0 kB/s 4096 bytes (4.1 kB) copied, 100.356 s, 0.0 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 100.348 s, 0.0 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 100.361 s, 0.0 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 100.479 s, 0.0 kB/s at_max=600 at_unhealthy_factor=3 ost.OSS.ost_io.threads_max=116 oleg315-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff880094286000.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff880094286000.ost_server_uuid in FULL state after 0 sec PASS 200 (107s) cleanup: ====================================================== == sanityn test complete, duration 4459 sec ============== 03:16:12 (1738484172) === sanityn: start cleanup 03:16:13 (1738484173) === Stopping clients: oleg315-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg315-client.virtnet /mnt/lustre2 opts: === sanityn: finish cleanup 03:17:23 (1738484243) ===