-----============= acceptance-small: sanityn ============----- Tue Apr 14 13:37:21 EDT 2026 oleg347-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanityn.*ex': No such file or directory excepting tests: 27 28 102 skipping tests SLOW=no: 33a Starting client oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Started clients oleg347-client.virtnet: 192.168.203.147@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt) oleg347-client.virtnet: executing check_config_client /mnt/lustre oleg347-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg347-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff888198860800.idle_timeout=debug osc.lustre-OST0000-osc-ffff8881996ba800.idle_timeout=debug osc.lustre-OST0001-osc-ffff888198860800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8881996ba800.idle_timeout=debug disable quota as required oleg347-server: oleg347-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028677 s, 36.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7160] == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 13:37:58 (1776188278) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (4s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 13:38:03 (1776188283) -rw-r--r-- 1 root root 0 Apr 14 13:38 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (5s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 13:38:08 (1776188288) -rw-r--r-- 1 root root 0 Apr 14 13:38 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (4s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 13:38:13 (1776188293) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (4s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 13:38:17 (1776188297) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (5s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 13:38:22 (1776188302) total 1 -rwxrwxrwx 1 root root 0 Apr 14 13:38 f2a -rwxrwxrwx 1 root root 0 Apr 14 13:38 f2b total 1 -rwxrwxrwx 1 root root 0 Apr 14 13:38 f2a -rwxrwxrwx 1 root root 0 Apr 14 13:38 f2b running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes copied, 0.0145608 s, 35.2 kB/s PASS 2e (5s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 13:38:27 (1776188307) SKIP: sanityn test_2f needs >= 2 MDTs SKIP 2f (3s) == sanityn test 2g: check blocks update on sync write ==== 13:38:30 (1776188310) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.479056 s, 4.4 MB/s /mnt/lustre/f2g.sanityn has 4103 blocks /mnt/lustre2/f2g.sanityn has 4103 blocks PASS 2g (6s) == sanityn test 3: symlink on one mtpt, readlink on another ===================================================================== 13:38:36 (1776188316) PASS 3 (5s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 13:38:42 (1776188322) PASS 4 (7s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 13:38:48 (1776188328) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (5s) == sanityn test 6: remove of open file on other node ============================================================================ 13:38:53 (1776188333) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (5s) == sanityn test 7: remove of open directory on other node ======================================================================= 13:38:58 (1776188338) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (5s) == sanityn test 8: remove of open special file on other node ==================================================================== 13:39:03 (1776188343) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (6s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 13:39:09 (1776188349) PASS 9a (6s) == sanityn test 9b: append to striped sparse file ======== 13:39:16 (1776188356) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0543578 s, 19.3 MB/s 3+0 records in 3+0 records out 3 bytes copied, 0.0920886 s, 0.0 kB/s Data read (expecting 'foo'): foo PASS 9b (5s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 13:39:21 (1776188361) 1+0 records in 1+0 records out 1 byte copied, 0.00959389 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00568376 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.010188 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00936435 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00815786 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00408842 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00920659 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00403168 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00404902 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00507855 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00610664 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00367978 s, 0.3 kB/s PASS 10a (6s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 13:39:27 (1776188367) 1+0 records in 1+0 records out 3072 bytes (3.1 kB, 3.0 KiB) copied, 0.0250854 s, 122 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0309301 s, 132 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB, 3.0 KiB) copied, 0.000358177 s, 8.6 MB/s PASS 10b (5s) == sanityn test 11: execution of file opened for write should return error ============================================================== 13:39:32 (1776188372) multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.7160 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 273: /mnt/lustre2/d11/f: Text file busy PASS 11 (7s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 13:39:39 (1776188379) warning: '-runtime' deprecated, use '-t runtime' instead - link 354 (time 1776188392.16 total 10.02 last 35.32) - link 772 (time 1776188402.17 total 20.03 last 41.77) - link 1201 (time 1776188412.18 total 30.05 last 42.83) - link 1618 (time 1776188422.20 total 40.06 last 41.65) - link 2123 (time 1776188432.21 total 50.07 last 50.44) - link 2541 (time 1776188442.21 total 60.07 last 41.79) - link 2915 (time 1776188452.23 total 70.09 last 37.35) - link 3308 (time 1776188462.25 total 80.11 last 39.20) - link 3642 (time 1776188472.25 total 90.12 last 33.39) total: 4008 link in 100.01 seconds: 40.08 ops/second using seed 2949602828 running for 100 seconds - stat 9180 (time 1776188394 ; total 11 ; last 11) - stat 10000 (time 1776188394 ; total 11 ; last 0) - stat 19545 (time 1776188405 ; total 22 ; last 11) - stat 20000 (time 1776188405 ; total 22 ; last 0) - stat 30000 (time 1776188415 ; total 32 ; last 10) - stat 40000 (time 1776188425 ; total 42 ; last 10) - stat 50000 (time 1776188435 ; total 52 ; last 10) - stat 55476 (time 1776188446 ; total 63 ; last 11) - stat 60000 (time 1776188454 ; total 71 ; last 8) - stat 65574 (time 1776188465 ; total 82 ; last 11) - stat 70000 (time 1776188474 ; total 91 ; last 9) total: 74849 stats in 100 seconds: 748.489990 stats/second - unlinked 0 (time 1776188433 ; total 0 ; last 0) unlink(/mnt/lustre2/lockdir/lockfile4008) error: No such file or directory total: 4007 unlinks in 88 seconds: 45.534092 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (19737) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (19739) - No such process PASS 12 (147s) == sanityn test 13: test directory page revocation ======= 13:42:06 (1776188526) f13 f13 PASS 13 (8s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 13:42:14 (1776188534) multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.7160 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 308: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4309: 20913 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (5s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 13:42:19 (1776188539) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4309: 21485 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (5s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 13:42:24 (1776188544) truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 323: 22057 Terminated $DIR1/$tdir/sleep 60 PASS 14b (5s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 13:42:29 (1776188549) cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 335: 22634 Terminated $DIR1/$tdir/sleep 60 PASS 14c (6s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 13:42:36 (1776188556) chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 346: 23211 Terminated $DIR1/$tdir/sleep 60 PASS 14d (7s) == sanityn test 15: test out-of-space with multiple writers ===================================================================== 13:42:43 (1776188563) PATH=/opt/iozone/bin:/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin: STRIPECOUNT=2 ORIGFREE=7525376 MAXFREE=800000 SKIP: oos2 test_15 oos2.sh: 7525376kB free gt MAXFREE 800000kB, increase 800000 (or reduce test fs size) to proceed sleep 5 for ZFS MDS Waiting for MDT destroys to complete SKIP 15 (19s) == sanityn test 16a: 500 iterations of dual-mount fsx ==== 13:43:02 (1776188582) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.293376 s, 7.1 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.231489 s, 9.1 MB/s Chance of close/open is 1 in 50 Seed set to 8584 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x271d9e 000002[0] 1776188585.737151 trunc from 00000000 to 0x271d9d (0x271d9e bytes) 000004[0] 1776188585.815043 write 0x2d3380 thru 0x2e08de (0xd55f bytes) 000006[1] 1776188585.849940 mapwrite 0x3b96a6 thru 0x3bd4ab (0x3e06 bytes) truncating to largest ever: 0x61ed72 000007[0] 1776188586.121174 trunc from 0x3bd4ac to 0x61ed71 (0x2618c6 bytes) 000009[0] 1776188586.225879 mapwrite 0x9c32d4 thru 0x9c8d7c (0x5aa9 bytes) 000010[0] 1776188586.428252 mapread 0x451985 thru 0x458daf (0x742b bytes) 000011[0] 1776188586.453067 mapread 0x0369eb thru 0x043795 (0xcdab bytes) 000013[0] 1776188586.518683 mapwrite 0x12b277 thru 0x12e229 (0x2fb3 bytes) 000016[1] 1776188586.685577 mapread 0x12eae8 thru 0x136df8 (0x8311 bytes) 000017[1] 1776188586.747360 mapwrite 0x014407 thru 0x01f08d (0xac87 bytes) 000019[1] 1776188586.917425 mapread 0x8382e1 thru 0x839845 (0x1565 bytes) 000020[1] 1776188586.974411 mapread 0x66b1fa thru 0x66f11b (0x3f22 bytes) 000021[0] 1776188587.027106 mapwrite 0x5a03a3 thru 0x5a3d70 (0x39ce bytes) 000023[1] 1776188587.166309 mapread 0x0758f9 thru 0x076705 (0xe0d bytes) 000025[1] 1776188587.240162 mapwrite 0x9a37e2 thru 0x9b2895 (0xf0b4 bytes) 000026[1] 1776188587.380380 write 0x911fd4 thru 0x915809 (0x3836 bytes) 000028[1] 1776188587.412279 mapwrite 0x822d5c thru 0x829dd1 (0x7076 bytes) 000029[0] 1776188587.534391 write 0x1bfb9b thru 0x1c5e8b (0x62f1 bytes) truncating to largest ever: 0x98543e 000031[1] 1776188587.613832 trunc from 0x9c8d7d to 0x98543d (0x4393f bytes) 000032[1] 1776188587.670135 write 0x6cc2f6 thru 0x6daa11 (0xe71c bytes) 000034[0] 1776188587.717072 read 0x0614dc thru 0x06600e (0x4b33 bytes) 000037[0] 1776188587.799725 mapread 0x47e0e7 thru 0x487c36 (0x9b50 bytes) 000039[1] 1776188587.889826 mapwrite 0x76669a thru 0x76f782 (0x90e9 bytes) 000040[1] 1776188587.998262 read 0x4e83b3 thru 0x4e8e4b (0xa99 bytes) 000042[0] 1776188588.026181 write 0x095985 thru 0x09b476 (0x5af2 bytes) 000044[1] 1776188588.102273 mapwrite 0x25e9e0 thru 0x263d17 (0x5338 bytes) 000045[0] 1776188588.218734 mapwrite 0x8415d8 thru 0x84de43 (0xc86c bytes) 000046[1] 1776188588.325193 mapread 0x6e6af5 thru 0x6e972d (0x2c39 bytes) 000052[0] 1776188588.388016 trunc from 0x98543e to 0x664c01 (0x32083c bytes) 000054[1] 1776188588.458851 mapwrite 0x147666 thru 0x151e91 (0xa82c bytes) 000055[1] 1776188588.553122 mapread 0x5f9c8e thru 0x600ec8 (0x723b bytes) 000056[0] 1776188588.613439 write 0x71bad9 thru 0x71e377 (0x289f bytes) 000058[1] 1776188588.650842 read 0x68e8e8 thru 0x68f388 (0xaa1 bytes) 000060[1] 1776188588.691429 mapread 0x237ad6 thru 0x244251 (0xc77c bytes) 000061[0] 1776188588.825224 mapread 0x5f175f thru 0x5f46cf (0x2f71 bytes) 000062[1] 1776188588.883254 mapread 0x0761fb thru 0x077670 (0x1476 bytes) 000063[1] 1776188588.925999 trunc from 0x71e378 to 0x8bbaa7 (0x19d730 bytes) 000064[1] 1776188588.973811 mapwrite 0x30066e thru 0x310206 (0xfb99 bytes) 000066[1] 1776188589.232105 trunc from 0x8bbaa8 to 0x8762f7 (0x457b0 bytes) 000067[1] 1776188589.292110 read 0x723e70 thru 0x72447c (0x60d bytes) 000068[1] 1776188589.299191 trunc from 0x8762f8 to 0x587b6e (0x2ee789 bytes) 000070[0] 1776188589.368509 mapwrite 0x357337 thru 0x36432b (0xcff5 bytes) 000071[0] 1776188589.488790 write 0x92f554 thru 0x93d51e (0xdfcb bytes) 000072[1] 1776188589.519920 write 0x63ce38 thru 0x64c7d6 (0xf99f bytes) 000073[1] 1776188589.557238 trunc from 0x93d51f to 0x713437 (0x22a0e7 bytes) 000074[0] 1776188589.614507 mapwrite 0x31657f thru 0x31b996 (0x5418 bytes) 000076[0] 1776188589.764547 write 0x569d65 thru 0x574409 (0xa6a5 bytes) 000078[0] 1776188589.802833 write 0x4475ad thru 0x44c095 (0x4ae9 bytes) 000079[1] 1776188589.831630 write 0x6d184e thru 0x6d9e87 (0x863a bytes) 000080[0] 1776188589.880778 mapwrite 0x9b8510 thru 0x9c38de (0xb3cf bytes) 000081[1] 1776188590.006268 mapwrite 0x188a77 thru 0x1926ec (0x9c76 bytes) 000082[0] 1776188590.155896 trunc from 0x9c38df to 0x51325d (0x4b0681 bytes) 000085[1] 1776188590.202768 write 0x1b863b thru 0x1bd218 (0x4bde bytes) 000089[0] 1776188590.289714 read 0x4493ae thru 0x44eba6 (0x57f9 bytes) 000094[1] 1776188590.373250 write 0x1a08b9 thru 0x1a402c (0x3774 bytes) 000095[1] 1776188590.394721 mapwrite 0x699051 thru 0x699496 (0x446 bytes) 000096[0] 1776188590.525283 read 0x48e268 thru 0x491090 (0x2e29 bytes) 000097[1] 1776188590.577596 mapread 0x1b658a thru 0x1c40c4 (0xdb3b bytes) 000099[1] 1776188590.640165 write 0x551dfd thru 0x554a64 (0x2c68 bytes) 000100[0] 1776188590.667255 mapwrite 0x154b0d thru 0x164510 (0xfa04 bytes) 000102[0] 1776188590.895709 write 0x6e4190 thru 0x6e7cef (0x3b60 bytes) 000103[0] 1776188590.929559 write 0x16f939 thru 0x171f44 (0x260c bytes) 000104[0] 1776188590.945571 write 0x7c3d3c thru 0x7c4195 (0x45a bytes) 000105[1] 1776188590.946457 trunc from 0x7c4196 to 0x71167c (0xb2b19 bytes) 000107[0] 1776188591.079524 mapread 0x3d51b8 thru 0x3de395 (0x91de bytes) 000108[0] 1776188591.184243 mapwrite 0x146cc7 thru 0x14863f (0x1979 bytes) 000109[0] 1776188591.266243 read 0x0012c2 thru 0x00c98b (0xb6ca bytes) 000110[0] 1776188591.463855 trunc from 0x71167d to 0x657c2a (0xb9a52 bytes) 000111[1] 1776188591.529053 write 0x9797f2 thru 0x988484 (0xec93 bytes) 000112[1] 1776188591.577772 write 0x2b734f thru 0x2c4db7 (0xda69 bytes) 000113[1] 1776188591.599683 trunc from 0x988485 to 0x2f7e72 (0x690612 bytes) 000114[0] 1776188591.643305 write 0x569763 thru 0x573372 (0x9c10 bytes) 000115[1] 1776188591.668696 trunc from 0x573373 to 0x7a39c9 (0x230657 bytes) 000116[1] 1776188591.707184 trunc from 0x7a39ca to 0x2684ba (0x53b50f bytes) 000117[1] 1776188591.738295 trunc from 0x2684bb to 0x37aba4 (0x1126ea bytes) 000120[0] 1776188591.753777 mapread 0x0c70a7 thru 0x0cae85 (0x3ddf bytes) 000124[1] 1776188591.837069 read 0x0ef598 thru 0x0ef6cf (0x138 bytes) 000126[0] 1776188591.887234 mapread 0x00b6ac thru 0x00d105 (0x1a5a bytes) 000127[1] 1776188591.924779 read 0x099308 thru 0x099d44 (0xa3d bytes) 000129[1] 1776188591.954003 write 0x1a4929 thru 0x1b076c (0xbe44 bytes) 000130[0] 1776188591.955250 read 0x12957f thru 0x12ef72 (0x59f4 bytes) 000131[0] 1776188592.019016 mapread 0x2a026b thru 0x2a9c66 (0x99fc bytes) 000133[1] 1776188592.027830 mapread 0x07566a thru 0x07a8d5 (0x526c bytes) 000134[0] 1776188592.068204 write 0x5ea58b thru 0x5f8bcb (0xe641 bytes) 000135[1] 1776188592.084674 write 0x0e1fe1 thru 0x0ec64d (0xa66d bytes) 000137[1] 1776188592.151690 mapread 0x4a50e6 thru 0x4ad05c (0x7f77 bytes) 000138[0] 1776188592.326917 mapwrite 0x6f12e0 thru 0x6f3fa1 (0x2cc2 bytes) 000139[1] 1776188592.460463 trunc from 0x6f3fa2 to 0x7bc4bd (0xc851c bytes) 000140[1] 1776188592.511006 read 0x054f67 thru 0x0605ff (0xb699 bytes) 000141[0] 1776188592.675483 read 0x5c9475 thru 0x5d570c (0xc298 bytes) 000142[1] 1776188592.757014 write 0x8eee3e thru 0x8f3d3a (0x4efd bytes) 000143[0] 1776188592.765883 trunc from 0x8f3d3b to 0x7f3af8 (0x100242 bytes) 000144[0] 1776188592.834665 read 0x0058e4 thru 0x00c8b3 (0x6fd0 bytes) 000145[0] 1776188592.990380 mapwrite 0x31e9d7 thru 0x31fafe (0x1128 bytes) 000146[0] 1776188593.041922 mapwrite 0x610419 thru 0x61d69f (0xd287 bytes) 000147[0] 1776188593.086986 read 0x639a06 thru 0x63fa31 (0x602c bytes) 000149[0] 1776188593.137495 mapread 0x6eafdd thru 0x6ef05a (0x407e bytes) 000150[0] 1776188593.167887 write 0x2eb638 thru 0x2f3e46 (0x880f bytes) 000154[1] 1776188593.273670 read 0x3617c4 thru 0x36479f (0x2fdc bytes) 000157[1] 1776188593.362885 trunc from 0x7f3af9 to 0x6e1d97 (0x111d61 bytes) 000159[1] 1776188593.529639 write 0x90cb66 thru 0x90d22a (0x6c5 bytes) 000161[1] 1776188593.582104 mapwrite 0x7eb5fa thru 0x7ee2a0 (0x2ca7 bytes) 000163[1] 1776188593.797282 write 0x566a31 thru 0x56895e (0x1f2e bytes) 000164[0] 1776188593.801748 read 0x25f9a9 thru 0x263ca4 (0x42fc bytes) 000166[0] 1776188593.839308 mapwrite 0x31a87f thru 0x320716 (0x5e98 bytes) 000168[1] 1776188594.080165 write 0x563c63 thru 0x56b161 (0x74ff bytes) 000169[1] 1776188594.142880 mapwrite 0x4f5b5e thru 0x4f9ad4 (0x3f77 bytes) 000170[1] 1776188594.263497 mapwrite 0x1cf60a thru 0x1dabad (0xb5a4 bytes) 000172[1] 1776188594.352065 write 0x21ca8b thru 0x22340a (0x6980 bytes) 000173[1] 1776188594.381571 mapread 0x1d183a thru 0x1de3e5 (0xcbac bytes) 000174[1] 1776188594.411881 read 0x8ca0ce thru 0x8d4c7e (0xabb1 bytes) 000175[1] 1776188594.420140 write 0x5758ca thru 0x58580a (0xff41 bytes) 000180[0] 1776188594.521664 mapread 0x5a2196 thru 0x5a99b2 (0x781d bytes) 000182[0] 1776188594.628567 mapwrite 0x33573c thru 0x339321 (0x3be6 bytes) 000184[0] 1776188594.817094 trunc from 0x90d22b to 0x2598cc (0x6b395e bytes) 000185[0] 1776188594.860114 trunc from 0x2598cd to 0x50de76 (0x2b45aa bytes) 000186[0] 1776188594.876182 mapwrite 0x5d5a75 thru 0x5df3c1 (0x994d bytes) 000188[1] 1776188595.107951 write 0x06fb64 thru 0x075a47 (0x5ee4 bytes) 000190[0] 1776188595.163966 write 0x6cdb5a thru 0x6dce5d (0xf304 bytes) 000192[0] 1776188595.226153 read 0x494a25 thru 0x49689f (0x1e7b bytes) 000194[0] 1776188595.332182 mapwrite 0x0c571d thru 0x0d5222 (0xfb06 bytes) 000195[0] 1776188595.563249 trunc from 0x6dce5e to 0x6c6609 (0x16854 bytes) 000196[0] 1776188595.614430 read 0x2cfb63 thru 0x2dca89 (0xcf27 bytes) 000197[1] 1776188595.667112 read 0x3d3fe6 thru 0x3e2538 (0xe553 bytes) 000200[0] 1776188595.745229 read 0x1fd318 thru 0x205ab1 (0x879a bytes) 000201[0] 1776188595.853098 write 0x8ef42e thru 0x8f99b5 (0xa588 bytes) 000202[1] 1776188595.880356 read 0x20165b thru 0x20f075 (0xda1b bytes) 000203[1] 1776188596.033155 mapread 0x145f50 thru 0x1498d2 (0x3983 bytes) 000204[0] 1776188596.089069 trunc from 0x8f99b6 to 0x673fcd (0x2859e8 bytes) 000207[0] 1776188596.211997 mapwrite 0x0c7b8f thru 0x0c8916 (0xd88 bytes) 000209[1] 1776188596.346816 read 0x5bc6af thru 0x5bde67 (0x17b9 bytes) 000210[0] 1776188596.400950 read 0x274687 thru 0x2835e7 (0xef61 bytes) 000211[1] 1776188596.450199 read 0x12eafb thru 0x13c755 (0xdc5b bytes) 000214[1] 1776188596.498180 mapwrite 0x83b09d thru 0x83d9de (0x2942 bytes) 000215[0] 1776188596.697197 read 0x073b71 thru 0x07fd8a (0xc21a bytes) 000217[1] 1776188596.744119 mapread 0x4cb21d thru 0x4ce039 (0x2e1d bytes) 000219[0] 1776188596.790554 write 0x308d26 thru 0x30aa3d (0x1d18 bytes) 000221[1] 1776188596.907687 read 0x29d635 thru 0x2ad3a2 (0xfd6e bytes) 000222[0] 1776188596.959521 read 0x17a378 thru 0x17fa14 (0x569d bytes) 000223[0] 1776188596.978987 read 0x711fff thru 0x71f27e (0xd280 bytes) 000224[1] 1776188596.979740 mapread 0x0b0f03 thru 0x0b7d0d (0x6e0b bytes) 000225[0] 1776188597.066075 mapread 0x6d9bbe thru 0x6e8016 (0xe459 bytes) 000226[0] 1776188597.097658 mapread 0x530153 thru 0x53430e (0x41bc bytes) 000228[0] 1776188597.099481 mapwrite 0x17df35 thru 0x18cd20 (0xedec bytes) 000230[0] 1776188597.218019 read 0x20dd7d thru 0x2107e6 (0x2a6a bytes) 000231[0] 1776188597.265893 write 0x6399d2 thru 0x63c818 (0x2e47 bytes) 000237[0] 1776188597.433975 trunc from 0x83d9df to 0x4f3f31 (0x349aad bytes) 000238[0] 1776188597.455268 trunc from 0x4f3f32 to 0x7b0cc9 (0x2bcd98 bytes) 000242[0] 1776188597.548074 mapwrite 0x73c84f thru 0x7487f5 (0xbfa7 bytes) 000243[0] 1776188597.704873 write 0x199622 thru 0x1a4de2 (0xb7c1 bytes) 000245[0] 1776188597.707472 mapread 0x433432 thru 0x43cf2d (0x9afc bytes) 000246[0] 1776188597.767794 read 0x357eec thru 0x3667a2 (0xe8b7 bytes) 000247[0] 1776188597.827685 mapwrite 0x7be583 thru 0x7c5f7d (0x79fb bytes) 000248[1] 1776188597.998176 mapwrite 0x9baaa0 thru 0x9c6221 (0xb782 bytes) 000249[0] 1776188598.273924 trunc from 0x9c6222 to 0x86ef28 (0x1572f9 bytes) 000250[1] 1776188598.388255 mapread 0x0949b6 thru 0x0a4448 (0xfa93 bytes) 000252[1] 1776188598.546521 mapwrite 0x2b982a thru 0x2c1dd8 (0x85af bytes) 000253[0] 1776188598.695917 mapwrite 0x23c9c7 thru 0x2480ca (0xb704 bytes) 000255[0] 1776188598.875261 mapwrite 0x33e23c thru 0x34846b (0xa230 bytes) 000257[0] 1776188599.032279 mapwrite 0x62ee71 thru 0x634942 (0x5ad2 bytes) 000262[1] 1776188599.184093 mapwrite 0x342176 thru 0x34ca57 (0xa8e2 bytes) 000265[0] 1776188599.349237 write 0x5f3910 thru 0x5fc17c (0x886d bytes) 000267[0] 1776188599.381878 write 0x202671 thru 0x211f01 (0xf891 bytes) 000268[0] 1776188599.411108 mapread 0x3f7abe thru 0x3f86c0 (0xc03 bytes) 000269[0] 1776188599.421037 mapread 0x5a2300 thru 0x5ab278 (0x8f79 bytes) 000270[0] 1776188599.459833 trunc from 0x86ef29 to 0x8f1c36 (0x82d0e bytes) 000282[1] 1776188599.607993 trunc from 0x8f1c37 to 0x774836 (0x17d400 bytes) 000285[0] 1776188599.661492 mapread 0x3748ba thru 0x381487 (0xcbce bytes) 000288[0] 1776188599.790757 read 0x41d387 thru 0x428152 (0xadcc bytes) 000289[0] 1776188599.865526 read 0x6b8835 thru 0x6b9113 (0x8df bytes) 000290[1] 1776188599.865946 write 0x16ebad thru 0x175133 (0x6587 bytes) 000293[1] 1776188599.940665 read 0x14aa06 thru 0x14d358 (0x2953 bytes) 000295[0] 1776188599.948271 read 0x5a84bf thru 0x5b6655 (0xe197 bytes) 000296[0] 1776188599.977895 mapwrite 0x0122c8 thru 0x019314 (0x704d bytes) 000297[1] 1776188600.061966 write 0x97390a thru 0x9774b3 (0x3baa bytes) 000298[1] 1776188600.098060 mapwrite 0x1e5a14 thru 0x1f25ae (0xcb9b bytes) 000299[0] 1776188600.238615 write 0x4c1cf5 thru 0x4d0337 (0xe643 bytes) 000302[0] 1776188600.311152 trunc from 0x9774b4 to 0x067881 (0x90fc32 bytes) 000304[0] 1776188600.410706 mapread 0x04752e thru 0x052504 (0xafd7 bytes) 000305[1] 1776188600.459921 trunc from 0x067882 to 0x33db58 (0x2d62d7 bytes) 000306[1] 1776188600.547990 mapread 0x2c1978 thru 0x2c59f7 (0x4080 bytes) 000307[0] 1776188600.604146 mapread 0x06409c thru 0x069bc5 (0x5b2a bytes) 000309[1] 1776188600.653813 mapread 0x20a0d0 thru 0x20d023 (0x2f54 bytes) 000310[1] 1776188600.682030 write 0x4f7892 thru 0x4fbd3e (0x44ad bytes) 000311[1] 1776188600.694895 trunc from 0x4fbd3f to 0x20be05 (0x2eff39 bytes) 000312[0] 1776188600.724849 mapread 0x181729 thru 0x18d58d (0xbe65 bytes) 000314[1] 1776188600.780882 mapread 0x11e30b thru 0x1237a6 (0x549c bytes) 000315[1] 1776188600.818087 read 0x0e6c5b thru 0x0e957d (0x2923 bytes) 000316[1] 1776188600.818539 read 0x18220f thru 0x18c22c (0xa01e bytes) 000319[0] 1776188600.870070 mapwrite 0x8a6e5a thru 0x8aa856 (0x39fd bytes) 000320[1] 1776188601.044726 mapwrite 0x3175b7 thru 0x326aeb (0xf535 bytes) 000321[0] 1776188601.367978 write 0x5e4de2 thru 0x5e88de (0x3afd bytes) 000323[1] 1776188601.412616 read 0x67088b thru 0x678429 (0x7b9f bytes) 000324[0] 1776188601.448586 write 0x811945 thru 0x81412c (0x27e8 bytes) 000327[0] 1776188601.500822 mapread 0x22e3e3 thru 0x237ac8 (0x96e6 bytes) 000328[1] 1776188601.539397 write 0x1f68b1 thru 0x2014a2 (0xabf2 bytes) 000329[1] 1776188601.701037 trunc from 0x8aa857 to 0x10b7b5 (0x79f0a1 bytes) 000330[0] 1776188601.755124 mapwrite 0x6ec8d4 thru 0x6f8b6d (0xc29a bytes) 000331[1] 1776188601.874966 read 0x4d1c6b thru 0x4d7fab (0x6341 bytes) 000333[0] 1776188601.968835 mapread 0x38c7d1 thru 0x39123a (0x4a6a bytes) 000334[0] 1776188602.008228 write 0x9bc787 thru 0x9c8017 (0xb891 bytes) 000336[0] 1776188602.044753 read 0x0d04d7 thru 0x0dae15 (0xa93f bytes) 000338[0] 1776188602.247739 mapread 0x97b84e thru 0x988cd8 (0xd48b bytes) 000340[0] 1776188602.297632 trunc from 0x9c8018 to 0x71fd24 (0x2a82f3 bytes) 000341[0] 1776188602.346457 write 0x6db4e0 thru 0x6e5443 (0x9f64 bytes) 000342[0] 1776188602.381970 mapread 0x0cf5f2 thru 0x0d8d48 (0x9757 bytes) 000343[0] 1776188602.438662 write 0x0538a0 thru 0x05f4e0 (0xbc41 bytes) 000349[0] 1776188602.523808 mapwrite 0x7b4453 thru 0x7c1f75 (0xdb23 bytes) 000350[0] 1776188602.680776 write 0x8d5f82 thru 0x8d6f13 (0xf92 bytes) 000352[1] 1776188602.688614 read 0x1cc3cc thru 0x1d1d68 (0x599d bytes) 000353[1] 1776188602.742986 read 0x2be9d7 thru 0x2c585e (0x6e88 bytes) 000356[0] 1776188602.859150 read 0x75bac3 thru 0x7683b7 (0xc8f5 bytes) 000358[0] 1776188602.903241 mapwrite 0x306b52 thru 0x311015 (0xa4c4 bytes) 000359[1] 1776188603.063691 mapwrite 0x310999 thru 0x312ab3 (0x211b bytes) 000360[0] 1776188603.203852 write 0x1a6f75 thru 0x1a8e3d (0x1ec9 bytes) 000361[1] 1776188603.233716 mapwrite 0x6b173c thru 0x6b6e7b (0x5740 bytes) 000364[0] 1776188603.457898 trunc from 0x8d6f14 to 0x101c83 (0x7d5290 bytes) 000366[1] 1776188603.495216 write 0x638434 thru 0x63a51a (0x20e7 bytes) 000370[1] 1776188603.605539 mapwrite 0x219093 thru 0x2219d5 (0x8943 bytes) 000371[1] 1776188603.756882 mapread 0x10b203 thru 0x115922 (0xa720 bytes) 000374[1] 1776188603.827864 mapwrite 0x251572 thru 0x254d27 (0x37b6 bytes) 000375[1] 1776188603.906710 mapread 0x03697a thru 0x041207 (0xa88e bytes) 000378[0] 1776188603.951775 write 0x7d17bf thru 0x7db0be (0x9900 bytes) 000380[1] 1776188603.994876 read 0x45c329 thru 0x464080 (0x7d58 bytes) 000381[0] 1776188604.013844 read 0x1512ac thru 0x15677d (0x54d2 bytes) 000384[0] 1776188604.073149 write 0x7fd19d thru 0x7fe7dc (0x1640 bytes) 000385[1] 1776188604.091970 mapread 0x2b28ab thru 0x2b3332 (0xa88 bytes) truncating to largest ever: 0x9f202d 000386[0] 1776188604.126601 trunc from 0x7fe7dd to 0x9f202c (0x1f3850 bytes) 000387[0] 1776188604.172025 mapwrite 0x6c2baf thru 0x6ca864 (0x7cb6 bytes) 000389[1] 1776188604.439382 trunc from 0x9f202d to 0x8ce698 (0x123994 bytes) 000391[0] 1776188604.562608 mapwrite 0x829a77 thru 0x82f56d (0x5af7 bytes) 000393[0] 1776188604.825439 trunc from 0x8ce699 to 0x8e2768 (0x140d0 bytes) 000395[0] 1776188604.932618 mapwrite 0x2ea0ff thru 0x2f5045 (0xaf47 bytes) 000396[1] 1776188605.067199 mapwrite 0x32c114 thru 0x33bd58 (0xfc45 bytes) 000401[0] 1776188605.277324 mapread 0x5c02ea thru 0x5c461f (0x4336 bytes) 000402[0] 1776188605.315839 mapwrite 0x5c556d thru 0x5cfa79 (0xa50d bytes) 000405[0] 1776188605.508687 read 0x20bf8f thru 0x215971 (0x99e3 bytes) 000408[0] 1776188605.579945 mapread 0x398d09 thru 0x39ef5f (0x6257 bytes) 000409[0] 1776188605.616565 write 0x937d92 thru 0x938260 (0x4cf bytes) 000411[1] 1776188605.617625 write 0x81268a thru 0x81f2a2 (0xcc19 bytes) 000412[1] 1776188605.667975 mapwrite 0x09166d thru 0x0a0d45 (0xf6d9 bytes) 000413[0] 1776188605.806915 write 0x958d81 thru 0x960c8d (0x7f0d bytes) 000416[1] 1776188605.846320 trunc from 0x960c8e to 0x402a54 (0x55e239 bytes) 000417[0] 1776188605.912170 write 0x77c5b0 thru 0x782020 (0x5a71 bytes) 000418[0] 1776188605.955449 write 0x9ca5bf thru 0x9cde58 (0x389a bytes) 000421[0] 1776188606.016446 write 0x068b6b thru 0x073e47 (0xb2dd bytes) 000422[1] 1776188606.042125 trunc from 0x9cde59 to 0x76822b (0x265c2d bytes) 000423[1] 1776188606.082784 mapwrite 0x853134 thru 0x85c292 (0x915f bytes) 000424[0] 1776188606.192541 mapwrite 0x03e8a8 thru 0x040f03 (0x265c bytes) 000427[1] 1776188606.380126 read 0x4feffd thru 0x50dcff (0xed03 bytes) 000428[1] 1776188606.486860 trunc from 0x85c293 to 0x1230c1 (0x7391d1 bytes) 000429[0] 1776188606.534177 read 0x0a2232 thru 0x0a31ec (0xfbb bytes) 000434[1] 1776188606.640505 mapread 0x0c2837 thru 0x0cf3b2 (0xcb7c bytes) 000435[0] 1776188606.733409 write 0x36c63b thru 0x36d05c (0xa22 bytes) 000436[0] 1776188606.771457 mapwrite 0x6cdfb3 thru 0x6d16d2 (0x3720 bytes) 000437[0] 1776188606.961410 mapwrite 0x6f8855 thru 0x6f919c (0x948 bytes) 000440[1] 1776188607.143722 write 0x653886 thru 0x654276 (0x9f1 bytes) 000442[1] 1776188607.218227 mapread 0x040424 thru 0x04c8cb (0xc4a8 bytes) 000443[0] 1776188607.338615 trunc from 0x6f919d to 0x9a5980 (0x2ac7e4 bytes) 000445[1] 1776188607.416391 mapwrite 0x36f1b9 thru 0x3745f1 (0x5439 bytes) 000446[1] 1776188607.561928 read 0x67cd5a thru 0x681db4 (0x505b bytes) 000448[0] 1776188607.644843 mapwrite 0x34234d thru 0x34ca1a (0xa6ce bytes) 000449[0] 1776188607.791466 trunc from 0x9a5981 to 0x4b8ee5 (0x4eca9b bytes) 000450[0] 1776188607.823889 write 0x329826 thru 0x333a5f (0xa23a bytes) 000451[1] 1776188607.860097 write 0x9d3e89 thru 0x9d8d18 (0x4e90 bytes) 000452[0] 1776188607.890588 trunc from 0x9d8d19 to 0x7550bb (0x283c5d bytes) 000453[0] 1776188607.976911 write 0x71d0e2 thru 0x7218a7 (0x47c6 bytes) 000454[1] 1776188608.001322 mapwrite 0x4a9488 thru 0x4add76 (0x48ef bytes) 000455[0] 1776188608.158758 write 0x8d78fa thru 0x8d9b35 (0x223c bytes) 000457[1] 1776188608.201120 write 0x6272aa thru 0x62e4df (0x7236 bytes) 000458[1] 1776188608.256011 trunc from 0x8d9b36 to 0x0e9352 (0x7f07e3 bytes) 000459[1] 1776188608.303550 write 0x904a37 thru 0x905fb8 (0x1582 bytes) 000460[1] 1776188608.328103 read 0x53c686 thru 0x53d76c (0x10e7 bytes) 000461[0] 1776188608.372087 write 0x348b17 thru 0x3575ad (0xea97 bytes) 000462[0] 1776188608.448659 read 0x4effee thru 0x4f000d (0x20 bytes) 000466[0] 1776188608.569819 write 0x73df39 thru 0x742f6f (0x5037 bytes) 000473[1] 1776188608.674965 mapwrite 0x1c4f2a thru 0x1c7039 (0x2110 bytes) 000474[0] 1776188608.767544 read 0x1667a5 thru 0x17053e (0x9d9a bytes) 000475[1] 1776188608.792279 mapwrite 0x6c35a0 thru 0x6c6449 (0x2eaa bytes) 000476[1] 1776188608.888453 write 0x69a7c4 thru 0x6a6bde (0xc41b bytes) 000477[0] 1776188608.899570 mapread 0x32a2d5 thru 0x32be09 (0x1b35 bytes) 000478[0] 1776188608.938209 mapread 0x401ac6 thru 0x40798f (0x5eca bytes) 000479[0] 1776188608.997197 trunc from 0x905fb9 to 0x111399 (0x7f4c1f bytes) 000480[1] 1776188609.066817 mapwrite 0x07caa6 thru 0x088184 (0xb6df bytes) 000484[1] 1776188609.274017 mapread 0x03d79f thru 0x04c86e (0xf0d0 bytes) 000485[0] 1776188609.352719 trunc from 0x11139a to 0x85ed52 (0x74d9b9 bytes) 000487[0] 1776188609.407877 trunc from 0x85ed53 to 0x7d42c8 (0x8aa8a bytes) 000490[1] 1776188609.464639 read 0x29a732 thru 0x2a37e8 (0x90b7 bytes) 000491[1] 1776188609.506994 read 0x31c9dd thru 0x326c32 (0xa256 bytes) 000493[0] 1776188609.622748 trunc from 0x7d42c9 to 0x9765fc (0x1a2334 bytes) 000496[1] 1776188609.750995 write 0x77ddfc thru 0x78ceb9 (0xf0be bytes) 000498[1] 1776188609.830200 mapwrite 0x58d72b thru 0x59b822 (0xe0f8 bytes) 000499[1] 1776188610.054219 write 0x4a8387 thru 0x4b2cc2 (0xa93c bytes) 000500[0] 1776188610.132271 trunc from 0x9765fd to 0x6f328f (0x28336d bytes) All operations completed A-OK! Chance of close/open is 1 in 50 Seed set to 8610 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read 000003[0] 1776188610.695862 mapwrite 0x0ad000 thru 0x0aeb46 (0x1b47 bytes) 000008[1] 1776188610.892742 read_OD 0x039000 thru 0x03bfff (0x3000 bytes) truncating to largest ever: 0x1df0d8 000009[0] 1776188610.918114 trunc from 0x0aeb47 to 0x1df0d7 (0x130591 bytes) 000011[0] 1776188610.962300 mapread 0x050000 thru 0x05c167 (0xc168 bytes) truncating to largest ever: 0x6ade2b 000012[1] 1776188610.986877 trunc from 0x1df0d8 to 0x6ade2a (0x4ced53 bytes) 000015[0] 1776188611.079042 mapwrite 0x57a000 thru 0x5812e8 (0x72e9 bytes) 000016[1] 1776188611.185066 trunc from 0x6ade2b to 0x1c46b6 (0x4e9774 bytes) 000017[0] 1776188611.234748 mapread 0x081000 thru 0x088e5a (0x7e5b bytes) 000018[1] 1776188611.273919 trunc from 0x1c46b7 to 0x024686 (0x1a0030 bytes) 000019[0] 1776188611.304199 trunc from 0x024687 to 0x49cfb7 (0x478931 bytes) 000021[0] 1776188611.373942 write 0x391000 thru 0x399df9 (0x8dfa bytes) 000024[0] 1776188611.450325 write 0x251000 thru 0x252044 (0x1045 bytes) 000026[1] 1776188611.500808 write_OD 0x562000 thru 0x569fff (0x8000 bytes) 000031[0] 1776188611.563167 read 0x4a0000 thru 0x4ab3cb (0xb3cc bytes) 000032[1] 1776188611.569006 write_OD 0x22d000 thru 0x238fff (0xc000 bytes) 000035[1] 1776188611.639694 mapwrite 0x408000 thru 0x40d0ae (0x50af bytes) 000037[1] 1776188611.725462 read_OD 0x417000 thru 0x41cfff (0x6000 bytes) 000039[0] 1776188611.747876 mapread 0x2e0000 thru 0x2eb9ba (0xb9bb bytes) 000044[1] 1776188611.776587 mapread 0x3be000 thru 0x3cab03 (0xcb04 bytes) truncating to largest ever: 0x7b2ce2 000045[0] 1776188611.891511 trunc from 0x56a000 to 0x7b2ce1 (0x248ce2 bytes) 000046[0] 1776188611.948907 write 0x28d000 thru 0x296a14 (0x9a15 bytes) 000047[1] 1776188611.974425 mapread 0x5e3000 thru 0x5f2723 (0xf724 bytes) 000048[0] 1776188612.056250 trunc from 0x7b2ce2 to 0x109d4a (0x6a8f97 bytes) 000049[0] 1776188612.107988 read 0x09a000 thru 0x0a683a (0xc83b bytes) 000050[0] 1776188612.150508 read 0x08c000 thru 0x0977d1 (0xb7d2 bytes) 000051[1] 1776188612.168734 read_OD 0x03c000 thru 0x045fff (0xa000 bytes) 000055[0] 1776188612.208300 mapwrite 0x83b000 thru 0x841b32 (0x6b33 bytes) 000056[1] 1776188612.445705 mapwrite 0x782000 thru 0x7832b9 (0x12ba bytes) 000058[1] 1776188612.683471 mapwrite 0x853000 thru 0x861fa0 (0xefa1 bytes) 000060[1] 1776188612.795311 read_OD 0x152000 thru 0x158fff (0x7000 bytes) 000061[1] 1776188612.829685 read_OD 0x311000 thru 0x317fff (0x7000 bytes) 000062[0] 1776188612.836578 mapread 0x2ed000 thru 0x2effbc (0x2fbd bytes) 000064[1] 1776188612.853590 mapread 0x6aa000 thru 0x6acedf (0x2ee0 bytes) 000067[1] 1776188612.954371 mapread 0x45b000 thru 0x45e335 (0x3336 bytes) 000069[1] 1776188612.954960 read_OD 0x433000 thru 0x438fff (0x6000 bytes) 000071[1] 1776188612.966703 write_OD 0x0c5000 thru 0x0cbfff (0x7000 bytes) 000072[1] 1776188613.014810 trunc from 0x861fa1 to 0x3cca4f (0x495551 bytes) 000073[1] 1776188613.064401 read_OD 0x32b000 thru 0x335fff (0xb000 bytes) 000074[1] 1776188613.080560 trunc from 0x3cca50 to 0x33ec9d (0x8ddb2 bytes) 000075[1] 1776188613.132074 read_OD 0x15d000 thru 0x164fff (0x8000 bytes) 000086[0] 1776188613.168392 write 0x9b4000 thru 0x9b7126 (0x3127 bytes) 000088[1] 1776188613.188513 read_OD 0x7e5000 thru 0x7edfff (0x9000 bytes) 000089[0] 1776188613.238671 read 0x59a000 thru 0x5a27a9 (0x87aa bytes) 000092[0] 1776188613.315500 mapread 0x3e4000 thru 0x3ef180 (0xb181 bytes) 000093[1] 1776188613.394628 read_OD 0x5f9000 thru 0x5fefff (0x6000 bytes) truncating to largest ever: 0x88e8a6 000095[1] 1776188613.401170 trunc from 0x9b7127 to 0x88e8a5 (0x128881 bytes) 000097[1] 1776188613.448695 trunc from 0x88e8a6 to 0x84c9d9 (0x41ecc bytes) 000100[0] 1776188613.463078 read 0x197000 thru 0x1a1994 (0xa995 bytes) 000101[1] 1776188613.628513 write_OD 0x168000 thru 0x174fff (0xd000 bytes) 000102[0] 1776188613.713651 trunc from 0x84c9da to 0x2a2d8b (0x5a9c4e bytes) 000105[1] 1776188613.769203 write_OD 0x1b7000 thru 0x1b9fff (0x3000 bytes) 000107[1] 1776188613.848264 mapread 0x177000 thru 0x186e65 (0xfe66 bytes) 000108[0] 1776188613.933723 mapwrite 0x091000 thru 0x09943a (0x843b bytes) 000109[1] 1776188614.056380 read_OD 0x102000 thru 0x104fff (0x3000 bytes) 000110[0] 1776188614.076765 write 0x2bd000 thru 0x2c7efd (0xaefe bytes) 000111[0] 1776188614.093309 mapwrite 0x5a8000 thru 0x5b265a (0xa65b bytes) 000112[1] 1776188614.219607 write_OD 0x2f3000 thru 0x2fafff (0x8000 bytes) 000113[1] 1776188614.269603 trunc from 0x5b265b to 0x66ef4e (0xbc8f4 bytes) 000116[1] 1776188614.317609 trunc from 0x66ef4f to 0x7dd127 (0x16e1d9 bytes) 000117[1] 1776188614.352835 trunc from 0x7dd128 to 0x5dc128 (0x200fff bytes) 000118[1] 1776188614.379388 write_OD 0x4ac000 thru 0x4b5fff (0xa000 bytes) 000119[0] 1776188614.432188 read 0x48c000 thru 0x48ddb5 (0x1db6 bytes) truncating to largest ever: 0x9b2a58 000120[0] 1776188614.481749 trunc from 0x5dc129 to 0x9b2a57 (0x3d692f bytes) 000123[1] 1776188614.552786 mapread 0x40c000 thru 0x40cb81 (0xb82 bytes) 000124[0] 1776188614.728951 mapwrite 0x42e000 thru 0x438faa (0xafab bytes) 000125[0] 1776188614.951275 trunc from 0x9b2a58 to 0x2c5b4e (0x6ecf09 bytes) 000126[0] 1776188615.021056 write 0x143000 thru 0x14b692 (0x8693 bytes) 000129[0] 1776188615.055812 read 0x18b000 thru 0x199307 (0xe308 bytes) 000130[1] 1776188615.096914 write_OD 0x228000 thru 0x233fff (0xc000 bytes) 000131[0] 1776188615.151775 read 0x131000 thru 0x138dab (0x7dac bytes) 000132[1] 1776188615.182378 mapread 0x1b7000 thru 0x1bf285 (0x8286 bytes) 000133[0] 1776188615.222790 write 0x878000 thru 0x87a114 (0x2115 bytes) 000137[1] 1776188615.271923 read_OD 0x67e000 thru 0x688fff (0xb000 bytes) 000138[0] 1776188615.294915 read 0x1c4000 thru 0x1c4866 (0x867 bytes) 000146[0] 1776188615.407470 write 0x728000 thru 0x729ea3 (0x1ea4 bytes) 000147[0] 1776188615.466872 mapread 0x5fb000 thru 0x5fb160 (0x161 bytes) 000148[0] 1776188615.475531 trunc from 0x87a115 to 0x2a620d (0x5d3f07 bytes) 000151[1] 1776188615.548437 write_OD 0x4a8000 thru 0x4abfff (0x4000 bytes) 000154[1] 1776188615.617272 mapwrite 0x6b8000 thru 0x6b9f1e (0x1f1f bytes) 000155[1] 1776188615.787071 mapwrite 0x6aa000 thru 0x6b914a (0xf14b bytes) 000158[1] 1776188615.943676 write_OD 0x203000 thru 0x20bfff (0x9000 bytes) 000162[0] 1776188616.012105 read 0x5e5000 thru 0x5e9cff (0x4d00 bytes) 000163[1] 1776188616.058126 mapwrite 0x794000 thru 0x7a129d (0xd29e bytes) 000165[1] 1776188616.255092 mapread 0x268000 thru 0x270dce (0x8dcf bytes) 000166[1] 1776188616.303579 trunc from 0x7a129e to 0x7de976 (0x3d6d9 bytes) 000167[1] 1776188616.322458 mapread 0x2af000 thru 0x2b8dd0 (0x9dd1 bytes) 000168[1] 1776188616.411585 write_OD 0x679000 thru 0x681fff (0x9000 bytes) 000169[0] 1776188616.467978 mapread 0x75a000 thru 0x760a8f (0x6a90 bytes) 000170[1] 1776188616.494760 write_OD 0x6d5000 thru 0x6defff (0xa000 bytes) 000172[0] 1776188616.559647 write 0x977000 thru 0x98644a (0xf44b bytes) 000175[0] 1776188616.581051 mapread 0x61a000 thru 0x6273cb (0xd3cc bytes) 000176[0] 1776188616.685658 write 0x435000 thru 0x43a0c9 (0x50ca bytes) 000177[1] 1776188616.705444 write_OD 0x22e000 thru 0x239fff (0xc000 bytes) 000178[0] 1776188616.788545 write 0x144000 thru 0x15191d (0xd91e bytes) 000181[1] 1776188616.821285 write_OD 0x216000 thru 0x224fff (0xf000 bytes) 000184[0] 1776188616.888724 mapwrite 0x05f000 thru 0x06406b (0x506c bytes) 000185[0] 1776188616.980913 write 0x0d9000 thru 0x0dc2c7 (0x32c8 bytes) 000186[1] 1776188616.999183 mapread 0x2fe000 thru 0x305237 (0x7238 bytes) 000187[1] 1776188617.057655 mapwrite 0x0a7000 thru 0x0b0662 (0x9663 bytes) 000189[1] 1776188617.219008 write_OD 0x13f000 thru 0x140fff (0x2000 bytes) 000190[1] 1776188617.285267 read_OD 0x692000 thru 0x69efff (0xd000 bytes) 000191[0] 1776188617.312227 read 0x73a000 thru 0x742fd9 (0x8fda bytes) 000197[0] 1776188617.398457 mapwrite 0x673000 thru 0x67f1c1 (0xc1c2 bytes) 000198[0] 1776188617.574695 write 0x0e8000 thru 0x0f05e4 (0x85e5 bytes) truncating to largest ever: 0x9fe3e1 000199[0] 1776188617.584070 trunc from 0x98644b to 0x9fe3e0 (0x77f96 bytes) 000204[1] 1776188617.672731 trunc from 0x9fe3e1 to 0x006813 (0x9f7bcd bytes) 000205[0] 1776188617.748414 mapread 0x003000 thru 0x00655f (0x3560 bytes) 000206[0] 1776188617.805878 trunc from 0x006814 to 0x82b963 (0x825150 bytes) 000207[1] 1776188617.871862 mapread 0x3fb000 thru 0x3fb88c (0x88d bytes) 000209[1] 1776188617.968289 mapwrite 0x185000 thru 0x188272 (0x3273 bytes) 000211[1] 1776188618.078758 read_OD 0x124000 thru 0x125fff (0x2000 bytes) 000213[0] 1776188618.092010 mapwrite 0x6a7000 thru 0x6b37d7 (0xc7d8 bytes) 000215[1] 1776188618.206415 trunc from 0x82b964 to 0x6e678b (0x1451d8 bytes) 000217[0] 1776188618.247283 mapread 0x623000 thru 0x62af8d (0x7f8e bytes) 000218[1] 1776188618.290294 read_OD 0x0ad000 thru 0x0affff (0x3000 bytes) 000220[0] 1776188618.297099 mapwrite 0x6ce000 thru 0x6d5b23 (0x7b24 bytes) 000221[0] 1776188618.390674 read 0x1eb000 thru 0x1fa163 (0xf164 bytes) 000222[0] 1776188618.432972 write 0x89e000 thru 0x8ab2b3 (0xd2b4 bytes) 000225[0] 1776188618.499739 write 0x4f1000 thru 0x4fbd52 (0xad53 bytes) 000227[0] 1776188618.519762 mapwrite 0x82c000 thru 0x8399b2 (0xd9b3 bytes) 000231[1] 1776188618.646995 write_OD 0x978000 thru 0x979fff (0x2000 bytes) 000232[0] 1776188618.704145 write 0x3fc000 thru 0x409730 (0xd731 bytes) 000233[0] 1776188618.729227 mapread 0x5fb000 thru 0x605687 (0xa688 bytes) 000235[1] 1776188618.783675 mapwrite 0x32c000 thru 0x337a01 (0xba02 bytes) 000236[0] 1776188619.012417 trunc from 0x97a000 to 0x8c4036 (0xb5fc9 bytes) 000238[1] 1776188619.057083 write_OD 0x1e3000 thru 0x1e8fff (0x6000 bytes) 000239[0] 1776188619.094464 trunc from 0x8c4037 to 0x67854f (0x24bae7 bytes) 000240[1] 1776188619.127121 trunc from 0x678550 to 0x910d4e (0x2987ff bytes) 000241[0] 1776188619.161164 write 0x70f000 thru 0x71a2b2 (0xb2b3 bytes) 000243[0] 1776188619.235986 trunc from 0x910d4f to 0x2f2673 (0x61e6db bytes) 000244[0] 1776188619.262619 mapwrite 0x15e000 thru 0x16b7f3 (0xd7f4 bytes) 000245[0] 1776188619.401112 mapread 0x19e000 thru 0x1ab064 (0xd065 bytes) 000247[1] 1776188619.500940 read_OD 0x064000 thru 0x06dfff (0xa000 bytes) 000250[0] 1776188619.536759 trunc from 0x2f2674 to 0x9cd3e4 (0x6dad71 bytes) 000252[0] 1776188619.623187 mapread 0x826000 thru 0x834f16 (0xef17 bytes) 000254[0] 1776188619.763302 trunc from 0x9cd3e5 to 0x96fcde (0x5d706 bytes) 000255[0] 1776188619.805275 mapwrite 0x9bb000 thru 0x9c00c1 (0x50c2 bytes) 000257[1] 1776188619.959969 trunc from 0x9c00c2 to 0x616ead (0x3a9214 bytes) 000258[1] 1776188619.993134 mapwrite 0x693000 thru 0x69d6c6 (0xa6c7 bytes) 000260[1] 1776188620.195465 mapread 0x32b000 thru 0x33a245 (0xf246 bytes) 000261[0] 1776188620.243255 write 0x2ad000 thru 0x2b3db1 (0x6db2 bytes) 000263[0] 1776188620.320944 mapread 0x3ae000 thru 0x3b9e21 (0xbe22 bytes) 000265[0] 1776188620.413510 write 0x136000 thru 0x141e9d (0xbe9e bytes) 000266[0] 1776188620.422040 mapread 0x688000 thru 0x6953f5 (0xd3f6 bytes) 000270[0] 1776188620.571440 trunc from 0x69d6c7 to 0x7f393d (0x156277 bytes) 000272[0] 1776188620.618645 write 0x159000 thru 0x166d86 (0xdd87 bytes) 000273[0] 1776188620.641650 trunc from 0x7f393e to 0x2f78bc (0x4fc081 bytes) 000276[0] 1776188620.699939 mapwrite 0x0bc000 thru 0x0cb4c0 (0xf4c1 bytes) 000277[0] 1776188620.962267 write 0x534000 thru 0x5340ab (0xac bytes) 000279[1] 1776188620.977312 write_OD 0x969000 thru 0x974fff (0xc000 bytes) 000281[0] 1776188621.073598 mapwrite 0x301000 thru 0x30240b (0x140c bytes) 000283[1] 1776188621.199654 mapread 0x245000 thru 0x24653e (0x153f bytes) 000288[0] 1776188621.242562 read 0x1ca000 thru 0x1d81ca (0xe1cb bytes) 000289[1] 1776188621.312993 trunc from 0x975000 to 0x5673bd (0x40dc42 bytes) 000291[1] 1776188621.410407 mapwrite 0x139000 thru 0x13ebaf (0x5bb0 bytes) 000292[1] 1776188621.528791 mapread 0x06b000 thru 0x06f55d (0x455e bytes) 000294[0] 1776188621.599410 mapread 0x4c9000 thru 0x4cf753 (0x6754 bytes) 000295[1] 1776188621.702414 mapwrite 0x932000 thru 0x93d379 (0xb37a bytes) 000296[0] 1776188621.982554 mapread 0x717000 thru 0x7256a5 (0xe6a6 bytes) 000298[0] 1776188622.128572 trunc from 0x93d37a to 0x6694e6 (0x2d3e93 bytes) 000300[0] 1776188622.212291 mapread 0x328000 thru 0x32b43e (0x343f bytes) 000301[1] 1776188622.253015 mapwrite 0x8fa000 thru 0x90424a (0xa24b bytes) 000304[0] 1776188622.422539 read 0x26b000 thru 0x27926c (0xe26d bytes) 000305[0] 1776188622.529580 mapwrite 0x4f2000 thru 0x4fba57 (0x9a58 bytes) 000308[0] 1776188622.849792 mapwrite 0x916000 thru 0x917a0c (0x1a0d bytes) 000310[1] 1776188622.995406 mapread 0x137000 thru 0x13c75a (0x575b bytes) 000312[1] 1776188623.085462 mapread 0x324000 thru 0x327e5f (0x3e60 bytes) 000314[0] 1776188623.105576 write 0x3b1000 thru 0x3b2d03 (0x1d04 bytes) 000315[1] 1776188623.126305 mapwrite 0x86c000 thru 0x874f07 (0x8f08 bytes) 000316[1] 1776188623.290096 trunc from 0x917a0d to 0x6c0d1a (0x256cf2 bytes) 000317[0] 1776188623.318025 mapwrite 0x3c6000 thru 0x3cda49 (0x7a4a bytes) 000318[1] 1776188623.491130 read_OD 0x40d000 thru 0x416fff (0xa000 bytes) 000326[1] 1776188623.535288 mapread 0x38d000 thru 0x3970d9 (0xa0da bytes) 000328[0] 1776188623.669055 trunc from 0x6c0d1b to 0x473158 (0x24dbc2 bytes) 000330[0] 1776188623.734411 trunc from 0x473159 to 0x5d0528 (0x15d3d0 bytes) 000333[1] 1776188623.829732 mapread 0x4fe000 thru 0x5039e5 (0x59e6 bytes) 000334[0] 1776188623.915289 trunc from 0x5d0529 to 0x4a4479 (0x12c0af bytes) 000335[0] 1776188623.967979 trunc from 0x4a447a to 0x906ea5 (0x462a2c bytes) 000336[0] 1776188624.064312 trunc from 0x906ea6 to 0x0e88cf (0x81e5d6 bytes) 000337[1] 1776188624.112408 trunc from 0x0e88d0 to 0x6b9e35 (0x5d1566 bytes) 000338[0] 1776188624.139154 write 0x1dd000 thru 0x1eb3a7 (0xe3a8 bytes) 000339[0] 1776188624.162424 mapwrite 0x442000 thru 0x4492a9 (0x72aa bytes) 000342[0] 1776188624.268301 write 0x347000 thru 0x349a85 (0x2a86 bytes) 000344[1] 1776188624.273612 mapwrite 0x8d3000 thru 0x8d76bf (0x46c0 bytes) 000346[1] 1776188624.430255 mapread 0x0c1000 thru 0x0cacf0 (0x9cf1 bytes) 000348[1] 1776188624.490136 read_OD 0x2db000 thru 0x2e8fff (0xe000 bytes) 000349[0] 1776188624.514071 mapread 0x107000 thru 0x1136f3 (0xc6f4 bytes) 000351[0] 1776188624.581974 trunc from 0x8d76c0 to 0x56ab53 (0x36cb6c bytes) 000352[0] 1776188624.625303 mapread 0x201000 thru 0x20310a (0x210b bytes) 000360[0] 1776188624.778963 mapread 0x4aa000 thru 0x4b47a5 (0xa7a6 bytes) 000362[0] 1776188624.860995 trunc from 0x56ab54 to 0x8be6a4 (0x353b51 bytes) 000363[0] 1776188624.887139 read 0x78d000 thru 0x797105 (0xa106 bytes) 000365[0] 1776188624.950273 write 0x669000 thru 0x66fb76 (0x6b77 bytes) 000368[0] 1776188624.960749 write 0x6cf000 thru 0x6d0bab (0x1bac bytes) 000369[1] 1776188624.978377 write_OD 0x53e000 thru 0x546fff (0x9000 bytes) 000373[0] 1776188625.067254 mapwrite 0x904000 thru 0x90cc26 (0x8c27 bytes) 000374[0] 1776188625.250158 write 0x50f000 thru 0x5107e8 (0x17e9 bytes) 000377[0] 1776188625.362281 trunc from 0x90cc27 to 0x479ab8 (0x49316e bytes) 000378[0] 1776188625.436021 trunc from 0x479ab9 to 0x29631f (0x1e3799 bytes) 000379[1] 1776188625.458231 trunc from 0x296320 to 0x1ffb46 (0x967d9 bytes) 000382[1] 1776188625.534824 write_OD 0x97b000 thru 0x97efff (0x4000 bytes) 000384[1] 1776188625.651495 write_OD 0x4ad000 thru 0x4b9fff (0xd000 bytes) 000385[0] 1776188625.710365 mapread 0x3a8000 thru 0x3abcd3 (0x3cd4 bytes) 000388[0] 1776188625.749169 mapwrite 0x29e000 thru 0x2a241d (0x441e bytes) 000392[1] 1776188625.908044 mapwrite 0x9e8000 thru 0x9f31e6 (0xb1e7 bytes) 000395[0] 1776188626.319133 mapread 0x4c5000 thru 0x4c74c3 (0x24c4 bytes) 000396[1] 1776188626.411258 read_OD 0x607000 thru 0x60dfff (0x7000 bytes) 000397[1] 1776188626.419906 mapread 0x324000 thru 0x3280cd (0x40ce bytes) 000402[0] 1776188626.524277 write 0x675000 thru 0x67f7ba (0xa7bb bytes) 000405[1] 1776188626.606727 mapwrite 0x356000 thru 0x35b6a6 (0x56a7 bytes) 000406[1] 1776188626.737756 write_OD 0x2b1000 thru 0x2bafff (0xa000 bytes) 000407[1] 1776188626.841435 mapread 0x992000 thru 0x9a0414 (0xe415 bytes) 000409[0] 1776188626.906158 trunc from 0x9f31e7 to 0x37081f (0x6829c7 bytes) 000413[1] 1776188627.004036 trunc from 0x370820 to 0x3da99c (0x6a17d bytes) 000414[1] 1776188627.057316 read_OD 0x2ca000 thru 0x2cdfff (0x4000 bytes) 000416[1] 1776188627.076429 mapread 0x360000 thru 0x36255b (0x255c bytes) 000419[1] 1776188627.132192 mapread 0x042000 thru 0x04e8c7 (0xc8c8 bytes) 000420[1] 1776188627.191130 read_OD 0x0fb000 thru 0x103fff (0x9000 bytes) 000421[0] 1776188627.198059 mapread 0x1c6000 thru 0x1c67d8 (0x7d9 bytes) 000423[1] 1776188627.207850 mapwrite 0x012000 thru 0x01f0eb (0xd0ec bytes) 000425[1] 1776188627.441988 trunc from 0x3da99d to 0x0433d2 (0x3975ca bytes) 000426[0] 1776188627.468089 write 0x5b7000 thru 0x5b7fa3 (0xfa4 bytes) 000427[1] 1776188627.498536 write_OD 0x7c7000 thru 0x7d3fff (0xd000 bytes) 000428[0] 1776188627.556546 read 0x40a000 thru 0x40a9ef (0x9f0 bytes) 000429[1] 1776188627.605102 trunc from 0x7d4000 to 0x91767c (0x14367d bytes) 000430[0] 1776188627.718207 write 0x730000 thru 0x73cd57 (0xcd58 bytes) 000436[0] 1776188627.837241 write 0x00f000 thru 0x01e2d1 (0xf2d2 bytes) 000437[1] 1776188627.843829 mapread 0x618000 thru 0x626918 (0xe919 bytes) 000439[0] 1776188627.980070 write 0x016000 thru 0x021977 (0xb978 bytes) 000441[0] 1776188628.038141 mapread 0x475000 thru 0x475e46 (0xe47 bytes) 000443[0] 1776188628.049141 mapwrite 0x3e2000 thru 0x3e2bd4 (0xbd5 bytes) 000446[1] 1776188628.203821 write_OD 0x555000 thru 0x55cfff (0x8000 bytes) 000447[1] 1776188628.275567 trunc from 0x91767d to 0x6e18ff (0x235d7d bytes) 000449[0] 1776188628.362763 write 0x5a4000 thru 0x5a9a7a (0x5a7b bytes) 000454[0] 1776188628.453757 write 0x249000 thru 0x24ecba (0x5cbb bytes) 000458[1] 1776188628.483952 trunc from 0x6e1900 to 0x01b043 (0x6c68bc bytes) 000459[0] 1776188628.563747 mapread 0x004000 thru 0x00c645 (0x8646 bytes) 000460[0] 1776188628.675894 mapread 0x011000 thru 0x01ad0f (0x9d10 bytes) 000463[1] 1776188628.724324 mapwrite 0x9ba000 thru 0x9c3fd3 (0x9fd4 bytes) 000464[1] 1776188628.913665 mapread 0x74a000 thru 0x753384 (0x9385 bytes) 000465[0] 1776188628.998938 mapread 0x341000 thru 0x3496c3 (0x86c4 bytes) 000466[0] 1776188629.124986 read 0x0eb000 thru 0x0f361c (0x861d bytes) 000468[0] 1776188629.254063 mapwrite 0x9ce000 thru 0x9d32bd (0x52be bytes) 000470[1] 1776188629.411358 mapread 0x874000 thru 0x876298 (0x2299 bytes) 000472[1] 1776188629.513068 mapwrite 0x73a000 thru 0x744ab3 (0xaab4 bytes) 000474[1] 1776188629.727933 read_OD 0x342000 thru 0x343fff (0x2000 bytes) 000475[1] 1776188629.742044 read_OD 0x317000 thru 0x318fff (0x2000 bytes) 000481[1] 1776188629.751597 read_OD 0x4aa000 thru 0x4b4fff (0xb000 bytes) 000482[1] 1776188629.762834 trunc from 0x9d32be to 0x2cbce4 (0x7075d9 bytes) 000484[0] 1776188629.805189 trunc from 0x2cbce5 to 0x372cc2 (0xa6fde bytes) 000485[1] 1776188629.837400 mapread 0x2e4000 thru 0x2eb703 (0x7704 bytes) 000486[1] 1776188629.895463 mapread 0x066000 thru 0x06dd5e (0x7d5f bytes) 000487[0] 1776188629.936390 mapwrite 0x8d5000 thru 0x8dda60 (0x8a61 bytes) 000489[0] 1776188630.155610 trunc from 0x8dda61 to 0x1b5e66 (0x727bfa bytes) 000490[0] 1776188630.182209 mapwrite 0x147000 thru 0x14f69e (0x869f bytes) 000492[0] 1776188630.331626 trunc from 0x1b5e67 to 0x3f26b5 (0x23c84f bytes) 000494[0] 1776188630.368926 mapread 0x276000 thru 0x28373c (0xd73d bytes) 000496[0] 1776188630.451526 write 0x3ee000 thru 0x3fd532 (0xf533 bytes) 000500[0] 1776188630.521374 mapwrite 0x735000 thru 0x73ee3d (0x9e3e bytes) All operations completed A-OK! PASS 16a (52s) == sanityn test 16b: 500 iterations of dual-mount fsx at small size ========================================================== 13:43:55 (1776188635) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.327777 s, 6.4 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.295665 s, 7.1 MB/s Chance of close/open is 1 in 50 Seed set to 8637 fd 0: /mnt/lustre/f16b.sanityn fd 1: /mnt/lustre2/f16b.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000003[0] 1776188637.927271 mapwrite 0x827a94 thru 0x82847d (0x9ea bytes) 000005[1] 1776188638.108231 read 0x3ff725 thru 0x40026e (0xb4a bytes) 000007[1] 1776188638.158938 read 0x3733d3 thru 0x3736cb (0x2f9 bytes) 000008[1] 1776188638.225007 mapwrite 0x1f58cb thru 0x1f5d6b (0x4a1 bytes) 000009[0] 1776188638.303260 write 0x900046 thru 0x90045c (0x417 bytes) 000010[1] 1776188638.332887 mapread 0x23bd69 thru 0x23dcd9 (0x1f71 bytes) 000013[0] 1776188638.401650 write 0x90efd3 thru 0x910af9 (0x1b27 bytes) 000014[1] 1776188638.402536 mapread 0x388251 thru 0x38a021 (0x1dd1 bytes) 000018[1] 1776188638.467965 read 0x63df2c thru 0x63f493 (0x1568 bytes) 000020[1] 1776188638.471881 write 0x5db3c9 thru 0x5db9ab (0x5e3 bytes) 000021[1] 1776188638.539443 read 0x527159 thru 0x52780f (0x6b7 bytes) 000024[0] 1776188638.626045 read 0x886302 thru 0x886cfe (0x9fd bytes) 000026[1] 1776188638.675443 mapwrite 0x3b8452 thru 0x3b8657 (0x206 bytes) 000028[1] 1776188638.732192 mapread 0x10eab5 thru 0x1102ab (0x17f7 bytes) truncating to largest ever: 0x49bfcd 000030[0] 1776188638.761824 trunc from 0x910afa to 0x49bfcc (0x474b2d bytes) 000031[1] 1776188638.835106 trunc from 0x49bfcd to 0x10f614 (0x38c9b8 bytes) 000032[1] 1776188638.907079 mapread 0x0c4a64 thru 0x0c5a2b (0xfc8 bytes) 000033[0] 1776188638.919670 mapread 0x0e9859 thru 0x0e9e56 (0x5fe bytes) truncating to largest ever: 0x6c6317 000035[1] 1776188638.986702 trunc from 0x10f615 to 0x6c6316 (0x5b6d02 bytes) truncating to largest ever: 0x82e307 000036[0] 1776188639.029992 trunc from 0x6c6317 to 0x82e306 (0x167ff0 bytes) 000037[1] 1776188639.076102 mapwrite 0x077d02 thru 0x078e5c (0x115b bytes) 000041[0] 1776188639.259275 mapwrite 0x1c4145 thru 0x1c4854 (0x710 bytes) 000042[0] 1776188639.335134 mapwrite 0x08100a thru 0x082c18 (0x1c0f bytes) 000043[1] 1776188639.431270 mapread 0x266d98 thru 0x268ac1 (0x1d2a bytes) 000046[0] 1776188639.507724 mapwrite 0x61cd67 thru 0x61d36e (0x608 bytes) 000049[0] 1776188639.611762 write 0x54a4d5 thru 0x54b722 (0x124e bytes) 000050[1] 1776188639.627122 mapwrite 0x5c3661 thru 0x5c3fd1 (0x971 bytes) 000052[1] 1776188639.736692 mapwrite 0x325c51 thru 0x327846 (0x1bf6 bytes) 000053[0] 1776188639.807666 mapwrite 0x1476a8 thru 0x148abe (0x1417 bytes) 000054[1] 1776188639.875759 mapread 0x663817 thru 0x664fde (0x17c8 bytes) 000059[0] 1776188639.953582 mapwrite 0x66c669 thru 0x66d972 (0x130a bytes) truncating to largest ever: 0x9a2712 000060[1] 1776188640.076842 trunc from 0x82e307 to 0x9a2711 (0x17440b bytes) 000061[1] 1776188640.157869 mapread 0x3d035a thru 0x3d1bb2 (0x1859 bytes) 000062[0] 1776188640.213628 mapread 0x90a0db thru 0x90af46 (0xe6c bytes) 000064[1] 1776188640.280872 mapread 0x690510 thru 0x6910c7 (0xbb8 bytes) 000065[1] 1776188640.322685 trunc from 0x9a2712 to 0x3dc475 (0x5c629c bytes) 000066[0] 1776188640.408007 mapwrite 0x542c2b thru 0x5445ba (0x1990 bytes) 000067[1] 1776188640.548628 read 0x499bf0 thru 0x49a357 (0x768 bytes) 000068[0] 1776188640.577127 mapread 0x46aa20 thru 0x46ae74 (0x455 bytes) 000070[1] 1776188640.617516 trunc from 0x5445bb to 0x13b6bc (0x408efe bytes) 000071[0] 1776188640.676956 trunc from 0x13b6bd to 0x5a5643 (0x469f87 bytes) 000072[0] 1776188640.749973 write 0x0d7ac4 thru 0x0d8983 (0xec0 bytes) 000073[1] 1776188640.764536 read 0x459fb5 thru 0x45b3ce (0x141a bytes) 000074[1] 1776188640.813569 trunc from 0x5a5644 to 0x08d1bf (0x518484 bytes) 000075[1] 1776188640.928996 write 0x2d4f0c thru 0x2d5bb9 (0xcae bytes) 000076[1] 1776188640.951449 write 0x2a599e thru 0x2a739f (0x1a02 bytes) 000077[1] 1776188640.974459 mapwrite 0x8effc7 thru 0x8f0af2 (0xb2c bytes) 000078[1] 1776188641.166319 write 0x35eede thru 0x360aa8 (0x1bcb bytes) 000080[0] 1776188641.214965 mapwrite 0x02874d thru 0x0294a4 (0xd58 bytes) 000084[1] 1776188641.418607 write 0x213c6e thru 0x21562d (0x19c0 bytes) 000085[0] 1776188641.464747 write 0x3fe74d thru 0x3fee06 (0x6ba bytes) 000088[1] 1776188641.550751 trunc from 0x8f0af3 to 0x749c1f (0x1a6ed3 bytes) 000089[0] 1776188641.588673 mapread 0x33be17 thru 0x33c276 (0x460 bytes) 000091[1] 1776188641.679003 mapwrite 0x1e3876 thru 0x1e3a9c (0x227 bytes) 000094[1] 1776188641.820619 read 0x3edd7e thru 0x3ee103 (0x386 bytes) 000097[0] 1776188641.896922 mapread 0x71a89d thru 0x71abb8 (0x31c bytes) 000099[0] 1776188641.947163 mapwrite 0x4ba57a thru 0x4bc556 (0x1fdd bytes) 000100[0] 1776188642.039274 mapread 0x013a81 thru 0x01574a (0x1cca bytes) 000103[0] 1776188642.116827 read 0x09f836 thru 0x0a136e (0x1b39 bytes) 000104[0] 1776188642.189272 trunc from 0x749c20 to 0x74c01a (0x23fb bytes) 000105[0] 1776188642.235242 mapread 0x2121eb thru 0x212fd4 (0xdea bytes) 000107[1] 1776188642.263441 mapread 0x3c769c thru 0x3c917d (0x1ae2 bytes) 000111[0] 1776188642.357150 mapwrite 0x4eee05 thru 0x4efe8a (0x1086 bytes) 000113[0] 1776188642.426607 mapwrite 0x9d5a91 thru 0x9d6561 (0xad1 bytes) 000114[1] 1776188642.556903 trunc from 0x9d6562 to 0x3c3f1e (0x612643 bytes) 000115[1] 1776188642.615961 write 0x683a07 thru 0x683da0 (0x39a bytes) 000116[1] 1776188642.621393 write 0x2cbba8 thru 0x2cd777 (0x1bd0 bytes) 000120[0] 1776188642.638187 mapwrite 0x4bdcf1 thru 0x4be540 (0x850 bytes) 000125[1] 1776188642.865048 read 0x557cda thru 0x5581ef (0x516 bytes) 000129[0] 1776188642.982773 read 0x5cec7d thru 0x5ceee0 (0x264 bytes) 000135[1] 1776188643.051011 read 0x13d007 thru 0x13ed8e (0x1d88 bytes) 000136[0] 1776188643.086084 trunc from 0x683da1 to 0x9289dd (0x2a4c3d bytes) 000137[0] 1776188643.140377 read 0x0a4055 thru 0x0a541e (0x13ca bytes) 000142[0] 1776188643.298156 read 0x8eeb7a thru 0x8eeff3 (0x47a bytes) 000147[1] 1776188643.316080 mapread 0x4da96b thru 0x4db538 (0xbce bytes) 000149[0] 1776188643.421713 write 0x818a86 thru 0x81a960 (0x1edb bytes) 000152[0] 1776188643.482245 write 0x2143de thru 0x215de9 (0x1a0c bytes) 000154[1] 1776188643.510798 mapread 0x358a7e thru 0x358c75 (0x1f8 bytes) 000155[0] 1776188643.576283 write 0x27d9ff thru 0x27f007 (0x1609 bytes) 000158[1] 1776188643.601902 mapread 0x59b042 thru 0x59bb56 (0xb15 bytes) 000161[1] 1776188643.670816 mapread 0x6af7eb thru 0x6affbe (0x7d4 bytes) 000162[1] 1776188643.796978 trunc from 0x9289de to 0x3747ab (0x5b4232 bytes) 000163[0] 1776188643.893304 read 0x203cc8 thru 0x2047c0 (0xaf9 bytes) 000165[1] 1776188643.964038 read 0x1b4ba2 thru 0x1b64fc (0x195b bytes) 000166[1] 1776188644.014844 read 0x2eef33 thru 0x2f0ecf (0x1f9d bytes) 000167[1] 1776188644.032684 mapwrite 0x604b9e thru 0x605ac9 (0xf2c bytes) 000168[1] 1776188644.135755 read 0x0173a8 thru 0x018f23 (0x1b7c bytes) 000172[1] 1776188644.266782 read 0x232314 thru 0x233901 (0x15ee bytes) 000176[1] 1776188644.294289 read 0x1c1cbb thru 0x1c2732 (0xa78 bytes) 000180[0] 1776188644.349756 write 0x2ab3c9 thru 0x2ad19c (0x1dd4 bytes) 000182[1] 1776188644.398302 trunc from 0x605aca to 0x14e5f4 (0x4b74d5 bytes) 000183[0] 1776188644.446085 trunc from 0x14e5f5 to 0x101cf9 (0x4c8fb bytes) 000184[1] 1776188644.518207 trunc from 0x101cfa to 0x03acda (0xc701f bytes) 000185[0] 1776188644.553792 mapwrite 0x4a8164 thru 0x4a9de6 (0x1c83 bytes) 000186[1] 1776188644.711607 write 0x03b3c0 thru 0x03c4b2 (0x10f3 bytes) 000190[1] 1776188644.836131 mapread 0x4a825e thru 0x4a9de6 (0x1b89 bytes) 000191[1] 1776188644.899459 trunc from 0x4a9de7 to 0x75baee (0x2b1d08 bytes) 000198[1] 1776188645.023278 write 0x234557 thru 0x235532 (0xfdc bytes) 000199[0] 1776188645.044685 mapread 0x073e8a thru 0x07497a (0xaf1 bytes) 000202[1] 1776188645.109460 mapwrite 0x476c1b thru 0x478b39 (0x1f1f bytes) 000203[1] 1776188645.194527 mapread 0x3901bb thru 0x39163a (0x1480 bytes) 000205[0] 1776188645.214999 mapread 0x36337c thru 0x3641d1 (0xe56 bytes) 000209[1] 1776188645.296588 mapread 0x5728bf thru 0x57445b (0x1b9d bytes) 000210[0] 1776188645.339309 write 0x648879 thru 0x6490dc (0x864 bytes) 000212[1] 1776188645.365803 mapread 0x0171a4 thru 0x017651 (0x4ae bytes) 000213[1] 1776188645.398434 mapread 0x443bef thru 0x44599d (0x1daf bytes) 000214[0] 1776188645.420908 mapwrite 0x6fa633 thru 0x6fb910 (0x12de bytes) 000218[0] 1776188645.535071 read 0x17cbc5 thru 0x17ced4 (0x310 bytes) 000219[1] 1776188645.608682 read 0x2c10c9 thru 0x2c14ff (0x437 bytes) 000220[0] 1776188645.689975 read 0x636aeb thru 0x638413 (0x1929 bytes) 000221[1] 1776188645.717904 mapwrite 0x7665a7 thru 0x7679b6 (0x1410 bytes) 000223[0] 1776188645.886687 mapwrite 0x0a09a4 thru 0x0a1541 (0xb9e bytes) 000224[0] 1776188646.006415 trunc from 0x7679b7 to 0x685989 (0xe202d bytes) 000226[0] 1776188646.081103 trunc from 0x68598a to 0x70b311 (0x85988 bytes) 000230[0] 1776188646.171039 mapread 0x08e21e thru 0x08f01e (0xe01 bytes) 000231[0] 1776188646.182856 mapwrite 0x8f5070 thru 0x8f64c7 (0x1458 bytes) 000232[1] 1776188646.288130 mapwrite 0x80a923 thru 0x80bb4a (0x1228 bytes) 000233[0] 1776188646.381561 write 0x5a8193 thru 0x5a944c (0x12ba bytes) 000234[1] 1776188646.407487 read 0x8a9e87 thru 0x8aa4d0 (0x64a bytes) 000236[1] 1776188646.467177 read 0x753871 thru 0x754720 (0xeb0 bytes) 000237[1] 1776188646.526516 write 0x02602d thru 0x0269ca (0x99e bytes) 000240[0] 1776188646.551179 mapread 0x324514 thru 0x324fa7 (0xa94 bytes) 000242[0] 1776188646.564767 read 0x353766 thru 0x354581 (0xe1c bytes) 000243[0] 1776188646.581168 mapread 0x479d92 thru 0x47a459 (0x6c8 bytes) truncating to largest ever: 0x9a95ab 000244[1] 1776188646.734484 trunc from 0x8f64c8 to 0x9a95aa (0xb30e3 bytes) 000245[1] 1776188646.805057 mapwrite 0x1000dc thru 0x10055a (0x47f bytes) 000249[1] 1776188646.982656 write 0x38213a thru 0x383424 (0x12eb bytes) 000250[0] 1776188647.016312 mapwrite 0x9e747f thru 0x9e85f5 (0x1177 bytes) 000252[0] 1776188647.156106 mapread 0x5649e5 thru 0x5664c0 (0x1adc bytes) 000253[1] 1776188647.191648 read 0x611c9e thru 0x61368f (0x19f2 bytes) 000254[0] 1776188647.245077 mapread 0x5406ff thru 0x542310 (0x1c12 bytes) 000255[1] 1776188647.283056 read 0x5969b0 thru 0x598379 (0x19ca bytes) 000256[1] 1776188647.377084 mapwrite 0x030038 thru 0x0302fa (0x2c3 bytes) 000260[0] 1776188647.467920 mapread 0x8f4627 thru 0x8f616e (0x1b48 bytes) 000262[0] 1776188647.536264 mapwrite 0x1979d8 thru 0x197c72 (0x29b bytes) 000263[0] 1776188647.619706 trunc from 0x9e85f6 to 0x9627ed (0x85e08 bytes) 000265[0] 1776188647.694418 trunc from 0x9627ee to 0x10c474 (0x856379 bytes) 000267[1] 1776188647.717998 write 0x65ec6e thru 0x66081b (0x1bae bytes) 000269[1] 1776188647.771513 read 0x62e08d thru 0x62f2bb (0x122f bytes) 000270[1] 1776188647.801084 read 0x3f8534 thru 0x3f8fc3 (0xa90 bytes) 000272[1] 1776188647.886888 mapwrite 0x12f63a thru 0x1306e2 (0x10a9 bytes) 000273[0] 1776188648.031949 mapwrite 0x05ec9a thru 0x060184 (0x14eb bytes) 000275[0] 1776188648.180097 mapwrite 0x644438 thru 0x644567 (0x130 bytes) 000276[0] 1776188648.254911 mapwrite 0x8ec700 thru 0x8ecbb3 (0x4b4 bytes) 000279[0] 1776188648.475414 mapwrite 0x0886b1 thru 0x0894f2 (0xe42 bytes) 000280[1] 1776188648.541643 read 0x0e0ab2 thru 0x0e0ff5 (0x544 bytes) 000281[0] 1776188648.567827 write 0x8c6805 thru 0x8c6fb9 (0x7b5 bytes) 000282[0] 1776188648.606744 read 0x7811ea thru 0x782871 (0x1688 bytes) 000283[0] 1776188648.664875 trunc from 0x8ecbb4 to 0x999e4c (0xad299 bytes) 000284[1] 1776188648.688500 read 0x2eb2f3 thru 0x2ed20d (0x1f1b bytes) 000285[0] 1776188648.712717 read 0x58751a thru 0x587d22 (0x809 bytes) 000289[1] 1776188648.790649 mapread 0x8acb25 thru 0x8acf56 (0x432 bytes) 000291[0] 1776188648.844697 mapread 0x08ae18 thru 0x08b46b (0x654 bytes) 000292[1] 1776188648.869745 trunc from 0x999e4d to 0x22da28 (0x76c424 bytes) 000294[0] 1776188648.954094 trunc from 0x22da29 to 0x71bb56 (0x4ee12e bytes) 000295[0] 1776188649.050077 trunc from 0x71bb57 to 0x020ade (0x6fb078 bytes) 000297[1] 1776188649.123147 mapwrite 0x934d35 thru 0x935de1 (0x10ad bytes) 000299[0] 1776188649.423453 mapwrite 0x581341 thru 0x5832df (0x1f9f bytes) 000304[1] 1776188649.593079 mapwrite 0x2820e0 thru 0x282d99 (0xcba bytes) 000305[0] 1776188649.742096 write 0x0e611d thru 0x0e66cf (0x5b3 bytes) 000306[1] 1776188649.781059 mapwrite 0x66db41 thru 0x66e832 (0xcf2 bytes) 000309[0] 1776188649.938376 read 0x2905ac thru 0x29171a (0x116f bytes) 000310[0] 1776188650.074944 trunc from 0x935de2 to 0x0fc962 (0x83947f bytes) 000311[0] 1776188650.163757 write 0x2cc27b thru 0x2cde53 (0x1bd9 bytes) 000313[1] 1776188650.212284 write 0x7af4b4 thru 0x7b0bc9 (0x1716 bytes) 000316[1] 1776188650.264816 mapread 0x6e6935 thru 0x6e7f5e (0x162a bytes) 000318[0] 1776188650.319187 trunc from 0x7b0bca to 0x4de148 (0x2d2a81 bytes) 000319[0] 1776188650.414076 mapwrite 0x4e22f1 thru 0x4e24c1 (0x1d1 bytes) 000322[1] 1776188650.549233 mapread 0x461309 thru 0x4623f0 (0x10e8 bytes) 000323[0] 1776188650.590207 trunc from 0x4e24c2 to 0x3b4788 (0x12dd39 bytes) 000324[1] 1776188650.662123 read 0x24a19e thru 0x24b640 (0x14a3 bytes) 000326[1] 1776188650.706820 mapread 0x3a6d12 thru 0x3a89bb (0x1caa bytes) 000328[0] 1776188650.749995 trunc from 0x3b4789 to 0x928a60 (0x5742d8 bytes) 000335[1] 1776188650.888764 write 0x7c9d2b thru 0x7c9f71 (0x247 bytes) 000338[0] 1776188650.970935 mapread 0x3b6256 thru 0x3b6ea0 (0xc4b bytes) 000341[0] 1776188651.030130 mapread 0x5d6edf thru 0x5d8c88 (0x1daa bytes) 000343[1] 1776188651.065655 trunc from 0x928a61 to 0x94c9c4 (0x23f64 bytes) 000344[1] 1776188651.122855 read 0x10ead9 thru 0x10f1c9 (0x6f1 bytes) 000345[1] 1776188651.208660 write 0x826438 thru 0x82736f (0xf38 bytes) 000346[0] 1776188651.299975 write 0x4cada5 thru 0x4cbeb4 (0x1110 bytes) 000348[0] 1776188651.361124 read 0x0f1c21 thru 0x0f2124 (0x504 bytes) 000349[0] 1776188651.383970 write 0x5b9298 thru 0x5b955d (0x2c6 bytes) 000350[0] 1776188651.481890 write 0x5ca782 thru 0x5cc415 (0x1c94 bytes) 000351[0] 1776188651.530290 mapwrite 0x53ee82 thru 0x53f959 (0xad8 bytes) 000352[0] 1776188651.586161 write 0x8286f1 thru 0x828ef2 (0x802 bytes) 000353[0] 1776188651.606327 write 0x286a80 thru 0x2880e2 (0x1663 bytes) 000354[1] 1776188651.631126 mapwrite 0x67f0a4 thru 0x6807bd (0x171a bytes) 000355[1] 1776188651.719200 read 0x4772ac thru 0x477529 (0x27e bytes) 000357[1] 1776188651.754736 mapread 0x6cff8c thru 0x6d1474 (0x14e9 bytes) 000360[1] 1776188651.806652 write 0x91e411 thru 0x91fbd2 (0x17c2 bytes) 000362[0] 1776188651.883602 mapwrite 0x3b60e4 thru 0x3b72b7 (0x11d4 bytes) 000364[0] 1776188651.993436 trunc from 0x94c9c5 to 0x3f3ceb (0x558cd9 bytes) 000368[0] 1776188652.052409 write 0x56be15 thru 0x56be82 (0x6e bytes) 000369[0] 1776188652.054018 trunc from 0x56be83 to 0x4edd4f (0x7e133 bytes) 000370[1] 1776188652.069554 write 0x8a397e thru 0x8a3ee1 (0x564 bytes) 000371[0] 1776188652.095631 mapread 0x3c814f thru 0x3c94c7 (0x1379 bytes) 000372[1] 1776188652.145011 mapread 0x65bc95 thru 0x65dbd6 (0x1f42 bytes) 000374[1] 1776188652.219003 write 0x43886a thru 0x4395c2 (0xd59 bytes) 000375[0] 1776188652.244270 write 0x279a06 thru 0x27abe4 (0x11df bytes) 000377[0] 1776188652.280378 read 0x3360fb thru 0x337ec0 (0x1dc6 bytes) 000378[0] 1776188652.392258 read 0x2d8949 thru 0x2d9358 (0xa10 bytes) 000380[0] 1776188652.423817 trunc from 0x8a3ee2 to 0x67f9e3 (0x2244fe bytes) 000382[1] 1776188652.480096 write 0x3a1de8 thru 0x3a3b00 (0x1d19 bytes) 000386[1] 1776188652.599884 write 0x68ee40 thru 0x68efac (0x16d bytes) 000389[1] 1776188652.622381 write 0x9da944 thru 0x9dae72 (0x52f bytes) 000390[1] 1776188652.625095 mapwrite 0x20899f thru 0x2099c0 (0x1022 bytes) 000391[1] 1776188652.726843 write 0x6fdc1a thru 0x6fe1e1 (0x5c8 bytes) 000392[1] 1776188652.747804 mapread 0x18ef8e thru 0x18f4c2 (0x535 bytes) 000393[1] 1776188652.760876 trunc from 0x9dae73 to 0x927af4 (0xb337e bytes) 000395[1] 1776188652.843989 read 0x3bf78c thru 0x3c1594 (0x1e09 bytes) 000396[0] 1776188652.967614 mapwrite 0x659fd6 thru 0x65be59 (0x1e84 bytes) 000397[1] 1776188653.092027 mapread 0x01bba1 thru 0x01d866 (0x1cc6 bytes) 000398[0] 1776188653.154675 mapwrite 0x0265c9 thru 0x026bc8 (0x600 bytes) 000400[1] 1776188653.258023 write 0x904267 thru 0x904db8 (0xb52 bytes) 000401[1] 1776188653.279753 write 0x19705e thru 0x19880f (0x17b2 bytes) 000402[1] 1776188653.303383 mapwrite 0x9dcde5 thru 0x9de7ab (0x19c7 bytes) 000404[0] 1776188653.428558 mapread 0x0be988 thru 0x0bff50 (0x15c9 bytes) 000406[0] 1776188653.464808 write 0x9cd004 thru 0x9cec9c (0x1c99 bytes) 000407[0] 1776188653.516141 trunc from 0x9de7ac to 0x8b80f1 (0x1266ba bytes) 000409[0] 1776188653.557672 mapwrite 0x4d9e39 thru 0x4da4b2 (0x67a bytes) 000411[0] 1776188653.732701 mapwrite 0x459265 thru 0x4593eb (0x187 bytes) 000412[1] 1776188653.795660 write 0x75c58d thru 0x75ddb0 (0x1824 bytes) 000413[1] 1776188653.825851 trunc from 0x8b80f2 to 0x31d807 (0x59a8ea bytes) 000415[0] 1776188653.931723 trunc from 0x31d808 to 0x010347 (0x30d4c0 bytes) 000416[1] 1776188653.961762 read 0x007095 thru 0x0077e8 (0x754 bytes) 000417[0] 1776188654.007813 trunc from 0x010348 to 0x016288 (0x5f41 bytes) 000418[1] 1776188654.041747 trunc from 0x016289 to 0x61cb4a (0x6068c2 bytes) 000419[1] 1776188654.098949 mapread 0x14f551 thru 0x15082d (0x12dd bytes) 000420[1] 1776188654.195909 trunc from 0x61cb4b to 0x822f61 (0x206417 bytes) 000422[1] 1776188654.216626 mapread 0x6a9a34 thru 0x6a9b10 (0xdd bytes) 000425[0] 1776188654.292432 read 0x0b64c6 thru 0x0b7035 (0xb70 bytes) 000426[0] 1776188654.347690 read 0x76ee22 thru 0x76ee89 (0x68 bytes) 000427[1] 1776188654.399067 write 0x370067 thru 0x3713e5 (0x137f bytes) 000431[1] 1776188654.445698 trunc from 0x822f62 to 0x553295 (0x2cfccc bytes) 000432[1] 1776188654.498410 mapwrite 0x9dc610 thru 0x9ddedb (0x18cc bytes) 000433[0] 1776188654.605967 trunc from 0x9ddedc to 0x2a78c2 (0x736619 bytes) 000434[0] 1776188654.638211 mapread 0x235a1b thru 0x2378c5 (0x1eab bytes) 000436[1] 1776188654.697066 mapwrite 0x32c378 thru 0x32d5b9 (0x1242 bytes) 000438[1] 1776188654.869847 write 0x4df7e0 thru 0x4e0961 (0x1182 bytes) 000439[0] 1776188654.873758 mapwrite 0x564e44 thru 0x566379 (0x1536 bytes) 000443[0] 1776188655.072940 write 0x719b7c thru 0x71b27f (0x1704 bytes) 000445[0] 1776188655.098514 mapread 0x0a19a8 thru 0x0a3512 (0x1b6b bytes) 000447[0] 1776188655.143203 trunc from 0x71b280 to 0x3c449b (0x356de4 bytes) 000448[1] 1776188655.192269 read 0x07a2f4 thru 0x07b306 (0x1013 bytes) 000450[0] 1776188655.250777 read 0x296f55 thru 0x2973d8 (0x484 bytes) 000451[1] 1776188655.272578 mapwrite 0x2b5fd1 thru 0x2b61eb (0x21b bytes) 000454[0] 1776188655.399697 write 0x979fce thru 0x97baf1 (0x1b24 bytes) 000455[1] 1776188655.430196 read 0x41081a thru 0x412356 (0x1b3d bytes) 000461[0] 1776188655.579568 mapread 0x51498e thru 0x51558e (0xc01 bytes) 000464[0] 1776188655.652703 write 0x0d9620 thru 0x0d9b63 (0x544 bytes) 000466[1] 1776188655.738618 trunc from 0x97baf2 to 0x51ae08 (0x460ce9 bytes) 000470[0] 1776188655.818865 mapwrite 0x177767 thru 0x177f69 (0x803 bytes) 000471[0] 1776188655.912057 read 0x508c9e thru 0x50a8a1 (0x1c04 bytes) 000473[0] 1776188655.965051 trunc from 0x51ae09 to 0x341f11 (0x1d8ef7 bytes) 000474[0] 1776188656.017154 mapwrite 0x4e73e6 thru 0x4e765a (0x275 bytes) 000476[0] 1776188656.106825 mapread 0x376b36 thru 0x378414 (0x18df bytes) 000480[0] 1776188656.194857 mapread 0x1fa9a6 thru 0x1fbaef (0x114a bytes) 000482[1] 1776188656.258720 write 0x5d8a61 thru 0x5d93fc (0x99c bytes) 000483[1] 1776188656.293245 mapread 0x1d97a5 thru 0x1dafcf (0x182b bytes) 000485[1] 1776188656.348731 write 0x870a1a thru 0x871487 (0xa6e bytes) 000486[1] 1776188656.371639 write 0x54cc22 thru 0x54ce40 (0x21f bytes) 000487[0] 1776188656.433322 mapread 0x83983f thru 0x83aed8 (0x169a bytes) 000490[1] 1776188656.528671 mapread 0x6c0ba5 thru 0x6c1fe8 (0x1444 bytes) 000492[1] 1776188656.576384 write 0x3fdefe thru 0x3ffceb (0x1dee bytes) 000493[1] 1776188656.614847 mapwrite 0x27232d thru 0x273c6b (0x193f bytes) 000495[1] 1776188656.745785 read 0x560ad3 thru 0x561622 (0xb50 bytes) 000497[1] 1776188656.821263 write 0x9f0526 thru 0x9f23fa (0x1ed5 bytes) 000498[1] 1776188656.869229 read 0x5285b7 thru 0x52a1f1 (0x1c3b bytes) 000499[0] 1776188656.869997 trunc from 0x9f23fb to 0x23a6d1 (0x7b7d29 bytes) 000500[0] 1776188656.993069 mapread 0x098989 thru 0x09900d (0x685 bytes) All operations completed A-OK! PASS 16b (26s) == sanityn test 16c: verify data consistency on ldiskfs with cache disabled (b=17397) ========================================================== 13:44:21 (1776188661) SKIP: sanityn test_16c dio on ldiskfs only SKIP 16c (3s) == sanityn test 16d: Verify DIO and buffer IO with two clients ========================================================== 13:44:24 (1776188664) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.305685 s, 6.9 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.207936 s, 10.1 MB/s ldlm.namespaces.MGC192.168.203.147@tcp.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff888198860800.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8881996ba800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff888198860800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8881996ba800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff888198860800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8881996ba800.lru_size=clear 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.5361 s, 11.0 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 2.51383 s, 41.7 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 1.70465 s, 61.5 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 3.83059 s, 27.4 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 6.73994 s, 15.6 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 2.7811 s, 37.7 MB/s PASS 16d (37s) == sanityn test 16e: Verify size consistency for O_DIRECT write ========================================================== 13:45:01 (1776188701) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.156178 s, 67.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0709632 s, 14.8 MB/s PASS 16e (4s) == sanityn test 16f: rw sequential consistency vs drop_caches ========================================================== 13:45:05 (1776188705) TIMEOUT PASS 16f (26s) == sanityn test 16g: mmap rw sequential consistency vs drop_caches ========================================================== 13:45:31 (1776188731) TIMEOUT PASS 16g (26s) == sanityn test 16i: read after truncate file ============ 13:45:57 (1776188757) ------- before truncate -------- 0002700 6e65 7265 7461 726f 4420 6561 6f6d 3a6e 0002720 762f 7261 6c2f 6269 722f 676e 3a64 732f 0002740 6962 2f6e 6f6e 6f6c 6967 0a6e 0002754 ------- after truncate -------- 0001320 746e 7520 6573 2064 7962 7420 6568 7420 0001340 6f72 7375 7265 2073 6170 6b63 6761 2065 0001360 6f74 7320 6e61 0001366 PASS 16i (5s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 13:46:03 (1776188763) fail_loc=0x8000030a PASS 17 (9s) == sanityn test 18: mmap sanity check =========================================================================================== 13:46:11 (1776188771) mmap test1: basic mmap operation (PASS, 0.1044s) mmap test2: MAP_PRIVATE not write back (PASS, 0.062315s) mmap test3: concurrent mmap ops on two nodes (PASS, 12.972s) mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 2.3379s) mmap test5: read/write file to/from the buffer which mmapped to just this file (PASS, 0.10116s) mmap test6: check mmap write/read content on two nodes (PASS, 0.13377s) mmap test7: file i/o with an unmapped buffer (SKIPPED, 0s) mmap test8: SIGBUS for beyond file size (SKIPPED, 0s) mmap test9: SIGBUS for negative file offset (SKIPPED, 0s) mmap test10: mtime not change for readonly mmap access (PASS, 1.0745s) PASS 18 (23s) == sanityn test 19: test concurrent uncached read races ========================================================================= 13:46:34 (1776188794) oleg347-server: error: get_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory pdsh@oleg347-client: oleg347-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (5s) == sanityn test 20: test extra readahead page left in cache ============================================================== 13:46:39 (1776188799) PASS 20 (6s) == sanityn test 21: Try to remove mountpoint on another dir ============================================================== 13:46:45 (1776188805) rmdir: removing directory, '/mnt/lustre/d21.sanityn' rmdir: failed to remove '/mnt/lustre/d21.sanityn': Device or resource busy rmdir: removing directory, '/mnt/lustre2/d21.sanityn' Removed mounted directory from another mountpoint, needs to be fixed PASS 21 (6s) == sanityn test 23: others should see updated atime while another read============================================================== 13:46:51 (1776188811) now is 1776188813 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.7160 new atime is 1776188874 PASS 23 (68s) == sanityn test 24a: lfs df [-ih] [path] test =================================================================================== 13:47:59 (1776188879) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.5K 368 488.1K 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 115.3K 375 114.9K 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 115.3K 373 114.9K 1% /mnt/lustre[OST:1] filesystem_summary: 230.2K 368 229.8K 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.5K 368 488.1K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.3K 375 114.9K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 115.3K 373 114.9K 1% /mnt/lustre2[OST:1] filesystem_summary: 230.2K 368 229.8K 1% /mnt/lustre2 UUID bytes Used Available Use% Mounted on lustre-MDT0000_UUID 2.1G 3.2M 2.1G 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3.6G 5.0M 3.6G 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3.6G 6.0M 3.6G 1% /mnt/lustre[OST:1] filesystem_summary: 7.2G 11.0M 7.2G 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500203 368 499835 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118071 375 117696 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 118037 373 117664 1% /mnt/lustre2[OST:1] filesystem_summary: 235728 368 235360 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.5K 368 488.1K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.3K 375 114.9K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 115.3K 373 114.9K 1% /mnt/lustre2[OST:1] filesystem_summary: 230.2K 368 229.8K 1% /mnt/lustre2 No device found for name osc: Invalid argument UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500203 368 499835 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 118071 375 117696 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 118037 373 117664 1% /mnt/lustre[OST:1] filesystem_summary: 235728 368 235360 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500203 368 499835 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118071 375 117696 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 118037 373 117664 1% /mnt/lustre2[OST:1] filesystem_summary: 235728 368 235360 1% /mnt/lustre2 No device found for name osc: Invalid argument UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre2 PASS 24a (5s) == sanityn test 24b: lfs df should show both filesystems ========================================================================= 13:48:04 (1776188884) PASS 24b (5s) == sanityn test 25a: change ACL on one mountpoint be seen on another ============================================================= 13:48:09 (1776188889) running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] PASS 25a (6s) == sanityn test 25b: change ACL under remote dir on one mountpoint be seen on another ========================================================== 13:48:15 (1776188895) SKIP: sanityn test_25b needs >= 2 MDTs SKIP 25b (2s) == sanityn test 26a: allow mtime to get older ============ 13:48:18 (1776188898) utime: good mknod times 1776188898 <= 1776188899 <= 1776188899 for /mnt/lustre/f26a utime: good mknod times 1776188898 <= 1776188899 <= 1776188899 for /mnt/lustre2/f26a utime: good utime mtimes 100000, atime 200000 utime: updated times for /mnt/lustre2/f26a PASS 26a (7s) == sanityn test 26b: sync mtime between ost and mds ====== 13:48:24 (1776188904) PASS 26b (7s) SKIP: sanityn test_27 skipping excluded test 27 SKIP: sanityn test_28 skipping ALWAYS excluded test 28 == sanityn test 30: recreate file race =================== 13:48:34 (1776188914) 0 PASS 30 (7s) == sanityn test 31a: voluntary cancel / blocking ast race======================================================================== 13:48:41 (1776188921) fail_loc=0x314 PASS 31a (6s) == sanityn test 31b: voluntary OST cancel / blocking ast race======================================================================== 13:48:48 (1776188928) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg347-server mds-ost sync done. sleep 5 for ZFS MDS Waiting for MDT destroys to complete fail_loc=0x314 fail_loc=0x316 fail_loc=0 fail_loc=0 Filesystem 1K-blocks Used Available Use% Mounted on 192.168.203.147@tcp:/lustre 7542784 13312 7525376 1% /mnt/lustre2 PASS 31b (20s) == sanityn test 31r: open-rename(replace) race =========== 13:49:07 (1776188947) -rw-r--r-- 1 root root 0 Apr 14 13:49 /mnt/lustre/f31r.sanityn.target fail_loc=0x1419 fail_val=3 PASS 31r (8s) SKIP: sanityn test_33a skipping SLOW test 33a == sanityn test 33b: COS: cross create/delete, 2 clients, benchmark under remote dir ========================================================== 13:49:16 (1776188956) SKIP: sanityn test_33b Need two or more clients, have 1 SKIP 33b (2s) == sanityn test 33c: Cancel cross-MDT lock should trigger Sync-Lock-Cancel ========================================================== 13:49:19 (1776188959) SKIP: sanityn test_33c needs >= 2 MDTs SKIP 33c (2s) == sanityn test 33d: DNE distributed operation should trigger COS ========================================================== 13:49:21 (1776188961) SKIP: sanityn test_33d needs >= 2 MDTs SKIP 33d (3s) == sanityn test 33e: DNE local operation shouldn't trigger COS ========================================================== 13:49:24 (1776188964) SKIP: sanityn test_33e Need two or more clients, have 1 SKIP 33e (3s) == sanityn test 34: no lock timeout under IO ============= 13:49:27 (1776188967) fail_loc=0x512 fail_loc=0x512 lock should not expire writing on client1 reading on client2 success fail_loc=0x511 fail_loc=0x511 lock should expire writing on client1 reading on client2 success oleg347-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff888198860800.ost_server_uuid,osc.lustre-OST0000-osc-ffff8881996ba800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff888198860800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0000-osc-ffff8881996ba800.ost_server_uuid in IDLE state after 0 sec oleg347-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff888198860800.ost_server_uuid,osc.lustre-OST0001-osc-ffff8881996ba800.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff888198860800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0001-osc-ffff8881996ba800.ost_server_uuid in FULL state after 0 sec oleg347-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff888198860800.ost_server_uuid,osc.lustre-OST0000-osc-ffff8881996ba800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff888198860800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0000-osc-ffff8881996ba800.ost_server_uuid in IDLE state after 0 sec oleg347-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff888198860800.ost_server_uuid,osc.lustre-OST0001-osc-ffff8881996ba800.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff888198860800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0001-osc-ffff8881996ba800.ost_server_uuid in FULL state after 0 sec oleg347-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff888198860800.ost_server_uuid,osc.lustre-OST0000-osc-ffff8881996ba800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff888198860800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0000-osc-ffff8881996ba800.ost_server_uuid in IDLE state after 0 sec oleg347-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff888198860800.ost_server_uuid,osc.lustre-OST0001-osc-ffff8881996ba800.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff888198860800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0001-osc-ffff8881996ba800.ost_server_uuid in FULL state after 0 sec PASS 34 (123s) == sanityn test 35: -EINTR cp_ast vs. bl_ast race does not evict client ========================================================== 13:51:30 (1776189090) fail_loc=0x80000317 Race attempt 0 Wait for 44713 44760 for 60 sec... - open/close 808 (time 1776189106.41 total 10.01 last 80.76) - open/close 1641 (time 1776189116.42 total 20.01 last 83.28) - open/close 2419 (time 1776189126.43 total 30.02 last 77.68) - open/close 3195 (time 1776189136.44 total 40.03 last 77.57) - open/close 3916 (time 1776189146.44 total 50.03 last 72.10) total: 4000 open/close in 51.27 seconds: 78.02 ops/second fail_loc=0x0 Filesystem Size Used Avail Use% Mounted on 192.168.203.147@tcp:/lustre 7.2G 13M 7.2G 1% /mnt/lustre 192.168.203.147@tcp:/lustre 7.2G 13M 7.2G 1% /mnt/lustre2 PASS 35 (72s) == sanityn test 36: handle ESTALE/open-unlink correctly == 13:52:42 (1776189162) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg347-server mds-ost sync done. Waiting for MDT destroys to complete 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.883152 s, 59.4 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7160 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(0) *** before(7525376) after_dd(7474176) after(7525376) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.02752 s, 51.0 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7160 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(1) *** before(7525376) after_dd(7474176) after(7525376) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.05434 s, 49.7 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7160 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(2) *** before(7525376) after_dd(7474176) after(7525376) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.04073 s, 50.4 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7160 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(3) *** before(7525376) after_dd(7474176) after(7525376) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.85996 s, 61.0 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7160 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(4) *** before(7525376) after_dd(7472128) after(7523328) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.06018 s, 49.5 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7160 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(5) *** before(7523328) after_dd(7474176) after(7525376) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.01724 s, 51.5 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7160 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(6) *** before(7525376) after_dd(7472128) after(7523328) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.00848 s, 52.0 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7160 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(7) *** before(7523328) after_dd(7465984) after(7517184) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 0.986576 s, 53.1 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7160 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(8) *** before(7517184) after_dd(7474176) after(7525376) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.21036 s, 43.3 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7160 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(9) *** before(7525376) after_dd(7470080) after(7521280) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.02903 s, 50.9 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7160 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(10) *** before(7521280) after_dd(7470080) after(7521280) PASS 36 (298s) == sanityn test 37: check i_size is not updated for directory on close (bug 18695) ======================================================================== 13:57:41 (1776189461) multiop /mnt/lustre/d37.sanityn vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.7160 - create 1428 (time 1776189473.96 total 10.00 last 142.79) - create 2897 (time 1776189483.96 total 20.00 last 146.89) - create 4309 (time 1776189493.97 total 30.00 last 141.17) - create 5800 (time 1776189503.97 total 40.01 last 149.02) - create 7360 (time 1776189513.97 total 50.01 last 155.99) - create 8810 (time 1776189523.97 total 60.01 last 144.98) total: 10000 create in 67.81 seconds: 147.47 ops/second PASS 37 (79s) == sanityn test 39a: test from 11063 ============================================================================================ 13:58:59 (1776189539) repeat after cancel_lru_locks PASS 39a (6s) == sanityn test 39b: 11063 problem 1 ============================================================================================ 13:59:05 (1776189545) repeat after cancel_lru_locks PASS 39b (7s) == sanityn test 39c: check truncate mtime update ================================================================================ 13:59:12 (1776189552) repeat after cancel_lru_locks PASS 39c (7s) == sanityn test 39d: sync write should update mtime ====== 13:59:19 (1776189559) fail_loc=0x411 fail_loc=0 PASS 39d (5s) == sanityn test 40a: pdirops: create vs others ======================================================================== 13:59:24 (1776189564) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40a (15s) == sanityn test 40b: pdirops: open|create and others ======================================================================== 13:59:39 (1776189579) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40b (17s) == sanityn test 40c: pdirops: link and others ======================================================================== 13:59:57 (1776189597) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40c (17s) == sanityn test 40d: pdirops: unlink and others ======================================================================== 14:00:13 (1776189613) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40d (16s) == sanityn test 40e: pdirops: rename and others ======================================================================== 14:00:29 (1776189629) No conflict No conflict No conflict No conflict No conflict No conflict PASS 40e (16s) == sanityn test 41a: pdirops: create vs mkdir ======================================================================== 14:00:45 (1776189645) mkdir: cannot create directory '/mnt/lustre2/f41a.sanityn': File exists Conflict PASS 41a (13s) == sanityn test 41b: pdirops: create vs create ======================================================================== 14:00:58 (1776189658) open: File exists Conflict PASS 41b (13s) == sanityn test 41c: pdirops: create vs link ======================================================================== 14:01:11 (1776189671) link: cannot create link '/mnt/lustre2/f41c.sanityn' to '/mnt/lustre2/f41c.sanityn-2': File exists Conflict PASS 41c (12s) == sanityn test 41d: pdirops: create vs unlink ======================================================================== 14:01:23 (1776189683) Conflict PASS 41d (12s) == sanityn test 41e: pdirops: create and rename (tgt) ======================================================================== 14:01:35 (1776189695) Conflict PASS 41e (11s) == sanityn test 41f: pdirops: create and rename (src) ======================================================================== 14:01:46 (1776189706) Conflict PASS 41f (11s) == sanityn test 41g: pdirops: create vs getattr ======================================================================== 14:01:58 (1776189718) Conflict PASS 41g (12s) == sanityn test 41h: pdirops: create vs readdir ======================================================================== 14:02:09 (1776189729) Conflict PASS 41h (16s) == sanityn test 41i: reint_open: create vs create ======== 14:02:25 (1776189745) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 41i (1012s) == sanityn test 42a: pdirops: mkdir vs mkdir ======================================================================== 14:19:17 (1776190757) mkdir: cannot create directory '/mnt/lustre2/f42a.sanityn': File exists Conflict PASS 42a (13s) == sanityn test 42b: pdirops: mkdir vs create ======================================================================== 14:19:30 (1776190770) open: File exists Conflict PASS 42b (11s) == sanityn test 42c: pdirops: mkdir vs link ======================================================================== 14:19:41 (1776190781) link: cannot create link '/mnt/lustre2/f42c.sanityn' to '/mnt/lustre2/f42c.sanityn-2': File exists Conflict PASS 42c (12s) == sanityn test 42d: pdirops: mkdir vs unlink ======================================================================== 14:19:53 (1776190793) Conflict PASS 42d (10s) == sanityn test 42e: pdirops: mkdir and rename (tgt) ======================================================================== 14:20:03 (1776190803) mv: cannot overwrite directory '/mnt/lustre2/f42e.sanityn' with non-directory Conflict PASS 42e (11s) == sanityn test 42f: pdirops: mkdir and rename (src) ======================================================================== 14:20:14 (1776190814) Conflict PASS 42f (12s) == sanityn test 42g: pdirops: mkdir vs getattr ======================================================================== 14:20:26 (1776190826) Conflict PASS 42g (11s) == sanityn test 42h: pdirops: mkdir vs readdir ======================================================================== 14:20:37 (1776190837) Conflict PASS 42h (9s) == sanityn test 43a: rmdir,mkdir doesn't return -EEXIST ======================================================================== 14:20:47 (1776190847) PASS 43a (50s) == sanityn test 43b: pdirops: unlink vs create ======================================================================== 14:21:36 (1776190896) Conflict PASS 43b (10s) == sanityn test 43c: pdirops: unlink vs link ======================================================================== 14:21:46 (1776190906) Conflict PASS 43c (11s) == sanityn test 43d: pdirops: unlink vs unlink ======================================================================== 14:21:58 (1776190918) rm: cannot remove '/mnt/lustre2/f43d.sanityn': No such file or directory Conflict PASS 43d (12s) == sanityn test 43e: pdirops: unlink and rename (tgt) ======================================================================== 14:22:10 (1776190930) Conflict PASS 43e (11s) == sanityn test 43f: pdirops: unlink and rename (src) ======================================================================== 14:22:21 (1776190941) mv: cannot stat '/mnt/lustre2/f43f.sanityn': No such file or directory Conflict PASS 43f (11s) == sanityn test 43g: pdirops: unlink vs getattr ======================================================================== 14:22:32 (1776190952) stat: cannot statx '/mnt/lustre2/f43g.sanityn': No such file or directory Conflict PASS 43g (10s) == sanityn test 43h: pdirops: unlink vs readdir ======================================================================== 14:22:42 (1776190962) Conflict PASS 43h (11s) == sanityn test 43i: pdirops: unlink vs remote mkdir ===== 14:22:53 (1776190973) SKIP: sanityn test_43i needs >= 2 MDTs SKIP 43i (2s) == sanityn test 43j: racy mkdir return EEXIST ======================================================================== 14:22:55 (1776190975) mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists PASS 43j (112s) == sanityn test 43k: unlink vs create ==================== 14:24:47 (1776191087) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 43k (1043s) == sanityn test 44a: pdirops: rename tgt vs mkdir ======================================================================== 14:42:10 (1776192130) mkdir: cannot create directory '/mnt/lustre2/f44a.sanityn': File exists Conflict Tue Apr 14 14:42:18 EDT 2026 PASS 44a (12s) == sanityn test 44b: pdirops: rename tgt vs create ======================================================================== 14:42:22 (1776192142) open: File exists Conflict PASS 44b (12s) == sanityn test 44c: pdirops: rename tgt vs link ======================================================================== 14:42:34 (1776192154) link: cannot create link '/mnt/lustre2/f44c.sanityn' to '/mnt/lustre2/f44c.sanityn-3': File exists Conflict PASS 44c (12s) == sanityn test 44d: pdirops: rename tgt vs unlink ======================================================================== 14:42:46 (1776192166) Conflict PASS 44d (11s) == sanityn test 44e: pdirops: rename tgt and rename (tgt) ======================================================================== 14:42:57 (1776192177) Conflict PASS 44e (14s) == sanityn test 44f: pdirops: rename tgt and rename (src) ======================================================================== 14:43:11 (1776192191) Conflict PASS 44f (13s) == sanityn test 44g: pdirops: rename tgt vs getattr ======================================================================== 14:43:24 (1776192204) Conflict PASS 44g (12s) == sanityn test 44h: pdirops: rename tgt vs readdir ======================================================================== 14:43:36 (1776192216) Conflict PASS 44h (13s) == sanityn test 44i: pdirops: rename tgt vs remote mkdir ========================================================== 14:43:49 (1776192229) SKIP: sanityn test_44i needs >= 2 MDTs SKIP 44i (3s) == sanityn test 45a: rename,mkdir doesn't return -EEXIST ======================================================================== 14:43:52 (1776192232) PASS 45a (98s) == sanityn test 45b: pdirops: rename src vs create ======================================================================== 14:45:30 (1776192330) Conflict PASS 45b (13s) == sanityn test 45c: pdirops: rename src vs link ======================================================================== 14:45:43 (1776192343) Conflict PASS 45c (14s) == sanityn test 45d: pdirops: rename src vs unlink ======================================================================== 14:45:58 (1776192358) rm: cannot remove '/mnt/lustre2/f45d.sanityn': No such file or directory Conflict PASS 45d (10s) == sanityn test 45e: pdirops: rename src and rename (tgt) ======================================================================== 14:46:08 (1776192368) Conflict PASS 45e (11s) == sanityn test 45f: pdirops: rename src and rename (src) ======================================================================== 14:46:19 (1776192379) mv: cannot stat '/mnt/lustre2/f45f.sanityn': No such file or directory Conflict PASS 45f (9s) == sanityn test 45g: pdirops: rename src vs getattr ======================================================================== 14:46:28 (1776192388) stat: cannot statx '/mnt/lustre2/f45g.sanityn': No such file or directory Conflict PASS 45g (13s) == sanityn test 45h: pdirops: unlink vs readdir ======================================================================== 14:46:42 (1776192402) Conflict PASS 45h (12s) == sanityn test 45i: pdirops: rename src vs remote mkdir ========================================================== 14:46:54 (1776192414) SKIP: sanityn test_45i needs >= 2 MDTs SKIP 45i (2s) == sanityn test 45j: read vs rename ====================== 14:46:57 (1776192417) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 45j (1179s) == sanityn test 46a: pdirops: link vs mkdir ======================================================================== 15:06:36 (1776193596) mkdir: cannot create directory '/mnt/lustre2/f46a.sanityn': File exists Conflict PASS 46a (12s) == sanityn test 46b: pdirops: link vs create ======================================================================== 15:06:49 (1776193609) open: File exists Conflict PASS 46b (13s) == sanityn test 46c: pdirops: link vs link ======================================================================== 15:07:01 (1776193621) link: cannot create link '/mnt/lustre2/f46c.sanityn' to '/mnt/lustre2/f46c.sanityn': File exists Conflict PASS 46c (11s) == sanityn test 46d: pdirops: link vs unlink ======================================================================== 15:07:13 (1776193633) Conflict PASS 46d (13s) == sanityn test 46e: pdirops: link and rename (tgt) ======================================================================== 15:07:25 (1776193645) Conflict PASS 46e (13s) == sanityn test 46f: pdirops: link and rename (src) ======================================================================== 15:07:38 (1776193658) Conflict PASS 46f (13s) == sanityn test 46g: pdirops: link vs getattr ======================================================================== 15:07:51 (1776193671) Conflict PASS 46g (12s) == sanityn test 46h: pdirops: link vs readdir ======================================================================== 15:08:04 (1776193684) Conflict PASS 46h (11s) == sanityn test 46i: pdirops: link vs remote mkdir ======= 15:08:15 (1776193695) SKIP: sanityn test_46i needs >= 2 MDTs SKIP 46i (2s) == sanityn test 47a: pdirops: remote mkdir vs mkdir ====== 15:08:18 (1776193698) SKIP: sanityn test_47a needs >= 2 MDTs SKIP 47a (4s) == sanityn test 47b: pdirops: remote mkdir vs create ===== 15:08:21 (1776193701) SKIP: sanityn test_47b needs >= 2 MDTs SKIP 47b (3s) == sanityn test 47c: pdirops: remote mkdir vs link ======= 15:08:24 (1776193704) SKIP: sanityn test_47c needs >= 2 MDTs SKIP 47c (2s) == sanityn test 47d: pdirops: remote mkdir vs unlink ===== 15:08:27 (1776193707) SKIP: sanityn test_47d needs >= 2 MDTs SKIP 47d (3s) == sanityn test 47e: pdirops: remote mkdir and rename (tgt) ========================================================== 15:08:30 (1776193710) SKIP: sanityn test_47e needs >= 2 MDTs SKIP 47e (4s) == sanityn test 47f: pdirops: remote mkdir and rename (src) ========================================================== 15:08:34 (1776193714) SKIP: sanityn test_47f needs >= 2 MDTs SKIP 47f (3s) == sanityn test 47g: pdirops: remote mkdir vs getattr ==== 15:08:37 (1776193717) SKIP: sanityn test_47g needs >= 2 MDTs SKIP 47g (3s) == sanityn test 50: osc lvb attrs: enqueue vs. CP AST ======================================================================== 15:08:40 (1776193720) 10+0 records in 10+0 records out 10240 bytes (10 kB, 10 KiB) copied, 0.132874 s, 77.1 kB/s fail_loc=0x410 fail_loc=0x0 PASS 50 (12s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 15:08:52 (1776193732) 0+1 records in 0+1 records out 158 bytes copied, 0.0273855 s, 5.8 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3146: kill: (242673) - No such process PASS 51a (10s) == sanityn test 51b: layout lock: glimpse should be able to restart if layout changed ========================================================== 15:09:02 (1776193742) 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0189373 s, 54.1 kB/s fail_loc=0x1404 fail_val=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.15365 s, 6.8 MB/s 3145728 PASS 51b (20s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 15:09:22 (1776193762) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0407801 s, 25.1 kB/s PASS 51c (12s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 15:09:34 (1776193774) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0397494 s, 26.4 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (7s) == sanityn test 51e: lfs getstripe does not break leases, part 2 ========================================================== 15:09:41 (1776193781) /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2431 0x97f 0 write lease(2) has applied. /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2431 0x97f 0 read lease(1) has applied. PASS 51e (9s) == sanityn test 54: rename locking ======================= 15:09:50 (1776193790) llite.lustre-ffff888198860800.xattr_cache=1 llite.lustre-ffff8881996ba800.xattr_cache=1 ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000153 File: /mnt/lustre/d1/d2 Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504962 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 15:09:51.000000000 -0400 Modify: 2026-04-14 15:09:51.000000000 -0400 Change: 2026-04-14 15:09:51.000000000 -0400 Birth: 2026-04-14 15:09:51.000000000 -0400 ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000154 File: /mnt/lustre/d1/d2 Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504965 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 15:09:58.000000000 -0400 Modify: 2026-04-14 15:09:59.000000000 -0400 Change: 2026-04-14 15:09:59.000000000 -0400 Birth: 2026-04-14 15:09:57.000000000 -0400 ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000153 File: /mnt/lustre/d1/d2 Size: 512 Blocks: 1 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504968 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 15:10:04.000000000 -0400 Modify: 2026-04-14 15:10:04.000000000 -0400 Change: 2026-04-14 15:10:04.000000000 -0400 Birth: 2026-04-14 15:10:04.000000000 -0400 open(O_RDWR|O_CREAT): Is a directory File: /mnt/lustre/d1 Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504967 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 15:10:04.000000000 -0400 Modify: 2026-04-14 15:10:05.000000000 -0400 Change: 2026-04-14 15:10:05.000000000 -0400 Birth: 2026-04-14 15:10:04.000000000 -0400 ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000154 open(O_RDWR|O_CREAT): Is a directory File: /mnt/lustre/d1/d2 Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504971 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 15:10:10.000000000 -0400 Modify: 2026-04-14 15:10:11.000000000 -0400 Change: 2026-04-14 15:10:11.000000000 -0400 Birth: 2026-04-14 15:10:10.000000000 -0400 File: /mnt/lustre/d1 Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504970 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 15:10:10.000000000 -0400 Modify: 2026-04-14 15:10:11.000000000 -0400 Change: 2026-04-14 15:10:11.000000000 -0400 Birth: 2026-04-14 15:10:10.000000000 -0400 PASS 54 (31s) == sanityn test 55a: rename vs unlink target dir ========= 15:10:21 (1776193821) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55a.sanityn/d1/d2' to '/mnt/lustre/d55a.sanityn/d3/d2': No such file or directory PASS 55a (12s) == sanityn test 55b: rename vs unlink source dir ========= 15:10:33 (1776193833) fail_loc=0x80000156 mv: cannot stat '/mnt/lustre/d55b.sanityn/d1/d2': No such file or directory PASS 55b (11s) == sanityn test 55c: rename vs unlink orphan target dir == 15:10:44 (1776193844) fail_loc=0x156 mv: cannot move '/mnt/lustre/d55c.sanityn/d1/d2' to '/mnt/lustre/d55c.sanityn/d3/d2': No such file or directory PASS 55c (18s) == sanityn test 55d: rename file vs link ================= 15:11:02 (1776193862) fail_loc=0x155 mv: '/mnt/lustre/d55d.sanityn/f1' and '/mnt/lustre/d55d.sanityn/d55d.sanityn/f1' are the same file PASS 55d (15s) == sanityn test 60: Verify data_version behaviour ======== 15:11:17 (1776193877) PASS 60 (8s) == sanityn test 70a: cd directory && rm directory ======== 15:11:25 (1776193885) PASS 70a (6s) == sanityn test 70b: remove files after calling rm_entry ========================================================== 15:11:31 (1776193891) PASS 70b (6s) == sanityn test 71a: correct file map just after write operation is finished ========================================================== 15:11:37 (1776193897) 1+0 records in 1+0 records out 65536 bytes (66 kB, 64 KiB) copied, 0.0101922 s, 6.4 MB/s SKIP: sanityn test_71a ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71a (3s) == sanityn test 71b: check fiemap support for stripecount > 1 ========================================================== 15:11:40 (1776193900) 1+0 records in 1+0 records out 65536 bytes (66 kB, 64 KiB) copied, 0.0100025 s, 6.6 MB/s SKIP: sanityn test_71b ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71b (3s) == sanityn test 71c: check FIEMAP_EXTENT_LAST flag with different extents number ========================================================== 15:11:43 (1776193903) SKIP: sanityn test_71c support only ldiskfs ost SKIP 71c (3s) == sanityn test 71d: fiemap corruption test with fm_extent_count=0 ========================================================== 15:11:46 (1776193906) 1+0 records in 1+0 records out 65536 bytes (66 kB, 64 KiB) copied, 0.0146991 s, 4.5 MB/s SKIP: sanityn test_71d ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71d (3s) == sanityn test 72: getxattr/setxattr cache should be consistent between nodes ========================================================== 15:11:49 (1776193909) llite.lustre-ffff888198860800.xattr_cache=1 llite.lustre-ffff8881996ba800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names user.attr1="value1" getfattr: Removing leading '/' from absolute path names user.attr1="value2" getfattr: Removing leading '/' from absolute path names getfattr: Removing leading '/' from absolute path names b362740ad371eae580e7f85452e8830b - 870e072da1ebfc20ea8c0cd3d6bdf3b6 - PASS 72 (5s) == sanityn test 73: getxattr should not cause xattr lock cancellation ========================================================== 15:11:54 (1776193914) llite.lustre-ffff888198860800.xattr_cache=1 llite.lustre-ffff8881996ba800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" PASS 73 (5s) == sanityn test 74: flock deadlock: different mounts ======================================================================== 15:11:59 (1776193919) 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00806979 s, 127 kB/s 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0084988 s, 120 kB/s 252710: get lock2 252713: get lock1 252713: done 252713: get lock2 252710: done 252710: get lock1 fcntl cmd 7 failed: Resource deadlock avoided 252710: cannot get lock1: Resource deadlock avoided 252713: done 252713: exit rc=0 252710: done 252710: exit rc=0 PASS 74 (9s) == sanityn test 75: osc: upcall after unuse lock============================================================================= 15:12:08 (1776193928) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0700288 s, 29.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0403186 s, 26.0 MB/s fail_loc=0x31d /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3714: 253286 Killed stat -c %s $DIR1/$tfile fail_loc=0 PASS 75 (10s) == sanityn test 76: Verify MDT open_files listing ======== 15:12:18 (1776193938) opening files: ........ closing files: ........ PASS 76 (62s) == sanityn test 77a: check FIFO NRS policy =============== 15:13:20 (1776194000) ost.OSS.ost.nrs_policies=fifo ost.OSS.ost_create.nrs_policies=fifo ost.OSS.ost_io.nrs_policies=fifo ost.OSS.ost_out.nrs_policies=fifo ost.OSS.ost_seq.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.377964 s, 44.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0452099 s, 23.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0462719 s, 22.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.141861 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.191491 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.203193 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.205812 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.226102 s, 4.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.213405 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.235811 s, 4.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.241136 s, 4.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.253894 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.252604 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.293771 s, 3.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.235195 s, 4.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.273903 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.272374 s, 3.8 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff888198860800.lock_unused_count=7 ldlm.namespaces.lustre-OST0001-osc-ffff888198860800.lock_unused_count=7 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00277409 s, 378 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0611291 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201317 s, 52.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00507752 s, 207 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0410503 s, 25.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142961 s, 73.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112647 s, 93.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00822216 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0588974 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0613341 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.11514 s, 9.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00846441 s, 124 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0617843 s, 17.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.102509 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215552 s, 48.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138434 s, 75.7 MB/s removed '/mnt/lustre/d77a.sanityn/nrs_w_oleg347-client.virtnet' removed '/mnt/lustre/d77a.sanityn/nrs_r_oleg347-client.virtnet' removed directory '/mnt/lustre/d77a.sanityn' PASS 77a (8s) == sanityn test 77b: check CRR-N NRS policy ============== 15:13:28 (1776194008) ost.OSS.ost.nrs_policies=crrn ost.OSS.ost_create.nrs_policies=crrn ost.OSS.ost_io.nrs_policies=crrn ost.OSS.ost_out.nrs_policies=crrn ost.OSS.ost_seq.nrs_policies=crrn ost.OSS.ost.nrs_crrn_quantum=1 ost.OSS.ost_create.nrs_crrn_quantum=1 ost.OSS.ost_io.nrs_crrn_quantum=1 ost.OSS.ost_out.nrs_crrn_quantum=1 ost.OSS.ost_seq.nrs_crrn_quantum=1 policy: crr-n, crrn_quantum 1 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.391777 s, 42.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282551 s, 37.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0417079 s, 25.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0399867 s, 26.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0705476 s, 14.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0574114 s, 18.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0495747 s, 21.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0649562 s, 16.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0440668 s, 23.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125995 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.154461 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.14691 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.134782 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137147 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.178138 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.179336 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.186619 s, 5.6 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff888198860800.lock_unused_count=3 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0420519 s, 24.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0389698 s, 26.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0627982 s, 16.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0438527 s, 23.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0716614 s, 14.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0503754 s, 20.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0597607 s, 17.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0601803 s, 17.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0475909 s, 22.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0650948 s, 16.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0620128 s, 16.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0571836 s, 18.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0634079 s, 16.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0791679 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.077527 s, 13.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0820169 s, 12.8 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg347-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg347-client.virtnet' removed directory '/mnt/lustre/d77b.sanityn' ost.OSS.ost.nrs_crrn_quantum=64 ost.OSS.ost_create.nrs_crrn_quantum=64 ost.OSS.ost_io.nrs_crrn_quantum=64 ost.OSS.ost_out.nrs_crrn_quantum=64 ost.OSS.ost_seq.nrs_crrn_quantum=64 policy: crr-n, crrn_quantum 64 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.363284 s, 46.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0625272 s, 16.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0648051 s, 16.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0868526 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.115195 s, 9.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0487143 s, 21.5 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104112 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0859864 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0872974 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.192268 s, 5.5 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff888198860800.lock_unused_count=1 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.203999 s, 5.1 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.170931 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.192249 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.259531 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.193082 s, 5.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.186121 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0738336 s, 14.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103318 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0416259 s, 25.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.045133 s, 23.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0613823 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0532361 s, 19.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.091221 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0916504 s, 11.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0954531 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0969456 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0990862 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.405396 s, 2.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.111597 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152013 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.118094 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0938475 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129512 s, 8.1 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff888198860800.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff888198860800.lock_unused_count=3 removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg347-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg347-client.virtnet' removed directory '/mnt/lustre/d77b.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77b (12s) == sanityn test 77c: check ORR NRS policy ================ 15:13:40 (1776194020) ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_orr_quantum=1 ost.OSS.ost_io.nrs_orr_offset_type=physical ost.OSS.ost_io.nrs_orr_supported=reads policy: orr, orr_quantum 1, orr_offset_type physical, orr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.359747 s, 46.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295694 s, 35.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0643717 s, 16.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0659116 s, 15.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0933767 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0950481 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.171965 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.141378 s, 7.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.193857 s, 5.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.208806 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.214834 s, 4.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.229319 s, 4.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.215522 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.192378 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.192769 s, 5.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.26643 s, 3.9 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff888198860800.lock_unused_count=6 ldlm.namespaces.lustre-OST0001-osc-ffff888198860800.lock_unused_count=5 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.279482 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154456 s, 67.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0860349 s, 12.2 MB/s1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00588981 s, 178 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0865208 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0734033 s, 14.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.115905 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0896897 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109816 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.140344 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843998 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0685484 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.146451 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0787141 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.123003 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303127 s, 34.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152895 s, 6.9 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg347-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg347-client.virtnet' removed directory '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=writes ost.OSS.ost_io.nrs_orr_quantum=64 policy: orr, orr_quantum 64, orr_offset_type physical, orr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.313578 s, 53.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0914721 s, 11.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.116266 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.127595 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.154498 s, 6.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.206472 s, 5.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.164143 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.200308 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.213638 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.261712 s, 4.0 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.222396 s, 4.7 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff888198860800.lock_unused_count=5 ldlm.namespaces.lustre-OST0001-osc-ffff888198860800.lock_unused_count=2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.324446 s, 3.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.325926 s, 3.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.349946 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.262193 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.284857 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.314932 s, 3.3 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff888198860800.lock_unused_count=1 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0490397 s, 21.4 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0442794 s, 23.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0498027 s, 21.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0559997 s, 18.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291325 s, 36.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259295 s, 40.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0381282 s, 27.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0828913 s, 12.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0408839 s, 25.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0570495 s, 18.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0634415 s, 16.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.053301 s, 19.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0916131 s, 11.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0467022 s, 22.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00735083 s, 143 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0536299 s, 19.6 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg347-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg347-client.virtnet' removed directory '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=reads_and_writes ost.OSS.ost_io.nrs_orr_offset_type=logical policy: orr, orr_quantum 64, orr_offset_type logical, orr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.344549 s, 48.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0330473 s, 31.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0545857 s, 19.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0551071 s, 19.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236925 s, 44.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0601113 s, 17.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0866734 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0554433 s, 18.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0980324 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107365 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0852615 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0965927 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.10211 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.135652 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.154999 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.178192 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.194868 s, 5.4 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff888198860800.lock_unused_count=7 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0449029 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0415257 s, 25.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0514269 s, 20.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.05426 s, 19.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0472103 s, 22.2 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0471815 s, 22.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0495642 s, 21.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0827768 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0463268 s, 22.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0848217 s, 12.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0852048 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0553872 s, 18.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0566989 s, 18.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0573779 s, 18.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0680644 s, 15.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0960847 s, 10.9 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg347-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg347-client.virtnet' removed directory '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77c (15s) == sanityn test 77d: check TRR nrs policy ================ 15:13:55 (1776194035) ost.OSS.ost_io.nrs_policies=trr ost.OSS.ost_io.nrs_trr_quantum=1 ost.OSS.ost_io.nrs_trr_offset_type=physical ost.OSS.ost_io.nrs_trr_supported=reads policy: trr, trr_quantum 1, trr_offset_type physical, trr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.403137 s, 41.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0583512 s, 18.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0777202 s, 13.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152133 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.189368 s, 5.5 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.202088 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.227389 s, 4.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.200242 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.252912 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.206267 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.263449 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.330396 s, 3.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.365342 s, 2.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.342645 s, 3.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.325052 s, 3.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.312096 s, 3.4 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff888198860800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.425858 s, 2.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129607 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.099823 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.165927 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.141974 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104153 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.141825 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.122799 s, 8.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.141864 s, 7.4 MB/s1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.123903 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.157202 s, 6.7 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.143635 s, 7.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.169634 s, 6.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.128642 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.135874 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133126 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.139359 s, 7.5 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg347-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg347-client.virtnet' removed directory '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=writes ost.OSS.ost_io.nrs_trr_quantum=64 policy: trr, trr_quantum 64, trr_offset_type physical, trr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.417806 s, 40.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0650735 s, 16.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0705409 s, 14.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.10358 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0913284 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.122899 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105983 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0632178 s, 16.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.100607 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.13132 s, 8.0 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff888198860800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.260275 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.229885 s, 4.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.302996 s, 3.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.316802 s, 3.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.254522 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.364505 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.413821 s, 2.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00878228 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00741761 s, 141 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0098213 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867367 s, 121 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff888198860800.lock_unused_count=4 ldlm.namespaces.lustre-OST0001-osc-ffff888198860800.lock_unused_count=2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00258939 s, 405 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00244955 s, 428 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133874 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.139276 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.181701 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.164962 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.118863 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0854279 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.112178 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0516206 s, 20.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239361 s, 43.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0502617 s, 20.9 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg347-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg347-client.virtnet' removed directory '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=reads_and_writes ost.OSS.ost_io.nrs_trr_offset_type=logical policy: trr, trr_quantum 64, trr_offset_type logical, trr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.344249 s, 48.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.1009 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.115473 s, 9.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.154919 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.110163 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.095561 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.241924 s, 4.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.186742 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.20825 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.281258 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.311693 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.1872 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.283664 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.267597 s, 3.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.30726 s, 3.4 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff888198860800.lock_unused_count=5 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.229868 s, 4.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.341138 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0673554 s, 15.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00450389 s, 233 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0096448 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00611198 s, 172 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00321289 s, 326 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00776125 s, 135 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0676383 s, 15.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0603508 s, 17.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101418 s, 10.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.082199 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0398845 s, 26.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.055671 s, 18.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0426828 s, 24.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0350924 s, 29.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027077 s, 38.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0366525 s, 28.6 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg347-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg347-client.virtnet' removed directory '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77d (16s) == sanityn test 77e: check TBF NID nrs policy ============ 15:14:12 (1776194052) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_tbf_rule=start localhost nid={0@lo} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start clients nid={192.168.203.47@tcp} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start others nid={*.*.*.*@tcp} rate=50 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.216482 s, 77.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259752 s, 40.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.034476 s, 30.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0483248 s, 21.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260875 s, 40.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0815605 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0905769 s, 11.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233139 s, 45.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188325 s, 55.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0994006 s, 10.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.135871 s, 7.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0906902 s, 11.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0984578 s, 10.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321405 s, 32.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0974437 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125504 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0945415 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0551003 s, 19.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0579849 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0398255 s, 26.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0592504 s, 17.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0674779 s, 15.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0526226 s, 19.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0608026 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0588995 s, 17.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0904889 s, 11.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0634831 s, 16.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0707407 s, 14.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0719268 s, 14.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0791078 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0821906 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0777933 s, 13.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0919179 s, 11.4 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg347-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg347-client.virtnet' removed directory '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change localhost rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change clients rate=101 ost.OSS.ost_io.nrs_tbf_rule=change others rate=51 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.537911 s, 31.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0671883 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0618127 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0799665 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0474246 s, 22.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103436 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.14369 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0588726 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.193529 s, 5.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0562111 s, 18.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0844585 s, 12.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.28518 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.187594 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.177076 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.266509 s, 3.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.340924 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.260152 s, 4.0 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff888198860800.lock_unused_count=6 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0374572 s, 28.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0550492 s, 19.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0575169 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0366736 s, 28.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0395647 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0642172 s, 16.3 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0474122 s, 22.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0673451 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0510088 s, 20.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0586461 s, 17.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0794939 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0629504 s, 16.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0752345 s, 13.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0752322 s, 13.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.069713 s, 15.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0795192 s, 13.2 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg347-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg347-client.virtnet' removed directory '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop localhost ost.OSS.ost_io.nrs_tbf_rule=stop clients ost.OSS.ost_io.nrs_tbf_rule=stop others 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.683596 s, 24.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.089092 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0507699 s, 20.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180618 s, 58.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.110606 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318958 s, 32.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0485317 s, 21.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.157812 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125134 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.165936 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0409 s, 25.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0507071 s, 20.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.282579 s, 3.7 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.312015 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.138445 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.225637 s, 4.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.256332 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00238823 s, 439 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0841701 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0750551 s, 14.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0618561 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0925272 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0908076 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.091812 s, 11.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0950408 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0979252 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0985001 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104332 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104853 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.068612 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.124918 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0415791 s, 25.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0665998 s, 15.7 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg347-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg347-client.virtnet' removed directory '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.277883 s, 60.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137712 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.174688 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0785938 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152199 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.254935 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.097181 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.264657 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.172915 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.280272 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.286238 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.371824 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.466338 s, 2.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.258403 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.410016 s, 2.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.351367 s, 3.0 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff888198860800.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff888198860800.lock_unused_count=7 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.51735 s, 2.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.115437 s, 9.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0647764 s, 16.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0519705 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00244515 s, 429 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00245797 s, 427 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115468 s, 90.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0898265 s, 11.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103789 s, 10.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0537852 s, 19.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0447233 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0832601 s, 12.6 MB/s1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.130576 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.122244 s, 8.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.208034 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.110424 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.218133 s, 4.8 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg347-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg347-client.virtnet' removed directory '/mnt/lustre/d77e.sanityn' PASS 77e (23s) == sanityn test 77f: check TBF JobID nrs policy ========== 15:14:35 (1776194075) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start runas jobid={iozone.500 dd.500 tiotest.500} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start iozone_runas jobid={iozone.500} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg347-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.413103 s, 40.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0586784 s, 17.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0979626 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0772103 s, 13.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.151765 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.181513 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.201021 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.221076 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.277423 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.201861 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.246688 s, 4.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.263913 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.242766 s, 4.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.285762 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.234066 s, 4.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.221128 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.34867 s, 3.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory ldlm.namespaces.lustre-OST0000-osc-ffff888198860800.lock_unused_count=2 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0346861 s, 30.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0653848 s, 16.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0142649 s, 73.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.112386 s, 9.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0374047 s, 28.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104111 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0658142 s, 15.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00443797 s, 236 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00550292 s, 191 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.117448 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0360056 s, 29.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199983 s, 52.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00632286 s, 166 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.149297 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017989 s, 58.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223801 s, 46.9 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg347-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg347-client.virtnet' removed directory '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change runas rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change iozone_runas rate=101 ost.OSS.ost_io.nrs_tbf_rule=change dd_runas rate=51 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg347-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.468568 s, 35.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0713444 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0544871 s, 19.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103784 s, 10.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.17701 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.175224 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.225693 s, 4.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.218826 s, 4.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.268383 s, 3.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.273709 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.277012 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.306933 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.288216 s, 3.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.336234 s, 3.1 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff888198860800.lock_unused_count=3 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.344255 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.367623 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.406222 s, 2.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0454247 s, 23.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191042 s, 54.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.100225 s, 10.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.123601 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0831558 s, 12.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0944271 s, 11.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.161316 s, 6.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156037 s, 67.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.19618 s, 5.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.206601 s, 5.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.171568 s, 6.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0364786 s, 28.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.174712 s, 6.0 MB/s1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.118754 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0583573 s, 18.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125037 s, 8.4 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg347-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg347-client.virtnet' removed directory '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop runas ost.OSS.ost_io.nrs_tbf_rule=stop iozone_runas ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg347-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.438327 s, 38.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0401684 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0532587 s, 19.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0579103 s, 18.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.173307 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.207011 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.164927 s, 6.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.227386 s, 4.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.254405 s, 4.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.239532 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.269543 s, 3.9 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff888198860800.lock_unused_count=2 ldlm.namespaces.lustre-OST0001-osc-ffff888198860800.lock_unused_count=5 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.284315 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.259918 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.286988 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.291951 s, 3.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.292327 s, 3.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.421673 s, 2.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.241976 s, 4.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0383079 s, 27.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.216122 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0564346 s, 18.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.213797 s, 4.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0401293 s, 26.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.120124 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0353129 s, 29.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308554 s, 34.0 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.121632 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0725852 s, 14.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0663329 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116276 s, 90.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0652118 s, 16.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.146517 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021594 s, 48.6 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg347-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg347-client.virtnet' removed directory '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_policies=fifo running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg347-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.492831 s, 34.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271827 s, 38.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0153695 s, 68.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.069335 s, 15.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0578498 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.110725 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0701711 s, 14.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.117739 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0701274 s, 15.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.042063 s, 24.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0382403 s, 27.4 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff888198860800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107333 s, 9.8 MB/s 1+0 records in 1+0 records out running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.186998 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.233702 s, 4.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.167272 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.215388 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.23122 s, 4.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00496585 s, 211 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.136734 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0816201 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.134446 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.14074 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0720364 s, 14.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00684938 s, 153 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.12567 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0984517 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0702072 s, 14.9 MB/s1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0634828 s, 16.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0517471 s, 20.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0357863 s, 29.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.046413 s, 22.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0360807 s, 29.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0384548 s, 27.3 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg347-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg347-client.virtnet' removed directory '/mnt/lustre/d77f.sanityn' PASS 77f (21s) == sanityn test 77g: Change TBF type directly ============ 15:14:57 (1776194097) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 ost.OSS.ost_io.nrs_policies=fifo PASS 77g (10s) == sanityn test 77h: Wrong policy name should report error, not LBUG ========================================================== 15:15:07 (1776194107) oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=abc: No such file or directory pdsh@oleg347-client: oleg347-server: ssh exited with exit code 2 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc: Unknown error 524 pdsh@oleg347-client: oleg347-server: ssh exited with exit code 12 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf reg abc: Unknown error 524 pdsh@oleg347-client: oleg347-server: ssh exited with exit code 12 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc efg: Unknown error 524 pdsh@oleg347-client: oleg347-server: ssh exited with exit code 12 PASS 77h (12s) == sanityn test 77i: Change rank of TBF rule ============= 15:15:18 (1776194118) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start before jobid={jobid} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start after jobid={jobid} rate=1000 rank=default ost.OSS.ost_io.nrs_tbf_rule=start target jobid={jobid} rate=1000 rank=after Move before itself ost.OSS.ost_io.nrs_tbf_rule=change target rank=target Move to higher rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=before Move to lower rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=after Move before default ost.OSS.ost_io.nrs_tbf_rule=change target rank=default ost.OSS.ost_io.nrs_policies=fifo PASS 77i (22s) == sanityn test 77j: check TBF-OPCode NRS policy ========= 15:15:40 (1776194140) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf opcode ost.OSS.ost_io.nrs_tbf_rule=start ost_r opcode={ost_read} rate=5 ost.OSS.ost_io.nrs_tbf_rule=start ost_w opcode={ost_write} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.38703 s, 43.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0511603 s, 20.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0594287 s, 17.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.111699 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.116745 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.153121 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.164566 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.179251 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133794 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.18339 s, 5.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.188389 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.17927 s, 5.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.19102 s, 5.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.213282 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.171952 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.176285 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.188527 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0442412 s, 23.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.053928 s, 19.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0565675 s, 18.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0498737 s, 21.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0555227 s, 18.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0612541 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0614361 s, 17.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0701946 s, 14.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0736786 s, 14.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0752649 s, 13.9 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0632153 s, 16.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0739201 s, 14.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.100725 s, 10.4 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0823657 s, 12.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0752898 s, 13.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.09446 s, 11.1 MB/s removed '/mnt/lustre/d77j.sanityn/nrs_w_oleg347-client.virtnet' removed '/mnt/lustre/d77j.sanityn/nrs_r_oleg347-client.virtnet' removed directory '/mnt/lustre/d77j.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 5 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 7.01331 s, 15.0 MB/s Write runtime is 8 s, speed is 12.500000 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.5902 s, 5.4 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77j.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_r ost.OSS.ost_io.nrs_tbf_rule=stop ost_w ost.OSS.ost_io.nrs_policies=fifo PASS 77j (64s) == sanityn test 77ja: check TBF-UID/GID NRS policy ======= 15:16:44 (1776194204) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg347-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.772707 s, 21.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.053124 s, 19.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.135969 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0743227 s, 14.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.106668 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.117678 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.121905 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107074 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.175496 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.256835 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.270275 s, 3.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.337071 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.291451 s, 3.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.355426 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.319666 s, 3.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.336792 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.392975 s, 2.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00243129 s, 431 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00227845 s, 460 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00644655 s, 163 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00772258 s, 136 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00229057 s, 458 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.060999 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00761573 s, 138 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00874551 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0734242 s, 14.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0383401 s, 27.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0550132 s, 19.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104814 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.09163 s, 11.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0129774 s, 80.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129602 s, 8.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0788594 s, 13.3 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg347-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg347-client.virtnet' removed directory '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.7915 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.9376 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg347-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.775474 s, 21.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.068431 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0822434 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0804353 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.17141 s, 6.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.14022 s, 7.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.123889 s, 8.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.114598 s, 9.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137505 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.232288 s, 4.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.247663 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.225467 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.267926 s, 3.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.311717 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.272636 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.296966 s, 3.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.351493 s, 3.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0324436 s, 32.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0432574 s, 24.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211151 s, 49.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278539 s, 37.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00835282 s, 126 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0459872 s, 22.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0496843 s, 21.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0685363 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0379168 s, 27.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0445752 s, 23.5 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111296 s, 94.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.108966 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00634124 s, 165 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144408 s, 72.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130755 s, 80.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262653 s, 39.9 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg347-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg347-client.virtnet' removed directory '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.7252 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.9992 s, 5.2 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77ja (148s) == sanityn test 77k: check TBF policy with NID/JobID/OPCode expression ========================================================== 15:19:13 (1776194353) ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_tbf_rule=start ext_w jobid={dd.500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r jobid={dd.500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg347-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.482032 s, 34.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0725554 s, 14.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0766247 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0807125 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.119883 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.180667 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.232581 s, 4.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.211676 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.23039 s, 4.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.197865 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.214258 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.197784 s, 5.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.192001 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.214412 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.283576 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.308815 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.255056 s, 4.1 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff888198860800.lock_unused_count=2 running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0548458 s, 19.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00259364 s, 404 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00692011 s, 152 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0664082 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.144931 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.110491 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125509 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0938275 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0885107 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00931443 s, 113 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0601883 s, 17.4 MB/s1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0402123 s, 26.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0486364 s, 21.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0556565 s, 18.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301174 s, 34.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0360353 s, 29.1 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg347-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg347-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 8.20499 s, 12.8 MB/s Write runtime is 9 s, speed is 11.111111 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.87689 s, 10.6 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext_w nid={0@lo 192.168.203.47@tcp}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r nid={0@lo 192.168.203.47@tcp}&opcode={ost_read} rate=10 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.450667 s, 37.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0533735 s, 19.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0691017 s, 15.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0592212 s, 17.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104459 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.115085 s, 9.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.157321 s, 6.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.176411 s, 5.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.170508 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.140897 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.157899 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.179472 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.14627 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.185007 s, 5.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.138332 s, 7.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.164709 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.171891 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282995 s, 37.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0760144 s, 13.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0535313 s, 19.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0614432 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316083 s, 33.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274301 s, 38.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0351998 s, 29.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0348006 s, 30.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0352593 s, 29.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.042067 s, 24.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0497857 s, 21.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.126053 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0705773 s, 14.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0614449 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0789755 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0666202 s, 15.7 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg347-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg347-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 7.97234 s, 13.2 MB/s Write runtime is 9 s, speed is 11.111111 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.89556 s, 10.6 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext nid={0@lo 192.168.203.47@tcp}&jobid={dd.500} rate=20 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg347-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.547336 s, 30.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0644388 s, 16.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0856393 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.14356 s, 7.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.171959 s, 6.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.252664 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.226058 s, 4.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.187549 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.205682 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.272026 s, 3.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.220826 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.263438 s, 4.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.235142 s, 4.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.305575 s, 3.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.27124 s, 3.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.311691 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.266155 s, 3.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0518701 s, 20.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.066249 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0658824 s, 15.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0765081 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0842725 s, 12.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0858936 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0930677 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0555106 s, 18.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0672356 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0603503 s, 17.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101496 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0684114 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0722331 s, 14.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0753102 s, 13.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.119514 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0909502 s, 11.5 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg347-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg347-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 8.70015 s, 12.1 MB/s Write runtime is 10 s, speed is 10.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.04515 s, 20.8 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext ost.OSS.ost_io.nrs_tbf_rule=start ext_a jobid={dd.500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b jobid={dd.500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg347-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.556787 s, 30.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0825435 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0852114 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.151574 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.16642 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152367 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.13962 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.139949 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107548 s, 9.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.159501 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.190191 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.196283 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.235334 s, 4.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.115994 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.22217 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.191234 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.204917 s, 5.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0402241 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0520222 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0820033 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0509229 s, 20.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0629503 s, 16.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0610011 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0935005 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0542896 s, 19.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0574064 s, 18.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0987949 s, 10.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101161 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0603913 s, 17.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0771468 s, 13.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107392 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0754166 s, 13.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0844402 s, 12.4 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg347-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg347-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 10.4549 s, 10.0 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.87587 s, 10.6 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 7.52632 s, 13.9 MB/s Write runtime is 8 s, speed is 12.500000 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.98157 s, 10.5 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_tbf_rule=start ext_ug uid={500}&gid={1000} rate=5 running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg347-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.781703 s, 21.5 MB/s running as uid/gid/euid/egid 500/1000/500/1000, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0861235 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133213 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0927169 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152503 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.163712 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.141828 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.16075 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.197178 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.247825 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.221741 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.239214 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.258114 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.264623 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.271655 s, 3.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.348902 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.318425 s, 3.3 MB/s running as uid/gid/euid/egid 500/1000/500/1000, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148884 s, 70.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245681 s, 42.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0802085 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200806 s, 52.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270711 s, 38.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287896 s, 36.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0396257 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0553493 s, 18.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0420339 s, 24.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0457159 s, 22.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0566731 s, 18.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0542028 s, 19.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0623468 s, 16.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.062577 s, 16.8 MB/s1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0649652 s, 16.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0919254 s, 11.4 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg347-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg347-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.856 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.6183 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_ug ost.OSS.ost_io.nrs_tbf_rule=start ext_uw uid={500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_ur uid={500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg347-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.544655 s, 30.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026201 s, 40.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0765577 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103507 s, 10.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0726919 s, 14.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0888224 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.153777 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.188914 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.160633 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.207848 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.218159 s, 4.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.239636 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152006 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133402 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.199527 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.194348 s, 5.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.234303 s, 4.5 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff888198860800.lock_unused_count=4 running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164079 s, 63.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175291 s, 59.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265553 s, 39.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0542382 s, 19.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253719 s, 41.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0418014 s, 25.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313535 s, 33.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028696 s, 36.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.038117 s, 27.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0460826 s, 22.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0420346 s, 24.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0521526 s, 20.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0455025 s, 23.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0474151 s, 22.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.053024 s, 19.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0634814 s, 16.5 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg347-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg347-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 8.84227 s, 11.9 MB/s Write runtime is 10 s, speed is 10.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.9427 s, 10.5 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_uw ost.OSS.ost_io.nrs_tbf_rule=stop ext_ur ost.OSS.ost_io.nrs_tbf_rule=start ext_a uid={500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b uid={500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg347-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.412869 s, 40.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292787 s, 35.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322912 s, 32.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0472179 s, 22.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0675158 s, 15.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0876556 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0998062 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0943768 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0953237 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.164476 s, 6.4 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.179376 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.205495 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.201057 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.245696 s, 4.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.257509 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.258307 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.299338 s, 3.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.154951 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.188329 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.224905 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152862 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.185699 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188749 s, 55.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152197 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.146719 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.148736 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.118104 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0975273 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.146139 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0800367 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.135925 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0719645 s, 14.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0759907 s, 13.8 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg347-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg347-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 13.7645 s, 7.6 MB/s Write runtime is 15 s, speed is 6.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.93407 s, 10.6 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 10.3537 s, 10.1 MB/s Write runtime is 12 s, speed is 8.333333 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.91988 s, 10.6 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_policies=fifo PASS 77k (439s) == sanityn test 77l: check the output of NRS policies for generic TBF ========================================================== 15:26:31 (1776194791) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_policies=fifo PASS 77l (11s) == sanityn test 77m: check NRS Delay slows write RPC processing ========================================================== 15:26:42 (1776194802) ost.OSS.ost_io.nrs_policies=delay ost.OSS.ost_io.nrs_delay_min=4 ost.OSS.ost_io.nrs_delay_max=4 ost.OSS.ost_io.nrs_delay_pct=100 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg347-client.virtnet] [bs=1M] [count=1] [oflag=direct] [conv=fdatasync] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 3.70111 s, 283 kB/s running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg347-client.virtnet] [bs=1M] [count=10] [oflag=direct] [conv=fdatasync] 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 40.0947 s, 262 kB/s ost.OSS.ost_io.nrs_policies=fifo PASS 77m (57s) == sanityn test 77n: check wildcard support for TBF JobID NRS policy ========================================================== 15:27:39 (1776194859) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={*.500} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.325613 s, 51.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0375876 s, 27.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0862909 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.112903 s, 9.3 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.132987 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.132178 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.190279 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.208815 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.237464 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.175734 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.179706 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.259238 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.196038 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.195215 s, 5.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.253587 s, 4.1 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff888198860800.lock_unused_count=6 ldlm.namespaces.lustre-OST0001-osc-ffff888198860800.lock_unused_count=6 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.232019 s, 4.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.344149 s, 3.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206063 s, 50.9 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217007 s, 48.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0473224 s, 22.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0831338 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0784345 s, 13.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0376075 s, 27.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.102821 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0489066 s, 21.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0557334 s, 18.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0960915 s, 10.9 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff888198860800.lock_unused_count=4 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.072154 s, 14.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0689887 s, 15.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0764003 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0830895 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0881927 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0967784 s, 10.8 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg347-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg347-client.virtnet' removed directory '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77n.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 7.45216 s, 14.1 MB/s Write runtime is 9 s, speed is 11.111111 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77n.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.19545 s, 20.2 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.*} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.266945 s, 62.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0655059 s, 16.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.083448 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0974834 s, 10.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.205631 s, 5.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.13702 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.18853 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.157582 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.241666 s, 4.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.188639 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.184005 s, 5.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.158873 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.257928 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.224037 s, 4.7 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.259976 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.23713 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.208302 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0746912 s, 14.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0412877 s, 25.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0476645 s, 22.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0484475 s, 21.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0595679 s, 17.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0990125 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0735156 s, 14.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0589285 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0663016 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0666651 s, 15.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0709224 s, 14.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0661 s, 15.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104083 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107592 s, 9.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0737017 s, 14.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0786511 s, 13.3 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg347-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg347-client.virtnet' removed directory '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 8.19082 s, 12.8 MB/s Write runtime is 10 s, speed is 10.000000 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.02891 s, 20.9 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_policies=fifo PASS 77n (92s) == sanityn test 77o: Changing rank should not panic ====== 15:29:11 (1776194951) mds.MDS.mdt.nrs_policies=tbf nid mds.MDS.mdt.nrs_tbf_rule=start name nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=start name1 nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=change name1 rank=name mds.MDS.mdt.nrs_tbf_rule=stop name mds.MDS.mdt.nrs_policies=fifo PASS 77o (10s) == sanityn test 77q: Parallel TBF rule definitions should not panic ========================================================== 15:29:21 (1776194961) mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_policies=fifo PASS 77q (104s) == sanityn test 77p: Check validity of rule names for TBF policies ========================================================== 15:31:05 (1776195065) mds.MDS.mdt.nrs_policies=tbf oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_overflo uid={500} rate=500: File name too long pdsh@oleg347-client: oleg347-server: ssh exited with exit code 36 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_empty: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p@spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p.spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p~spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p#spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p/spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p^spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p%spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p*spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p;spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p,spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p?spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77pspec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p:spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p+spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p=spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p)spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p(spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p{spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p}spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p|spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p[spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p]spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p!spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p&spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p$spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p`spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p\spec uid={500} rate=500: Invalid argument pdsh@oleg347-client: oleg347-server: ssh exited with exit code 22 mds.MDS.mdt.nrs_policies=fifo PASS 77p (31s) == sanityn test 78: Enable policy and specify tunings right away ========================================================== 15:31:36 (1776195096) oleg347-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_orr_quantum=1: No such device pdsh@oleg347-client: oleg347-server: ssh exited with exit code 19 ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_policies=fifo PASS 78 (8s) == sanityn test 79: xattr: intent error ================== 15:31:44 (1776195104) File: /mnt/lustre/d79.sanityn Size: 512 Blocks: 1 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272505430 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 15:31:46.000000000 -0400 Modify: 2026-04-14 15:31:46.000000000 -0400 Change: 2026-04-14 15:31:46.000000000 -0400 Birth: 2026-04-14 15:31:45.000000000 -0400 fail_val=0 fail_loc=0x80000160 fail_val=0 fail_loc=0x80000131 # file: mnt/lustre/d79.sanityn trusted.name1="value1" PASS 79 (18s) == sanityn test 80a: migrate directory when some children is being opened ========================================================== 15:32:03 (1776195123) SKIP: sanityn test_80a needs >= 2 MDTs SKIP 80a (3s) == sanityn test 80b: Accessing directory during migration ========================================================== 15:32:06 (1776195126) SKIP: sanityn test_80b needs >= 2 MDTs SKIP 80b (3s) == sanityn test 81a: rename and stat under striped directory ========================================================== 15:32:09 (1776195129) SKIP: sanityn test_81a needs >= 2 MDTs SKIP 81a (2s) == sanityn test 81b: rename under striped directory doesn't deadlock ========================================================== 15:32:12 (1776195132) SKIP: sanityn test_81b We need at least 2 MDTs for this test SKIP 81b (3s) == sanityn test 81c: rename revoke LOOKUP lock for remote object ========================================================== 15:32:15 (1776195135) SKIP: sanityn test_81c needs >= 4 MDTs SKIP 81c (3s) == sanityn test 82: fsetxattr and fgetxattr on orphan files ========================================================== 15:32:18 (1776195138) multiop /mnt/lustre/f82.sanityn vO_ac TMPPIPE=/tmp/multiop_open_wait_pipe.7160 multiop /mnt/lustre2/f82.sanityn vo_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.7160 PASS 82 (7s) == sanityn test 83: access striped directory while it is being created/unlinked ========================================================== 15:32:25 (1776195145) SKIP: sanityn test_83 needs >= 2 MDTs SKIP 83 (3s) == sanityn test 84: 0-nlink race in lu_object_find() ===== 15:32:28 (1776195148) fail_loc=0x8000060b PASS 84 (12s) == sanityn test 90: open/create and unlink striped directory ========================================================== 15:32:40 (1776195160) SKIP: sanityn test_90 needs >= 2 MDTs SKIP 90 (3s) == sanityn test 91: chmod and unlink striped directory === 15:32:43 (1776195163) SKIP: sanityn test_91 needs >= 2 MDTs SKIP 91 (3s) == sanityn test 92: create remote directory under orphan directory ========================================================== 15:32:46 (1776195166) SKIP: sanityn test_92 needs >= 2 MDTs SKIP 92 (2s) == sanityn test 93: alloc_rr should not allocate on same ost ========================================================== 15:32:49 (1776195169) fail_loc=0x00000163 fail_loc=0x0 /mnt/lustre/f93.sanityn-1/file1 lmm_stripe_count: 2 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2626 0xa42 0 0 2644 0xa54 0 /mnt/lustre2/f93.sanityn-2/file2 lmm_stripe_count: 2 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2645 0xa55 0 1 2627 0xa43 0 rc1=0 and rc2=0 PASS 93 (14s) == sanityn test 94: signal vs CP callback race =========== 15:33:03 (1776195183) osc.lustre-OST0000-osc-ffff888198860800.idle_timeout=0 osc.lustre-OST0000-osc-ffff8881996ba800.idle_timeout=0 osc.lustre-OST0001-osc-ffff888198860800.idle_timeout=0 osc.lustre-OST0001-osc-ffff8881996ba800.idle_timeout=0 2+0 records in 2+0 records out 8192 bytes (8.2 kB, 8.0 KiB) copied, 0.238246 s, 34.4 kB/s fail_val=5 fail_loc=0x80000312 fail_val=6 fail_loc=0x80000329 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 3.07598 s, 1.3 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 5135: 283259 Alarm clock dd if=/dev/zero of=$DIR/$tfile conv=notrunc oflag=append bs=4k count=1 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0722694 s, 56.7 kB/s osc.lustre-OST0000-osc-ffff888198860800.idle_timeout=debug osc.lustre-OST0000-osc-ffff8881996ba800.idle_timeout=debug osc.lustre-OST0001-osc-ffff888198860800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8881996ba800.idle_timeout=debug PASS 94 (14s) == sanityn test 95b: Check readpage() on a page that is no longer uptodate ========================================================== 15:33:18 (1776195198) llite.lustre-ffff888198860800.fast_read=0 llite.lustre-ffff8881996ba800.fast_read=0 1+0 records in 1+0 records out 12288 bytes (12 kB, 12 KiB) copied, 0.0100094 s, 1.2 MB/s fail_loc=0x80001424 fail_val=5 fail_loc=0 llite.lustre-ffff888198860800.fast_read=1 llite.lustre-ffff8881996ba800.fast_read=1 PASS 95b (13s) == sanityn test 100a: DoM: glimpse RPCs for stat without IO lock (DoM only file) ========================================================== 15:33:31 (1776195211) SKIP: sanityn test_100a Reserved for glimpse-ahead SKIP 100a (3s) == sanityn test 100b: DoM: no glimpse RPC for stat with IO lock (DoM only file) ========================================================== 15:33:34 (1776195214) 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00427209 s, 959 kB/s /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK PASS 100b (7s) == sanityn test 100c: DoM: write vs stat without IO lock (combined file) ========================================================== 15:33:41 (1776195221) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.102938 s, 20.4 MB/s /mnt/lustre/d100c.sanityn/dom has type file OK /mnt/lustre/d100c.sanityn/dom has size 2097152 OK PASS 100c (6s) == sanityn test 100d: DoM: write+truncate vs stat without IO lock (combined file) ========================================================== 15:33:47 (1776195227) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0591809 s, 35.4 MB/s /mnt/lustre/d100d.sanityn/dom has type file OK /mnt/lustre/d100d.sanityn/dom has size 4096 OK PASS 100d (5s) == sanityn test 100e: DoM: read on open and file size ==== 15:33:52 (1776195232) 1+0 records in 1+0 records out 12000 bytes (12 kB, 12 KiB) copied, 0.00950348 s, 1.3 MB/s PASS 100e (6s) == sanityn test 101a: Discard DoM data on unlink ========= 15:33:58 (1776195238) /mnt/lustre/f101a.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000874492 s, 4.7 MB/s PASS 101a (5s) == sanityn test 101b: Discard DoM data on rename ========= 15:34:03 (1776195243) /mnt/lustre/f101b.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00443633 s, 923 kB/s PASS 101b (5s) == sanityn test 101c: Discard DoM data on close-unlink === 15:34:08 (1776195248) /mnt/lustre/f101c.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00223098 s, 1.8 MB/s PASS 101c (7s) SKIP: sanityn test_102 skipping ALWAYS excluded test 102 == sanityn test 103: Test size correctness with lockahead ========================================================== 15:34:16 (1776195256) fail_loc=0x415 fail_loc=0x415 fail_val=2 Incorrect size expected (no glimpse fix): Starting test test23 at 1776195259 lockahead_test: lockahead_test.c:1186: test23: assertion 'sb.st_size == sb2.st_size' failed: size on /mnt/lustre/d103.sanityn/f103.sanityn and /mnt/lustre2/d103.sanityn/f103.sanityn differs: 0 vs 1048576 fail_loc=0 fail_loc=0x214 fail_val=2 Starting test test23 at 1776195262 Finishing test test23 at 1776195262 PASS 103 (13s) == sanityn test 104: Verify that MDS stores atime/mtime/ctime during close ========================================================== 15:34:29 (1776195269) SKIP: sanityn test_104 ldiskfs only test SKIP 104 (3s) == sanityn test 105: Glimpse and lock cancel race ======== 15:34:32 (1776195272) fail_loc=0x416 PASS 105 (51s) == sanityn test 106a: Verify the btime via statx() ======= 15:35:24 (1776195324) SKIP: sanityn test_106a Test only for ldiskfs and statx() supported SKIP 106a (2s) == sanityn test 106b: Glimpse RPCs test for statx ======== 15:35:26 (1776195326) 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0132927 s, 77.0 kB/s File: /mnt/lustre/f106b.sanityn Size: 1024 Blocks: 1 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 144115205272505458 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 15:35:28.000000000 -0400 Modify: 2026-04-14 15:35:28.000000000 -0400 Change: 2026-04-14 15:35:28.000000000 -0400 Birth: 2026-04-14 15:35:27.000000000 -0400 /mnt/lustre/f106b.sanityn 144115205272505458 -rw-r--r-- 1 0 0 1776195327 1776195328 1776195328 File: /mnt/lustre/f106b.sanityn Size: 1024 Blocks: 1 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 144115205272505458 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 15:35:28.000000000 -0400 Modify: 2026-04-14 15:35:28.000000000 -0400 Change: 2026-04-14 15:35:28.000000000 -0400 Birth: 2026-04-14 15:35:27.000000000 -0400 1776195328 1024 1 PASS 106b (6s) == sanityn test 106c: Verify statx attributes mask ======= 15:35:33 (1776195333) PASS 106c (7s) == sanityn test 107a: Basic grouplock conflict =========== 15:35:39 (1776195339) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.206279 s, 50.8 MB/s /mnt/lustre/f107a.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2653 0xa5d 0 multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.7160 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.7160 First grouplock blocks second one PASS 107a (8s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 15:35:48 (1776195348) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.236091 s, 44.4 MB/s /mnt/lustre/f107b.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2632 0xa48 0 multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.7160 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (11s) == sanityn test 108a: lseek: parallel updates ============ 15:35:59 (1776195359) 1+0 records in 1+0 records out 10000 bytes (10 kB, 9.8 KiB) copied, 0.00748039 s, 1.3 MB/s fail_val=4 fail_loc=0x80000414 1+0 records in 1+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 4.92625 s, 1.7 MB/s PASS 108a (11s) == sanityn test 109: Race with several mount instances on 1 node ========================================================== 15:36:10 (1776195370) 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Starting race between client mount instances (50 iterations): Iteration 1 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 3 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 4 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 5 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 6 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 7 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 8 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 9 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 10 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 11 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 12 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 13 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 14 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 15 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 16 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 17 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 18 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 19 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 20 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 21 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 22 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 23 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 24 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 25 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 26 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 27 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 28 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 29 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 30 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 31 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Iteration 32 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 33 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 34 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 35 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 36 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 37 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 38 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 39 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 40 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 41 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 42 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 43 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 44 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 45 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 46 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 47 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 48 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 49 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Iteration 50 Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 192.168.203.147@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.203.147@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg347-client.virtnet /mnt/lustre (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg347-server' oleg347-server: oleg347-server.virtnet: executing load_modules_local oleg347-server: Loading modules from /home/green/git/lustre-release/lustre oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg347-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg347-server: detected 4 online CPUs by sysfs oleg347-server: Force libcfs to create 2 CPU partitions Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre Starting client: oleg347-client.virtnet: -o user_xattr,flock oleg347-server@tcp:/lustre /mnt/lustre2 PASS 109 (1184s) == sanityn test 110: do not grant another lock on resend ========================================================== 15:55:54 (1776196554) fail_loc=0x525 fail_val=3 fail_loc=0x534 File: /mnt/lustre/f110.sanityn Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205306056707 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 15:55:55.000000000 -0400 Modify: 2026-04-14 15:55:55.000000000 -0400 Change: 2026-04-14 15:55:55.000000000 -0400 Birth: 2026-04-14 15:55:55.000000000 -0400 fail_loc=0 fail_val=0 Connected clients: oleg347-client.virtnet oleg347-client.virtnet PASS 110 (41s) == sanityn test 111: A racy rename/link an open file should not cause fs corruption ========================================================== 15:56:35 (1776196595) SKIP: sanityn test_111 needs >= 2 MDTs SKIP 111 (3s) == sanityn test 112: update max-inherit in default LMV === 15:56:38 (1776196598) SKIP: sanityn test_112 We need at least 2 MDTs for this test SKIP 112 (2s) == sanityn test 113: check servers of specified fs ======= 15:56:41 (1776196601) lustre-OST0000-osc-ffff8881901a1000 active. lustre-OST0001-osc-ffff8881901a1000 active. lustre-OST0000-osc-ffff8881901a1000 active. lustre-OST0001-osc-ffff8881901a1000 active. MGC192.168.203.147@tcp active. PASS 113 (6s) cleanup: ====================================================== == sanityn test complete, duration 8366 sec ============== 15:56:49 (1776196609) Stopping clients: oleg347-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg347-client.virtnet /mnt/lustre2 opts: