-----============= acceptance-small: sanityn ============----- Tue Apr 14 14:09:21 EDT 2026 oleg214-server: ls: cannot access '/home/green/git/lustre-release/lustre/tests/except/sanityn.*ex': No such file or directory excepting tests: 27 28 102 skipping tests SLOW=no: 33a Starting client oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 Started clients oleg214-client.virtnet: 192.168.202.114@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt) oleg214-client.virtnet: executing check_config_client /mnt/lustre oleg214-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg214-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9039c7e21800.idle_timeout=debug osc.lustre-OST0000-osc-ffff9039c92f2800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9039c7e21800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9039c92f2800.idle_timeout=debug disable quota as required oleg214-server: oleg214-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0384627 s, 27.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f7152] == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 14:10:18 (1776190218) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (7s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 14:10:25 (1776190225) -rw-r--r-- 1 root root 0 Apr 14 14:10 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (7s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 14:10:32 (1776190232) -rw-r--r-- 1 root root 0 Apr 14 14:10 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (8s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 14:10:40 (1776190240) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (7s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 14:10:47 (1776190247) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (7s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 14:10:54 (1776190254) total 1 -rwxrwxrwx 1 root root 0 Apr 14 14:10 f2a -rwxrwxrwx 1 root root 0 Apr 14 14:10 f2b total 1 -rwxrwxrwx 1 root root 0 Apr 14 14:10 f2a -rwxrwxrwx 1 root root 0 Apr 14 14:10 f2b running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes copied, 0.0158168 s, 32.4 kB/s PASS 2e (8s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 14:11:02 (1776190262) SKIP: sanityn test_2f needs >= 2 MDTs SKIP 2f (3s) == sanityn test 2g: check blocks update on sync write ==== 14:11:06 (1776190266) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.512964 s, 4.1 MB/s /mnt/lustre/f2g.sanityn has 4103 blocks /mnt/lustre2/f2g.sanityn has 4103 blocks PASS 2g (7s) == sanityn test 3: symlink on one mtpt, readlink on another ===================================================================== 14:11:13 (1776190273) PASS 3 (7s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 14:11:20 (1776190280) PASS 4 (8s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 14:11:28 (1776190288) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (8s) == sanityn test 6: remove of open file on other node ============================================================================ 14:11:36 (1776190296) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (8s) == sanityn test 7: remove of open directory on other node ======================================================================= 14:11:44 (1776190304) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (7s) == sanityn test 8: remove of open special file on other node ==================================================================== 14:11:51 (1776190311) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (7s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 14:11:58 (1776190318) PASS 9a (7s) == sanityn test 9b: append to striped sparse file ======== 14:12:05 (1776190325) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.049263 s, 21.3 MB/s 3+0 records in 3+0 records out 3 bytes copied, 0.131181 s, 0.0 kB/s Data read (expecting 'foo'): foo PASS 9b (8s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 14:12:13 (1776190333) 1+0 records in 1+0 records out 1 byte copied, 0.010843 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00789876 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00766784 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00662173 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0196467 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0134244 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0116738 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0104336 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.00586603 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0073174 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.0053944 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte copied, 0.008401 s, 0.1 kB/s PASS 10a (9s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 14:12:22 (1776190342) 1+0 records in 1+0 records out 3072 bytes (3.1 kB, 3.0 KiB) copied, 0.058285 s, 52.7 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0552143 s, 74.2 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB, 3.0 KiB) copied, 0.000301874 s, 10.2 MB/s PASS 10b (7s) == sanityn test 11: execution of file opened for write should return error ============================================================== 14:12:29 (1776190349) multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.7152 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 273: /mnt/lustre2/d11/f: Text file busy PASS 11 (7s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 14:12:37 (1776190357) warning: '-runtime' deprecated, use '-t runtime' instead - link 299 (time 1776190369.52 total 10.02 last 29.85) - link 579 (time 1776190379.54 total 20.04 last 27.94) - link 906 (time 1776190389.55 total 30.05 last 32.67) - link 1173 (time 1776190399.57 total 40.07 last 26.65) - link 1491 (time 1776190409.59 total 50.09 last 31.74) - link 1801 (time 1776190419.62 total 60.11 last 30.91) - link 2054 (time 1776190429.64 total 70.14 last 25.24) - link 2317 (time 1776190439.67 total 80.17 last 26.23) - link 2569 (time 1776190449.70 total 90.19 last 25.13) total: 2828 link in 100.05 seconds: 28.27 ops/second using seed 4158507633 running for 100 seconds - stat 8170 (time 1776190371 ; total 11 ; last 11) - stat 10000 (time 1776190372 ; total 12 ; last 1) - stat 16511 (time 1776190383 ; total 23 ; last 11) - stat 20000 (time 1776190387 ; total 27 ; last 4) - stat 30000 (time 1776190397 ; total 37 ; last 10) - stat 39289 (time 1776190408 ; total 48 ; last 11) - stat 40000 (time 1776190408 ; total 48 ; last 0) - stat 45288 (time 1776190419 ; total 59 ; last 11) - stat 50000 (time 1776190428 ; total 68 ; last 9) - stat 54265 (time 1776190439 ; total 79 ; last 11) - stat 58962 (time 1776190450 ; total 90 ; last 11) - stat 60000 (time 1776190453 ; total 93 ; last 3) total: 62758 stats in 100 seconds: 627.580017 stats/second - unlinked 0 (time 1776190410 ; total 0 ; last 0) unlink(/mnt/lustre2/lockdir/lockfile2828) error: No such file or directory total: 2827 unlinks in 82 seconds: 34.475609 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (19739) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (19741) - No such process PASS 12 (141s) == sanityn test 13: test directory page revocation ======= 14:14:58 (1776190498) f13 f13 PASS 13 (10s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 14:15:08 (1776190508) multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.7152 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 308: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4309: 20912 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (9s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 14:15:17 (1776190517) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4309: 21486 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (8s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 14:15:25 (1776190525) truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 323: 22058 Terminated $DIR1/$tdir/sleep 60 PASS 14b (7s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 14:15:32 (1776190532) cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 335: 22635 Terminated $DIR1/$tdir/sleep 60 PASS 14c (9s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 14:15:41 (1776190541) chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 346: 23211 Terminated $DIR1/$tdir/sleep 60 PASS 14d (9s) == sanityn test 15: test out-of-space with multiple writers ===================================================================== 14:15:51 (1776190551) PATH=/opt/iozone/bin:/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin: STRIPECOUNT=2 ORIGFREE=7524352 MAXFREE=800000 SKIP: oos2 test_15 oos2.sh: 7524352kB free gt MAXFREE 800000kB, increase 800000 (or reduce test fs size) to proceed sleep 5 for ZFS MDS Waiting for MDT destroys to complete SKIP 15 (24s) == sanityn test 16a: 500 iterations of dual-mount fsx ==== 14:16:15 (1776190575) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.654443 s, 3.2 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.229361 s, 9.1 MB/s Chance of close/open is 1 in 50 Seed set to 580 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read 000004[0] 1776190580.891755 write 0x0190d9 thru 0x01aaf4 (0x1a1c bytes) 000006[0] 1776190580.932056 mapwrite 0x4896ad thru 0x49793b (0xe28f bytes) 000008[1] 1776190581.132419 read 0x165874 thru 0x16e38e (0x8b1b bytes) 000011[1] 1776190581.178414 write 0x0076d8 thru 0x0161ff (0xeb28 bytes) 000012[1] 1776190581.211456 read 0x2f9429 thru 0x309422 (0xfffa bytes) 000013[1] 1776190581.259323 read 0x146e09 thru 0x151067 (0xa25f bytes) 000016[0] 1776190581.332614 mapwrite 0x419f15 thru 0x4276e8 (0xd7d4 bytes) 000018[0] 1776190581.562678 read 0x3267d0 thru 0x331b8a (0xb3bb bytes) 000019[0] 1776190581.589488 mapwrite 0x1b10d8 thru 0x1ba09e (0x8fc7 bytes) 000021[0] 1776190581.777868 write 0x28bb5d thru 0x28dbd3 (0x2077 bytes) 000022[1] 1776190581.854403 write 0x548cd2 thru 0x54c1b4 (0x34e3 bytes) 000025[1] 1776190581.918719 read 0x0032ee thru 0x004853 (0x1566 bytes) 000028[1] 1776190582.035405 read 0x45b2fa thru 0x466bef (0xb8f6 bytes) 000030[0] 1776190582.072748 write 0x74cef8 thru 0x7577ae (0xa8b7 bytes) truncating to largest ever: 0x707e88 000031[1] 1776190582.094079 trunc from 0x7577af to 0x707e87 (0x4f927 bytes) 000032[1] 1776190582.189352 trunc from 0x707e88 to 0x1da5f0 (0x52d897 bytes) 000033[0] 1776190582.210236 write 0x408f50 thru 0x412f07 (0x9fb8 bytes) 000034[1] 1776190582.241528 write 0x5cf1cd thru 0x5d94f2 (0xa326 bytes) 000035[1] 1776190582.254101 mapread 0x13e29f thru 0x14bcda (0xda3c bytes) 000036[1] 1776190582.356097 mapwrite 0x8a2441 thru 0x8b0605 (0xe1c5 bytes) 000037[1] 1776190582.567638 read 0x356974 thru 0x35c187 (0x5814 bytes) 000038[1] 1776190582.707316 mapwrite 0x21e4e6 thru 0x21e5b7 (0xd2 bytes) 000041[0] 1776190582.861007 mapread 0x7781ec thru 0x77deb7 (0x5ccc bytes) 000044[1] 1776190583.013417 read 0x184a66 thru 0x193d73 (0xf30e bytes) 000045[0] 1776190583.094168 mapread 0x4b984f thru 0x4c6ae7 (0xd299 bytes) 000048[0] 1776190583.201916 write 0x10a9dd thru 0x1197c5 (0xede9 bytes) 000049[0] 1776190583.316943 trunc from 0x8b0606 to 0x4b342f (0x3fd1d6 bytes) 000050[0] 1776190583.382997 read 0x26d907 thru 0x27cc1f (0xf319 bytes) 000051[0] 1776190583.464351 write 0x92d70c thru 0x9323c8 (0x4cbd bytes) 000053[1] 1776190583.500379 mapread 0x7e0180 thru 0x7ea7a9 (0xa62a bytes) 000054[0] 1776190583.665760 write 0x66bd5e thru 0x66ec56 (0x2ef9 bytes) 000055[1] 1776190583.718568 mapread 0x51e50b thru 0x52df51 (0xfa47 bytes) 000059[1] 1776190583.881743 mapwrite 0x21432c thru 0x2226e7 (0xe3bc bytes) 000062[0] 1776190584.226145 mapwrite 0x5a05c9 thru 0x5a3ec2 (0x38fa bytes) 000065[1] 1776190584.477739 read 0x20f4e8 thru 0x21bb94 (0xc6ad bytes) 000066[0] 1776190584.530368 trunc from 0x9323c9 to 0x4fdce6 (0x4346e2 bytes) truncating to largest ever: 0x99b081 000071[0] 1776190584.586693 trunc from 0x4fdce7 to 0x99b080 (0x49d39a bytes) 000075[1] 1776190584.663529 read 0x57e893 thru 0x58bda1 (0xd50f bytes) 000076[1] 1776190584.704983 mapwrite 0x94d44f thru 0x9588e3 (0xb495 bytes) 000077[1] 1776190584.897986 trunc from 0x99b081 to 0x06fa3e (0x92b642 bytes) 000081[1] 1776190585.058247 trunc from 0x06fa3f to 0x9872a6 (0x917868 bytes) 000082[0] 1776190585.128053 read 0x8b5eae thru 0x8bdc1a (0x7d6d bytes) 000084[1] 1776190585.195539 read 0x137633 thru 0x13ce6d (0x583b bytes) 000085[1] 1776190585.323157 mapread 0x3dd2af thru 0x3e7b53 (0xa8a5 bytes) 000088[0] 1776190585.411658 read 0x141c71 thru 0x14d3e5 (0xb775 bytes) 000090[0] 1776190585.668429 read 0x3cc7b9 thru 0x3d3838 (0x7080 bytes) 000091[0] 1776190585.669294 write 0x782cf9 thru 0x78b3a5 (0x86ad bytes) 000093[0] 1776190585.719940 write 0x1d8a72 thru 0x1deeae (0x643d bytes) 000094[1] 1776190585.732913 read 0x34bb3a thru 0x35b5ed (0xfab4 bytes) 000095[1] 1776190585.848448 mapread 0x2b82e5 thru 0x2bf21b (0x6f37 bytes) 000097[1] 1776190585.849551 mapwrite 0x405d7d thru 0x40ed7b (0x8fff bytes) 000098[1] 1776190586.034494 read 0x1ad224 thru 0x1b74e0 (0xa2bd bytes) 000100[1] 1776190586.110495 mapread 0x59e70e thru 0x5a5487 (0x6d7a bytes) 000102[0] 1776190586.184070 mapread 0x706cd7 thru 0x70e8c5 (0x7bef bytes) 000103[1] 1776190586.230684 trunc from 0x9872a7 to 0x597c05 (0x3ef6a1 bytes) 000106[0] 1776190586.325067 trunc from 0x597c06 to 0x07d3ff (0x51a806 bytes) 000109[0] 1776190586.380301 mapread 0x037172 thru 0x03bc9a (0x4b29 bytes) 000110[1] 1776190586.400910 write 0x402e73 thru 0x40d1a3 (0xa331 bytes) 000111[0] 1776190586.438606 mapwrite 0x716aa0 thru 0x722e5b (0xc3bc bytes) 000112[1] 1776190586.663817 write 0x0c58d7 thru 0x0c7156 (0x1880 bytes) 000113[0] 1776190586.708351 write 0x94629a thru 0x947c46 (0x19ad bytes) 000114[1] 1776190586.733441 mapwrite 0x4e2d4a thru 0x4ee21a (0xb4d1 bytes) 000115[0] 1776190586.961847 trunc from 0x947c47 to 0x8b9f46 (0x8dd00 bytes) 000116[1] 1776190587.061950 write 0x1d16c8 thru 0x1d6eff (0x5838 bytes) 000118[0] 1776190587.187519 mapread 0x1cf094 thru 0x1ded0f (0xfc7c bytes) 000122[1] 1776190587.511909 mapread 0x70721f thru 0x709c16 (0x29f8 bytes) 000124[0] 1776190587.671032 mapwrite 0x99dca8 thru 0x9a5fb1 (0x830a bytes) 000126[0] 1776190588.022878 write 0x06ae38 thru 0x074e6f (0xa038 bytes) 000128[0] 1776190588.049621 write 0x9906fe thru 0x9978fb (0x71fe bytes) 000131[1] 1776190588.142660 read 0x445c0e thru 0x45188e (0xbc81 bytes) 000134[1] 1776190588.279698 write 0x779ffb thru 0x785dfa (0xbe00 bytes) 000136[1] 1776190588.374283 write 0x7d86c8 thru 0x7d97f3 (0x112c bytes) 000137[0] 1776190588.413072 mapwrite 0x964013 thru 0x968c78 (0x4c66 bytes) 000138[0] 1776190588.573072 mapread 0x598a9c thru 0x598dee (0x353 bytes) 000140[0] 1776190588.599409 mapwrite 0x59c42e thru 0x5a5979 (0x954c bytes) 000141[1] 1776190588.731791 read 0x98cf2d thru 0x99868a (0xb75e bytes) 000142[1] 1776190588.772437 write 0x1e8550 thru 0x1f4319 (0xbdca bytes) 000143[1] 1776190588.815324 write 0x1dd27f thru 0x1e77a5 (0xa527 bytes) 000146[1] 1776190588.840998 trunc from 0x9a5fb2 to 0x46250d (0x543aa4 bytes) 000147[0] 1776190588.895815 mapread 0x331ea7 thru 0x337b20 (0x5c7a bytes) 000148[1] 1776190589.097367 mapwrite 0x97178d thru 0x97571a (0x3f8e bytes) 000149[1] 1776190589.405133 write 0x2098e5 thru 0x213f15 (0xa631 bytes) 000150[1] 1776190589.471857 read 0x6c080e thru 0x6cb7be (0xafb1 bytes) 000151[0] 1776190589.577282 read 0x2e412b thru 0x2ef4cb (0xb3a1 bytes) 000153[0] 1776190589.637655 mapread 0x6ecc32 thru 0x6fa942 (0xdd11 bytes) 000154[1] 1776190589.743939 trunc from 0x97571b to 0x57d8cf (0x3f7e4b bytes) 000156[1] 1776190589.826338 mapread 0x216515 thru 0x223a5d (0xd549 bytes) 000158[1] 1776190589.955167 write 0x3d1170 thru 0x3de398 (0xd229 bytes) 000160[1] 1776190590.035227 read 0x338658 thru 0x34856e (0xff17 bytes) 000163[0] 1776190590.134652 read 0x3505d6 thru 0x350af4 (0x51f bytes) 000164[1] 1776190590.222454 mapwrite 0x044958 thru 0x051c74 (0xd31d bytes) 000165[1] 1776190590.392156 mapread 0x0193f0 thru 0x027597 (0xe1a8 bytes) 000167[0] 1776190590.486701 write 0x91a130 thru 0x9288c9 (0xe79a bytes) 000168[0] 1776190590.526636 mapread 0x252025 thru 0x25877f (0x675b bytes) 000169[1] 1776190590.675164 write 0x8023b8 thru 0x802d50 (0x999 bytes) 000170[1] 1776190590.711281 write 0x9bdc9d thru 0x9c6a5a (0x8dbe bytes) 000172[0] 1776190590.751608 mapwrite 0x01bca9 thru 0x025230 (0x9588 bytes) 000173[0] 1776190590.894691 write 0x03c360 thru 0x0458b0 (0x9551 bytes) 000175[1] 1776190590.976417 mapwrite 0x7bc540 thru 0x7c107c (0x4b3d bytes) 000177[1] 1776190591.185428 mapwrite 0x56c10c thru 0x57b3a9 (0xf29e bytes) 000179[0] 1776190591.388345 trunc from 0x9c6a5b to 0x4ae8b4 (0x5181a6 bytes) 000180[0] 1776190591.433257 mapread 0x17be09 thru 0x185ce6 (0x9ede bytes) 000181[1] 1776190591.494742 trunc from 0x4ae8b5 to 0x68dad0 (0x1df21c bytes) 000182[1] 1776190591.575274 mapwrite 0x57bc4c thru 0x58929a (0xd64f bytes) 000184[0] 1776190591.706432 mapread 0x2cc74b thru 0x2d4f23 (0x87d9 bytes) 000185[1] 1776190591.783657 write 0x4b3510 thru 0x4c1e7c (0xe96d bytes) 000187[0] 1776190591.846954 trunc from 0x68dad1 to 0x73a4c5 (0xac9f5 bytes) 000188[0] 1776190591.955403 read 0x43b82e thru 0x4482f7 (0xcaca bytes) 000189[1] 1776190592.028009 write 0x1b1b18 thru 0x1bd227 (0xb710 bytes) 000191[0] 1776190592.100909 trunc from 0x73a4c6 to 0x566857 (0x1d3c6e bytes) 000192[0] 1776190592.169194 mapwrite 0x232c8e thru 0x233ae9 (0xe5c bytes) 000195[0] 1776190592.358020 mapread 0x555e64 thru 0x557b14 (0x1cb1 bytes) 000199[0] 1776190592.414346 trunc from 0x566858 to 0x071cb6 (0x4f4ba1 bytes) 000200[0] 1776190592.469992 write 0x25bdd1 thru 0x2652f4 (0x9524 bytes) 000201[0] 1776190592.476103 write 0x6674e9 thru 0x66c4bd (0x4fd5 bytes) 000202[0] 1776190592.478660 trunc from 0x66c4be to 0x678a25 (0xc568 bytes) 000203[0] 1776190592.533490 read 0x6752ba thru 0x678a25 (0x376c bytes) 000206[0] 1776190592.568145 mapwrite 0x5c7b73 thru 0x5d2aa4 (0xaf32 bytes) 000207[1] 1776190592.669895 write 0x158ec4 thru 0x16647b (0xd5b8 bytes) 000208[0] 1776190592.703365 mapread 0x5fd82d thru 0x607952 (0xa126 bytes) 000212[1] 1776190592.805738 mapwrite 0x686ce2 thru 0x695e78 (0xf197 bytes) 000217[0] 1776190593.099724 mapwrite 0x7f14de thru 0x7f8bfc (0x771f bytes) 000218[1] 1776190593.310201 read 0x73db04 thru 0x73e2f1 (0x7ee bytes) 000220[1] 1776190593.363996 read 0x20f998 thru 0x210adb (0x1144 bytes) 000221[1] 1776190593.540705 write 0x34d72b thru 0x3507af (0x3085 bytes) 000223[1] 1776190593.625890 mapwrite 0x83afdf thru 0x83fcb6 (0x4cd8 bytes) 000224[1] 1776190593.732058 mapwrite 0x790b81 thru 0x798141 (0x75c1 bytes) 000225[1] 1776190593.840043 write 0x48da38 thru 0x490fc9 (0x3592 bytes) 000226[1] 1776190593.849646 mapread 0x1cab08 thru 0x1d91df (0xe6d8 bytes) 000227[0] 1776190593.934118 mapwrite 0x060708 thru 0x0685f2 (0x7eeb bytes) 000228[0] 1776190594.076981 mapread 0x2d2f70 thru 0x2dce98 (0x9f29 bytes) 000229[1] 1776190594.150504 trunc from 0x83fcb7 to 0x27164f (0x5ce667 bytes) 000230[0] 1776190594.187730 trunc from 0x271650 to 0x881c11 (0x6105c2 bytes) 000232[0] 1776190594.283394 write 0x200783 thru 0x20b93a (0xb1b8 bytes) 000234[1] 1776190594.322242 trunc from 0x881c12 to 0x001782 (0x88048f bytes) 000235[0] 1776190594.369367 read 0x001180 thru 0x001782 (0x603 bytes) 000237[0] 1776190594.403424 mapwrite 0x63a81d thru 0x6486a4 (0xde88 bytes) 000242[1] 1776190594.855547 mapread 0x4d0026 thru 0x4de278 (0xe253 bytes) 000245[1] 1776190594.975837 trunc from 0x6486a5 to 0x48cf7a (0x1bb72a bytes) 000249[0] 1776190595.034262 read 0x2abf20 thru 0x2b1c02 (0x5ce3 bytes) 000251[0] 1776190595.064951 mapwrite 0x7ea4ee thru 0x7eb863 (0x1376 bytes) 000252[1] 1776190595.355748 write 0x7d797d thru 0x7db0eb (0x376f bytes) 000253[0] 1776190595.397513 write 0x78873d thru 0x78e933 (0x61f7 bytes) 000254[1] 1776190595.458536 mapread 0x403087 thru 0x40a51a (0x7494 bytes) 000255[1] 1776190595.544430 read 0x164eb5 thru 0x16a79c (0x58e8 bytes) 000258[0] 1776190595.666996 write 0x4d499c thru 0x4e00bf (0xb724 bytes) 000260[0] 1776190595.732260 mapwrite 0x1c9ccd thru 0x1cf482 (0x57b6 bytes) 000262[1] 1776190595.886724 write 0x9b7ec0 thru 0x9c7b96 (0xfcd7 bytes) 000263[0] 1776190595.921464 read 0x8f498c thru 0x903b68 (0xf1dd bytes) 000269[1] 1776190596.075309 mapread 0x575cfd thru 0x5763ca (0x6ce bytes) 000273[0] 1776190596.133714 mapread 0x6396bd thru 0x63ab59 (0x149d bytes) 000275[1] 1776190596.144577 mapwrite 0x3f5542 thru 0x3feb52 (0x9611 bytes) 000279[0] 1776190596.347573 write 0x7aa6be thru 0x7ad508 (0x2e4b bytes) 000283[1] 1776190596.516599 trunc from 0x9c7b97 to 0x8d82e5 (0xef8b1 bytes) 000284[1] 1776190596.629643 mapwrite 0x4484dc thru 0x451862 (0x9387 bytes) 000286[0] 1776190596.797767 mapwrite 0x3a6f75 thru 0x3ad198 (0x6224 bytes) 000287[1] 1776190596.942511 write 0x33f6ae thru 0x3422c4 (0x2c17 bytes) 000289[1] 1776190596.988296 read 0x58f385 thru 0x598ddd (0x9a59 bytes) 000290[1] 1776190597.040694 mapwrite 0x030fb7 thru 0x031390 (0x3da bytes) 000291[1] 1776190597.078593 trunc from 0x8d82e6 to 0x39527e (0x543067 bytes) 000292[0] 1776190597.109925 write 0x294c4d thru 0x29f634 (0xa9e8 bytes) 000294[1] 1776190597.186232 read 0x2405a9 thru 0x249557 (0x8faf bytes) 000295[1] 1776190597.237671 mapread 0x09810d thru 0x09c370 (0x4264 bytes) 000297[0] 1776190597.324360 write 0x4a27ea thru 0x4a9761 (0x6f78 bytes) 000298[1] 1776190597.363942 read 0x2f0901 thru 0x2f6dd5 (0x64d5 bytes) 000301[1] 1776190597.466178 write 0x440623 thru 0x449705 (0x90e3 bytes) 000302[0] 1776190597.490427 mapread 0x3e9146 thru 0x3f4b60 (0xba1b bytes) 000303[0] 1776190597.697178 read 0x437763 thru 0x441c6f (0xa50d bytes) 000308[0] 1776190597.809630 read 0x2953b9 thru 0x298842 (0x348a bytes) 000309[1] 1776190597.863495 mapread 0x0829dd thru 0x08acea (0x830e bytes) 000311[0] 1776190597.934566 mapread 0x2f15e6 thru 0x2f5988 (0x43a3 bytes) 000314[1] 1776190597.939507 mapwrite 0x3fb3c4 thru 0x400a9f (0x56dc bytes) 000315[0] 1776190598.170346 trunc from 0x4a9762 to 0x763402 (0x2b9ca1 bytes) 000316[0] 1776190598.221497 read 0x05c3dc thru 0x060d8a (0x49af bytes) 000318[0] 1776190598.393761 mapwrite 0x423e4b thru 0x42a1ac (0x6362 bytes) 000321[1] 1776190598.475400 write 0x8b673b thru 0x8c2c30 (0xc4f6 bytes) 000322[0] 1776190598.512911 mapwrite 0x0e5acf thru 0x0e86bf (0x2bf1 bytes) 000325[0] 1776190598.663182 mapread 0x140b45 thru 0x1446f3 (0x3baf bytes) 000326[0] 1776190598.663933 read 0x753a41 thru 0x75d244 (0x9804 bytes) 000327[1] 1776190598.664602 trunc from 0x8c2c31 to 0x135718 (0x78d518 bytes) 000328[0] 1776190598.737981 trunc from 0x135719 to 0x895d2e (0x760616 bytes) 000333[1] 1776190598.918750 read 0x7d68d0 thru 0x7e5276 (0xe9a7 bytes) 000335[0] 1776190599.003722 mapwrite 0x657dfb thru 0x6617ca (0x99d0 bytes) 000336[0] 1776190599.207606 read 0x426b9f thru 0x432b1d (0xbf7f bytes) 000338[1] 1776190599.298647 mapwrite 0x78c1fb thru 0x78d7c9 (0x15cf bytes) 000341[0] 1776190599.417518 read 0x006013 thru 0x00e01b (0x8009 bytes) 000343[0] 1776190599.516699 trunc from 0x895d2f to 0x8335b0 (0x6277e bytes) 000344[1] 1776190599.602244 write 0x3ad805 thru 0x3b0007 (0x2803 bytes) 000345[1] 1776190599.641190 read 0x3da9ec thru 0x3e8025 (0xd63a bytes) 000346[1] 1776190599.674426 read 0x45d26e thru 0x469c69 (0xc9fc bytes) 000347[0] 1776190599.803505 trunc from 0x8335b1 to 0x0a3f85 (0x78f62b bytes) 000348[1] 1776190599.896595 mapread 0x07cca4 thru 0x07da50 (0xdad bytes) 000349[1] 1776190599.950342 read 0x039580 thru 0x03cc9f (0x3720 bytes) 000353[1] 1776190600.027485 mapwrite 0x0d0ad9 thru 0x0e08a7 (0xfdcf bytes) 000357[1] 1776190600.217038 mapread 0x034093 thru 0x037f76 (0x3ee4 bytes) 000361[0] 1776190600.309856 mapwrite 0x17f8b3 thru 0x18f0f3 (0xf841 bytes) 000362[0] 1776190600.444272 mapread 0x0ccbd5 thru 0x0d3107 (0x6533 bytes) 000366[1] 1776190600.528287 trunc from 0x18f0f4 to 0x8f6a7e (0x76798b bytes) 000367[1] 1776190600.639570 mapread 0x5030c0 thru 0x50e774 (0xb6b5 bytes) 000370[1] 1776190600.755154 trunc from 0x8f6a7f to 0x17d18a (0x7798f4 bytes) 000371[0] 1776190600.784938 read 0x0e91c0 thru 0x0f5e3c (0xcc7d bytes) 000376[0] 1776190600.873560 read 0x17b635 thru 0x17d18a (0x1b56 bytes) 000377[1] 1776190600.906012 mapwrite 0x7c084d thru 0x7ceac1 (0xe275 bytes) 000378[0] 1776190601.209663 mapread 0x1d35ce thru 0x1d6f15 (0x3948 bytes) 000379[1] 1776190601.301165 trunc from 0x7ceac2 to 0x5f0dbd (0x1ddd04 bytes) 000380[1] 1776190601.392137 mapread 0x174d53 thru 0x17a6cb (0x5979 bytes) 000383[1] 1776190601.491401 read 0x5af6b4 thru 0x5b0bf8 (0x1545 bytes) 000384[0] 1776190601.542157 read 0x36f65f thru 0x374ec6 (0x5868 bytes) 000386[0] 1776190601.636045 mapread 0x046cca thru 0x0524d7 (0xb80e bytes) 000388[0] 1776190601.885208 write 0x3f82e0 thru 0x405d0a (0xda2b bytes) 000389[0] 1776190601.990449 mapread 0x3c0901 thru 0x3ce6f4 (0xddf4 bytes) 000392[1] 1776190602.152705 read 0x03ba2e thru 0x04074b (0x4d1e bytes) 000394[1] 1776190602.265413 mapread 0x02aab5 thru 0x02fcb2 (0x51fe bytes) 000397[1] 1776190602.343679 mapread 0x5ce732 thru 0x5dc0bf (0xd98e bytes) 000400[0] 1776190602.542662 mapwrite 0x1b552a thru 0x1be187 (0x8c5e bytes) 000401[0] 1776190602.790508 read 0x2e24f7 thru 0x2edd81 (0xb88b bytes) 000402[1] 1776190602.884436 write 0x4a47fd thru 0x4ac9fa (0x81fe bytes) 000404[1] 1776190602.948210 trunc from 0x5f0dbe to 0x355621 (0x29b79c bytes) 000406[1] 1776190603.015054 mapwrite 0x7ce033 thru 0x7d23ef (0x43bd bytes) 000407[1] 1776190603.239938 mapread 0x27439c thru 0x278a65 (0x46ca bytes) 000408[1] 1776190603.309289 write 0x1f2e40 thru 0x2017f4 (0xe9b5 bytes) 000411[0] 1776190603.379847 write 0x861355 thru 0x86b50a (0xa1b6 bytes) 000413[0] 1776190603.432264 trunc from 0x86b50b to 0x63c8e5 (0x22ec25 bytes) 000415[1] 1776190603.497837 mapread 0x2da4bc thru 0x2de48f (0x3fd4 bytes) 000416[1] 1776190603.558337 mapwrite 0x3b75cc thru 0x3c70c7 (0xfafc bytes) 000417[1] 1776190603.804905 mapread 0x03135a thru 0x036c8f (0x5936 bytes) 000418[1] 1776190603.864170 read 0x53daa0 thru 0x53dc89 (0x1ea bytes) 000419[1] 1776190603.891363 mapwrite 0x163848 thru 0x16386f (0x28 bytes) 000422[0] 1776190603.956041 write 0x1b0a44 thru 0x1b5379 (0x4936 bytes) 000425[0] 1776190604.026193 mapread 0x1267d6 thru 0x1317c0 (0xafeb bytes) 000430[0] 1776190604.184453 read 0x3a07b3 thru 0x3a7759 (0x6fa7 bytes) 000431[1] 1776190604.248391 mapread 0x056c49 thru 0x05c3ee (0x57a6 bytes) 000434[1] 1776190604.349537 mapread 0x04a075 thru 0x051d92 (0x7d1e bytes) 000435[0] 1776190604.440267 mapwrite 0x63908f thru 0x63ee67 (0x5dd9 bytes) 000437[1] 1776190604.713863 read 0x37493e thru 0x37bfb8 (0x767b bytes) 000438[0] 1776190604.781820 mapwrite 0x10da5c thru 0x11040f (0x29b4 bytes) 000439[0] 1776190604.893513 mapread 0x350703 thru 0x35bb8b (0xb489 bytes) 000440[1] 1776190604.991005 read 0x4510a6 thru 0x452c1c (0x1b77 bytes) 000445[1] 1776190605.059333 write 0x428cc4 thru 0x436fab (0xe2e8 bytes) 000446[0] 1776190605.109432 trunc from 0x63ee68 to 0x8c8c91 (0x289e2a bytes) 000448[0] 1776190605.202126 write 0x359abc thru 0x35bd40 (0x2285 bytes) 000449[1] 1776190605.240462 mapwrite 0x603e74 thru 0x607528 (0x36b5 bytes) 000450[0] 1776190605.389219 mapwrite 0x3c5b16 thru 0x3c6986 (0xe71 bytes) 000451[1] 1776190605.492141 mapread 0x62913e thru 0x62ef22 (0x5de5 bytes) 000452[0] 1776190605.611618 mapread 0x094c6c thru 0x09d961 (0x8cf6 bytes) 000453[1] 1776190605.734364 write 0x434c2a thru 0x43eb22 (0x9ef9 bytes) 000454[1] 1776190605.795330 write 0x91a7c5 thru 0x92371d (0x8f59 bytes) 000457[0] 1776190605.931390 read 0x5ed2e9 thru 0x5f544f (0x8167 bytes) 000459[0] 1776190606.033305 read 0x35759c thru 0x35ba2c (0x4491 bytes) truncating to largest ever: 0x9ba874 000460[0] 1776190606.100191 trunc from 0x92371e to 0x9ba873 (0x97156 bytes) 000461[0] 1776190606.206191 read 0x7f963a thru 0x8073d7 (0xdd9e bytes) 000462[1] 1776190606.292021 mapread 0x6144fe thru 0x61a082 (0x5b85 bytes) 000464[0] 1776190606.391425 write 0x9b0ac2 thru 0x9b2101 (0x1640 bytes) 000465[1] 1776190606.415279 mapwrite 0x28dd76 thru 0x29b897 (0xdb22 bytes) 000466[0] 1776190606.618133 mapread 0x56bc26 thru 0x56d98a (0x1d65 bytes) 000468[0] 1776190606.677489 mapwrite 0x287198 thru 0x289c30 (0x2a99 bytes) 000470[0] 1776190606.826322 mapread 0x0b1dc0 thru 0x0be93e (0xcb7f bytes) 000471[1] 1776190606.993554 read 0x2b145f thru 0x2b8742 (0x72e4 bytes) 000472[0] 1776190607.071002 read 0x3f436b thru 0x3f63b4 (0x204a bytes) 000475[0] 1776190607.320426 mapwrite 0x240ca8 thru 0x2453bb (0x4714 bytes) 000476[0] 1776190607.453978 read 0x1ed09c thru 0x1f982a (0xc78f bytes) 000477[0] 1776190607.593481 write 0x456cfb thru 0x45b530 (0x4836 bytes) 000478[1] 1776190607.619220 write 0x994c8b thru 0x996c1d (0x1f93 bytes) 000479[0] 1776190607.664060 trunc from 0x9ba874 to 0x5bf094 (0x3fb7df bytes) 000480[0] 1776190607.756676 trunc from 0x5bf095 to 0x18e489 (0x430c0b bytes) 000481[0] 1776190607.833150 trunc from 0x18e48a to 0x8e3aea (0x755661 bytes) 000482[1] 1776190607.881310 mapread 0x2b838f thru 0x2bf390 (0x7002 bytes) 000484[0] 1776190607.995578 write 0x569d58 thru 0x56f953 (0x5bfc bytes) 000486[0] 1776190608.069308 read 0x008459 thru 0x014c15 (0xc7bd bytes) 000487[0] 1776190608.255210 read 0x23b0b2 thru 0x24ac3d (0xfb8c bytes) 000488[1] 1776190608.344704 trunc from 0x8e3aeb to 0x1df5c4 (0x704526 bytes) 000490[0] 1776190608.419451 trunc from 0x1df5c5 to 0x0a9e15 (0x1357af bytes) 000491[0] 1776190608.493745 write 0x4dc345 thru 0x4dd393 (0x104f bytes) 000493[1] 1776190608.554185 mapread 0x3bc987 thru 0x3c1007 (0x4681 bytes) 000494[0] 1776190608.692243 trunc from 0x4dd394 to 0x05d231 (0x480162 bytes) 000495[0] 1776190608.741985 mapwrite 0x056c61 thru 0x0613c2 (0xa762 bytes) 000496[1] 1776190608.904440 read 0x035a0c thru 0x0394bb (0x3ab0 bytes) 000497[0] 1776190608.945117 write 0x2a3af8 thru 0x2ad462 (0x996b bytes) 000500[0] 1776190609.024952 trunc from 0x2ad463 to 0x1d11fb (0xdc267 bytes) All operations completed A-OK! Chance of close/open is 1 in 50 Seed set to 609 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x5c5e2b 000005[1] 1776190609.915513 trunc from 00000000 to 0x5c5e2a (0x5c5e2b bytes) 000009[0] 1776190610.003670 mapread 0x337000 thru 0x33a9fd (0x39fe bytes) 000013[0] 1776190610.062633 trunc from 0x5c5e2b to 0x49d49f (0x12898b bytes) 000014[1] 1776190610.119495 write_OD 0x64d000 thru 0x651fff (0x5000 bytes) 000015[1] 1776190610.185285 mapwrite 0x57e000 thru 0x5837e8 (0x57e9 bytes) 000019[0] 1776190610.362466 mapread 0x341000 thru 0x348e8c (0x7e8d bytes) 000021[0] 1776190610.423131 mapread 0x5b0000 thru 0x5bdcf1 (0xdcf2 bytes) truncating to largest ever: 0x745a6f 000022[1] 1776190610.473151 trunc from 0x652000 to 0x745a6e (0xf3a6f bytes) 000023[0] 1776190610.512251 read_OD 0x729000 thru 0x736fff (0xe000 bytes) 000025[1] 1776190610.550516 read_OD 0x276000 thru 0x27cfff (0x7000 bytes) 000029[0] 1776190610.561487 trunc from 0x745a6f to 0x22c63f (0x51942f bytes) 000031[1] 1776190610.636208 write_OD 0x7ef000 thru 0x7f9fff (0xb000 bytes) 000034[1] 1776190610.723744 write_OD 0x2a0000 thru 0x2a2fff (0x3000 bytes) 000035[1] 1776190610.821425 mapwrite 0x868000 thru 0x86b7f9 (0x37fa bytes) truncating to largest ever: 0x7f5f12 000036[0] 1776190610.992525 trunc from 0x86b7fa to 0x7f5f11 (0x758e8 bytes) 000037[0] 1776190611.101408 trunc from 0x7f5f12 to 0x5fdc0a (0x1f8307 bytes) 000038[1] 1776190611.170281 read_OD 0x186000 thru 0x18afff (0x5000 bytes) 000040[1] 1776190611.210440 mapread 0x406000 thru 0x40c349 (0x634a bytes) 000041[1] 1776190611.429581 read_OD 0x5c7000 thru 0x5d1fff (0xb000 bytes) 000042[0] 1776190611.460970 mapwrite 0x2c9000 thru 0x2d8a84 (0xfa85 bytes) 000044[1] 1776190611.718255 mapwrite 0x460000 thru 0x460786 (0x787 bytes) 000047[1] 1776190611.924460 read_OD 0x2e4000 thru 0x2e7fff (0x4000 bytes) 000048[0] 1776190611.956359 mapwrite 0x6ba000 thru 0x6c520f (0xb210 bytes) 000050[0] 1776190612.108686 trunc from 0x6c5210 to 0x757cf5 (0x92ae6 bytes) 000053[0] 1776190612.181821 mapwrite 0x8fc000 thru 0x90b81d (0xf81e bytes) 000056[0] 1776190612.344743 write_OD 0x8a6000 thru 0x8abfff (0x6000 bytes) 000058[1] 1776190612.420502 write_OD 0x0b4000 thru 0x0b7fff (0x4000 bytes) 000060[1] 1776190612.495527 write_OD 0x123000 thru 0x12dfff (0xb000 bytes) 000062[0] 1776190612.580738 mapwrite 0x28f000 thru 0x299714 (0xa715 bytes) 000064[0] 1776190612.671507 write_OD 0x203000 thru 0x20afff (0x8000 bytes) truncating to largest ever: 0x95e079 000066[1] 1776190612.746612 trunc from 0x90b81e to 0x95e078 (0x5285b bytes) 000067[0] 1776190612.790899 trunc from 0x95e079 to 0x3e1e49 (0x57c22f bytes) 000068[0] 1776190612.842413 write_OD 0x3c1000 thru 0x3c4fff (0x4000 bytes) 000069[1] 1776190612.905141 mapread 0x289000 thru 0x29375e (0xa75f bytes) 000070[1] 1776190612.999443 trunc from 0x3e1e4a to 0x72514c (0x343303 bytes) 000071[0] 1776190613.049118 write_OD 0x995000 thru 0x99dfff (0x9000 bytes) 000073[1] 1776190613.136409 write_OD 0x180000 thru 0x189fff (0xa000 bytes) 000074[0] 1776190613.209517 trunc from 0x99e000 to 0x0d6077 (0x8c7f88 bytes) 000075[0] 1776190613.249897 mapread 0x016000 thru 0x0170b6 (0x10b7 bytes) 000077[1] 1776190613.303328 read_OD 0x03f000 thru 0x04bfff (0xd000 bytes) 000082[0] 1776190613.342189 trunc from 0x0d6078 to 0x589020 (0x4b2fa9 bytes) 000084[0] 1776190613.431319 read_OD 0x09a000 thru 0x09bfff (0x2000 bytes) 000087[1] 1776190613.474937 mapwrite 0x26b000 thru 0x26e246 (0x3247 bytes) 000091[0] 1776190613.850181 mapread 0x576000 thru 0x57767f (0x1680 bytes) 000092[1] 1776190614.026714 read_OD 0x512000 thru 0x51efff (0xd000 bytes) 000093[1] 1776190614.040603 trunc from 0x589021 to 0x4c956c (0xbfab4 bytes) 000096[0] 1776190614.095104 read_OD 0x031000 thru 0x032fff (0x2000 bytes) 000098[0] 1776190614.132571 write_OD 0x848000 thru 0x84ffff (0x8000 bytes) 000099[0] 1776190614.188296 write_OD 0x77b000 thru 0x77bfff (0x1000 bytes) 000101[0] 1776190614.236437 mapwrite 0x064000 thru 0x0671c0 (0x31c1 bytes) 000102[1] 1776190614.422321 mapwrite 0x5d7000 thru 0x5d9dc5 (0x2dc6 bytes) 000108[0] 1776190614.583125 trunc from 0x850000 to 0x00db82 (0x84247d bytes) 000109[1] 1776190614.626690 write_OD 0x186000 thru 0x186fff (0x1000 bytes) 000110[0] 1776190614.692296 mapread 0x156000 thru 0x15d924 (0x7925 bytes) 000112[1] 1776190614.739496 trunc from 0x187000 to 0x8aec07 (0x727c08 bytes) 000113[0] 1776190614.807103 trunc from 0x8aec08 to 0x58bb4d (0x3230ba bytes) 000114[1] 1776190614.851145 mapread 0x120000 thru 0x127f88 (0x7f89 bytes) 000119[1] 1776190614.959637 mapread 0x1b4000 thru 0x1b6808 (0x2809 bytes) 000120[1] 1776190615.001122 mapread 0x09e000 thru 0x0abafa (0xdafb bytes) 000122[1] 1776190615.120424 mapread 0x432000 thru 0x43bcd0 (0x9cd1 bytes) 000123[1] 1776190615.204484 mapwrite 0x36f000 thru 0x371342 (0x2343 bytes) 000124[0] 1776190615.318530 read_OD 0x3f6000 thru 0x3fdfff (0x8000 bytes) 000125[0] 1776190615.347928 mapwrite 0x171000 thru 0x17caa9 (0xbaaa bytes) 000126[1] 1776190615.554225 read_OD 0x207000 thru 0x213fff (0xd000 bytes) 000127[0] 1776190615.586574 trunc from 0x58bb4e to 0x2392e7 (0x352866 bytes) 000128[0] 1776190615.632180 read_OD 0x1d0000 thru 0x1dbfff (0xc000 bytes) 000130[0] 1776190615.663463 mapwrite 0x843000 thru 0x850e7d (0xde7e bytes) 000131[0] 1776190615.883074 trunc from 0x850e7e to 0x36acbc (0x4e61c1 bytes) 000132[1] 1776190615.913133 mapread 0x19a000 thru 0x1a055b (0x655c bytes) 000133[0] 1776190616.077414 mapwrite 0x82e000 thru 0x834bfe (0x6bff bytes) 000134[0] 1776190616.226614 write_OD 0x46d000 thru 0x46ffff (0x3000 bytes) 000136[1] 1776190616.308260 mapread 0x2f2000 thru 0x2faea7 (0x8ea8 bytes) 000137[0] 1776190616.529257 mapread 0x733000 thru 0x73abff (0x7c00 bytes) 000138[1] 1776190616.579459 read_OD 0x1bf000 thru 0x1c8fff (0xa000 bytes) 000140[1] 1776190616.595292 write_OD 0x70a000 thru 0x70bfff (0x2000 bytes) 000143[0] 1776190616.646018 mapwrite 0x69e000 thru 0x6a5a9c (0x7a9d bytes) 000144[1] 1776190616.736875 mapwrite 0x0ea000 thru 0x0f8de7 (0xede8 bytes) 000146[1] 1776190617.059765 trunc from 0x834bff to 0x27f2a5 (0x5b5959 bytes) 000148[1] 1776190617.134375 mapread 0x1e1000 thru 0x1eaae7 (0x9ae8 bytes) 000152[0] 1776190617.194251 mapread 0x037000 thru 0x03743c (0x43d bytes) 000154[1] 1776190617.236034 write_OD 0x20b000 thru 0x216fff (0xc000 bytes) 000158[0] 1776190617.341081 mapread 0x074000 thru 0x075d6d (0x1d6e bytes) 000160[0] 1776190617.354123 mapread 0x179000 thru 0x17c0ee (0x30ef bytes) 000162[0] 1776190617.391405 mapread 0x090000 thru 0x09fc13 (0xfc14 bytes) 000163[1] 1776190617.495743 trunc from 0x27f2a6 to 0x87cdb8 (0x5fdb13 bytes) 000164[0] 1776190617.541252 mapwrite 0x562000 thru 0x56f80f (0xd810 bytes) 000165[0] 1776190617.967698 read_OD 0x254000 thru 0x257fff (0x4000 bytes) 000167[0] 1776190618.013813 mapwrite 0x350000 thru 0x35c902 (0xc903 bytes) 000169[0] 1776190618.243013 mapread 0x4b0000 thru 0x4bbb04 (0xbb05 bytes) 000170[0] 1776190618.262543 mapread 0x55f000 thru 0x55f01d (0x1e bytes) 000173[1] 1776190618.303527 mapwrite 0x194000 thru 0x19cd4d (0x8d4e bytes) 000174[0] 1776190618.502234 write_OD 0x1da000 thru 0x1e4fff (0xb000 bytes) 000177[1] 1776190618.588500 mapwrite 0x668000 thru 0x670f96 (0x8f97 bytes) 000180[0] 1776190618.766706 trunc from 0x87cdb9 to 0x2995a2 (0x5e3816 bytes) 000181[1] 1776190618.856611 read_OD 0x164000 thru 0x170fff (0xd000 bytes) 000182[1] 1776190618.896374 trunc from 0x2995a3 to 0x48f59f (0x1f5ffd bytes) 000184[0] 1776190618.964616 trunc from 0x48f5a0 to 0x249ec4 (0x2456db bytes) 000185[0] 1776190619.011227 mapwrite 0x7c2000 thru 0x7c2550 (0x551 bytes) 000187[0] 1776190619.122543 read_OD 0x377000 thru 0x37efff (0x8000 bytes) 000190[1] 1776190619.167388 mapwrite 0x4ea000 thru 0x4f8b7f (0xeb80 bytes) 000191[1] 1776190619.494885 write_OD 0x9c8000 thru 0x9cefff (0x7000 bytes) 000192[0] 1776190619.583675 read_OD 0x199000 thru 0x1a5fff (0xd000 bytes) 000194[0] 1776190619.601932 trunc from 0x9cf000 to 0x884eba (0x14a145 bytes) 000196[1] 1776190619.651409 mapread 0x685000 thru 0x68d994 (0x8995 bytes) 000198[1] 1776190619.761529 mapwrite 0x140000 thru 0x14b53d (0xb53e bytes) 000204[0] 1776190620.228402 mapread 0x3ef000 thru 0x3f313b (0x413c bytes) 000205[1] 1776190620.494709 read_OD 0x243000 thru 0x250fff (0xe000 bytes) 000206[1] 1776190620.540736 read_OD 0x49d000 thru 0x4abfff (0xf000 bytes) 000208[0] 1776190620.554305 trunc from 0x884ebb to 0x17d7c7 (0x7076f3 bytes) 000209[0] 1776190620.626263 mapwrite 0x239000 thru 0x248d63 (0xfd64 bytes) 000210[1] 1776190620.840669 trunc from 0x248d64 to 0x5ecd05 (0x3a3fa2 bytes) 000213[0] 1776190620.981188 read_OD 0x59f000 thru 0x5adfff (0xf000 bytes) 000215[1] 1776190621.020751 read_OD 0x2a5000 thru 0x2affff (0xb000 bytes) 000217[1] 1776190621.036000 trunc from 0x5ecd06 to 0x396fde (0x255d27 bytes) 000221[0] 1776190621.098740 mapread 0x0d6000 thru 0x0e0bb9 (0xabba bytes) 000222[0] 1776190621.196112 trunc from 0x396fdf to 0x63bc7e (0x2a4ca0 bytes) 000223[1] 1776190621.258147 read_OD 0x398000 thru 0x39bfff (0x4000 bytes) 000224[1] 1776190621.289603 trunc from 0x63bc7f to 0x87c9a6 (0x240d28 bytes) 000227[1] 1776190621.356459 mapwrite 0x99d000 thru 0x9a66e8 (0x96e9 bytes) 000231[1] 1776190621.749210 write_OD 0x44d000 thru 0x459fff (0xd000 bytes) 000232[1] 1776190621.884359 trunc from 0x9a66e9 to 0x269c58 (0x73ca90 bytes) 000234[1] 1776190621.949155 trunc from 0x269c59 to 0x490239 (0x2265e1 bytes) 000235[1] 1776190621.981370 read_OD 0x3e9000 thru 0x3f3fff (0xb000 bytes) 000237[1] 1776190622.015308 write_OD 0x1ac000 thru 0x1b3fff (0x8000 bytes) 000238[0] 1776190622.094008 mapread 0x12f000 thru 0x13b331 (0xc332 bytes) 000239[1] 1776190622.200140 mapread 0x259000 thru 0x268f19 (0xff1a bytes) 000243[0] 1776190622.289436 trunc from 0x49023a to 0x03df9e (0x45229b bytes) 000244[1] 1776190622.323099 read_OD 0x02d000 thru 0x039fff (0xd000 bytes) 000245[1] 1776190622.362548 write_OD 0x135000 thru 0x13efff (0xa000 bytes) 000246[0] 1776190622.437085 write_OD 0x37f000 thru 0x388fff (0xa000 bytes) 000247[1] 1776190622.492098 mapread 0x049000 thru 0x056b78 (0xdb79 bytes) 000248[0] 1776190622.577932 trunc from 0x389000 to 0x276f48 (0x1120b7 bytes) 000250[1] 1776190622.665649 write_OD 0x927000 thru 0x935fff (0xf000 bytes) 000252[0] 1776190622.757311 trunc from 0x936000 to 0x02d45a (0x908ba5 bytes) 000257[1] 1776190622.858099 trunc from 0x02d45b to 0x82cb94 (0x7ff73a bytes) 000258[1] 1776190622.925336 mapwrite 0x260000 thru 0x26f70a (0xf70b bytes) 000260[1] 1776190623.220714 read_OD 0x1df000 thru 0x1edfff (0xf000 bytes) 000262[1] 1776190623.250193 trunc from 0x82cb95 to 0x831477 (0x48e3 bytes) 000264[1] 1776190623.289014 trunc from 0x831478 to 0x4e949e (0x347fd9 bytes) 000266[1] 1776190623.326756 trunc from 0x4e949f to 0x69b6a8 (0x1b220a bytes) 000268[0] 1776190623.390155 mapwrite 0x0f6000 thru 0x105134 (0xf135 bytes) 000269[1] 1776190623.604348 mapread 0x22c000 thru 0x238e0f (0xce10 bytes) 000273[0] 1776190623.718253 trunc from 0x69b6a9 to 0x82edd3 (0x19372b bytes) 000275[1] 1776190623.789465 read_OD 0x790000 thru 0x799fff (0xa000 bytes) 000276[1] 1776190623.816636 mapwrite 0x5d2000 thru 0x5d2fa5 (0xfa6 bytes) 000277[1] 1776190623.932850 trunc from 0x82edd4 to 0x12ebc1 (0x700212 bytes) 000282[1] 1776190624.088172 trunc from 0x12ebc2 to 0x2b0cce (0x18210d bytes) 000284[0] 1776190624.167442 mapread 0x118000 thru 0x11a039 (0x203a bytes) 000285[1] 1776190624.321622 read_OD 0x075000 thru 0x07ffff (0xb000 bytes) 000289[0] 1776190624.356696 mapwrite 0x91a000 thru 0x91e29f (0x42a0 bytes) 000290[1] 1776190624.571546 mapwrite 0x8b0000 thru 0x8b96b0 (0x96b1 bytes) 000291[0] 1776190624.857525 mapread 0x570000 thru 0x5715ca (0x15cb bytes) 000292[1] 1776190624.922597 mapwrite 0x9e7000 thru 0x9ebdf7 (0x4df8 bytes) 000293[1] 1776190625.183392 mapread 0x43f000 thru 0x44aafa (0xbafb bytes) 000294[1] 1776190625.318108 trunc from 0x9ebdf8 to 0x4ebf76 (0x4ffe81 bytes) 000295[1] 1776190625.362048 read_OD 0x1b7000 thru 0x1bbfff (0x5000 bytes) truncating to largest ever: 0x9ec446 000298[0] 1776190625.399665 trunc from 0x4ebf77 to 0x9ec445 (0x5004cf bytes) 000299[1] 1776190625.466983 mapread 0x770000 thru 0x77a4b8 (0xa4b9 bytes) 000302[1] 1776190625.713463 mapread 0x137000 thru 0x1413d7 (0xa3d8 bytes) 000304[0] 1776190625.821047 mapwrite 0x76e000 thru 0x776ad8 (0x8ad9 bytes) 000305[1] 1776190626.006444 mapread 0x7e8000 thru 0x7e9457 (0x1458 bytes) 000306[1] 1776190626.050615 read_OD 0x5b3000 thru 0x5b7fff (0x5000 bytes) 000310[1] 1776190626.059477 trunc from 0x9ec446 to 0x9e5e77 (0x65ce bytes) 000311[1] 1776190626.125550 trunc from 0x9e5e78 to 0x419ab5 (0x5cc3c2 bytes) 000313[1] 1776190626.183373 mapread 0x05e000 thru 0x060f76 (0x2f77 bytes) 000316[1] 1776190626.312215 trunc from 0x419ab6 to 0x1c7d20 (0x251d95 bytes) 000320[0] 1776190626.447493 write_OD 0x6a4000 thru 0x6b0fff (0xd000 bytes) 000322[1] 1776190626.542425 write_OD 0x1d7000 thru 0x1dafff (0x4000 bytes) 000324[0] 1776190626.640047 trunc from 0x6b1000 to 0x917c5b (0x266c5c bytes) 000326[1] 1776190626.753345 mapwrite 0x50b000 thru 0x513f3e (0x8f3f bytes) 000328[0] 1776190627.198361 trunc from 0x917c5c to 0x820cb2 (0xf6fa9 bytes) 000329[0] 1776190627.242039 trunc from 0x820cb3 to 0x64ef0e (0x1d1da4 bytes) 000330[0] 1776190627.274034 mapread 0x3d6000 thru 0x3e03de (0xa3df bytes) 000331[0] 1776190627.333222 mapwrite 0x1f0000 thru 0x1f928c (0x928d bytes) 000332[1] 1776190627.442403 trunc from 0x64ef0f to 0x90321a (0x2b430c bytes) truncating to largest ever: 0x9ec487 000333[0] 1776190627.481157 trunc from 0x90321b to 0x9ec486 (0xe926c bytes) 000334[1] 1776190627.516128 mapread 0x786000 thru 0x78bc98 (0x5c99 bytes) 000335[0] 1776190627.598413 mapwrite 0x18e000 thru 0x194e34 (0x6e35 bytes) 000336[0] 1776190627.760110 mapwrite 0x662000 thru 0x665a9b (0x3a9c bytes) 000337[0] 1776190627.978437 write_OD 0x87b000 thru 0x887fff (0xd000 bytes) 000339[0] 1776190628.085111 mapwrite 0x469000 thru 0x4705d7 (0x75d8 bytes) 000344[0] 1776190628.367656 read_OD 0x28c000 thru 0x295fff (0xa000 bytes) 000347[1] 1776190628.398683 read_OD 0x610000 thru 0x618fff (0x9000 bytes) 000349[0] 1776190628.411355 write_OD 0x6b4000 thru 0x6bffff (0xc000 bytes) 000352[0] 1776190628.478634 write_OD 0x1ae000 thru 0x1aefff (0x1000 bytes) 000353[1] 1776190628.551510 mapwrite 0x216000 thru 0x21b73a (0x573b bytes) 000354[0] 1776190628.921356 read_OD 0x35d000 thru 0x35efff (0x2000 bytes) 000355[1] 1776190628.961341 mapread 0x4a4000 thru 0x4b0c62 (0xcc63 bytes) 000356[1] 1776190629.048644 mapwrite 0x5b8000 thru 0x5c3d59 (0xbd5a bytes) 000358[0] 1776190629.238017 trunc from 0x9ec487 to 0x6da28d (0x3121f9 bytes) 000359[0] 1776190629.310418 trunc from 0x6da28e to 0x6da08a (0x203 bytes) 000360[1] 1776190629.378566 read_OD 0x486000 thru 0x48dfff (0x8000 bytes) 000362[0] 1776190629.461049 mapread 0x5a3000 thru 0x5ad4ff (0xa500 bytes) 000363[1] 1776190629.591500 mapread 0x04a000 thru 0x04e9a6 (0x49a7 bytes) 000364[0] 1776190629.686661 mapwrite 0x058000 thru 0x0622a0 (0xa2a1 bytes) 000365[1] 1776190629.966945 trunc from 0x6da08b to 0x0e90d9 (0x5f0fb1 bytes) 000369[0] 1776190630.075283 mapwrite 0x640000 thru 0x642075 (0x2076 bytes) 000372[1] 1776190630.277431 mapread 0x089000 thru 0x097a32 (0xea33 bytes) 000373[0] 1776190630.460122 read_OD 0x06d000 thru 0x075fff (0x9000 bytes) 000374[0] 1776190630.470441 mapread 0x0e7000 thru 0x0ea1a2 (0x31a3 bytes) 000377[0] 1776190630.667225 mapwrite 0x7b0000 thru 0x7b0f0d (0xf0e bytes) 000379[0] 1776190631.001582 mapwrite 0x86b000 thru 0x872645 (0x7646 bytes) 000382[1] 1776190631.426871 read_OD 0x292000 thru 0x29afff (0x9000 bytes) 000383[1] 1776190631.532325 mapread 0x73b000 thru 0x7468e4 (0xb8e5 bytes) 000384[1] 1776190631.725629 read_OD 0x3ff000 thru 0x403fff (0x5000 bytes) 000385[1] 1776190631.735219 trunc from 0x872646 to 0x32b2c5 (0x547380 bytes) 000386[0] 1776190631.781050 mapread 0x0fd000 thru 0x107fcf (0xafd0 bytes) 000387[1] 1776190631.865498 mapwrite 0x11e000 thru 0x12b16f (0xd170 bytes) 000389[1] 1776190632.050444 mapread 0x2e5000 thru 0x2e838b (0x338c bytes) 000394[0] 1776190632.119461 trunc from 0x32b2c6 to 0x8ea827 (0x5bf562 bytes) 000396[0] 1776190632.162352 read_OD 0x39b000 thru 0x39cfff (0x2000 bytes) 000398[1] 1776190632.187241 mapread 0x572000 thru 0x57b7e3 (0x97e4 bytes) 000399[1] 1776190632.276634 mapread 0x7c7000 thru 0x7d3cda (0xccdb bytes) 000401[0] 1776190632.296767 read_OD 0x243000 thru 0x243fff (0x1000 bytes) 000402[1] 1776190632.324071 write_OD 0x8d8000 thru 0x8e3fff (0xc000 bytes) 000403[1] 1776190632.448319 write_OD 0x2da000 thru 0x2e1fff (0x8000 bytes) 000405[0] 1776190632.542992 trunc from 0x8ea828 to 0x3c940b (0x52141c bytes) 000406[1] 1776190632.600092 write_OD 0x928000 thru 0x930fff (0x9000 bytes) 000407[0] 1776190632.704008 read_OD 0x434000 thru 0x43cfff (0x9000 bytes) 000410[0] 1776190632.719479 trunc from 0x931000 to 0x18e51e (0x7a2ae1 bytes) 000411[0] 1776190632.775645 write_OD 0x5f9000 thru 0x5fbfff (0x3000 bytes) 000412[1] 1776190632.845448 mapwrite 0x76a000 thru 0x76d80d (0x380e bytes) 000414[1] 1776190633.008356 read_OD 0x1d0000 thru 0x1d6fff (0x7000 bytes) 000416[1] 1776190633.034736 mapwrite 0x6ae000 thru 0x6b13ec (0x33ed bytes) 000417[1] 1776190633.291877 mapread 0x68a000 thru 0x696420 (0xc421 bytes) 000420[1] 1776190633.334231 mapread 0x6c9000 thru 0x6d1244 (0x8245 bytes) 000421[1] 1776190633.356104 mapwrite 0x452000 thru 0x452a1b (0xa1c bytes) 000422[1] 1776190633.423712 trunc from 0x76d80e to 0x214182 (0x55968b bytes) 000424[1] 1776190633.492232 trunc from 0x214183 to 0x7cab63 (0x5b69e1 bytes) 000425[1] 1776190633.548328 mapread 0x65c000 thru 0x660084 (0x4085 bytes) 000426[0] 1776190633.592148 trunc from 0x7cab64 to 0x54507e (0x285ae5 bytes) 000429[0] 1776190633.661213 read_OD 0x176000 thru 0x17dfff (0x8000 bytes) 000430[1] 1776190633.686240 mapread 0x402000 thru 0x40e91d (0xc91e bytes) 000431[1] 1776190633.763313 trunc from 0x54507f to 0x9e1b1d (0x49ca9f bytes) 000432[0] 1776190633.823367 mapwrite 0x177000 thru 0x1793b0 (0x23b1 bytes) 000434[1] 1776190634.071873 trunc from 0x9e1b1e to 0x1d83b2 (0x80976b bytes) 000435[1] 1776190634.155001 write_OD 0x3f6000 thru 0x400fff (0xb000 bytes) 000439[0] 1776190634.222146 mapread 0x295000 thru 0x295ce0 (0xce1 bytes) 000441[0] 1776190634.227568 write_OD 0x18d000 thru 0x190fff (0x4000 bytes) 000442[1] 1776190634.283921 trunc from 0x401000 to 0x384e2c (0x7c1d3 bytes) 000443[1] 1776190634.339017 read_OD 0x368000 thru 0x370fff (0x9000 bytes) 000445[1] 1776190634.402178 read_OD 0x10a000 thru 0x111fff (0x8000 bytes) 000447[1] 1776190634.443284 mapread 0x02a000 thru 0x032389 (0x838a bytes) 000448[0] 1776190634.677276 mapwrite 0x7a0000 thru 0x7a4d25 (0x4d26 bytes) 000450[0] 1776190635.014162 read_OD 0x737000 thru 0x73dfff (0x7000 bytes) 000451[1] 1776190635.070866 trunc from 0x7a4d26 to 0x26b1bc (0x539b69 bytes) 000453[1] 1776190635.214553 mapwrite 0x013000 thru 0x0220cb (0xf0cc bytes) 000455[0] 1776190635.443329 mapwrite 0x044000 thru 0x04b24c (0x724d bytes) 000459[1] 1776190635.610497 write_OD 0x188000 thru 0x192fff (0xb000 bytes) 000462[1] 1776190635.696931 trunc from 0x26b1bd to 0x3de21e (0x173062 bytes) 000464[1] 1776190635.759346 mapread 0x060000 thru 0x06f199 (0xf19a bytes) 000467[1] 1776190635.911481 mapwrite 0x9fd000 thru 0x9fdcb5 (0xcb6 bytes) 000468[1] 1776190636.219425 write_OD 0x93e000 thru 0x93ffff (0x2000 bytes) 000469[0] 1776190636.286347 mapread 0x095000 thru 0x0a22d6 (0xd2d7 bytes) 000471[0] 1776190636.422037 write_OD 0x2d8000 thru 0x2defff (0x7000 bytes) 000473[0] 1776190636.508509 trunc from 0x9fdcb6 to 0x469dcf (0x593ee6 bytes) 000475[0] 1776190636.603055 write_OD 0x7e9000 thru 0x7f7fff (0xf000 bytes) 000476[0] 1776190636.700416 read_OD 0x598000 thru 0x59cfff (0x5000 bytes) 000478[1] 1776190636.733881 trunc from 0x7f8000 to 0x0e8c83 (0x70f37c bytes) 000486[0] 1776190636.881598 write_OD 0x8e6000 thru 0x8eafff (0x5000 bytes) 000488[1] 1776190636.953140 trunc from 0x8eb000 to 0x0ed2a9 (0x7fdd56 bytes) 000490[1] 1776190637.012154 write_OD 0x482000 thru 0x482fff (0x1000 bytes) 000492[1] 1776190637.082283 read_OD 0x073000 thru 0x077fff (0x5000 bytes) 000494[0] 1776190637.100627 mapread 0x024000 thru 0x029451 (0x5452 bytes) 000495[1] 1776190637.136833 write_OD 0x630000 thru 0x636fff (0x7000 bytes) 000496[1] 1776190637.211084 write_OD 0x9a3000 thru 0x9a7fff (0x5000 bytes) 000499[1] 1776190637.279019 mapread 0x73a000 thru 0x73a5e5 (0x5e6 bytes) All operations completed A-OK! PASS 16a (68s) == sanityn test 16b: 500 iterations of dual-mount fsx at small size ========================================================== 14:17:23 (1776190643) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.448576 s, 4.7 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.209536 s, 10.0 MB/s Chance of close/open is 1 in 50 Seed set to 647 fd 0: /mnt/lustre/f16b.sanityn fd 1: /mnt/lustre2/f16b.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000005[1] 1776190648.873019 mapwrite 0x62e7c4 thru 0x62f730 (0xf6d bytes) truncating to largest ever: 0x44928e 000006[1] 1776190649.169701 trunc from 0x62f731 to 0x44928d (0x1e64a3 bytes) 000008[0] 1776190649.267529 mapread 0x0b8084 thru 0x0b95a4 (0x1521 bytes) 000009[1] 1776190649.433216 mapread 0x02cdcb thru 0x02e23c (0x1472 bytes) 000010[1] 1776190649.539282 write 0x71d793 thru 0x71e9b9 (0x1227 bytes) 000011[1] 1776190649.543596 mapread 0x05de47 thru 0x05fb0d (0x1cc7 bytes) truncating to largest ever: 0x67ca62 000012[0] 1776190649.619277 trunc from 0x71e9ba to 0x67ca61 (0xa1f58 bytes) 000016[0] 1776190649.948239 mapread 0x267f26 thru 0x268105 (0x1e0 bytes) 000017[1] 1776190649.999005 read 0x00a63b thru 0x00a93e (0x304 bytes) 000018[0] 1776190650.045144 trunc from 0x67ca62 to 0x08aaf0 (0x5f1f71 bytes) 000019[0] 1776190650.104826 mapread 0x02b5bc thru 0x02c83b (0x1280 bytes) 000020[1] 1776190650.122177 mapwrite 0x7e60cd thru 0x7e709d (0xfd1 bytes) truncating to largest ever: 0x9d0df4 000021[1] 1776190650.436137 trunc from 0x7e709e to 0x9d0df3 (0x1e9d56 bytes) 000023[1] 1776190650.535043 read 0x3ff876 thru 0x400b29 (0x12b4 bytes) 000024[1] 1776190650.826596 mapwrite 0x1d48d6 thru 0x1d6170 (0x189b bytes) 000025[1] 1776190651.126985 read 0x4dc66d thru 0x4dcda0 (0x734 bytes) 000027[1] 1776190651.221679 mapread 0x97919c thru 0x97a4dc (0x1341 bytes) 000028[0] 1776190651.268938 trunc from 0x9d0df4 to 0x0ca9d3 (0x906420 bytes) 000030[1] 1776190651.514811 mapwrite 0x70d1b1 thru 0x70dd62 (0xbb2 bytes) 000034[1] 1776190651.808151 read 0x3f738a thru 0x3f8a6c (0x16e3 bytes) 000038[0] 1776190652.177256 mapread 0x6a9165 thru 0x6a9dcf (0xc6b bytes) 000045[0] 1776190652.318450 write 0x54cad1 thru 0x54e9b5 (0x1ee5 bytes) 000046[1] 1776190652.371911 mapwrite 0x08c358 thru 0x08d561 (0x120a bytes) 000047[0] 1776190652.504114 write 0x847e7d thru 0x84815e (0x2e2 bytes) 000048[0] 1776190652.527828 write 0x2af147 thru 0x2b0e09 (0x1cc3 bytes) 000049[1] 1776190652.541862 mapread 0x106afd thru 0x106ea6 (0x3aa bytes) 000050[1] 1776190652.617074 mapwrite 0x54e4b2 thru 0x54feac (0x19fb bytes) 000051[1] 1776190652.780828 read 0x185d45 thru 0x1876b7 (0x1973 bytes) 000052[1] 1776190652.822227 mapwrite 0x348fd1 thru 0x349bf0 (0xc20 bytes) 000053[1] 1776190652.972135 write 0x581e24 thru 0x583232 (0x140f bytes) 000054[1] 1776190653.003473 mapread 0x098e70 thru 0x09ada5 (0x1f36 bytes) 000058[1] 1776190653.260040 trunc from 0x84815f to 0x473a19 (0x3d4745 bytes) 000061[0] 1776190653.361606 write 0x850623 thru 0x850de0 (0x7be bytes) 000063[0] 1776190653.449022 trunc from 0x850de1 to 0x347311 (0x509acf bytes) 000064[0] 1776190653.520869 mapread 0x0d41fe thru 0x0d59ab (0x17ae bytes) 000066[0] 1776190653.634986 mapwrite 0x70e192 thru 0x70ef01 (0xd70 bytes) 000068[0] 1776190653.802912 write 0x18dbe1 thru 0x18e5d5 (0x9f5 bytes) 000069[0] 1776190653.822890 mapwrite 0x7fb8dc thru 0x7fcc64 (0x1389 bytes) 000071[1] 1776190654.054755 write 0x5e2f0d thru 0x5e3424 (0x518 bytes) 000072[0] 1776190654.136528 write 0x9e0fb9 thru 0x9e29e0 (0x1a28 bytes) 000073[0] 1776190654.189896 write 0x510be4 thru 0x512a10 (0x1e2d bytes) 000074[1] 1776190654.269842 write 0x4a2f98 thru 0x4a3df0 (0xe59 bytes) 000075[0] 1776190654.329399 trunc from 0x9e29e1 to 0x31bb9a (0x6c6e46 bytes) 000076[0] 1776190654.382246 trunc from 0x31bb9b to 0x7a607b (0x48a4e1 bytes) 000078[0] 1776190654.474951 write 0x0e47ff thru 0x0e4a8e (0x290 bytes) 000079[0] 1776190654.479885 read 0x2ec661 thru 0x2edaf4 (0x1494 bytes) 000081[1] 1776190654.486198 trunc from 0x7a607c to 0x821793 (0x7b718 bytes) 000082[0] 1776190654.536379 mapwrite 0x822f70 thru 0x823553 (0x5e4 bytes) 000083[0] 1776190654.664402 trunc from 0x823554 to 0x7e500a (0x3e549 bytes) 000085[0] 1776190654.729131 mapwrite 0x45e829 thru 0x45ed3f (0x517 bytes) 000086[1] 1776190654.830900 write 0x0a0461 thru 0x0a1c15 (0x17b5 bytes) 000087[0] 1776190654.877972 mapread 0x47c80f thru 0x47c89e (0x90 bytes) 000088[1] 1776190654.915380 mapwrite 0x32189a thru 0x321ce8 (0x44f bytes) 000092[1] 1776190655.133249 read 0x512631 thru 0x512d66 (0x736 bytes) 000100[0] 1776190655.240984 write 0x0ef49e thru 0x0f1248 (0x1dab bytes) 000101[1] 1776190655.286935 trunc from 0x7e500b to 0x7ef10d (0xa103 bytes) 000104[1] 1776190655.357023 read 0x2b6045 thru 0x2b786f (0x182b bytes) 000107[1] 1776190655.509380 mapwrite 0x9f69b6 thru 0x9f7961 (0xfac bytes) 000108[0] 1776190655.753897 mapwrite 0x384f4d thru 0x385e19 (0xecd bytes) 000110[0] 1776190655.969679 write 0x212aa9 thru 0x212b70 (0xc8 bytes) 000111[0] 1776190656.013382 mapwrite 0x4ead3a thru 0x4eb7f4 (0xabb bytes) 000112[0] 1776190656.133302 read 0x826603 thru 0x827393 (0xd91 bytes) 000113[1] 1776190656.176096 write 0x40b3c2 thru 0x40c94f (0x158e bytes) 000115[1] 1776190656.277146 mapread 0x5a5d0f thru 0x5a69a6 (0xc98 bytes) 000117[1] 1776190656.361219 write 0x712357 thru 0x713fbd (0x1c67 bytes) 000121[0] 1776190656.554032 trunc from 0x9f7962 to 0x66b0d0 (0x38c891 bytes) 000122[0] 1776190656.692909 read 0x03a766 thru 0x03c23d (0x1ad8 bytes) 000123[0] 1776190656.945867 trunc from 0x66b0d1 to 0x166c50 (0x504480 bytes) 000126[0] 1776190657.105295 mapwrite 0x6c6bca thru 0x6c895e (0x1d95 bytes) 000131[1] 1776190657.328981 write 0x893db5 thru 0x89449f (0x6eb bytes) 000132[0] 1776190657.380371 mapwrite 0x149233 thru 0x14a1de (0xfac bytes) 000133[0] 1776190657.526141 read 0x01f13e thru 0x01f3ab (0x26e bytes) 000135[0] 1776190657.742693 trunc from 0x8944a0 to 0x8ed29a (0x58dfb bytes) 000136[0] 1776190657.826205 mapread 0x1a4877 thru 0x1a4ba2 (0x32c bytes) 000137[0] 1776190657.850486 mapread 0x77b5db thru 0x77c798 (0x11be bytes) 000138[0] 1776190657.879183 mapwrite 0x900a31 thru 0x900ce6 (0x2b6 bytes) 000139[1] 1776190657.969572 trunc from 0x900ce7 to 0x908eb3 (0x81cd bytes) 000142[0] 1776190658.048815 mapwrite 0x47ee15 thru 0x4806e8 (0x18d4 bytes) 000143[0] 1776190658.183725 mapwrite 0x5b3bdc thru 0x5b517a (0x159f bytes) 000144[0] 1776190658.407134 trunc from 0x908eb4 to 0x327934 (0x5e157f bytes) 000146[0] 1776190658.497753 read 0x0e4ffd thru 0x0e69ed (0x19f1 bytes) 000148[1] 1776190658.589591 mapwrite 0x6ec84c thru 0x6edd4a (0x14ff bytes) 000150[1] 1776190658.793151 mapread 0x5cf250 thru 0x5cfb34 (0x8e5 bytes) 000151[0] 1776190658.799988 trunc from 0x6edd4b to 0x7b4bc9 (0xc6e7f bytes) 000152[1] 1776190658.854702 read 0x4f5741 thru 0x4f6cfd (0x15bd bytes) 000153[1] 1776190658.881309 trunc from 0x7b4bca to 0x38e436 (0x426793 bytes) 000154[0] 1776190658.965498 mapwrite 0x68330f thru 0x683cc7 (0x9b9 bytes) 000157[1] 1776190659.228910 read 0x5c0329 thru 0x5c0e04 (0xadc bytes) 000160[0] 1776190659.382644 trunc from 0x683cc8 to 0x477e05 (0x20bec2 bytes) 000161[0] 1776190659.589975 trunc from 0x477e06 to 0x9719b8 (0x4f9bb3 bytes) 000163[0] 1776190659.798257 read 0x5459cb thru 0x547795 (0x1dcb bytes) 000168[1] 1776190660.165702 mapread 0x7203d8 thru 0x7216f0 (0x1319 bytes) 000169[1] 1776190660.271481 trunc from 0x9719b9 to 0x4e6882 (0x48b136 bytes) 000170[1] 1776190660.418631 trunc from 0x4e6883 to 0x64801b (0x161799 bytes) 000176[1] 1776190660.570032 trunc from 0x64801c to 0x3a5bce (0x2a244d bytes) 000179[1] 1776190660.623102 read 0x12fa0e thru 0x130102 (0x6f5 bytes) 000181[1] 1776190660.696037 mapread 0x2281c6 thru 0x229fcf (0x1e0a bytes) 000182[1] 1776190660.735753 trunc from 0x3a5bcf to 0x0820d6 (0x323af8 bytes) 000183[1] 1776190660.759966 mapread 0x04f866 thru 0x0517ae (0x1f49 bytes) 000186[1] 1776190660.787086 read 0x000d2e thru 0x000f04 (0x1d7 bytes) 000189[1] 1776190660.829348 read 0x05982f thru 0x05ab86 (0x1358 bytes) 000190[0] 1776190660.830018 read 0x03a7fe thru 0x03bf3f (0x1742 bytes) 000192[1] 1776190660.888248 write 0x700f0b thru 0x700f46 (0x3c bytes) 000193[0] 1776190660.891948 mapread 0x54a3a5 thru 0x54a616 (0x272 bytes) 000197[1] 1776190661.038867 read 0x0ecc6d thru 0x0eebfb (0x1f8f bytes) 000198[1] 1776190661.141761 mapread 0x07fbd3 thru 0x080dfd (0x122b bytes) 000199[0] 1776190661.173965 write 0x5b4bda thru 0x5b63c3 (0x17ea bytes) 000200[1] 1776190661.226306 write 0x291004 thru 0x292978 (0x1975 bytes) 000201[0] 1776190661.276909 mapwrite 0x4ad50d thru 0x4adf86 (0xa7a bytes) 000204[1] 1776190661.436331 mapread 0x18a9a1 thru 0x18b695 (0xcf5 bytes) 000209[0] 1776190661.647564 trunc from 0x700f47 to 0x4dbd6c (0x2251da bytes) 000210[1] 1776190661.790983 write 0x847bf1 thru 0x849b95 (0x1fa5 bytes) 000212[0] 1776190661.955923 read 0x0dc9db thru 0x0dd140 (0x766 bytes) 000215[0] 1776190662.305223 read 0x756eab thru 0x7589ce (0x1b24 bytes) 000217[1] 1776190662.308378 trunc from 0x849b96 to 0x96a08c (0x1204f7 bytes) 000218[1] 1776190662.491921 mapread 0x21b845 thru 0x21bbd1 (0x38d bytes) 000219[1] 1776190662.679482 mapwrite 0x00383f thru 0x004de4 (0x15a6 bytes) 000221[0] 1776190662.926131 read 0x0ebee3 thru 0x0ed378 (0x1496 bytes) 000222[0] 1776190663.004505 read 0x25d238 thru 0x25d707 (0x4d0 bytes) 000223[0] 1776190663.058913 mapread 0x3ef7a3 thru 0x3f023c (0xa9a bytes) 000224[1] 1776190663.326384 mapread 0x23ccf7 thru 0x23e119 (0x1423 bytes) 000226[1] 1776190663.363963 mapread 0x652526 thru 0x6528a0 (0x37b bytes) 000227[1] 1776190663.374073 write 0x7c3d4a thru 0x7c541d (0x16d4 bytes) 000229[0] 1776190663.505370 mapread 0x4bf719 thru 0x4bf777 (0x5f bytes) 000231[1] 1776190663.536460 write 0x97d862 thru 0x97f7c4 (0x1f63 bytes) 000232[0] 1776190663.537262 mapread 0x444e6f thru 0x445dc1 (0xf53 bytes) 000233[1] 1776190663.546445 write 0x22e316 thru 0x22fd8b (0x1a76 bytes) 000234[1] 1776190663.683946 read 0x22045e thru 0x221f57 (0x1afa bytes) 000236[1] 1776190663.926897 mapread 0x185b79 thru 0x185f8e (0x416 bytes) 000237[0] 1776190663.998888 write 0x6def11 thru 0x6e04ca (0x15ba bytes) 000238[0] 1776190664.095625 read 0x54b9c5 thru 0x54d7b6 (0x1df2 bytes) 000240[1] 1776190664.258080 trunc from 0x97f7c5 to 0x0c459b (0x8bb229 bytes) 000242[1] 1776190664.598313 mapwrite 0x05291a thru 0x053eab (0x1592 bytes) 000244[0] 1776190664.765173 mapwrite 0x6d0795 thru 0x6d1867 (0x10d3 bytes) 000247[1] 1776190665.106734 read 0x34fde0 thru 0x351784 (0x19a5 bytes) 000248[1] 1776190665.205980 trunc from 0x6d1868 to 0x99bf7e (0x2ca717 bytes) 000251[0] 1776190665.339561 trunc from 0x99bf7f to 0x548ef1 (0x45308d bytes) 000252[1] 1776190665.465977 trunc from 0x548ef2 to 0x4ddaa0 (0x6b451 bytes) 000254[1] 1776190665.559056 mapwrite 0x6f80db thru 0x6f92a4 (0x11ca bytes) 000255[1] 1776190665.757453 write 0x340d61 thru 0x341729 (0x9c9 bytes) 000257[1] 1776190665.859019 trunc from 0x6f92a5 to 0x87a2dc (0x181038 bytes) 000258[1] 1776190665.899858 mapwrite 0x3fe935 thru 0x3ff7c9 (0xe95 bytes) 000259[1] 1776190666.190326 mapwrite 0x1ac648 thru 0x1add3d (0x16f6 bytes) 000261[1] 1776190666.437218 read 0x5a5b53 thru 0x5a5dae (0x25c bytes) 000262[0] 1776190666.469846 mapread 0x7b304b thru 0x7b4348 (0x12fe bytes) 000264[0] 1776190666.574975 trunc from 0x87a2dd to 0x8edd60 (0x73a84 bytes) 000265[0] 1776190666.737990 trunc from 0x8edd61 to 0x05e6f2 (0x88f66e bytes) 000266[0] 1776190666.849439 mapread 0x0543b1 thru 0x055533 (0x1183 bytes) 000267[1] 1776190666.906694 mapwrite 0x8129c0 thru 0x813bc4 (0x1205 bytes) 000270[0] 1776190667.073631 write 0x664112 thru 0x664c9e (0xb8d bytes) 000272[0] 1776190667.111761 write 0x771afb thru 0x772fca (0x14d0 bytes) 000275[0] 1776190667.144453 mapread 0x550914 thru 0x551dbd (0x14aa bytes) 000277[1] 1776190667.201740 write 0x03fa25 thru 0x03fc84 (0x260 bytes) 000278[1] 1776190667.228186 mapread 0x49ed20 thru 0x4a0c10 (0x1ef1 bytes) 000279[1] 1776190667.256950 mapread 0x7b4e5a thru 0x7b53b2 (0x559 bytes) 000280[0] 1776190667.287031 mapread 0x3594e4 thru 0x359a2b (0x548 bytes) 000281[0] 1776190667.296079 write 0x30bc8c thru 0x30d381 (0x16f6 bytes) 000283[1] 1776190667.338642 write 0x96e1e7 thru 0x96f48b (0x12a5 bytes) 000286[1] 1776190667.354029 write 0x7f6a1d thru 0x7f84f9 (0x1add bytes) 000289[1] 1776190667.395074 read 0x08f684 thru 0x0911ec (0x1b69 bytes) 000290[0] 1776190667.545215 trunc from 0x96f48c to 0x3db3f8 (0x594093 bytes) 000292[1] 1776190667.661252 trunc from 0x3db3f9 to 0x7c1316 (0x3e5f1e bytes) 000294[0] 1776190667.754012 write 0x3f2aec thru 0x3f2f3e (0x453 bytes) 000296[1] 1776190667.858757 mapread 0x7626fe thru 0x763ebd (0x17c0 bytes) 000297[0] 1776190667.956312 mapread 0x3fd13e thru 0x3fe0b8 (0xf7b bytes) 000298[0] 1776190667.989738 write 0x920964 thru 0x92153a (0xbd7 bytes) 000300[0] 1776190668.048537 write 0x5ce504 thru 0x5d006b (0x1b68 bytes) 000302[1] 1776190668.093730 read 0x187a6b thru 0x187e9c (0x432 bytes) truncating to largest ever: 0x9f1547 000306[0] 1776190668.342740 trunc from 0x92153b to 0x9f1546 (0xd000c bytes) 000307[0] 1776190668.436535 mapread 0x584216 thru 0x584c62 (0xa4d bytes) 000309[1] 1776190668.559568 write 0x24314c thru 0x243edf (0xd94 bytes) 000311[1] 1776190668.634145 read 0x3fff92 thru 0x4008ca (0x939 bytes) 000313[0] 1776190668.899370 mapwrite 0x7b906c thru 0x7b99ce (0x963 bytes) 000316[0] 1776190669.112207 mapwrite 0x046407 thru 0x046706 (0x300 bytes) 000318[0] 1776190669.280766 mapread 0x4c1d01 thru 0x4c391d (0x1c1d bytes) 000320[0] 1776190669.372970 mapwrite 0x3d6daf thru 0x3d70df (0x331 bytes) 000321[1] 1776190669.445087 read 0x2473dd thru 0x24933a (0x1f5e bytes) 000323[0] 1776190669.495182 mapread 0x25930b thru 0x25991e (0x614 bytes) 000324[0] 1776190669.503183 write 0x1eb73e thru 0x1ecff2 (0x18b5 bytes) 000327[0] 1776190669.573675 trunc from 0x9f1547 to 0x3efe4c (0x6016fa bytes) 000332[1] 1776190669.686892 mapwrite 0x90e2ce thru 0x90f521 (0x1254 bytes) 000333[0] 1776190670.024962 trunc from 0x90f522 to 0x0d08e0 (0x83ec41 bytes) 000334[0] 1776190670.100424 trunc from 0x0d08e1 to 0x7e5070 (0x714790 bytes) 000336[0] 1776190670.124482 write 0x837838 thru 0x83959c (0x1d65 bytes) 000343[0] 1776190670.170741 trunc from 0x83959d to 0x55539e (0x2e41fe bytes) 000344[1] 1776190670.218104 write 0x4dcfc9 thru 0x4de2bb (0x12f3 bytes) 000346[1] 1776190670.267202 mapwrite 0x19fa17 thru 0x1a197c (0x1f66 bytes) 000347[1] 1776190670.376876 mapwrite 0x64e498 thru 0x64fbfd (0x1766 bytes) 000349[0] 1776190670.477377 trunc from 0x64fbfe to 0x924a61 (0x2d4e64 bytes) 000351[0] 1776190670.558500 write 0x73edc6 thru 0x73f8fa (0xb35 bytes) 000353[0] 1776190670.573415 mapread 0x7c04bf thru 0x7c05aa (0xec bytes) 000355[0] 1776190670.594582 mapread 0x7f1e2e thru 0x7f2aaa (0xc7d bytes) 000357[1] 1776190670.664424 mapwrite 0x62d4e0 thru 0x62eaa9 (0x15ca bytes) 000358[0] 1776190670.907868 mapread 0x6f1b28 thru 0x6f354f (0x1a28 bytes) 000361[0] 1776190671.132663 trunc from 0x924a62 to 0x2f5c7d (0x62ede4 bytes) 000362[1] 1776190671.288003 read 0x06ec2c thru 0x06f36e (0x743 bytes) 000363[0] 1776190671.420071 trunc from 0x2f5c7e to 0x478cf6 (0x183079 bytes) 000364[0] 1776190671.549664 mapwrite 0x83d371 thru 0x83e1fe (0xe8e bytes) 000367[0] 1776190671.773544 mapread 0x775b5a thru 0x776877 (0xd1e bytes) 000370[1] 1776190671.988999 trunc from 0x83e1ff to 0x1aaec4 (0x69333a bytes) 000371[1] 1776190672.111943 write 0x7c0058 thru 0x7c0a7c (0xa25 bytes) 000372[1] 1776190672.169733 mapwrite 0x6928c7 thru 0x693cbf (0x13f9 bytes) 000373[0] 1776190672.479329 read 0x2c5fc9 thru 0x2c6b1b (0xb53 bytes) 000375[1] 1776190672.545172 read 0x32dd3a thru 0x32de51 (0x118 bytes) 000377[0] 1776190672.602595 mapwrite 0x91041f thru 0x911fd5 (0x1bb7 bytes) 000379[1] 1776190672.861987 write 0x8abafb thru 0x8acf42 (0x1448 bytes) 000380[1] 1776190672.899357 read 0x45a747 thru 0x45b11c (0x9d6 bytes) 000381[1] 1776190672.944998 mapwrite 0x08649d thru 0x086e0a (0x96e bytes) 000383[0] 1776190673.123362 write 0x192444 thru 0x192c22 (0x7df bytes) 000385[0] 1776190673.171235 mapwrite 0x7f8b60 thru 0x7fa20b (0x16ac bytes) 000387[0] 1776190673.266125 trunc from 0x911fd6 to 0x14a209 (0x7c7dcc bytes) 000388[0] 1776190673.304716 write 0x380086 thru 0x380cc8 (0xc43 bytes) 000389[0] 1776190673.344898 write 0x907232 thru 0x908762 (0x1531 bytes) 000390[1] 1776190673.391930 mapwrite 0x42a6a2 thru 0x42b2dd (0xc3c bytes) 000391[0] 1776190673.547316 trunc from 0x908763 to 0x7a7893 (0x160ecf bytes) 000392[1] 1776190673.637915 read 0x6ea929 thru 0x6eb4c2 (0xb9a bytes) 000393[0] 1776190673.697872 write 0x0f9029 thru 0x0fa027 (0xfff bytes) 000394[1] 1776190673.738377 mapwrite 0x39d7a0 thru 0x39f5dc (0x1e3d bytes) 000395[1] 1776190673.982761 trunc from 0x7a7894 to 0x75651a (0x51379 bytes) 000397[0] 1776190674.122589 mapread 0x6fcfec thru 0x6fed85 (0x1d9a bytes) 000400[1] 1776190674.317569 trunc from 0x75651b to 0x029e6d (0x72c6ad bytes) 000403[0] 1776190674.433696 trunc from 0x029e6e to 0x9709b4 (0x946b47 bytes) 000405[1] 1776190674.607431 read 0x8baf7c thru 0x8bba1e (0xaa3 bytes) 000408[1] 1776190674.706485 write 0x941ebd thru 0x942684 (0x7c8 bytes) 000409[0] 1776190674.738933 mapread 0x72db69 thru 0x72e713 (0xbab bytes) 000410[0] 1776190674.794033 write 0x6fcfed thru 0x6fe8ef (0x1903 bytes) 000412[1] 1776190674.905999 mapwrite 0x88c2f1 thru 0x88c683 (0x393 bytes) 000419[1] 1776190675.138817 read 0x111095 thru 0x112a32 (0x199e bytes) 000420[1] 1776190675.444466 mapread 0x12e965 thru 0x12edb7 (0x453 bytes) 000421[0] 1776190675.477239 read 0x4016e2 thru 0x4030b4 (0x19d3 bytes) 000423[0] 1776190675.734067 mapread 0x09d159 thru 0x09d403 (0x2ab bytes) 000427[1] 1776190675.777135 trunc from 0x9709b5 to 0x7d8aca (0x197eea bytes) 000428[1] 1776190675.929695 mapread 0x4b70f9 thru 0x4b8d53 (0x1c5b bytes) 000429[0] 1776190675.959289 mapwrite 0x39ac39 thru 0x39b05d (0x425 bytes) 000432[0] 1776190676.278600 read 0x5b53bd thru 0x5b6c93 (0x18d7 bytes) 000435[1] 1776190676.419907 mapwrite 0x5336fb thru 0x534d41 (0x1647 bytes) 000439[0] 1776190676.768716 trunc from 0x7d8acb to 0x5685d8 (0x2704f2 bytes) 000440[1] 1776190676.872639 read 0x27bead thru 0x27da47 (0x1b9b bytes) 000441[1] 1776190676.946303 mapread 0x24f165 thru 0x24fcc4 (0xb60 bytes) 000443[1] 1776190677.008312 mapread 0x544c87 thru 0x545608 (0x982 bytes) 000444[1] 1776190677.132108 mapwrite 0x383706 thru 0x383710 (0xb bytes) 000445[0] 1776190677.277556 trunc from 0x5685d9 to 0x101731 (0x466ea7 bytes) 000447[0] 1776190677.416613 mapread 0x0318ae thru 0x03295d (0x10b0 bytes) 000448[0] 1776190677.451118 read 0x0b4e00 thru 0x0b5a90 (0xc91 bytes) 000451[1] 1776190677.497032 mapread 0x062ebb thru 0x0644ea (0x1630 bytes) 000452[0] 1776190677.599024 trunc from 0x101732 to 0x33f1a9 (0x23da78 bytes) 000453[0] 1776190677.647552 mapwrite 0x965a87 thru 0x9677ef (0x1d69 bytes) 000454[0] 1776190678.050625 trunc from 0x9677f0 to 0x0bc50f (0x8ab2e0 bytes) 000455[0] 1776190678.158139 mapread 0x0a257e thru 0x0a37e7 (0x126a bytes) 000456[0] 1776190678.177939 trunc from 0x0bc510 to 0x37a32d (0x2bde1e bytes) 000458[1] 1776190678.244206 mapread 0x0f2361 thru 0x0f2829 (0x4c9 bytes) 000459[1] 1776190678.273804 trunc from 0x37a32e to 0x700c32 (0x386905 bytes) 000460[0] 1776190678.322167 trunc from 0x700c33 to 0x5aabc4 (0x15606e bytes) 000462[0] 1776190678.378906 write 0x59e9c6 thru 0x59ffc9 (0x1604 bytes) 000465[0] 1776190678.503730 trunc from 0x5aabc5 to 0x00bd02 (0x59eec2 bytes) 000466[1] 1776190678.564727 write 0x3a5827 thru 0x3a76ae (0x1e88 bytes) 000467[1] 1776190678.589498 write 0x4c8826 thru 0x4ca5b9 (0x1d94 bytes) 000468[1] 1776190678.601083 trunc from 0x4ca5ba to 0x6b7b7a (0x1ed5c1 bytes) 000471[0] 1776190678.659724 mapwrite 0x66abac thru 0x66c3a7 (0x17fc bytes) 000472[0] 1776190678.764151 write 0x7f5dc3 thru 0x7f745b (0x1699 bytes) 000475[1] 1776190678.857172 mapwrite 0x2811cd thru 0x281637 (0x46b bytes) 000478[1] 1776190679.115712 mapread 0x79e652 thru 0x79fff8 (0x19a7 bytes) 000479[0] 1776190679.189429 read 0x780934 thru 0x78098b (0x58 bytes) 000480[0] 1776190679.264057 write 0x8ca443 thru 0x8cbd01 (0x18bf bytes) 000482[1] 1776190679.336002 write 0x115fcc thru 0x116731 (0x766 bytes) 000483[0] 1776190679.433534 mapread 0x6a0d12 thru 0x6a0e06 (0xf5 bytes) 000485[0] 1776190679.539438 trunc from 0x8cbd02 to 0x38e6bd (0x53d644 bytes) 000486[1] 1776190679.643362 write 0x5427da thru 0x5435f1 (0xe18 bytes) 000487[0] 1776190679.721265 mapread 0x3465fc thru 0x3479ec (0x13f1 bytes) 000488[0] 1776190679.902143 trunc from 0x5435f2 to 0x3996bc (0x1a9f35 bytes) 000492[0] 1776190679.998132 trunc from 0x3996bd to 0x1ec0ea (0x1ad5d2 bytes) 000493[0] 1776190680.038523 trunc from 0x1ec0eb to 0x43903b (0x24cf51 bytes) 000494[1] 1776190680.080660 mapread 0x13a52b thru 0x13b75d (0x1233 bytes) 000495[1] 1776190680.109931 write 0x188b2a thru 0x18926b (0x742 bytes) All operations completed A-OK! PASS 16b (46s) == sanityn test 16c: verify data consistency on ldiskfs with cache disabled (b=17397) ========================================================== 14:18:09 (1776190689) SKIP: sanityn test_16c dio on ldiskfs only SKIP 16c (5s) == sanityn test 16d: Verify DIO and buffer IO with two clients ========================================================== 14:18:14 (1776190694) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.37853 s, 5.5 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.252786 s, 8.3 MB/s ldlm.namespaces.MGC192.168.202.114@tcp.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff9039c7e21800.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff9039c92f2800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff9039c7e21800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff9039c92f2800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff9039c7e21800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff9039c92f2800.lru_size=clear 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 11.7483 s, 8.9 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 4.84319 s, 21.7 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 3.17338 s, 33.0 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 6.74502 s, 15.5 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 10.2401 s, 10.2 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 4.69263 s, 22.3 MB/s PASS 16d (58s) == sanityn test 16e: Verify size consistency for O_DIRECT write ========================================================== 14:19:12 (1776190752) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.520672 s, 20.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.157256 s, 6.7 MB/s PASS 16e (8s) == sanityn test 16f: rw sequential consistency vs drop_caches ========================================================== 14:19:20 (1776190760) TIMEOUT PASS 16f (30s) == sanityn test 16g: mmap rw sequential consistency vs drop_caches ========================================================== 14:19:50 (1776190790) TIMEOUT PASS 16g (29s) == sanityn test 16i: read after truncate file ============ 14:20:19 (1776190819) ------- before truncate -------- 0002700 6e65 7265 7461 726f 4420 6561 6f6d 3a6e 0002720 762f 7261 6c2f 6269 722f 676e 3a64 732f 0002740 6962 2f6e 6f6e 6f6c 6967 0a6e 0002754 ------- after truncate -------- 0001320 746e 7520 6573 2064 7962 7420 6568 7420 0001340 6f72 7375 7265 2073 6170 6b63 6761 2065 0001360 6f74 7320 6e61 0001366 PASS 16i (8s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 14:20:27 (1776190827) fail_loc=0x8000030a PASS 17 (12s) == sanityn test 18: mmap sanity check =========================================================================================== 14:20:39 (1776190839) mmap test1: basic mmap operation (PASS, 0.12491s) mmap test2: MAP_PRIVATE not write back (PASS, 0.10329s) mmap test3: concurrent mmap ops on two nodes (PASS, 4.7386s) mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 2.5982s) mmap test5: read/write file to/from the buffer which mmapped to just this file (PASS, 0.12185s) mmap test6: check mmap write/read content on two nodes (PASS, 0.20746s) mmap test7: file i/o with an unmapped buffer (SKIPPED, 0s) mmap test8: SIGBUS for beyond file size (SKIPPED, 0s) mmap test9: SIGBUS for negative file offset (SKIPPED, 0s) mmap test10: mtime not change for readonly mmap access (PASS, 1.1149s) PASS 18 (19s) == sanityn test 19: test concurrent uncached read races ========================================================================= 14:20:58 (1776190858) oleg214-server: error: get_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory pdsh@oleg214-client: oleg214-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (5s) == sanityn test 20: test extra readahead page left in cache ============================================================== 14:21:03 (1776190863) PASS 20 (8s) == sanityn test 21: Try to remove mountpoint on another dir ============================================================== 14:21:11 (1776190871) rmdir: removing directory, '/mnt/lustre/d21.sanityn' rmdir: failed to remove '/mnt/lustre/d21.sanityn': Device or resource busy rmdir: removing directory, '/mnt/lustre2/d21.sanityn' Removed mounted directory from another mountpoint, needs to be fixed PASS 21 (9s) == sanityn test 23: others should see updated atime while another read============================================================== 14:21:20 (1776190880) now is 1776190884 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.7152 new atime is 1776190945 PASS 23 (71s) == sanityn test 24a: lfs df [-ih] [path] test =================================================================================== 14:22:32 (1776190952) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.5K 368 488.1K 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 115.3K 375 114.9K 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 115.3K 373 114.9K 1% /mnt/lustre[OST:1] filesystem_summary: 230.2K 368 229.8K 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.5K 368 488.1K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.3K 375 114.9K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 115.3K 373 114.9K 1% /mnt/lustre2[OST:1] filesystem_summary: 230.2K 368 229.8K 1% /mnt/lustre2 UUID bytes Used Available Use% Mounted on lustre-MDT0000_UUID 2.1G 3.2M 2.1G 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3.6G 5.0M 3.6G 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3.6G 6.0M 3.6G 1% /mnt/lustre[OST:1] filesystem_summary: 7.2G 11.0M 7.2G 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500203 368 499835 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118071 375 117696 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 118037 373 117664 1% /mnt/lustre2[OST:1] filesystem_summary: 235728 368 235360 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.5K 368 488.1K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.3K 375 114.9K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 115.3K 373 114.9K 1% /mnt/lustre2[OST:1] filesystem_summary: 230.2K 368 229.8K 1% /mnt/lustre2 No device found for name osc: Invalid argument UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500203 368 499835 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 118071 375 117696 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 118037 373 117664 1% /mnt/lustre[OST:1] filesystem_summary: 235728 368 235360 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500203 368 499835 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118071 375 117696 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 118037 373 117664 1% /mnt/lustre2[OST:1] filesystem_summary: 235728 368 235360 1% /mnt/lustre2 No device found for name osc: Invalid argument UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 5120 3764224 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 11264 7527424 1% /mnt/lustre2 PASS 24a (8s) == sanityn test 24b: lfs df should show both filesystems ========================================================================= 14:22:40 (1776190960) PASS 24b (8s) == sanityn test 25a: change ACL on one mountpoint be seen on another ============================================================= 14:22:48 (1776190968) running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] PASS 25a (8s) == sanityn test 25b: change ACL under remote dir on one mountpoint be seen on another ========================================================== 14:22:56 (1776190976) SKIP: sanityn test_25b needs >= 2 MDTs SKIP 25b (4s) == sanityn test 26a: allow mtime to get older ============ 14:23:01 (1776190981) utime: good mknod times 1776190981 <= 1776190982 <= 1776190983 for /mnt/lustre/f26a utime: good mknod times 1776190981 <= 1776190982 <= 1776190983 for /mnt/lustre2/f26a utime: good utime mtimes 100000, atime 200000 utime: updated times for /mnt/lustre2/f26a PASS 26a (8s) == sanityn test 26b: sync mtime between ost and mds ====== 14:23:10 (1776190990) PASS 26b (10s) SKIP: sanityn test_27 skipping excluded test 27 SKIP: sanityn test_28 skipping ALWAYS excluded test 28 == sanityn test 30: recreate file race =================== 14:23:24 (1776191004) 0 PASS 30 (10s) == sanityn test 31a: voluntary cancel / blocking ast race======================================================================== 14:23:34 (1776191014) fail_loc=0x314 PASS 31a (9s) == sanityn test 31b: voluntary OST cancel / blocking ast race======================================================================== 14:23:44 (1776191024) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg214-server mds-ost sync done. sleep 5 for ZFS MDS Waiting for MDT destroys to complete fail_loc=0x314 fail_loc=0x316 fail_loc=0 fail_loc=0 Filesystem 1K-blocks Used Available Use% Mounted on 192.168.202.114@tcp:/lustre 7542784 12288 7525376 1% /mnt/lustre2 PASS 31b (26s) == sanityn test 31r: open-rename(replace) race =========== 14:24:09 (1776191049) -rw-r--r-- 1 root root 0 Apr 14 14:24 /mnt/lustre/f31r.sanityn.target fail_loc=0x1419 fail_val=3 PASS 31r (11s) SKIP: sanityn test_33a skipping SLOW test 33a == sanityn test 33b: COS: cross create/delete, 2 clients, benchmark under remote dir ========================================================== 14:24:23 (1776191063) SKIP: sanityn test_33b Need two or more clients, have 1 SKIP 33b (4s) == sanityn test 33c: Cancel cross-MDT lock should trigger Sync-Lock-Cancel ========================================================== 14:24:28 (1776191068) SKIP: sanityn test_33c needs >= 2 MDTs SKIP 33c (4s) == sanityn test 33d: DNE distributed operation should trigger COS ========================================================== 14:24:32 (1776191072) SKIP: sanityn test_33d needs >= 2 MDTs SKIP 33d (4s) == sanityn test 33e: DNE local operation shouldn't trigger COS ========================================================== 14:24:37 (1776191077) SKIP: sanityn test_33e Need two or more clients, have 1 SKIP 33e (3s) == sanityn test 34: no lock timeout under IO ============= 14:24:41 (1776191081) fail_loc=0x512 fail_loc=0x512 lock should not expire writing on client1 reading on client2 success fail_loc=0x511 fail_loc=0x511 lock should expire writing on client1 reading on client2 success oleg214-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9039c7e21800.ost_server_uuid,osc.lustre-OST0000-osc-ffff9039c92f2800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff9039c7e21800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0000-osc-ffff9039c92f2800.ost_server_uuid in IDLE state after 0 sec oleg214-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9039c7e21800.ost_server_uuid,osc.lustre-OST0001-osc-ffff9039c92f2800.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff9039c7e21800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0001-osc-ffff9039c92f2800.ost_server_uuid in FULL state after 0 sec oleg214-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9039c7e21800.ost_server_uuid,osc.lustre-OST0000-osc-ffff9039c92f2800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff9039c7e21800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0000-osc-ffff9039c92f2800.ost_server_uuid in IDLE state after 0 sec oleg214-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9039c7e21800.ost_server_uuid,osc.lustre-OST0001-osc-ffff9039c92f2800.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff9039c7e21800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0001-osc-ffff9039c92f2800.ost_server_uuid in FULL state after 0 sec oleg214-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff9039c7e21800.ost_server_uuid,osc.lustre-OST0000-osc-ffff9039c92f2800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff9039c7e21800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0000-osc-ffff9039c92f2800.ost_server_uuid in IDLE state after 0 sec oleg214-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9039c7e21800.ost_server_uuid,osc.lustre-OST0001-osc-ffff9039c92f2800.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff9039c7e21800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0001-osc-ffff9039c92f2800.ost_server_uuid in FULL state after 0 sec PASS 34 (143s) == sanityn test 35: -EINTR cp_ast vs. bl_ast race does not evict client ========================================================== 14:27:04 (1776191224) fail_loc=0x80000317 Race attempt 0 Wait for 44746 44761 for 60 sec... - open/close 801 (time 1776191241.93 total 10.01 last 80.01) - open/close 1515 (time 1776191251.93 total 20.01 last 71.39) - open/close 2269 (time 1776191261.94 total 30.02 last 75.36) - open/close 2991 (time 1776191271.94 total 40.02 last 72.15) - open/close 3641 (time 1776191281.95 total 50.03 last 64.95) total: 4000 open/close in 55.35 seconds: 72.27 ops/second fail_loc=0x0 Filesystem Size Used Avail Use% Mounted on 192.168.202.114@tcp:/lustre 7.2G 13M 7.2G 1% /mnt/lustre 192.168.202.114@tcp:/lustre 7.2G 13M 7.2G 1% /mnt/lustre2 PASS 35 (73s) == sanityn test 36: handle ESTALE/open-unlink correctly == 14:28:17 (1776191297) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg214-server mds-ost sync done. Waiting for MDT destroys to complete 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.7409 s, 30.1 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7152 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(0) *** before(7525376) after_dd(7472128) after(7523328) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.04983 s, 49.9 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7152 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(1) *** before(7523328) after_dd(7468032) after(7519232) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.39167 s, 37.7 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7152 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(2) *** before(7519232) after_dd(7470080) after(7521280) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.98459 s, 26.4 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7152 sleep 5 for ZFS MDS Waiting for MDT destroys to complete *** cycle(3) *** before(7521280) after_dd(7472128) after(7523328) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.4008 s, 37.4 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7152 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(4) *** before(7523328) after_dd(7464960) after(7525376) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.7782 s, 29.5 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7152 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(5) *** before(7525376) after_dd(7472128) after(7525376) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.3691 s, 38.3 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7152 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(6) *** before(7525376) after_dd(7470080) after(7521280) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.25897 s, 41.6 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7152 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(7) *** before(7521280) after_dd(7474176) after(7525376) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.19098 s, 44.0 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7152 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(8) *** before(7525376) after_dd(7464960) after(7525376) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 2.14565 s, 24.4 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7152 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(9) *** before(7525376) after_dd(7474176) after(7525376) 50+0 records in 50+0 records out 52428800 bytes (52 MB, 50 MiB) copied, 1.46925 s, 35.7 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7152 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(10) *** before(7525376) after_dd(7472128) after(7525376) PASS 36 (347s) == sanityn test 37: check i_size is not updated for directory on close (bug 18695) ======================================================================== 14:34:04 (1776191644) multiop /mnt/lustre/d37.sanityn vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.7152 - create 1478 (time 1776191659.01 total 10.02 last 147.47) - create 3150 (time 1776191669.01 total 20.02 last 167.18) - create 4603 (time 1776191679.03 total 30.04 last 145.02) - create 6041 (time 1776191689.04 total 40.05 last 143.68) - create 7612 (time 1776191699.05 total 50.06 last 156.91) - create 9094 (time 1776191709.06 total 60.07 last 148.06) total: 10000 create in 66.33 seconds: 150.76 ops/second PASS 37 (78s) == sanityn test 39a: test from 11063 ============================================================================================ 14:35:23 (1776191723) repeat after cancel_lru_locks PASS 39a (6s) == sanityn test 39b: 11063 problem 1 ============================================================================================ 14:35:30 (1776191730) repeat after cancel_lru_locks PASS 39b (10s) == sanityn test 39c: check truncate mtime update ================================================================================ 14:35:39 (1776191739) repeat after cancel_lru_locks PASS 39c (8s) == sanityn test 39d: sync write should update mtime ====== 14:35:47 (1776191747) fail_loc=0x411 fail_loc=0 PASS 39d (7s) == sanityn test 40a: pdirops: create vs others ======================================================================== 14:35:54 (1776191754) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40a (18s) == sanityn test 40b: pdirops: open|create and others ======================================================================== 14:36:12 (1776191772) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40b (17s) == sanityn test 40c: pdirops: link and others ======================================================================== 14:36:30 (1776191790) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40c (18s) == sanityn test 40d: pdirops: unlink and others ======================================================================== 14:36:49 (1776191809) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40d (17s) == sanityn test 40e: pdirops: rename and others ======================================================================== 14:37:05 (1776191825) No conflict No conflict No conflict No conflict No conflict No conflict PASS 40e (16s) == sanityn test 41a: pdirops: create vs mkdir ======================================================================== 14:37:22 (1776191842) mkdir: cannot create directory '/mnt/lustre2/f41a.sanityn': File exists Conflict PASS 41a (12s) == sanityn test 41b: pdirops: create vs create ======================================================================== 14:37:34 (1776191854) open: File exists Conflict PASS 41b (13s) == sanityn test 41c: pdirops: create vs link ======================================================================== 14:37:47 (1776191867) link: cannot create link '/mnt/lustre2/f41c.sanityn' to '/mnt/lustre2/f41c.sanityn-2': File exists Conflict PASS 41c (16s) == sanityn test 41d: pdirops: create vs unlink ======================================================================== 14:38:03 (1776191883) Conflict PASS 41d (14s) == sanityn test 41e: pdirops: create and rename (tgt) ======================================================================== 14:38:17 (1776191897) Conflict PASS 41e (14s) == sanityn test 41f: pdirops: create and rename (src) ======================================================================== 14:38:32 (1776191912) Conflict PASS 41f (16s) == sanityn test 41g: pdirops: create vs getattr ======================================================================== 14:38:49 (1776191929) Conflict PASS 41g (15s) == sanityn test 41h: pdirops: create vs readdir ======================================================================== 14:39:03 (1776191943) Conflict PASS 41h (16s) == sanityn test 41i: reint_open: create vs create ======== 14:39:19 (1776191959) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 41i (1133s) == sanityn test 42a: pdirops: mkdir vs mkdir ======================================================================== 14:58:12 (1776193092) mkdir: cannot create directory '/mnt/lustre2/f42a.sanityn': File exists Conflict PASS 42a (12s) == sanityn test 42b: pdirops: mkdir vs create ======================================================================== 14:58:24 (1776193104) open: File exists Conflict PASS 42b (13s) == sanityn test 42c: pdirops: mkdir vs link ======================================================================== 14:58:38 (1776193118) link: cannot create link '/mnt/lustre2/f42c.sanityn' to '/mnt/lustre2/f42c.sanityn-2': File exists Conflict PASS 42c (14s) == sanityn test 42d: pdirops: mkdir vs unlink ======================================================================== 14:58:52 (1776193132) Conflict PASS 42d (13s) == sanityn test 42e: pdirops: mkdir and rename (tgt) ======================================================================== 14:59:05 (1776193145) mv: cannot overwrite directory '/mnt/lustre2/f42e.sanityn' with non-directory Conflict PASS 42e (14s) == sanityn test 42f: pdirops: mkdir and rename (src) ======================================================================== 14:59:19 (1776193159) Conflict PASS 42f (14s) == sanityn test 42g: pdirops: mkdir vs getattr ======================================================================== 14:59:33 (1776193173) Conflict PASS 42g (15s) == sanityn test 42h: pdirops: mkdir vs readdir ======================================================================== 14:59:48 (1776193188) Conflict PASS 42h (12s) == sanityn test 43a: rmdir,mkdir doesn't return -EEXIST ======================================================================== 15:00:00 (1776193200) PASS 43a (55s) == sanityn test 43b: pdirops: unlink vs create ======================================================================== 15:00:55 (1776193255) Conflict PASS 43b (16s) == sanityn test 43c: pdirops: unlink vs link ======================================================================== 15:01:11 (1776193271) Conflict PASS 43c (16s) == sanityn test 43d: pdirops: unlink vs unlink ======================================================================== 15:01:28 (1776193288) rm: cannot remove '/mnt/lustre2/f43d.sanityn': No such file or directory Conflict PASS 43d (14s) == sanityn test 43e: pdirops: unlink and rename (tgt) ======================================================================== 15:01:42 (1776193302) Conflict PASS 43e (14s) == sanityn test 43f: pdirops: unlink and rename (src) ======================================================================== 15:01:56 (1776193316) mv: cannot stat '/mnt/lustre2/f43f.sanityn': No such file or directory Conflict PASS 43f (15s) == sanityn test 43g: pdirops: unlink vs getattr ======================================================================== 15:02:11 (1776193331) stat: cannot statx '/mnt/lustre2/f43g.sanityn': No such file or directory Conflict PASS 43g (15s) == sanityn test 43h: pdirops: unlink vs readdir ======================================================================== 15:02:26 (1776193346) Conflict PASS 43h (15s) == sanityn test 43i: pdirops: unlink vs remote mkdir ===== 15:02:41 (1776193361) SKIP: sanityn test_43i needs >= 2 MDTs SKIP 43i (5s) == sanityn test 43j: racy mkdir return EEXIST ======================================================================== 15:02:46 (1776193366) mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists PASS 43j (153s) == sanityn test 43k: unlink vs create ==================== 15:05:19 (1776193519) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 43k (1291s) == sanityn test 44a: pdirops: rename tgt vs mkdir ======================================================================== 15:26:51 (1776194811) mkdir: cannot create directory '/mnt/lustre2/f44a.sanityn': File exists Conflict Tue Apr 14 15:26:59 EDT 2026 PASS 44a (13s) == sanityn test 44b: pdirops: rename tgt vs create ======================================================================== 15:27:04 (1776194824) open: File exists Conflict PASS 44b (14s) == sanityn test 44c: pdirops: rename tgt vs link ======================================================================== 15:27:18 (1776194838) link: cannot create link '/mnt/lustre2/f44c.sanityn' to '/mnt/lustre2/f44c.sanityn-3': File exists Conflict PASS 44c (13s) == sanityn test 44d: pdirops: rename tgt vs unlink ======================================================================== 15:27:31 (1776194851) Conflict PASS 44d (14s) == sanityn test 44e: pdirops: rename tgt and rename (tgt) ======================================================================== 15:27:45 (1776194865) Conflict PASS 44e (15s) == sanityn test 44f: pdirops: rename tgt and rename (src) ======================================================================== 15:28:00 (1776194880) Conflict PASS 44f (14s) == sanityn test 44g: pdirops: rename tgt vs getattr ======================================================================== 15:28:14 (1776194894) Conflict PASS 44g (13s) == sanityn test 44h: pdirops: rename tgt vs readdir ======================================================================== 15:28:27 (1776194907) Conflict PASS 44h (16s) == sanityn test 44i: pdirops: rename tgt vs remote mkdir ========================================================== 15:28:43 (1776194923) SKIP: sanityn test_44i needs >= 2 MDTs SKIP 44i (5s) == sanityn test 45a: rename,mkdir doesn't return -EEXIST ======================================================================== 15:28:48 (1776194928) PASS 45a (103s) == sanityn test 45b: pdirops: rename src vs create ======================================================================== 15:30:31 (1776195031) Conflict PASS 45b (14s) == sanityn test 45c: pdirops: rename src vs link ======================================================================== 15:30:45 (1776195045) Conflict PASS 45c (14s) == sanityn test 45d: pdirops: rename src vs unlink ======================================================================== 15:30:59 (1776195059) rm: cannot remove '/mnt/lustre2/f45d.sanityn': No such file or directory Conflict PASS 45d (14s) == sanityn test 45e: pdirops: rename src and rename (tgt) ======================================================================== 15:31:13 (1776195073) Conflict PASS 45e (14s) == sanityn test 45f: pdirops: rename src and rename (src) ======================================================================== 15:31:27 (1776195087) mv: cannot stat '/mnt/lustre2/f45f.sanityn': No such file or directory Conflict PASS 45f (14s) == sanityn test 45g: pdirops: rename src vs getattr ======================================================================== 15:31:41 (1776195101) stat: cannot statx '/mnt/lustre2/f45g.sanityn': No such file or directory Conflict PASS 45g (14s) == sanityn test 45h: pdirops: unlink vs readdir ======================================================================== 15:31:55 (1776195115) Conflict PASS 45h (14s) == sanityn test 45i: pdirops: rename src vs remote mkdir ========================================================== 15:32:10 (1776195130) SKIP: sanityn test_45i needs >= 2 MDTs SKIP 45i (4s) == sanityn test 45j: read vs rename ====================== 15:32:13 (1776195133) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 45j (1291s) == sanityn test 46a: pdirops: link vs mkdir ======================================================================== 15:53:44 (1776196424) mkdir: cannot create directory '/mnt/lustre2/f46a.sanityn': File exists Conflict PASS 46a (13s) == sanityn test 46b: pdirops: link vs create ======================================================================== 15:53:58 (1776196438) open: File exists Conflict PASS 46b (14s) == sanityn test 46c: pdirops: link vs link ======================================================================== 15:54:11 (1776196451) link: cannot create link '/mnt/lustre2/f46c.sanityn' to '/mnt/lustre2/f46c.sanityn': File exists Conflict PASS 46c (13s) == sanityn test 46d: pdirops: link vs unlink ======================================================================== 15:54:24 (1776196464) Conflict PASS 46d (11s) == sanityn test 46e: pdirops: link and rename (tgt) ======================================================================== 15:54:36 (1776196476) Conflict PASS 46e (13s) == sanityn test 46f: pdirops: link and rename (src) ======================================================================== 15:54:48 (1776196488) Conflict PASS 46f (13s) == sanityn test 46g: pdirops: link vs getattr ======================================================================== 15:55:02 (1776196502) Conflict PASS 46g (17s) == sanityn test 46h: pdirops: link vs readdir ======================================================================== 15:55:19 (1776196519) Conflict PASS 46h (17s) == sanityn test 46i: pdirops: link vs remote mkdir ======= 15:55:35 (1776196535) SKIP: sanityn test_46i needs >= 2 MDTs SKIP 46i (4s) == sanityn test 47a: pdirops: remote mkdir vs mkdir ====== 15:55:40 (1776196540) SKIP: sanityn test_47a needs >= 2 MDTs SKIP 47a (5s) == sanityn test 47b: pdirops: remote mkdir vs create ===== 15:55:45 (1776196545) SKIP: sanityn test_47b needs >= 2 MDTs SKIP 47b (4s) == sanityn test 47c: pdirops: remote mkdir vs link ======= 15:55:49 (1776196549) SKIP: sanityn test_47c needs >= 2 MDTs SKIP 47c (4s) == sanityn test 47d: pdirops: remote mkdir vs unlink ===== 15:55:53 (1776196553) SKIP: sanityn test_47d needs >= 2 MDTs SKIP 47d (4s) == sanityn test 47e: pdirops: remote mkdir and rename (tgt) ========================================================== 15:55:57 (1776196557) SKIP: sanityn test_47e needs >= 2 MDTs SKIP 47e (3s) == sanityn test 47f: pdirops: remote mkdir and rename (src) ========================================================== 15:56:00 (1776196560) SKIP: sanityn test_47f needs >= 2 MDTs SKIP 47f (4s) == sanityn test 47g: pdirops: remote mkdir vs getattr ==== 15:56:04 (1776196564) SKIP: sanityn test_47g needs >= 2 MDTs SKIP 47g (3s) == sanityn test 50: osc lvb attrs: enqueue vs. CP AST ======================================================================== 15:56:08 (1776196568) 10+0 records in 10+0 records out 10240 bytes (10 kB, 10 KiB) copied, 0.129006 s, 79.4 kB/s fail_loc=0x410 fail_loc=0x0 PASS 50 (12s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 15:56:20 (1776196580) 0+1 records in 0+1 records out 158 bytes copied, 0.0365643 s, 4.3 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3146: kill: (242845) - No such process PASS 51a (9s) == sanityn test 51b: layout lock: glimpse should be able to restart if layout changed ========================================================== 15:56:29 (1776196589) 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00906714 s, 113 kB/s fail_loc=0x1404 fail_val=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0925416 s, 11.3 MB/s 3145728 PASS 51b (20s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 15:56:49 (1776196609) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0190786 s, 53.7 kB/s PASS 51c (13s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 15:57:02 (1776196622) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0782648 s, 13.4 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (10s) == sanityn test 51e: lfs getstripe does not break leases, part 2 ========================================================== 15:57:13 (1776196633) /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2434 0x982 0 write lease(2) has applied. /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2434 0x982 0 read lease(1) has applied. PASS 51e (11s) == sanityn test 54: rename locking ======================= 15:57:23 (1776196643) llite.lustre-ffff9039c7e21800.xattr_cache=1 llite.lustre-ffff9039c92f2800.xattr_cache=1 ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000153 File: /mnt/lustre/d1/d2 Size: 512 Blocks: 1 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504962 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 15:57:25.000000000 -0400 Modify: 2026-04-14 15:57:25.000000000 -0400 Change: 2026-04-14 15:57:25.000000000 -0400 Birth: 2026-04-14 15:57:25.000000000 -0400 ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000154 File: /mnt/lustre/d1/d2 Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504965 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 15:57:31.000000000 -0400 Modify: 2026-04-14 15:57:32.000000000 -0400 Change: 2026-04-14 15:57:32.000000000 -0400 Birth: 2026-04-14 15:57:31.000000000 -0400 ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000153 File: /mnt/lustre/d1/d2 Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504968 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 15:57:37.000000000 -0400 Modify: 2026-04-14 15:57:37.000000000 -0400 Change: 2026-04-14 15:57:37.000000000 -0400 Birth: 2026-04-14 15:57:37.000000000 -0400 open(O_RDWR|O_CREAT): Is a directory File: /mnt/lustre/d1 Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504967 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 15:57:37.000000000 -0400 Modify: 2026-04-14 15:57:38.000000000 -0400 Change: 2026-04-14 15:57:38.000000000 -0400 Birth: 2026-04-14 15:57:37.000000000 -0400 ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000154 open(O_RDWR|O_CREAT): Is a directory File: /mnt/lustre/d1/d2 Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504971 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 15:57:43.000000000 -0400 Modify: 2026-04-14 15:57:44.000000000 -0400 Change: 2026-04-14 15:57:44.000000000 -0400 Birth: 2026-04-14 15:57:43.000000000 -0400 File: /mnt/lustre/d1 Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504970 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 15:57:43.000000000 -0400 Modify: 2026-04-14 15:57:44.000000000 -0400 Change: 2026-04-14 15:57:44.000000000 -0400 Birth: 2026-04-14 15:57:43.000000000 -0400 PASS 54 (32s) == sanityn test 55a: rename vs unlink target dir ========= 15:57:55 (1776196675) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55a.sanityn/d1/d2' to '/mnt/lustre/d55a.sanityn/d3/d2': No such file or directory PASS 55a (12s) == sanityn test 55b: rename vs unlink source dir ========= 15:58:07 (1776196687) fail_loc=0x80000156 mv: cannot stat '/mnt/lustre/d55b.sanityn/d1/d2': No such file or directory PASS 55b (14s) == sanityn test 55c: rename vs unlink orphan target dir == 15:58:21 (1776196701) fail_loc=0x156 mv: cannot move '/mnt/lustre/d55c.sanityn/d1/d2' to '/mnt/lustre/d55c.sanityn/d3/d2': No such file or directory PASS 55c (20s) == sanityn test 55d: rename file vs link ================= 15:58:41 (1776196721) fail_loc=0x155 mv: '/mnt/lustre/d55d.sanityn/f1' and '/mnt/lustre/d55d.sanityn/d55d.sanityn/f1' are the same file PASS 55d (16s) == sanityn test 60: Verify data_version behaviour ======== 15:58:57 (1776196737) PASS 60 (9s) == sanityn test 70a: cd directory && rm directory ======== 15:59:06 (1776196746) PASS 70a (10s) == sanityn test 70b: remove files after calling rm_entry ========================================================== 15:59:16 (1776196756) PASS 70b (9s) == sanityn test 71a: correct file map just after write operation is finished ========================================================== 15:59:25 (1776196765) 1+0 records in 1+0 records out 65536 bytes (66 kB, 64 KiB) copied, 0.0161886 s, 4.0 MB/s SKIP: sanityn test_71a ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71a (4s) == sanityn test 71b: check fiemap support for stripecount > 1 ========================================================== 15:59:29 (1776196769) 1+0 records in 1+0 records out 65536 bytes (66 kB, 64 KiB) copied, 0.0103833 s, 6.3 MB/s SKIP: sanityn test_71b ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71b (4s) == sanityn test 71c: check FIEMAP_EXTENT_LAST flag with different extents number ========================================================== 15:59:33 (1776196773) SKIP: sanityn test_71c support only ldiskfs ost SKIP 71c (4s) == sanityn test 71d: fiemap corruption test with fm_extent_count=0 ========================================================== 15:59:38 (1776196778) 1+0 records in 1+0 records out 65536 bytes (66 kB, 64 KiB) copied, 0.027344 s, 2.4 MB/s SKIP: sanityn test_71d ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71d (4s) == sanityn test 72: getxattr/setxattr cache should be consistent between nodes ========================================================== 15:59:41 (1776196781) llite.lustre-ffff9039c7e21800.xattr_cache=1 llite.lustre-ffff9039c92f2800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names user.attr1="value1" getfattr: Removing leading '/' from absolute path names user.attr1="value2" getfattr: Removing leading '/' from absolute path names getfattr: Removing leading '/' from absolute path names b362740ad371eae580e7f85452e8830b - 870e072da1ebfc20ea8c0cd3d6bdf3b6 - PASS 72 (8s) == sanityn test 73: getxattr should not cause xattr lock cancellation ========================================================== 15:59:49 (1776196789) llite.lustre-ffff9039c7e21800.xattr_cache=1 llite.lustre-ffff9039c92f2800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" PASS 73 (8s) == sanityn test 74: flock deadlock: different mounts ======================================================================== 15:59:58 (1776196798) 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00866554 s, 118 kB/s 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.0341408 s, 30.0 kB/s 252898: get lock1 252897: get lock2 252898: done 252898: get lock2 252897: done 252897: get lock1 fcntl cmd 7 failed: Resource deadlock avoided 252897: cannot get lock1: Resource deadlock avoided 252898: done 252898: exit rc=0 252897: done 252897: exit rc=0 PASS 74 (11s) == sanityn test 75: osc: upcall after unuse lock============================================================================= 16:00:09 (1776196809) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0729374 s, 28.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0390812 s, 26.8 MB/s fail_loc=0x31d /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3714: 253472 Killed stat -c %s $DIR1/$tfile fail_loc=0 PASS 75 (13s) == sanityn test 76: Verify MDT open_files listing ======== 16:00:22 (1776196822) opening files: ........ closing files: ........ PASS 76 (67s) == sanityn test 77a: check FIFO NRS policy =============== 16:01:29 (1776196889) ost.OSS.ost.nrs_policies=fifo ost.OSS.ost_create.nrs_policies=fifo ost.OSS.ost_io.nrs_policies=fifo ost.OSS.ost_out.nrs_policies=fifo ost.OSS.ost_seq.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.489513 s, 34.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0697197 s, 15.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.128336 s, 8.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.24424 s, 4.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.21435 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.18959 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.164371 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.229718 s, 4.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.289528 s, 3.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.283896 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.278117 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.280026 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.271372 s, 3.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.369112 s, 2.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.391274 s, 2.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.29454 s, 3.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.320293 s, 3.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0652851 s, 16.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112112 s, 93.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0438213 s, 23.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.102591 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0432589 s, 24.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0827273 s, 12.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0454029 s, 23.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0476933 s, 22.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0480631 s, 21.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.102068 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0719724 s, 14.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.05851 s, 17.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0798703 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0798792 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0817101 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258542 s, 40.6 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9039c7e21800.lock_unused_count=2 removed '/mnt/lustre/d77a.sanityn/nrs_w_oleg214-client.virtnet' removed '/mnt/lustre/d77a.sanityn/nrs_r_oleg214-client.virtnet' removed directory '/mnt/lustre/d77a.sanityn' PASS 77a (10s) == sanityn test 77b: check CRR-N NRS policy ============== 16:01:39 (1776196899) ost.OSS.ost.nrs_policies=crrn ost.OSS.ost_create.nrs_policies=crrn ost.OSS.ost_io.nrs_policies=crrn ost.OSS.ost_out.nrs_policies=crrn ost.OSS.ost_seq.nrs_policies=crrn ost.OSS.ost.nrs_crrn_quantum=1 ost.OSS.ost_create.nrs_crrn_quantum=1 ost.OSS.ost_io.nrs_crrn_quantum=1 ost.OSS.ost_out.nrs_crrn_quantum=1 ost.OSS.ost_seq.nrs_crrn_quantum=1 policy: crr-n, crrn_quantum 1 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.444695 s, 37.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0687813 s, 15.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0979295 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.253849 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.159096 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.155084 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.22655 s, 4.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.251722 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.343751 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.203966 s, 5.1 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9039c7e21800.lock_unused_count=5 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.394003 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.337301 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.575129 s, 1.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.651971 s, 1.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.482122 s, 2.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.578433 s, 1.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.630311 s, 1.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00243306 s, 431 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9039c7e21800.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff9039c7e21800.lock_unused_count=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00287405 s, 365 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00595969 s, 176 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00899284 s, 117 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00581393 s, 180 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.213531 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.138066 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00767865 s, 137 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122997 s, 85.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.154078 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.321094 s, 3.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.158401 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.145201 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0527114 s, 19.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0480169 s, 21.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0386083 s, 27.2 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg214-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg214-client.virtnet' removed directory '/mnt/lustre/d77b.sanityn' ost.OSS.ost.nrs_crrn_quantum=64 ost.OSS.ost_create.nrs_crrn_quantum=64 ost.OSS.ost_io.nrs_crrn_quantum=64 ost.OSS.ost_out.nrs_crrn_quantum=64 ost.OSS.ost_seq.nrs_crrn_quantum=64 policy: crr-n, crrn_quantum 64 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.424006 s, 39.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.056319 s, 18.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0763858 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0724432 s, 14.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0987794 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0930195 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.155101 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.197418 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0961194 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0665008 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.294417 s, 3.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.292884 s, 3.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.26931 s, 3.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.156839 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.280421 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.29173 s, 3.6 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9039c7e21800.lock_unused_count=7 ldlm.namespaces.lustre-OST0001-osc-ffff9039c7e21800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.323768 s, 3.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00562073 s, 187 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00650057 s, 161 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240855 s, 43.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026966 s, 38.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00256075 s, 409 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00251406 s, 417 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.217468 s, 4.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.193837 s, 5.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.191217 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.254009 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.176617 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867976 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.244514 s, 4.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0559939 s, 18.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0383734 s, 27.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.165511 s, 6.3 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg214-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg214-client.virtnet' removed directory '/mnt/lustre/d77b.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77b (15s) == sanityn test 77c: check ORR NRS policy ================ 16:01:54 (1776196914) ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_orr_quantum=1 ost.OSS.ost_io.nrs_orr_offset_type=physical ost.OSS.ost_io.nrs_orr_supported=reads policy: orr, orr_quantum 1, orr_offset_type physical, orr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.46516 s, 36.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0824908 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.079405 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.139526 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.199649 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.198179 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.100756 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0865373 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0365214 s, 28.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255243 s, 41.1 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff9039c7e21800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.140299 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.258745 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.121861 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.260557 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.217244 s, 4.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.358625 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.356347 s, 2.9 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9039c7e21800.lock_unused_count=7 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0974533 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0600731 s, 17.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0747825 s, 14.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0687498 s, 15.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0991277 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0662907 s, 15.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0541958 s, 19.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.080676 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0726168 s, 14.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107421 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0879412 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0894702 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0876772 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0870435 s, 12.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0970099 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0929718 s, 11.3 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg214-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg214-client.virtnet' removed directory '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=writes ost.OSS.ost_io.nrs_orr_quantum=64 policy: orr, orr_quantum 64, orr_offset_type physical, orr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.616047 s, 27.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0472084 s, 22.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0389946 s, 26.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103206 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.170475 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.121894 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.161007 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.150858 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.142704 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.056749 s, 18.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.163831 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.180766 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.283055 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.232074 s, 4.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.307243 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.148654 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.281483 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107116 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0435147 s, 24.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0630438 s, 16.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304361 s, 34.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177897 s, 58.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0721342 s, 14.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0792151 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00713173 s, 147 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0061235 s, 171 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00543665 s, 193 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0922149 s, 11.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00246923 s, 425 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0774371 s, 13.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.173473 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.080103 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0833355 s, 12.6 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg214-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg214-client.virtnet' removed directory '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=reads_and_writes ost.OSS.ost_io.nrs_orr_offset_type=logical policy: orr, orr_quantum 64, orr_offset_type logical, orr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.397304 s, 42.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0624021 s, 16.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0828788 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0908222 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104867 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.1224 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.170008 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.142384 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.170956 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.136599 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0468229 s, 22.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.205966 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.146196 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.225769 s, 4.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.182919 s, 5.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.225953 s, 4.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.296713 s, 3.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211833 s, 49.5 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0354353 s, 29.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0881611 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0782443 s, 13.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0616011 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.106019 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.083553 s, 12.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0677876 s, 15.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0593612 s, 17.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.121965 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186439 s, 56.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.115117 s, 9.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.127306 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0671293 s, 15.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0791804 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0469697 s, 22.3 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9039c7e21800.lock_unused_count=7 removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg214-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg214-client.virtnet' removed directory '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77c (19s) == sanityn test 77d: check TRR nrs policy ================ 16:02:13 (1776196933) ost.OSS.ost_io.nrs_policies=trr ost.OSS.ost_io.nrs_trr_quantum=1 ost.OSS.ost_io.nrs_trr_offset_type=physical ost.OSS.ost_io.nrs_trr_supported=reads policy: trr, trr_quantum 1, trr_offset_type physical, trr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.471462 s, 35.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0682668 s, 15.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0820177 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.119881 s, 8.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.143259 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.248266 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.253508 s, 4.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.194859 s, 5.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.300417 s, 3.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.237385 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.275716 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.271741 s, 3.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.249746 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.290325 s, 3.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.34398 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.294832 s, 3.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.436732 s, 2.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0459606 s, 22.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0550254 s, 19.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.040273 s, 26.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289539 s, 36.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0427413 s, 24.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0445935 s, 23.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0865085 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0588734 s, 17.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0444129 s, 23.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0824294 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0541528 s, 19.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0696783 s, 15.0 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0594394 s, 17.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.069462 s, 15.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103063 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107167 s, 9.8 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9039c7e21800.lock_unused_count=8 removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg214-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg214-client.virtnet' removed directory '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=writes ost.OSS.ost_io.nrs_trr_quantum=64 policy: trr, trr_quantum 64, trr_offset_type physical, trr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.473851 s, 35.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.077882 s, 13.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0646495 s, 16.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.119872 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0413359 s, 25.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.145879 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.202135 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.204039 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.257698 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.28301 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.295495 s, 3.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0638252 s, 16.4 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff9039c7e21800.lock_unused_count=3 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.300804 s, 3.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.296794 s, 3.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.343425 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.384873 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.12489 s, 8.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0643086 s, 16.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0661376 s, 15.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0833792 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.110169 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0808875 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0857682 s, 12.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0855698 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0867779 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0742175 s, 14.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.113409 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0945629 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.102117 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.119266 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109204 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.095796 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.163371 s, 6.4 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg214-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg214-client.virtnet' removed directory '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=reads_and_writes ost.OSS.ost_io.nrs_trr_offset_type=logical policy: trr, trr_quantum 64, trr_offset_type logical, trr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.480283 s, 34.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0613789 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0893043 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.215706 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.122279 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.173488 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.172069 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.183215 s, 5.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.224913 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.112833 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.232933 s, 4.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.128588 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.265697 s, 3.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.199593 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.256981 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.282378 s, 3.7 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9039c7e21800.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff9039c7e21800.lock_unused_count=2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.338901 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157665 s, 66.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167463 s, 62.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268538 s, 39.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.134172 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0336693 s, 31.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313766 s, 33.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0345081 s, 30.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0365807 s, 28.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0795151 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00283587 s, 370 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00488751 s, 215 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0545168 s, 19.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.006607 s, 159 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104209 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272231 s, 38.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229091 s, 45.8 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg214-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg214-client.virtnet' removed directory '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77d (18s) == sanityn test 77e: check TBF NID nrs policy ============ 16:02:32 (1776196952) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_tbf_rule=start localhost nid={0@lo} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start clients nid={192.168.202.14@tcp} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start others nid={*.*.*.*@tcp} rate=50 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.633263 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0711783 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.116049 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.221266 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.155034 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.147728 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.278504 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.284445 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.318084 s, 3.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.276576 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.238069 s, 4.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.281262 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.316409 s, 3.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.296215 s, 3.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.405933 s, 2.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.360257 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.42374 s, 2.5 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9039c7e21800.lock_unused_count=7 ldlm.namespaces.lustre-OST0001-osc-ffff9039c7e21800.lock_unused_count=3 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283508 s, 37.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0469012 s, 22.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0556686 s, 18.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292584 s, 35.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0714432 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0639574 s, 16.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0988165 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.067742 s, 15.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0536399 s, 19.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101901 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0578053 s, 18.1 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0801203 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0626583 s, 16.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0850112 s, 12.3 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0797767 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0902253 s, 11.6 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg214-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg214-client.virtnet' removed directory '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change localhost rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change clients rate=101 ost.OSS.ost_io.nrs_tbf_rule=change others rate=51 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.601264 s, 27.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0725013 s, 14.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0960052 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0978873 s, 10.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.22702 s, 4.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.192254 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.232297 s, 4.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.222629 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.215903 s, 4.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.245578 s, 4.3 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9039c7e21800.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff9039c7e21800.lock_unused_count=6 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.273757 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.242204 s, 4.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.297689 s, 3.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.244241 s, 4.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.280311 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.28459 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.311821 s, 3.4 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9039c7e21800.lock_unused_count=3 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0346246 s, 30.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0023783 s, 441 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0471955 s, 22.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0475463 s, 22.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00627788 s, 167 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0805043 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0416268 s, 25.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.117222 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317561 s, 33.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0660967 s, 15.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256031 s, 41.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257593 s, 40.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0350179 s, 29.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.035527 s, 29.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230433 s, 45.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202323 s, 51.8 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg214-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg214-client.virtnet' removed directory '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop localhost ost.OSS.ost_io.nrs_tbf_rule=stop clients ost.OSS.ost_io.nrs_tbf_rule=stop others 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.486803 s, 34.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.133889 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.163341 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.210658 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.297109 s, 3.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.229089 s, 4.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.209778 s, 5.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.23459 s, 4.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.212808 s, 4.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.332253 s, 3.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.368503 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.364547 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.379099 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.427215 s, 2.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.416084 s, 2.5 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9039c7e21800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.457861 s, 2.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.516596 s, 2.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0597113 s, 17.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0987565 s, 10.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103477 s, 10.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.155317 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.155239 s, 6.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0534854 s, 19.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0598242 s, 17.5 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9039c7e21800.lock_unused_count=3 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0730804 s, 14.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.127242 s, 8.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0793492 s, 13.2 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0661514 s, 15.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0789814 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0869255 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0772338 s, 13.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0950751 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.180458 s, 5.8 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg214-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg214-client.virtnet' removed directory '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.386564 s, 43.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0538498 s, 19.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.047361 s, 22.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.14282 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.177714 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.178047 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.219153 s, 4.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.164905 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.134812 s, 7.8 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff9039c7e21800.lock_unused_count=5 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.194022 s, 5.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.222668 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.375446 s, 2.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.408011 s, 2.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.393138 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.413237 s, 2.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.341865 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.453183 s, 2.3 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9039c7e21800.lock_unused_count=7 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0650459 s, 16.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300313 s, 34.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.122379 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159856 s, 65.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0400432 s, 26.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135114 s, 77.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.142902 s, 7.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00430654 s, 243 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0622467 s, 16.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0616935 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0484133 s, 21.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0660727 s, 15.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0886669 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0745065 s, 14.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137763 s, 76.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0681233 s, 15.4 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg214-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg214-client.virtnet' removed directory '/mnt/lustre/d77e.sanityn' PASS 77e (27s) == sanityn test 77f: check TBF JobID nrs policy ========== 16:02:58 (1776196978) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start runas jobid={iozone.500 dd.500 tiotest.500} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start iozone_runas jobid={iozone.500} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg214-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.494297 s, 33.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209814 s, 50.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0943972 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.126206 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.224043 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.140185 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.167868 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.244723 s, 4.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.24194 s, 4.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.246121 s, 4.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.238767 s, 4.4 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff9039c7e21800.lock_unused_count=7 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.269558 s, 3.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.408593 s, 2.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.384487 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.42469 s, 2.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.452083 s, 2.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.42999 s, 2.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory ldlm.namespaces.lustre-OST0000-osc-ffff9039c7e21800.lock_unused_count=2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00284379 s, 369 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.120684 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0362939 s, 28.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0465802 s, 22.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0648849 s, 16.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105388 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981883 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00303563 s, 345 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0744854 s, 14.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.176698 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127407 s, 82.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0949031 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.173338 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0850601 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00570594 s, 184 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266885 s, 39.3 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg214-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg214-client.virtnet' removed directory '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change runas rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change iozone_runas rate=101 ost.OSS.ost_io.nrs_tbf_rule=change dd_runas rate=51 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg214-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.438202 s, 38.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104363 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.139974 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.169281 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.167265 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.151814 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.289284 s, 3.6 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9039c7e21800.lock_unused_count=2 ldlm.namespaces.lustre-OST0001-osc-ffff9039c7e21800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.296068 s, 3.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.212315 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.336097 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.150569 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.290876 s, 3.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.312494 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.386294 s, 2.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.499044 s, 2.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.439051 s, 2.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.654521 s, 1.6 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9039c7e21800.lock_unused_count=2 ldlm.namespaces.lustre-OST0001-osc-ffff9039c7e21800.lock_unused_count=2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.110101 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0994724 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.115526 s, 9.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104263 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125003 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0881182 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0913395 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0903146 s, 11.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0760507 s, 13.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0827651 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.127845 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.108985 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0803711 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.169268 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.11029 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.13698 s, 7.7 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg214-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg214-client.virtnet' removed directory '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop runas ost.OSS.ost_io.nrs_tbf_rule=stop iozone_runas ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg214-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.550114 s, 30.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.134824 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.157946 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0984759 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.122687 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.138402 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.333201 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.219876 s, 4.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.308318 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.200556 s, 5.2 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff9039c7e21800.lock_unused_count=5 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.411071 s, 2.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.351289 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.453076 s, 2.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.37424 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.483446 s, 2.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.332712 s, 3.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.598259 s, 1.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122225 s, 85.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0162858 s, 64.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246447 s, 42.5 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9039c7e21800.lock_unused_count=2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0461545 s, 22.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.087972 s, 11.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.108482 s, 9.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121439 s, 86.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147702 s, 71.0 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123291 s, 85.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0130322 s, 80.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0157496 s, 66.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169934 s, 61.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173041 s, 60.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268977 s, 39.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251714 s, 41.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199992 s, 52.4 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg214-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg214-client.virtnet' removed directory '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_policies=fifo running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg214-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.833454 s, 20.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0689193 s, 15.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.140453 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.175094 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.187106 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.188469 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.167629 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.169624 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.250457 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.309063 s, 3.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.355954 s, 2.9 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.34737 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.407447 s, 2.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.168923 s, 6.2 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.242645 s, 4.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.317456 s, 3.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.152824 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0500273 s, 21.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011373 s, 92.2 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9039c7e21800.lock_unused_count=1 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.12243 s, 8.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179678 s, 58.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0373269 s, 28.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0145791 s, 71.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017703 s, 59.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316666 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105841 s, 99.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239395 s, 43.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0943896 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.173995 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0342539 s, 30.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104714 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0805503 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.052729 s, 19.9 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg214-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg214-client.virtnet' removed directory '/mnt/lustre/d77f.sanityn' PASS 77f (29s) == sanityn test 77g: Change TBF type directly ============ 16:03:27 (1776197007) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 ost.OSS.ost_io.nrs_policies=fifo PASS 77g (11s) == sanityn test 77h: Wrong policy name should report error, not LBUG ========================================================== 16:03:38 (1776197018) oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=abc: No such file or directory pdsh@oleg214-client: oleg214-server: ssh exited with exit code 2 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc: Unknown error 524 pdsh@oleg214-client: oleg214-server: ssh exited with exit code 12 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf reg abc: Unknown error 524 pdsh@oleg214-client: oleg214-server: ssh exited with exit code 12 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc efg: Unknown error 524 pdsh@oleg214-client: oleg214-server: ssh exited with exit code 12 PASS 77h (14s) == sanityn test 77i: Change rank of TBF rule ============= 16:03:52 (1776197032) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start before jobid={jobid} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start after jobid={jobid} rate=1000 rank=default ost.OSS.ost_io.nrs_tbf_rule=start target jobid={jobid} rate=1000 rank=after Move before itself ost.OSS.ost_io.nrs_tbf_rule=change target rank=target Move to higher rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=before Move to lower rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=after Move before default ost.OSS.ost_io.nrs_tbf_rule=change target rank=default ost.OSS.ost_io.nrs_policies=fifo PASS 77i (25s) == sanityn test 77j: check TBF-OPCode NRS policy ========= 16:04:17 (1776197057) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf opcode ost.OSS.ost_io.nrs_tbf_rule=start ost_r opcode={ost_read} rate=5 ost.OSS.ost_io.nrs_tbf_rule=start ost_w opcode={ost_write} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.431643 s, 38.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0463462 s, 22.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109756 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.102843 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0989455 s, 10.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0801977 s, 13.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0773528 s, 13.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.138333 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.136584 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0884005 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.203377 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.255783 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.22204 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.196782 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.192131 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.301138 s, 3.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.334035 s, 3.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0336381 s, 31.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104776 s, 10.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0493 s, 21.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00845696 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187643 s, 55.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105702 s, 99.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00721687 s, 145 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.138143 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198832 s, 52.7 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00529672 s, 198 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0616715 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0709296 s, 14.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.058009 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0463162 s, 22.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0368556 s, 28.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0623521 s, 16.8 MB/s removed '/mnt/lustre/d77j.sanityn/nrs_r_oleg214-client.virtnet' removed '/mnt/lustre/d77j.sanityn/nrs_w_oleg214-client.virtnet' removed directory '/mnt/lustre/d77j.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 5 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.26564 s, 11.3 MB/s Write runtime is 10 s, speed is 10.000000 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.6508 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77j.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_r ost.OSS.ost_io.nrs_tbf_rule=stop ost_w ost.OSS.ost_io.nrs_policies=fifo PASS 77j (65s) == sanityn test 77ja: check TBF-UID/GID NRS policy ======= 16:05:22 (1776197122) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg214-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.884761 s, 19.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.067344 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0776316 s, 13.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.131276 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0991935 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.161476 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.196111 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.110111 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.148115 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.17587 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.255929 s, 4.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.26261 s, 4.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.380566 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.409415 s, 2.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.26176 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.403712 s, 2.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.439515 s, 2.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00254251 s, 412 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0024856 s, 422 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018082 s, 58.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161911 s, 64.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.182649 s, 5.7 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.184903 s, 5.7 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00258727 s, 405 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.149482 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.127827 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.107984 s, 9.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.204072 s, 5.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.153941 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.156753 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0996297 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0632908 s, 16.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0764354 s, 13.7 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg214-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg214-client.virtnet' removed directory '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 20.1164 s, 5.2 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 20.0279 s, 5.2 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg214-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.882018 s, 19.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.149612 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.238103 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125311 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.202455 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.185056 s, 5.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.188403 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.254125 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.217429 s, 4.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.261865 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.266332 s, 3.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.228754 s, 4.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.226507 s, 4.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.308572 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.197809 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.383357 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.235633 s, 4.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0432509 s, 24.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0536017 s, 19.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.044026 s, 23.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0368219 s, 28.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0415175 s, 25.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0498189 s, 21.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0513351 s, 20.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0513753 s, 20.4 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0631271 s, 16.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0583399 s, 18.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.112837 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0658712 s, 15.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0671963 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0721179 s, 14.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0863446 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.085332 s, 12.3 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg214-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg214-client.virtnet' removed directory '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 20.0136 s, 5.2 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.9575 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77ja (155s) == sanityn test 77k: check TBF policy with NID/JobID/OPCode expression ========================================================== 16:07:57 (1776197277) ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_tbf_rule=start ext_w jobid={dd.500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r jobid={dd.500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg214-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.640513 s, 26.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0904208 s, 11.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0896243 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.082302 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0384199 s, 27.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.155176 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0544204 s, 19.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.190665 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283151 s, 37.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025507 s, 41.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.223937 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.170138 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.206074 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.145106 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.301579 s, 3.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.158901 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.244781 s, 4.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00234629 s, 447 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.173564 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.128428 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.156966 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.202138 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123012 s, 85.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184679 s, 56.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0846654 s, 12.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137331 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.116483 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125347 s, 8.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129112 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.125572 s, 8.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.123564 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.069126 s, 15.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0469068 s, 22.4 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg214-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg214-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 8.01339 s, 13.1 MB/s Write runtime is 9 s, speed is 11.111111 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 10.0018 s, 10.5 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext_w nid={0@lo 192.168.202.14@tcp}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r nid={0@lo 192.168.202.14@tcp}&opcode={ost_read} rate=10 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.488182 s, 34.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0689444 s, 15.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0492953 s, 21.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0993238 s, 10.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.122439 s, 8.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.213196 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.214772 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.220433 s, 4.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.224185 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.247459 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.221717 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.209611 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.284288 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.236318 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.294154 s, 3.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.321666 s, 3.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.296083 s, 3.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.129009 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0821562 s, 12.8 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.117049 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0908255 s, 11.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.143572 s, 7.3 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.101276 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.111697 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.184278 s, 5.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.170672 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.179431 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103125 s, 10.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.176824 s, 5.9 MB/s1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104048 s, 10.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.145741 s, 7.2 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104492 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.137899 s, 7.6 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg214-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg214-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 8.22259 s, 12.8 MB/s Write runtime is 9 s, speed is 11.111111 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.91656 s, 10.6 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext nid={0@lo 192.168.202.14@tcp}&jobid={dd.500} rate=20 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg214-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.514235 s, 32.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0873888 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0535661 s, 19.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0454752 s, 23.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.105371 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.200539 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.214555 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.210831 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.239112 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.159491 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.261391 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.20908 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.277886 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.320728 s, 3.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.290843 s, 3.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.312292 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.320371 s, 3.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0542988 s, 19.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0546523 s, 19.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0595044 s, 17.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0613443 s, 17.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.109913 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0712473 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0769574 s, 13.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0746122 s, 14.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0613685 s, 17.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.102595 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0930915 s, 11.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0894753 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0909546 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.103128 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0854786 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.121304 s, 8.6 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg214-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg214-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 8.61388 s, 12.2 MB/s Write runtime is 9 s, speed is 11.111111 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.06608 s, 20.7 MB/s Read runtime is 7 s, speed is 14.285714 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext ost.OSS.ost_io.nrs_tbf_rule=start ext_a jobid={dd.500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b jobid={dd.500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg214-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.719242 s, 23.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0341016 s, 30.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.116836 s, 9.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.16772 s, 6.3 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.177343 s, 5.9 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0850407 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0698884 s, 15.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.214096 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0878612 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.21664 s, 4.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0388608 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.366154 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.4059 s, 2.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.216961 s, 4.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.35865 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.434962 s, 2.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.210689 s, 5.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0490729 s, 21.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0325897 s, 32.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0342371 s, 30.6 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0487874 s, 21.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0363633 s, 28.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0460903 s, 22.8 MB/s1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0627818 s, 16.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0518281 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0891604 s, 11.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0532152 s, 19.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.064584 s, 16.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0654462 s, 16.0 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0665542 s, 15.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0683025 s, 15.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0668293 s, 15.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0742904 s, 14.1 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg214-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg214-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 13.1792 s, 8.0 MB/s Write runtime is 15 s, speed is 6.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 10.0367 s, 10.4 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 12.4862 s, 8.4 MB/s Write runtime is 14 s, speed is 7.142857 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 10.0169 s, 10.5 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_tbf_rule=start ext_ug uid={500}&gid={1000} rate=5 running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg214-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.864317 s, 19.4 MB/s running as uid/gid/euid/egid 500/1000/500/1000, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.146041 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.252156 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.279258 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.244411 s, 4.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.254126 s, 4.1 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.167068 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.291238 s, 3.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.229077 s, 4.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.19863 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.221966 s, 4.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.308605 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.308095 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.382225 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.316455 s, 3.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.345608 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.377325 s, 2.8 MB/s running as uid/gid/euid/egid 500/1000/500/1000, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0366175 s, 28.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00658651 s, 159 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00695948 s, 151 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00512813 s, 204 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948419 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00205312 s, 511 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283372 s, 37.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.060203 s, 17.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.104388 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262543 s, 39.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279489 s, 37.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0633318 s, 16.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0847087 s, 12.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.141237 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316722 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0426518 s, 24.6 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg214-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg214-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.9008 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 19.6604 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_ug ost.OSS.ost_io.nrs_tbf_rule=start ext_uw uid={500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_ur uid={500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg214-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.477037 s, 35.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0341306 s, 30.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0455779 s, 23.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0616946 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0666762 s, 15.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0999015 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.153784 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.12799 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.187519 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.167465 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.315923 s, 3.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.321727 s, 3.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.292814 s, 3.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.344218 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.343807 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.34344 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.420814 s, 2.5 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9039c7e21800.lock_unused_count=7 running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0787116 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0787166 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239061 s, 43.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0536955 s, 19.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026429 s, 39.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0586705 s, 17.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322217 s, 32.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0348196 s, 30.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0374939 s, 28.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.039597 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0465622 s, 22.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0789208 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0517896 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0514087 s, 20.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0527808 s, 19.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.072357 s, 14.5 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg214-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg214-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.24328 s, 11.3 MB/s Write runtime is 10 s, speed is 10.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 10.0003 s, 10.5 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_uw ost.OSS.ost_io.nrs_tbf_rule=stop ext_ur ost.OSS.ost_io.nrs_tbf_rule=start ext_a uid={500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b uid={500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg214-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.594617 s, 28.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0846264 s, 12.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.147477 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.158996 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.186191 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.275322 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.179316 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.151776 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.179503 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.313746 s, 3.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.38574 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.409077 s, 2.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.360275 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.437268 s, 2.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.303167 s, 3.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.298551 s, 3.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.533798 s, 2.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00542876 s, 193 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0416021 s, 25.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0652851 s, 16.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0532273 s, 19.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0911257 s, 11.5 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0542507 s, 19.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123256 s, 85.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0734544 s, 14.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0767314 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0640615 s, 16.4 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0639262 s, 16.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0635922 s, 16.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0793332 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0668756 s, 15.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.155562 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268906 s, 39.0 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg214-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg214-client.virtnet' removed directory '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 11.9366 s, 8.8 MB/s Write runtime is 13 s, speed is 7.692307 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.92987 s, 10.6 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 10.5254 s, 10.0 MB/s Write runtime is 12 s, speed is 8.333333 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 9.96061 s, 10.5 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_policies=fifo PASS 77k (445s) == sanityn test 77l: check the output of NRS policies for generic TBF ========================================================== 16:15:23 (1776197723) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_policies=fifo PASS 77l (9s) == sanityn test 77m: check NRS Delay slows write RPC processing ========================================================== 16:15:32 (1776197732) ost.OSS.ost_io.nrs_policies=delay ost.OSS.ost_io.nrs_delay_min=4 ost.OSS.ost_io.nrs_delay_max=4 ost.OSS.ost_io.nrs_delay_pct=100 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg214-client.virtnet] [bs=1M] [count=1] [oflag=direct] [conv=fdatasync] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 3.72526 s, 281 kB/s running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg214-client.virtnet] [bs=1M] [count=10] [oflag=direct] [conv=fdatasync] 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 40.0858 s, 262 kB/s ost.OSS.ost_io.nrs_policies=fifo PASS 77m (57s) == sanityn test 77n: check wildcard support for TBF JobID NRS policy ========================================================== 16:16:29 (1776197789) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={*.500} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.473258 s, 35.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0490224 s, 21.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0817287 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0459354 s, 22.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.180699 s, 5.8 MB/s 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.175841 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.15825 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.143044 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.131245 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.181532 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.189476 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.20979 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.210948 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.294966 s, 3.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.261114 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.259341 s, 4.0 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff9039c7e21800.lock_unused_count=7 ldlm.namespaces.lustre-OST0001-osc-ffff9039c7e21800.lock_unused_count=3 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.288049 s, 3.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0574838 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0769674 s, 13.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0613701 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0402201 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0673539 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0511925 s, 20.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0473211 s, 22.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.119 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0649614 s, 16.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0953778 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0703241 s, 14.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0838233 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.123874 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.131897 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.124548 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0768986 s, 13.6 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff9039c7e21800.lock_unused_count=5 removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg214-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg214-client.virtnet' removed directory '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77n.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 7.18713 s, 14.6 MB/s Write runtime is 9 s, speed is 11.111111 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77n.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.40785 s, 19.4 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.*} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB, 16 MiB) copied, 0.442372 s, 37.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0330391 s, 31.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0498922 s, 21.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0799393 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0937505 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0891352 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0995381 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.121756 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.21827 s, 4.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.131079 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.239102 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.173093 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.187916 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.226186 s, 4.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.311691 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.241649 s, 4.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.281625 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0516786 s, 20.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0590519 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0535468 s, 19.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.053437 s, 19.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0467915 s, 22.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.071267 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0608417 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0657321 s, 16.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0731641 s, 14.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0449921 s, 23.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0823622 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.102975 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0773367 s, 13.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0669292 s, 15.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0663013 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0879777 s, 11.9 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg214-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg214-client.virtnet' removed directory '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 8.73637 s, 12.0 MB/s Write runtime is 10 s, speed is 10.000000 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 5.26043 s, 19.9 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_policies=fifo PASS 77n (91s) == sanityn test 77o: Changing rank should not panic ====== 16:18:00 (1776197880) mds.MDS.mdt.nrs_policies=tbf nid mds.MDS.mdt.nrs_tbf_rule=start name nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=start name1 nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=change name1 rank=name mds.MDS.mdt.nrs_tbf_rule=stop name mds.MDS.mdt.nrs_policies=fifo PASS 77o (15s) == sanityn test 77q: Parallel TBF rule definitions should not panic ========================================================== 16:18:15 (1776197895) mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_policies=fifo PASS 77q (124s) == sanityn test 77p: Check validity of rule names for TBF policies ========================================================== 16:20:19 (1776198019) mds.MDS.mdt.nrs_policies=tbf oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_overflo uid={500} rate=500: File name too long pdsh@oleg214-client: oleg214-server: ssh exited with exit code 36 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_empty: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p@spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p.spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p~spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p#spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p/spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p^spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p%spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p*spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p;spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p,spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p?spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77pspec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p:spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p+spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p=spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p)spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p(spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p{spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p}spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p|spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p[spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p]spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p!spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p&spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p$spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p`spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p\spec uid={500} rate=500: Invalid argument pdsh@oleg214-client: oleg214-server: ssh exited with exit code 22 mds.MDS.mdt.nrs_policies=fifo PASS 77p (36s) == sanityn test 78: Enable policy and specify tunings right away ========================================================== 16:20:55 (1776198055) oleg214-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_orr_quantum=1: Resource temporarily unavailable pdsh@oleg214-client: oleg214-server: ssh exited with exit code 11 ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_policies=fifo PASS 78 (10s) == sanityn test 79: xattr: intent error ================== 16:21:05 (1776198065) File: /mnt/lustre/d79.sanityn Size: 512 Blocks: 1 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272505430 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 16:21:06.000000000 -0400 Modify: 2026-04-14 16:21:06.000000000 -0400 Change: 2026-04-14 16:21:06.000000000 -0400 Birth: 2026-04-14 16:21:06.000000000 -0400 fail_val=0 fail_loc=0x80000160 fail_val=0 fail_loc=0x80000131 # file: mnt/lustre/d79.sanityn trusted.name1="value1" PASS 79 (20s) == sanityn test 80a: migrate directory when some children is being opened ========================================================== 16:21:26 (1776198086) SKIP: sanityn test_80a needs >= 2 MDTs SKIP 80a (4s) == sanityn test 80b: Accessing directory during migration ========================================================== 16:21:31 (1776198091) SKIP: sanityn test_80b needs >= 2 MDTs SKIP 80b (4s) == sanityn test 81a: rename and stat under striped directory ========================================================== 16:21:35 (1776198095) SKIP: sanityn test_81a needs >= 2 MDTs SKIP 81a (3s) == sanityn test 81b: rename under striped directory doesn't deadlock ========================================================== 16:21:38 (1776198098) SKIP: sanityn test_81b We need at least 2 MDTs for this test SKIP 81b (4s) == sanityn test 81c: rename revoke LOOKUP lock for remote object ========================================================== 16:21:42 (1776198102) SKIP: sanityn test_81c needs >= 4 MDTs SKIP 81c (3s) == sanityn test 82: fsetxattr and fgetxattr on orphan files ========================================================== 16:21:45 (1776198105) multiop /mnt/lustre/f82.sanityn vO_ac TMPPIPE=/tmp/multiop_open_wait_pipe.7152 multiop /mnt/lustre2/f82.sanityn vo_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.7152 PASS 82 (7s) == sanityn test 83: access striped directory while it is being created/unlinked ========================================================== 16:21:52 (1776198112) SKIP: sanityn test_83 needs >= 2 MDTs SKIP 83 (3s) == sanityn test 84: 0-nlink race in lu_object_find() ===== 16:21:55 (1776198115) fail_loc=0x8000060b PASS 84 (13s) == sanityn test 90: open/create and unlink striped directory ========================================================== 16:22:08 (1776198128) SKIP: sanityn test_90 needs >= 2 MDTs SKIP 90 (4s) == sanityn test 91: chmod and unlink striped directory === 16:22:12 (1776198132) SKIP: sanityn test_91 needs >= 2 MDTs SKIP 91 (3s) == sanityn test 92: create remote directory under orphan directory ========================================================== 16:22:15 (1776198135) SKIP: sanityn test_92 needs >= 2 MDTs SKIP 92 (3s) == sanityn test 93: alloc_rr should not allocate on same ost ========================================================== 16:22:18 (1776198138) fail_loc=0x00000163 fail_loc=0x0 /mnt/lustre/f93.sanityn-1/file1 lmm_stripe_count: 2 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2624 0xa40 0 0 2644 0xa54 0 /mnt/lustre2/f93.sanityn-2/file2 lmm_stripe_count: 2 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2625 0xa41 0 0 2645 0xa55 0 rc1=0 and rc2=0 PASS 93 (16s) == sanityn test 94: signal vs CP callback race =========== 16:22:34 (1776198154) osc.lustre-OST0000-osc-ffff9039c7e21800.idle_timeout=0 osc.lustre-OST0000-osc-ffff9039c92f2800.idle_timeout=0 osc.lustre-OST0001-osc-ffff9039c7e21800.idle_timeout=0 osc.lustre-OST0001-osc-ffff9039c92f2800.idle_timeout=0 2+0 records in 2+0 records out 8192 bytes (8.2 kB, 8.0 KiB) copied, 0.215712 s, 38.0 kB/s fail_val=5 fail_loc=0x80000312 fail_val=6 fail_loc=0x80000329 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 2.95061 s, 1.4 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 5135: 282915 Alarm clock dd if=/dev/zero of=$DIR/$tfile conv=notrunc oflag=append bs=4k count=1 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0572453 s, 71.6 kB/s osc.lustre-OST0000-osc-ffff9039c7e21800.idle_timeout=debug osc.lustre-OST0000-osc-ffff9039c92f2800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9039c7e21800.idle_timeout=debug osc.lustre-OST0001-osc-ffff9039c92f2800.idle_timeout=debug PASS 94 (15s) == sanityn test 95b: Check readpage() on a page that is no longer uptodate ========================================================== 16:22:49 (1776198169) llite.lustre-ffff9039c7e21800.fast_read=0 llite.lustre-ffff9039c92f2800.fast_read=0 1+0 records in 1+0 records out 12288 bytes (12 kB, 12 KiB) copied, 0.0137317 s, 895 kB/s fail_loc=0x80001424 fail_val=5 fail_loc=0 llite.lustre-ffff9039c7e21800.fast_read=1 llite.lustre-ffff9039c92f2800.fast_read=1 PASS 95b (12s) == sanityn test 100a: DoM: glimpse RPCs for stat without IO lock (DoM only file) ========================================================== 16:23:01 (1776198181) SKIP: sanityn test_100a Reserved for glimpse-ahead SKIP 100a (4s) == sanityn test 100b: DoM: no glimpse RPC for stat with IO lock (DoM only file) ========================================================== 16:23:05 (1776198185) 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00722725 s, 567 kB/s /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK PASS 100b (7s) == sanityn test 100c: DoM: write vs stat without IO lock (combined file) ========================================================== 16:23:12 (1776198192) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0970493 s, 21.6 MB/s /mnt/lustre/d100c.sanityn/dom has type file OK /mnt/lustre/d100c.sanityn/dom has size 2097152 OK PASS 100c (8s) == sanityn test 100d: DoM: write+truncate vs stat without IO lock (combined file) ========================================================== 16:23:20 (1776198200) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB, 2.0 MiB) copied, 0.0859918 s, 24.4 MB/s /mnt/lustre/d100d.sanityn/dom has type file OK /mnt/lustre/d100d.sanityn/dom has size 4096 OK PASS 100d (7s) == sanityn test 100e: DoM: read on open and file size ==== 16:23:28 (1776198208) 1+0 records in 1+0 records out 12000 bytes (12 kB, 12 KiB) copied, 0.00269491 s, 4.5 MB/s PASS 100e (8s) == sanityn test 101a: Discard DoM data on unlink ========= 16:23:35 (1776198215) /mnt/lustre/f101a.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.0044681 s, 917 kB/s PASS 101a (6s) == sanityn test 101b: Discard DoM data on rename ========= 16:23:41 (1776198221) /mnt/lustre/f101b.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00361238 s, 1.1 MB/s PASS 101b (8s) == sanityn test 101c: Discard DoM data on close-unlink === 16:23:49 (1776198229) /mnt/lustre/f101c.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.003579 s, 1.1 MB/s PASS 101c (9s) SKIP: sanityn test_102 skipping ALWAYS excluded test 102 == sanityn test 103: Test size correctness with lockahead ========================================================== 16:23:59 (1776198239) fail_loc=0x415 fail_loc=0x415 fail_val=2 Incorrect size expected (no glimpse fix): Starting test test23 at 1776198242 lockahead_test: lockahead_test.c:1186: test23: assertion 'sb.st_size == sb2.st_size' failed: size on /mnt/lustre/d103.sanityn/f103.sanityn and /mnt/lustre2/d103.sanityn/f103.sanityn differs: 0 vs 1048576 fail_loc=0 fail_loc=0x214 fail_val=2 Starting test test23 at 1776198245 Finishing test test23 at 1776198245 PASS 103 (13s) == sanityn test 104: Verify that MDS stores atime/mtime/ctime during close ========================================================== 16:24:12 (1776198252) SKIP: sanityn test_104 ldiskfs only test SKIP 104 (3s) == sanityn test 105: Glimpse and lock cancel race ======== 16:24:16 (1776198256) fail_loc=0x416 PASS 105 (51s) == sanityn test 106a: Verify the btime via statx() ======= 16:25:07 (1776198307) SKIP: sanityn test_106a Test only for ldiskfs and statx() supported SKIP 106a (3s) == sanityn test 106b: Glimpse RPCs test for statx ======== 16:25:10 (1776198310) 1+0 records in 1+0 records out 1024 bytes (1.0 kB, 1.0 KiB) copied, 0.035034 s, 29.2 kB/s File: /mnt/lustre/f106b.sanityn Size: 1024 Blocks: 1 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 144115205272505458 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 16:25:12.000000000 -0400 Modify: 2026-04-14 16:25:12.000000000 -0400 Change: 2026-04-14 16:25:12.000000000 -0400 Birth: 2026-04-14 16:25:12.000000000 -0400 /mnt/lustre/f106b.sanityn 144115205272505458 -rw-r--r-- 1 0 0 1776198312 1776198312 1776198312 File: /mnt/lustre/f106b.sanityn Size: 1024 Blocks: 1 IO Block: 4194304 regular file Device: 2c54f966h/743766374d Inode: 144115205272505458 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 16:25:12.000000000 -0400 Modify: 2026-04-14 16:25:12.000000000 -0400 Change: 2026-04-14 16:25:12.000000000 -0400 Birth: 2026-04-14 16:25:12.000000000 -0400 1776198312 1024 11 PASS 106b (8s) == sanityn test 106c: Verify statx attributes mask ======= 16:25:18 (1776198318) PASS 106c (8s) == sanityn test 107a: Basic grouplock conflict =========== 16:25:26 (1776198326) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.305503 s, 34.3 MB/s /mnt/lustre/f107a.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2631 0xa47 0 multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.7152 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.7152 First grouplock blocks second one PASS 107a (9s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 16:25:35 (1776198335) 10+0 records in 10+0 records out 10485760 bytes (10 MB, 10 MiB) copied, 0.382181 s, 27.4 MB/s /mnt/lustre/f107b.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2652 0xa5c 0 multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.7152 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (13s) == sanityn test 108a: lseek: parallel updates ============ 16:25:48 (1776198348) 1+0 records in 1+0 records out 10000 bytes (10 kB, 9.8 KiB) copied, 0.0122264 s, 818 kB/s fail_val=4 fail_loc=0x80000414 1+0 records in 1+0 records out 8388608 bytes (8.4 MB, 8.0 MiB) copied, 4.7574 s, 1.8 MB/s PASS 108a (12s) == sanityn test 109: Race with several mount instances on 1 node ========================================================== 16:26:00 (1776198360) 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Starting race between client mount instances (50 iterations): Iteration 1 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 2 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 3 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 4 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 5 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 6 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: Force libcfs to create 2 CPU partitions Iteration 7 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 8 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 9 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 10 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 11 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 12 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 13 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 14 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 15 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 16 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 17 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 18 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 19 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 20 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 21 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 22 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 23 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 24 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 25 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 26 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 27 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 28 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 29 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 30 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 31 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 32 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: Force libcfs to create 2 CPU partitions Iteration 33 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 34 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 35 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 36 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 37 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 38 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 39 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 40 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: Force libcfs to create 2 CPU partitions Iteration 41 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 42 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 43 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 44 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 45 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 46 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 47 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 48 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 49 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Iteration 50 Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 192.168.202.114@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 192.168.202.114@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,encrypt 0 0 Stopping client oleg214-client.virtnet /mnt/lustre (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 (opts:) /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 99: echo: write error: Device or resource busy LNET ready to unload /home/green/git/lustre-release/lustre/scripts/lustre_rmmod: line 141: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg214-server' oleg214-server: oleg214-server.virtnet: executing load_modules_local oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 712: echo: write error: Device or resource busy oleg214-server: /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 713: echo: write error: Device or resource busy oleg214-server: Loading modules from /home/green/git/lustre-release/lustre oleg214-server: detected 4 online CPUs by sysfs oleg214-server: Force libcfs to create 2 CPU partitions Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre Starting client: oleg214-client.virtnet: -o user_xattr,flock oleg214-server@tcp:/lustre /mnt/lustre2 PASS 109 (1230s) == sanityn test 110: do not grant another lock on resend ========================================================== 16:46:30 (1776199590) fail_loc=0x525 fail_val=3 fail_loc=0x534 File: /mnt/lustre/f110.sanityn Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205306056707 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2026-04-14 16:46:32.000000000 -0400 Modify: 2026-04-14 16:46:32.000000000 -0400 Change: 2026-04-14 16:46:32.000000000 -0400 Birth: 2026-04-14 16:46:32.000000000 -0400 fail_loc=0 fail_val=0 Connected clients: oleg214-client.virtnet oleg214-client.virtnet PASS 110 (43s) == sanityn test 111: A racy rename/link an open file should not cause fs corruption ========================================================== 16:47:13 (1776199633) SKIP: sanityn test_111 needs >= 2 MDTs SKIP 111 (4s) == sanityn test 112: update max-inherit in default LMV === 16:47:17 (1776199637) SKIP: sanityn test_112 We need at least 2 MDTs for this test SKIP 112 (3s) == sanityn test 113: check servers of specified fs ======= 16:47:20 (1776199640) lustre-OST0000-osc-ffff9039d1f24800 active. lustre-OST0001-osc-ffff9039d1f24800 active. lustre-OST0000-osc-ffff9039d1f24800 active. lustre-OST0001-osc-ffff9039d1f24800 active. MGC192.168.202.114@tcp active. PASS 113 (6s) cleanup: ====================================================== == sanityn test complete, duration 9485 sec ============== 16:47:28 (1776199648) Stopping clients: oleg214-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg214-client.virtnet /mnt/lustre2 opts: