-----============= acceptance-small: sanityn ============----- Wed Jan 15 18:47:59 EST 2025 excepting tests: 27 28 102 skipping tests SLOW=no: 33a Starting client oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 Started clients oleg137-client.virtnet: 192.168.201.137@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt) oleg137-client.virtnet: executing check_config_client /mnt/lustre oleg137-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg137-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800a9f48800.idle_timeout=debug osc.lustre-OST0000-osc-ffff8800b6d0d800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800a9f48800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6d0d800.idle_timeout=debug disable quota as required oleg137-server: oleg137-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0250674 s, 41.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6857] == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 18:48:23 (1736984903) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (3s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 18:48:26 (1736984906) -rw-r--r-- 1 root root 0 Jan 15 18:48 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (4s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 18:48:30 (1736984910) -rw-r--r-- 1 root root 0 Jan 15 18:48 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (3s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 18:48:34 (1736984914) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (3s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 18:48:37 (1736984917) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (4s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 18:48:41 (1736984921) total 1 -rwxrwxrwx 1 root root 0 Jan 15 18:48 f2a -rwxrwxrwx 1 root root 0 Jan 15 18:48 f2b total 1 -rwxrwxrwx 1 root root 0 Jan 15 18:48 f2a -rwxrwxrwx 1 root root 0 Jan 15 18:48 f2b running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes (512 B) copied, 0.013498 s, 37.9 kB/s PASS 2e (3s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 18:48:44 (1736984924) SKIP: sanityn test_2f needs >= 2 MDTs SKIP 2f (2s) == sanityn test 2g: check blocks update on sync write ==== 18:48:46 (1736984926) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.290281 s, 7.2 MB/s /mnt/lustre/f2g.sanityn has 4103 blocks /mnt/lustre2/f2g.sanityn has 4103 blocks PASS 2g (4s) == sanityn test 3: symlink on one mtpt, readlink on another ===================================================================== 18:48:50 (1736984930) PASS 3 (3s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 18:48:54 (1736984934) PASS 4 (4s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 18:48:58 (1736984938) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (4s) == sanityn test 6: remove of open file on other node ============================================================================ 18:49:02 (1736984942) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (3s) == sanityn test 7: remove of open directory on other node ======================================================================= 18:49:05 (1736984945) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (4s) == sanityn test 8: remove of open special file on other node ==================================================================== 18:49:09 (1736984949) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (3s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 18:49:12 (1736984952) PASS 9a (4s) == sanityn test 9b: append to striped sparse file ======== 18:49:16 (1736984956) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0368182 s, 28.5 MB/s 3+0 records in 3+0 records out 3 bytes (3 B) copied, 0.048602 s, 0.1 kB/s Data read (expecting 'foo'): foo PASS 9b (4s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 18:49:20 (1736984960) 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00457265 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00344822 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0060084 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00395056 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00320635 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00243889 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0112632 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00803169 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00728543 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00400408 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0121629 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00326779 s, 0.3 kB/s PASS 10a (4s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 18:49:24 (1736984964) 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.0160098 s, 192 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0215096 s, 190 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.000735505 s, 4.2 MB/s PASS 10b (4s) == sanityn test 11: execution of file opened for write should return error ============================================================== 18:49:28 (1736984968) multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.6857 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 273: /mnt/lustre2/d11/f: Text file busy PASS 11 (3s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 18:49:31 (1736984971) warning: '-runtime' deprecated, use '-t runtime' instead - link 813 (time 1736984982.91 total 10.01 last 81.22) - link 1535 (time 1736984992.92 total 20.02 last 72.14) - link 2239 (time 1736985002.92 total 30.02 last 70.35) - link 2979 (time 1736985012.94 total 40.04 last 73.86) - link 3844 (time 1736985022.95 total 50.05 last 86.47) - link 4628 (time 1736985032.95 total 60.05 last 78.39) - link 5392 (time 1736985042.96 total 70.06 last 76.33) - link 6222 (time 1736985052.97 total 80.07 last 82.91) - link 7045 (time 1736985062.97 total 90.07 last 82.27) total: 7931 link in 100.01 seconds: 79.30 ops/second using seed 3921552896 running for 100 seconds - stat 10000 (time 1736984978 ; total 5 ; last 5) - stat 20000 (time 1736984982 ; total 9 ; last 4) - stat 30000 (time 1736984987 ; total 14 ; last 5) - stat 40000 (time 1736984991 ; total 18 ; last 4) - stat 50000 (time 1736984996 ; total 23 ; last 5) - stat 60000 (time 1736985001 ; total 28 ; last 5) - stat 70000 (time 1736985006 ; total 33 ; last 5) - stat 80000 (time 1736985011 ; total 38 ; last 5) - stat 90000 (time 1736985015 ; total 42 ; last 4) - stat 100000 (time 1736985020 ; total 47 ; last 5) - stat 110000 (time 1736985025 ; total 52 ; last 5) - stat 116024 (time 1736985036 ; total 63 ; last 11) - stat 120000 (time 1736985043 ; total 70 ; last 7) - stat 126500 (time 1736985054 ; total 81 ; last 11) - stat 130000 (time 1736985059 ; total 86 ; last 5) - stat 135762 (time 1736985070 ; total 97 ; last 11) total: 137983 stats in 100 seconds: 1379.829956 stats/second - unlinked 0 (time 1736985023 ; total 0 ; last 0) unlink(/mnt/lustre2/lockdir/lockfile7931) error: No such file or directory total: 7930 unlinks in 79 seconds: 100.379745 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (20492) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (20495) - No such process PASS 12 (133s) == sanityn test 13: test directory page revocation ======= 18:51:44 (1736985104) f13 f13 PASS 13 (3s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 18:51:47 (1736985107) multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.6857 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 308: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4260: 21867 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (2s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 18:51:49 (1736985109) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4260: 22495 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (2s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 18:51:51 (1736985111) truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 323: 23122 Terminated $DIR1/$tdir/sleep 60 PASS 14b (3s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 18:51:54 (1736985114) cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 335: 23751 Terminated $DIR1/$tdir/sleep 60 PASS 14c (2s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 18:51:56 (1736985116) chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 346: 24380 Terminated $DIR1/$tdir/sleep 60 PASS 14d (3s) == sanityn test 15: test out-of-space with multiple writers ===================================================================== 18:51:59 (1736985119) PATH=/opt/iozone/bin:/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin: STRIPECOUNT=2 ORIGFREE=7517184 MAXFREE=800000 SKIP: oos2 test_15 oos2.sh: 7517184kB free gt MAXFREE 800000kB, increase 800000 (or reduce test fs size) to proceed sleep 5 for ZFS zfs Waiting for MDT destroys to complete SKIP 15 (13s) == sanityn test 16a: 500 iterations of dual-mount fsx ==== 18:52:12 (1736985132) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.184986 s, 11.3 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.125233 s, 16.7 MB/s Chance of close/open is 1 in 50 Seed set to 5133 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read truncating to largest ever: 0x6e3653 000007[0] 1736985134.113303 trunc from 00000000 to 0x6e3652 (0x6e3653 bytes) 000008[1] 1736985134.136410 mapread 0x40f623 thru 0x4149f2 (0x53d0 bytes) 000009[1] 1736985134.177773 trunc from 0x6e3653 to 0x6ca046 (0x1960c bytes) 000012[0] 1736985134.229696 read 0x29f64b thru 0x2a1636 (0x1fec bytes) truncating to largest ever: 0x75e1ae 000013[0] 1736985134.249392 trunc from 0x6ca047 to 0x75e1ad (0x94167 bytes) 000014[0] 1736985134.286797 mapread 0x1c8890 thru 0x1ca87c (0x1fed bytes) truncating to largest ever: 0x8bc8e5 000019[1] 1736985134.339166 trunc from 0x75e1ae to 0x8bc8e4 (0x15e737 bytes) 000020[1] 1736985134.373252 trunc from 0x8bc8e5 to 0x797054 (0x125890 bytes) 000022[0] 1736985134.405141 trunc from 0x797055 to 0x71b770 (0x7b8e4 bytes) 000024[0] 1736985134.441485 mapwrite 0x2b0231 thru 0x2b09b8 (0x788 bytes) 000025[1] 1736985134.528711 write 0x60f119 thru 0x614ddd (0x5cc5 bytes) 000027[1] 1736985134.552214 write 0x5b3a92 thru 0x5b88a5 (0x4e14 bytes) truncating to largest ever: 0x985114 000028[1] 1736985134.564244 trunc from 0x71b771 to 0x985113 (0x2699a3 bytes) 000030[1] 1736985134.596751 write 0x31db08 thru 0x31e196 (0x68f bytes) 000032[0] 1736985134.628794 read 0x88a737 thru 0x899f30 (0xf7fa bytes) 000033[0] 1736985134.663973 read 0x883854 thru 0x88d4fb (0x9ca8 bytes) 000034[0] 1736985134.683162 write 0x84fc6e thru 0x85660d (0x69a0 bytes) 000035[0] 1736985134.708947 read 0x3f0c01 thru 0x3f1f80 (0x1380 bytes) 000036[0] 1736985134.769106 write 0x33690e thru 0x338d71 (0x2464 bytes) 000037[0] 1736985134.784574 read 0x04d65a thru 0x05c496 (0xee3d bytes) 000038[1] 1736985134.824590 read 0x102f52 thru 0x10cbb7 (0x9c66 bytes) 000039[0] 1736985134.866651 write 0x7065bc thru 0x7131c8 (0xcc0d bytes) 000040[1] 1736985134.885854 read 0x033cc7 thru 0x039c3a (0x5f74 bytes) 000041[0] 1736985134.916475 trunc from 0x985114 to 0x8ff88e (0x85885 bytes) 000042[1] 1736985134.947071 trunc from 0x8ff88f to 0x08866b (0x877223 bytes) 000045[0] 1736985135.019334 mapread 0x051926 thru 0x05ccd7 (0xb3b2 bytes) 000046[0] 1736985135.068066 trunc from 0x08866c to 0x2322b5 (0x1a9c4a bytes) 000047[0] 1736985135.089011 mapread 0x14469d thru 0x15127b (0xcbdf bytes) 000048[0] 1736985135.158683 mapread 0x1bbf01 thru 0x1c2a1c (0x6b1c bytes) 000049[1] 1736985135.191618 mapwrite 0x5c6f84 thru 0x5cba99 (0x4b16 bytes) 000050[1] 1736985135.326547 write 0x146477 thru 0x150fa2 (0xab2c bytes) 000051[0] 1736985135.334063 write 0x5fc508 thru 0x6049e7 (0x84e0 bytes) 000053[0] 1736985135.357637 read 0x2fbdbf thru 0x30289f (0x6ae1 bytes) 000061[1] 1736985135.415696 trunc from 0x6049e8 to 0x69577a (0x90d93 bytes) 000062[0] 1736985135.450046 mapread 0x3d7ddd thru 0x3dc06c (0x4290 bytes) 000063[0] 1736985135.501936 mapread 0x1fa0ac thru 0x2061a7 (0xc0fc bytes) 000064[1] 1736985135.551016 mapwrite 0x718065 thru 0x71aca4 (0x2c40 bytes) 000067[0] 1736985135.668979 trunc from 0x71aca5 to 0x7a4bab (0x89f07 bytes) 000069[0] 1736985135.707832 mapread 0x0a86c0 thru 0x0a8df4 (0x735 bytes) 000070[1] 1736985135.725918 mapwrite 0x1fde5c thru 0x20033c (0x24e1 bytes) 000071[1] 1736985135.810137 mapread 0x644a16 thru 0x6474e6 (0x2ad1 bytes) 000075[1] 1736985135.836757 trunc from 0x7a4bac to 0x316ec6 (0x48dce5 bytes) 000076[1] 1736985135.850099 write 0x4a6ee9 thru 0x4a8ba5 (0x1cbd bytes) 000077[0] 1736985135.850953 mapwrite 0x2b62ba thru 0x2b9499 (0x31e0 bytes) 000083[0] 1736985136.006959 read 0x08917d thru 0x08d308 (0x418c bytes) 000084[1] 1736985136.020670 trunc from 0x4a8ba6 to 0x763453 (0x2ba8ae bytes) 000085[1] 1736985136.040565 write 0x3b2268 thru 0x3b6025 (0x3dbe bytes) 000087[1] 1736985136.059751 mapread 0x53bc1a thru 0x54908d (0xd474 bytes) 000088[1] 1736985136.110946 mapwrite 0x0b8e47 thru 0x0bbe60 (0x301a bytes) 000091[1] 1736985136.180877 write 0x032978 thru 0x036c20 (0x42a9 bytes) 000093[0] 1736985136.216301 write 0x965ee1 thru 0x96a9f9 (0x4b19 bytes) 000094[1] 1736985136.247919 mapread 0x68dde7 thru 0x68de70 (0x8a bytes) 000096[0] 1736985136.290748 trunc from 0x96a9fa to 0x33102a (0x6399cf bytes) 000097[0] 1736985136.315201 mapread 0x1f8501 thru 0x1ffaf1 (0x75f1 bytes) 000101[1] 1736985136.358915 mapwrite 0x36befc thru 0x3758a1 (0x99a6 bytes) 000103[1] 1736985136.462183 mapwrite 0x959e78 thru 0x95ed4c (0x4ed5 bytes) 000106[1] 1736985136.554404 write 0x3b3229 thru 0x3b3bbd (0x995 bytes) 000107[0] 1736985136.556601 mapwrite 0x51c74f thru 0x5202c7 (0x3b79 bytes) 000109[0] 1736985136.678417 write 0x919675 thru 0x92644b (0xcdd7 bytes) 000111[1] 1736985136.702371 read 0x2f7d41 thru 0x306ead (0xf16d bytes) 000112[1] 1736985136.800944 mapwrite 0x0a6edd thru 0x0a98e2 (0x2a06 bytes) 000114[0] 1736985136.871884 trunc from 0x95ed4d to 0x867969 (0xf73e3 bytes) 000116[1] 1736985136.927895 write 0x1e552b thru 0x1f21f3 (0xccc9 bytes) 000117[1] 1736985136.963262 trunc from 0x86796a to 0x34859f (0x51f3ca bytes) 000118[0] 1736985136.986723 trunc from 0x3485a0 to 0x64b03d (0x302a9e bytes) 000119[0] 1736985137.009896 mapread 0x343b38 thru 0x34a4aa (0x6973 bytes) 000120[1] 1736985137.034419 write 0x426fc9 thru 0x434748 (0xd780 bytes) 000121[0] 1736985137.059513 trunc from 0x64b03e to 0x07979c (0x5d18a1 bytes) 000122[0] 1736985137.097784 write 0x07fc29 thru 0x089b2e (0x9f06 bytes) 000124[1] 1736985137.120506 read 0x066483 thru 0x06cbaf (0x672d bytes) 000125[1] 1736985137.156789 trunc from 0x089b2f to 0x6d9d00 (0x6501d2 bytes) 000126[0] 1736985137.191251 read 0x222262 thru 0x23062e (0xe3cd bytes) 000128[1] 1736985137.239500 write 0x1f4210 thru 0x1f8eae (0x4c9f bytes) 000129[0] 1736985137.303123 mapwrite 0x540ff9 thru 0x541650 (0x658 bytes) 000130[0] 1736985137.412245 mapwrite 0x983ca0 thru 0x990e3b (0xd19c bytes) 000131[1] 1736985137.538773 mapread 0x8e9c72 thru 0x8edbc2 (0x3f51 bytes) 000133[1] 1736985137.587251 mapwrite 0x79d79a thru 0x7a9a99 (0xc300 bytes) 000137[1] 1736985137.706946 read 0x1e4d31 thru 0x1efbe5 (0xaeb5 bytes) 000140[1] 1736985137.739634 mapread 0x7df161 thru 0x7ecf58 (0xddf8 bytes) 000143[0] 1736985137.790082 trunc from 0x990e3c to 0x0ebc77 (0x8a51c4 bytes) 000144[0] 1736985137.843362 read 0x037c51 thru 0x03aa77 (0x2e27 bytes) 000146[1] 1736985137.867689 write 0x53a08c thru 0x53c200 (0x2175 bytes) 000151[0] 1736985137.920761 write 0x20386b thru 0x20814a (0x48e0 bytes) 000152[0] 1736985137.930852 trunc from 0x53c201 to 0x62f334 (0xf3134 bytes) 000153[0] 1736985137.962078 trunc from 0x62f335 to 0x5895f8 (0xa5d3c bytes) 000155[0] 1736985137.976849 trunc from 0x5895f9 to 0x81470f (0x28b117 bytes) 000157[0] 1736985137.996858 write 0x56074a thru 0x560c80 (0x537 bytes) 000158[1] 1736985138.028497 trunc from 0x814710 to 0x057897 (0x7bce78 bytes) 000159[1] 1736985138.084239 mapwrite 0x1f496e thru 0x1fbaf2 (0x7185 bytes) 000162[0] 1736985138.163444 trunc from 0x1fbaf3 to 0x0ca868 (0x13128a bytes) 000167[0] 1736985138.252811 mapread 0x08baba thru 0x08be02 (0x349 bytes) 000168[1] 1736985138.255299 trunc from 0x0ca869 to 0x2b8cda (0x1ee472 bytes) 000170[0] 1736985138.280356 mapwrite 0x4c6049 thru 0x4d4dc5 (0xed7d bytes) 000175[0] 1736985138.438920 write 0x5629a6 thru 0x56717c (0x47d7 bytes) 000177[0] 1736985138.446742 read 0x303540 thru 0x30bade (0x859f bytes) 000178[0] 1736985138.463645 mapread 0x17d16e thru 0x1875e0 (0xa473 bytes) 000179[1] 1736985138.501385 trunc from 0x56717d to 0x5d58d0 (0x6e754 bytes) 000181[0] 1736985138.551726 mapwrite 0x25153b thru 0x255259 (0x3d1f bytes) 000184[1] 1736985138.649843 read 0x076503 thru 0x0864fa (0xfff8 bytes) 000186[1] 1736985138.719055 mapread 0x034646 thru 0x03da31 (0x93ec bytes) 000187[0] 1736985138.759916 mapwrite 0x8b5216 thru 0x8c35d0 (0xe3bb bytes) 000188[1] 1736985138.897732 mapread 0x1f4bdf thru 0x20317a (0xe59c bytes) 000189[0] 1736985139.026846 mapwrite 0x6b66f3 thru 0x6c4a41 (0xe34f bytes) 000191[0] 1736985139.141315 mapwrite 0x81b31d thru 0x81e295 (0x2f79 bytes) 000195[1] 1736985139.233205 write 0x3027ce thru 0x302f6a (0x79d bytes) 000196[0] 1736985139.259909 mapwrite 0x0cbd09 thru 0x0dba15 (0xfd0d bytes) 000200[0] 1736985139.417419 mapwrite 0x96a6a1 thru 0x973577 (0x8ed7 bytes) 000201[0] 1736985139.530263 trunc from 0x973578 to 0x3c980f (0x5a9d68 bytes) 000203[1] 1736985139.555717 mapwrite 0x9b5154 thru 0x9be11b (0x8fc8 bytes) 000204[1] 1736985139.655492 trunc from 0x9be11c to 0x093935 (0x92a7e6 bytes) 000205[0] 1736985139.677545 mapread 0x07594c thru 0x07d5fa (0x7caf bytes) 000208[1] 1736985139.724575 trunc from 0x093936 to 0x361357 (0x2cda22 bytes) 000209[1] 1736985139.750442 write 0x4adf4f thru 0x4b64cf (0x8581 bytes) 000210[0] 1736985139.764864 mapwrite 0x69f51f thru 0x6aeb25 (0xf607 bytes) 000211[1] 1736985139.905625 read 0x3ee00c thru 0x3fa050 (0xc045 bytes) 000214[1] 1736985139.954508 trunc from 0x6aeb26 to 0x1ffd93 (0x4aed92 bytes) 000215[0] 1736985139.992227 mapread 0x183503 thru 0x1921ad (0xecab bytes) 000216[0] 1736985140.085962 read 0x066629 thru 0x07655a (0xff32 bytes) 000218[1] 1736985140.113248 mapread 0x0e2868 thru 0x0e54f0 (0x2c89 bytes) 000219[1] 1736985140.130409 mapread 0x060758 thru 0x0678f0 (0x7199 bytes) 000221[1] 1736985140.153899 read 0x15a1b5 thru 0x161535 (0x7381 bytes) 000222[1] 1736985140.163504 mapread 0x0f9891 thru 0x0fb786 (0x1ef6 bytes) 000223[0] 1736985140.174510 mapread 0x0f1813 thru 0x0f984e (0x803c bytes) 000224[1] 1736985140.175117 mapread 0x11d6a8 thru 0x11ed9d (0x16f6 bytes) 000225[1] 1736985140.182834 mapread 0x1380d9 thru 0x14454d (0xc475 bytes) 000226[0] 1736985140.241508 mapwrite 0x08e340 thru 0x093de2 (0x5aa3 bytes) 000228[1] 1736985140.331314 mapread 0x1ef07a thru 0x1f3591 (0x4518 bytes) 000230[1] 1736985140.343924 write 0x7e55e0 thru 0x7f4321 (0xed42 bytes) 000231[0] 1736985140.366416 read 0x5a2acc thru 0x5af190 (0xc6c5 bytes) 000232[1] 1736985140.417275 mapwrite 0x57fd2a thru 0x58b288 (0xb55f bytes) 000233[0] 1736985140.536114 trunc from 0x7f4322 to 0x516ea5 (0x2dd47c bytes) 000234[1] 1736985140.554944 read 0x1b3d91 thru 0x1b4d8d (0xffd bytes) 000237[0] 1736985140.592462 read 0x1e43eb thru 0x1f3cf8 (0xf90e bytes) 000238[1] 1736985140.631441 read 0x4ac1d9 thru 0x4b81c2 (0xbfea bytes) 000241[1] 1736985140.648212 read 0x4715a8 thru 0x47b03d (0x9a96 bytes) 000243[0] 1736985140.655127 write 0x796b9b thru 0x7a1b42 (0xafa8 bytes) 000245[0] 1736985140.676577 write 0x61eb81 thru 0x6258e3 (0x6d63 bytes) 000246[1] 1736985140.697664 mapwrite 0x66c4aa thru 0x67b5e2 (0xf139 bytes) 000248[0] 1736985140.961708 trunc from 0x7a1b43 to 0x18bcce (0x615e74 bytes) 000250[0] 1736985140.988874 read 0x005cba thru 0x00e910 (0x8c57 bytes) 000252[1] 1736985141.032480 mapwrite 0x693d48 thru 0x6964e4 (0x279d bytes) 000253[1] 1736985141.119931 read 0x289df7 thru 0x297c80 (0xde8a bytes) 000254[1] 1736985141.164205 write 0x43340c thru 0x43f9d6 (0xc5cb bytes) 000255[0] 1736985141.165079 mapread 0x378b4a thru 0x37b8c2 (0x2d79 bytes) 000256[1] 1736985141.197199 read 0x4eca24 thru 0x4f406c (0x7649 bytes) 000257[1] 1736985141.201649 write 0x07bd9f thru 0x088d08 (0xcf6a bytes) 000258[0] 1736985141.213687 mapwrite 0x299b51 thru 0x29b85b (0x1d0b bytes) 000259[0] 1736985141.324219 write 0x273f6c thru 0x2821c9 (0xe25e bytes) 000260[0] 1736985141.325057 mapwrite 0x71504f thru 0x7223d7 (0xd389 bytes) 000261[0] 1736985141.440556 trunc from 0x7223d8 to 0x28b239 (0x49719e bytes) 000262[0] 1736985141.464443 trunc from 0x28b23a to 0x36f168 (0xe3f2f bytes) 000264[0] 1736985141.481689 read 0x2f6e8d thru 0x30518d (0xe301 bytes) 000266[0] 1736985141.496099 write 0x02e613 thru 0x03abb1 (0xc59f bytes) 000267[1] 1736985141.515874 write 0x332a34 thru 0x340508 (0xdad5 bytes) 000268[1] 1736985141.534701 write 0x10a425 thru 0x10c50a (0x20e6 bytes) 000273[1] 1736985141.586227 read 0x0b7088 thru 0x0c3cf9 (0xcc72 bytes) 000276[0] 1736985141.660715 write 0x5c1d9c thru 0x5cdfba (0xc21f bytes) 000279[1] 1736985141.689650 write 0x06f86d thru 0x07c5f7 (0xcd8b bytes) 000282[0] 1736985141.762211 mapread 0x004484 thru 0x00f577 (0xb0f4 bytes) 000283[1] 1736985141.842548 write 0x210f2b thru 0x2207bb (0xf891 bytes) 000285[0] 1736985141.880792 write 0x5a4723 thru 0x5af9ab (0xb289 bytes) 000286[1] 1736985141.889975 trunc from 0x5cdfbb to 0x3297d4 (0x2a47e6 bytes) 000290[0] 1736985141.958970 mapwrite 0x4b3f97 thru 0x4be7a1 (0xa80b bytes) 000294[1] 1736985142.099903 write 0x9598fb thru 0x96385e (0x9f64 bytes) 000300[0] 1736985142.170661 read 0x3675df thru 0x36ff4c (0x896e bytes) 000302[1] 1736985142.228873 mapwrite 0x1cba8f thru 0x1d65fc (0xab6e bytes) 000304[0] 1736985142.338346 trunc from 0x96385f to 0x4dc16e (0x4876f0 bytes) 000305[0] 1736985142.361886 mapread 0x248d63 thru 0x249c8f (0xf2d bytes) 000307[0] 1736985142.366262 read 0x24c7b6 thru 0x250326 (0x3b71 bytes) 000309[1] 1736985142.382022 mapwrite 0x4dd33b thru 0x4e2d11 (0x59d7 bytes) 000310[1] 1736985142.481976 write 0x3becd9 thru 0x3bef78 (0x2a0 bytes) 000311[1] 1736985142.486753 mapread 0x12e5d1 thru 0x130d4c (0x277c bytes) 000312[0] 1736985142.494757 read 0x0c873c thru 0x0d6048 (0xd90d bytes) 000314[0] 1736985142.517952 write 0x044cf4 thru 0x04d83e (0x8b4b bytes) 000315[0] 1736985142.541508 mapread 0x04f10c thru 0x05ece7 (0xfbdc bytes) 000317[1] 1736985142.635927 write 0x958eb9 thru 0x95ab86 (0x1cce bytes) 000318[0] 1736985142.652105 read 0x4aec76 thru 0x4bcb6f (0xdefa bytes) 000319[0] 1736985142.670547 read 0x076fff thru 0x07912e (0x2130 bytes) 000321[0] 1736985142.697036 mapwrite 0x7a5bf5 thru 0x7ac292 (0x669e bytes) 000323[1] 1736985142.816915 read 0x301585 thru 0x306b7d (0x55f9 bytes) 000324[1] 1736985142.856657 trunc from 0x95ab87 to 0x370338 (0x5ea84e bytes) 000327[1] 1736985142.931217 mapwrite 0x6a6a57 thru 0x6a84e9 (0x1a93 bytes) 000328[0] 1736985143.026474 mapwrite 0x67e516 thru 0x6804c6 (0x1fb1 bytes) 000332[0] 1736985143.143852 trunc from 0x6a84ea to 0x16aa87 (0x53da62 bytes) 000333[0] 1736985143.182027 trunc from 0x16aa88 to 0x34b565 (0x1e0ade bytes) 000337[1] 1736985143.211980 trunc from 0x34b566 to 0x53ae2e (0x1ef8c9 bytes) 000340[0] 1736985143.277118 write 0x2a2da0 thru 0x2afd8d (0xcfee bytes) 000341[1] 1736985143.302320 read 0x092536 thru 0x092c9f (0x76a bytes) 000342[0] 1736985143.402860 read 0x19d36f thru 0x1a11fb (0x3e8d bytes) 000344[1] 1736985143.442163 mapwrite 0x7430c9 thru 0x74bbcd (0x8b05 bytes) 000346[0] 1736985143.534233 read 0x6636a9 thru 0x671cfa (0xe652 bytes) 000347[0] 1736985143.559175 write 0x5b06d2 thru 0x5b260f (0x1f3e bytes) 000348[0] 1736985143.584762 write 0x227ec8 thru 0x22de12 (0x5f4b bytes) 000349[0] 1736985143.600394 trunc from 0x74bbce to 0x77bee8 (0x3031b bytes) 000351[1] 1736985143.617091 mapwrite 0x787777 thru 0x7953ae (0xdc38 bytes) 000352[0] 1736985143.772799 trunc from 0x7953af to 0x5d3489 (0x1c1f25 bytes) 000353[1] 1736985143.800149 trunc from 0x5d348a to 0x319404 (0x2ba085 bytes) 000356[0] 1736985143.846962 trunc from 0x319405 to 0x588a75 (0x26f671 bytes) 000357[0] 1736985143.883468 mapread 0x063da1 thru 0x06548e (0x16ee bytes) 000358[0] 1736985143.907421 mapwrite 0x4a8805 thru 0x4b0dd6 (0x85d2 bytes) 000360[1] 1736985144.018015 mapread 0x342480 thru 0x35048f (0xe010 bytes) 000362[1] 1736985144.089515 mapread 0x1fc4fa thru 0x1fe65f (0x2166 bytes) 000363[1] 1736985144.119359 mapwrite 0x4f3348 thru 0x4f7bbe (0x4877 bytes) 000366[0] 1736985144.229437 write 0x7243b6 thru 0x733daa (0xf9f5 bytes) 000369[1] 1736985144.268243 mapwrite 0x5eb76d thru 0x5f1d1c (0x65b0 bytes) 000370[0] 1736985144.355634 mapread 0x2c8eaf thru 0x2cdf23 (0x5075 bytes) 000372[1] 1736985144.390363 trunc from 0x733dab to 0x28ba89 (0x4a8321 bytes) 000376[0] 1736985144.419820 mapwrite 0x209ede thru 0x21367d (0x97a0 bytes) 000378[0] 1736985144.519389 mapwrite 0x8b4697 thru 0x8b4698 (0x2 bytes) 000379[0] 1736985144.585781 trunc from 0x8b4699 to 0x47dcbd (0x4369db bytes) 000381[0] 1736985144.610117 trunc from 0x47dcbe to 0x6b88d8 (0x23ac1b bytes) 000382[0] 1736985144.632827 write 0x8ce4b5 thru 0x8d466b (0x61b7 bytes) 000385[0] 1736985144.657962 mapread 0x3f8296 thru 0x403617 (0xb382 bytes) 000387[1] 1736985144.684869 mapread 0x063d95 thru 0x07074b (0xc9b7 bytes) 000390[1] 1736985144.759585 mapwrite 0x4f604a thru 0x4fdf6c (0x7f23 bytes) 000391[1] 1736985144.845607 mapread 0x385b71 thru 0x3954d8 (0xf968 bytes) 000392[0] 1736985144.924220 write 0x57ffa6 thru 0x58c97e (0xc9d9 bytes) 000394[1] 1736985144.956683 trunc from 0x8d466c to 0x4dcd63 (0x3f7908 bytes) 000396[0] 1736985144.991448 mapwrite 0x1efad0 thru 0x1f00e6 (0x617 bytes) 000398[1] 1736985145.066001 read 0x2259bf thru 0x22bd53 (0x6395 bytes) 000399[0] 1736985145.088614 mapread 0x32f702 thru 0x334b12 (0x5411 bytes) 000400[1] 1736985145.110430 read 0x404fd0 thru 0x40e880 (0x98b1 bytes) 000401[0] 1736985145.138651 write 0x3500e8 thru 0x35e3b2 (0xe2cb bytes) 000404[0] 1736985145.174438 trunc from 0x4dcd64 to 0x302a01 (0x1da362 bytes) 000405[0] 1736985145.199776 mapwrite 0x603675 thru 0x610fd9 (0xd965 bytes) 000406[1] 1736985145.256929 write 0x45c102 thru 0x463f6d (0x7e6c bytes) 000407[1] 1736985145.275898 trunc from 0x610fda to 0x7f8863 (0x1e788a bytes) 000408[1] 1736985145.294468 mapwrite 0x0517d3 thru 0x05ca8e (0xb2bc bytes) 000409[1] 1736985145.397261 read 0x09fbed thru 0x0a0db1 (0x11c5 bytes) 000411[1] 1736985145.442645 trunc from 0x7f8864 to 0x76f2ea (0x89579 bytes) 000413[1] 1736985145.457160 mapread 0x4f8116 thru 0x4fd9e5 (0x58d0 bytes) 000415[0] 1736985145.470187 mapwrite 0x0320d0 thru 0x03efe9 (0xcf1a bytes) 000416[1] 1736985145.551627 trunc from 0x76f2eb to 0x41ae87 (0x354463 bytes) 000417[0] 1736985145.568255 trunc from 0x41ae88 to 0x57aa4f (0x15fbc8 bytes) 000419[0] 1736985145.600176 mapwrite 0x15cefb thru 0x160b14 (0x3c1a bytes) 000429[0] 1736985145.670770 mapwrite 0x7b3974 thru 0x7b8739 (0x4dc6 bytes) 000430[0] 1736985145.728132 read 0x3eb106 thru 0x3f3105 (0x8000 bytes) 000431[1] 1736985145.743275 trunc from 0x7b873a to 0x745be1 (0x72b58 bytes) 000432[1] 1736985145.757219 read 0x41dcb7 thru 0x424fa5 (0x72ef bytes) 000433[1] 1736985145.793606 mapread 0x3f5ee6 thru 0x3fd0ba (0x71d5 bytes) 000435[0] 1736985145.835077 trunc from 0x745be2 to 0x220f4a (0x524c97 bytes) 000436[0] 1736985145.863835 write 0x2bcde0 thru 0x2c1724 (0x4945 bytes) 000439[0] 1736985145.877614 trunc from 0x2c1725 to 0x3f690e (0x1351ea bytes) 000440[0] 1736985145.888220 write 0x10249a thru 0x102fce (0xb35 bytes) 000441[0] 1736985145.900920 mapread 0x381a88 thru 0x38e5e9 (0xcb62 bytes) 000442[1] 1736985145.925968 read 0x3c52bb thru 0x3cb6f8 (0x643e bytes) 000443[0] 1736985145.949021 write 0x21635d thru 0x21ccd1 (0x6975 bytes) 000446[0] 1736985145.958330 write 0x9cf82a thru 0x9da886 (0xb05d bytes) 000448[0] 1736985145.974411 mapwrite 0x5edcf1 thru 0x5f4162 (0x6472 bytes) 000450[1] 1736985146.058685 write 0x354463 thru 0x354db0 (0x94e bytes) 000451[1] 1736985146.086311 read 0x88a797 thru 0x897dd1 (0xd63b bytes) 000454[0] 1736985146.143589 mapread 0x7792ec thru 0x77afb3 (0x1cc8 bytes) 000456[0] 1736985146.177420 mapread 0x8a4bb4 thru 0x8b14db (0xc928 bytes) 000457[0] 1736985146.201572 write 0x84e509 thru 0x84f662 (0x115a bytes) 000461[1] 1736985146.224353 mapread 0x25936d thru 0x25c468 (0x30fc bytes) 000465[1] 1736985146.245306 mapread 0x753163 thru 0x76181b (0xe6b9 bytes) 000469[1] 1736985146.286506 write 0x9534dc thru 0x9578cc (0x43f1 bytes) 000471[0] 1736985146.310268 mapwrite 0x64227b thru 0x64b8f0 (0x9676 bytes) 000472[1] 1736985146.379086 trunc from 0x9da887 to 0x5364e1 (0x4a43a5 bytes) 000473[0] 1736985146.404263 trunc from 0x5364e2 to 0x914d42 (0x3de861 bytes) 000474[0] 1736985146.426956 read 0x51beda thru 0x52b39c (0xf4c3 bytes) 000475[0] 1736985146.455182 mapwrite 0x391d2e thru 0x3a0110 (0xe3e3 bytes) 000476[0] 1736985146.515375 mapread 0x50df49 thru 0x5143e1 (0x6499 bytes) 000477[1] 1736985146.531140 trunc from 0x914d43 to 0x2d986c (0x63b4d6 bytes) 000480[1] 1736985146.561938 trunc from 0x2d986d to 0x5acb17 (0x2d32ab bytes) 000483[0] 1736985146.606945 mapwrite 0x6306ef thru 0x6333b7 (0x2cc9 bytes) 000484[0] 1736985146.685407 mapread 0x2b863b thru 0x2b8cf2 (0x6b8 bytes) 000485[0] 1736985146.694000 read 0x38a83e thru 0x397f37 (0xd6fa bytes) 000486[0] 1736985146.718918 trunc from 0x6333b8 to 0x67b61e (0x48267 bytes) 000488[1] 1736985146.742384 trunc from 0x67b61f to 0x81c626 (0x1a1008 bytes) 000489[1] 1736985146.785029 trunc from 0x81c627 to 0x83dccc (0x216a6 bytes) 000490[1] 1736985146.797566 write 0x15fcb2 thru 0x16f66c (0xf9bb bytes) 000494[0] 1736985146.858763 read 0x0e8bc1 thru 0x0f7541 (0xe981 bytes) 000495[0] 1736985146.880975 mapread 0x7a6c3d thru 0x7a91f1 (0x25b5 bytes) 000496[1] 1736985146.932615 mapread 0x335e8d thru 0x3393e0 (0x3554 bytes) 000498[0] 1736985146.958172 mapwrite 0x3aa999 thru 0x3b28b0 (0x7f18 bytes) All operations completed A-OK! Chance of close/open is 1 in 50 Seed set to 5147 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001[0] 1736985147.356203 write 0x054000 thru 0x05a63a (0x663b bytes) 000002[1] 1736985147.370619 write_OD 0x33e000 thru 0x33efff (0x1000 bytes) 000006[1] 1736985147.426425 mapwrite 0x432000 thru 0x43cc81 (0xac82 bytes) 000009[1] 1736985147.532594 mapread 0x2a4000 thru 0x2a7105 (0x3106 bytes) 000012[0] 1736985147.562647 write 0x07c000 thru 0x07d7ef (0x17f0 bytes) 000013[0] 1736985147.578216 write 0x891000 thru 0x89394f (0x2950 bytes) 000015[1] 1736985147.580672 read_OD 0x725000 thru 0x732fff (0xe000 bytes) truncating to largest ever: 0x3c6def 000016[0] 1736985147.605128 trunc from 0x893950 to 0x3c6dee (0x4ccb61 bytes) truncating to largest ever: 0x98a352 000017[1] 1736985147.633010 trunc from 0x3c6def to 0x98a351 (0x5c3563 bytes) 000018[1] 1736985147.666452 trunc from 0x98a352 to 0x84152b (0x148e26 bytes) 000019[1] 1736985147.676272 read_OD 0x34e000 thru 0x350fff (0x3000 bytes) 000020[1] 1736985147.681838 trunc from 0x84152c to 0x7bb7ab (0x85d80 bytes) 000021[0] 1736985147.693452 mapwrite 0x1ef000 thru 0x1f08fb (0x18fc bytes) 000023[0] 1736985147.768641 mapread 0x064000 thru 0x066b37 (0x2b38 bytes) 000025[0] 1736985147.793670 mapread 0x379000 thru 0x37afc8 (0x1fc9 bytes) 000027[0] 1736985147.821207 mapwrite 0x3d9000 thru 0x3d92f2 (0x2f3 bytes) 000028[1] 1736985147.868350 mapread 0x45d000 thru 0x46bdec (0xeded bytes) 000029[1] 1736985147.942504 mapwrite 0x5cb000 thru 0x5d5ad0 (0xaad1 bytes) 000030[0] 1736985148.052090 mapread 0x1ca000 thru 0x1d5f6e (0xbf6f bytes) 000033[0] 1736985148.082948 read 0x04e000 thru 0x05809a (0xa09b bytes) 000035[0] 1736985148.087014 mapread 0x11f000 thru 0x11fb11 (0xb12 bytes) 000038[0] 1736985148.094023 read 0x715000 thru 0x71dc3c (0x8c3d bytes) 000039[0] 1736985148.101890 write 0x4da000 thru 0x4e9629 (0xf62a bytes) 000041[1] 1736985148.116566 trunc from 0x7bb7ac to 0x579554 (0x242257 bytes) 000042[0] 1736985148.133409 trunc from 0x579555 to 0x453823 (0x125d31 bytes) 000043[0] 1736985148.153406 mapwrite 0x7d4000 thru 0x7de49d (0xa49e bytes) 000044[0] 1736985148.208317 write 0x0e7000 thru 0x0ec847 (0x5848 bytes) 000045[0] 1736985148.217770 write 0x6fa000 thru 0x70555a (0xb55b bytes) 000046[1] 1736985148.222831 read_OD 0x77a000 thru 0x77bfff (0x2000 bytes) 000047[1] 1736985148.248049 mapwrite 0x7f0000 thru 0x7f1448 (0x1449 bytes) 000050[1] 1736985148.320422 write_OD 0x183000 thru 0x18bfff (0x9000 bytes) 000052[1] 1736985148.367591 mapread 0x071000 thru 0x0723fc (0x13fd bytes) 000054[1] 1736985148.377178 write_OD 0x494000 thru 0x494fff (0x1000 bytes) 000055[0] 1736985148.410577 mapwrite 0x4d9000 thru 0x4e7027 (0xe028 bytes) 000059[1] 1736985148.557600 write_OD 0x74b000 thru 0x750fff (0x6000 bytes) 000061[1] 1736985148.607210 mapread 0x596000 thru 0x59f0ca (0x90cb bytes) 000062[1] 1736985148.637158 trunc from 0x7f1449 to 0x89371c (0xa22d4 bytes) 000063[1] 1736985148.656918 write_OD 0x6d5000 thru 0x6d8fff (0x4000 bytes) 000065[0] 1736985148.703403 read 0x2b1000 thru 0x2ba480 (0x9481 bytes) 000066[1] 1736985148.751397 write_OD 0x175000 thru 0x182fff (0xe000 bytes) 000068[1] 1736985148.805937 read_OD 0x75b000 thru 0x75cfff (0x2000 bytes) 000070[0] 1736985148.816456 trunc from 0x89371d to 0x65ff95 (0x233787 bytes) 000073[1] 1736985148.847961 read_OD 0x1f2000 thru 0x1fdfff (0xc000 bytes) 000074[1] 1736985148.859887 mapread 0x3bf000 thru 0x3ce9e3 (0xf9e4 bytes) 000075[1] 1736985148.898597 trunc from 0x65ff96 to 0x10a0a7 (0x555eee bytes) 000078[0] 1736985148.965025 write 0x7c7000 thru 0x7cf21b (0x821c bytes) 000079[0] 1736985148.983927 mapwrite 0x5b5000 thru 0x5bf681 (0xa682 bytes) 000081[1] 1736985149.068186 mapread 0x113000 thru 0x11ab80 (0x7b81 bytes) 000084[0] 1736985149.118109 trunc from 0x7cf21c to 0x5719a9 (0x25d872 bytes) 000085[0] 1736985149.153234 read 0x49d000 thru 0x4a60f1 (0x90f2 bytes) 000088[0] 1736985149.176720 mapwrite 0x761000 thru 0x7659fa (0x49fb bytes) 000089[0] 1736985149.238034 trunc from 0x7659fb to 0x6b687a (0xaf180 bytes) 000091[0] 1736985149.263604 mapread 0x50d000 thru 0x518391 (0xb392 bytes) 000092[0] 1736985149.272649 trunc from 0x6b687b to 0x8d4907 (0x21e08d bytes) 000093[0] 1736985149.283348 trunc from 0x8d4908 to 0x2f7b65 (0x5dcda2 bytes) 000094[1] 1736985149.302828 trunc from 0x2f7b66 to 0x86e2de (0x576779 bytes) 000097[1] 1736985149.332627 mapwrite 0x67f000 thru 0x6878b9 (0x88ba bytes) 000100[0] 1736985149.393572 mapread 0x39e000 thru 0x3ac6f0 (0xe6f1 bytes) 000103[0] 1736985149.444879 write 0x35f000 thru 0x36a00d (0xb00e bytes) 000105[1] 1736985149.462863 mapread 0x67a000 thru 0x67f76f (0x5770 bytes) 000106[0] 1736985149.502512 write 0x648000 thru 0x64ebf4 (0x6bf5 bytes) 000107[1] 1736985149.521748 trunc from 0x86e2df to 0x761724 (0x10cbba bytes) 000109[0] 1736985149.560047 write 0x5b3000 thru 0x5b338e (0x38f bytes) 000111[1] 1736985149.590277 write_OD 0x547000 thru 0x54afff (0x4000 bytes) 000112[0] 1736985149.651345 write 0x384000 thru 0x390e03 (0xce04 bytes) 000114[1] 1736985149.662166 read_OD 0x6ab000 thru 0x6b5fff (0xb000 bytes) 000117[1] 1736985149.679504 trunc from 0x761725 to 0x23d963 (0x523dc1 bytes) 000118[1] 1736985149.701512 mapread 0x11a000 thru 0x127bc9 (0xdbca bytes) 000119[0] 1736985149.737082 mapread 0x0d6000 thru 0x0d9e1c (0x3e1d bytes) 000120[1] 1736985149.758765 trunc from 0x23d964 to 0x30ca17 (0xcf0b4 bytes) 000121[1] 1736985149.772927 write_OD 0x9be000 thru 0x9befff (0x1000 bytes) 000122[1] 1736985149.810365 read_OD 0x725000 thru 0x732fff (0xe000 bytes) 000123[1] 1736985149.818409 trunc from 0x9bf000 to 0x1eda39 (0x7d15c6 bytes) 000125[0] 1736985149.849376 mapread 0x04a000 thru 0x04d4f1 (0x34f2 bytes) 000129[1] 1736985149.872882 mapread 0x08a000 thru 0x096185 (0xc186 bytes) 000132[0] 1736985149.930057 mapread 0x12b000 thru 0x134db9 (0x9dba bytes) 000133[1] 1736985149.964364 write_OD 0x8a9000 thru 0x8b1fff (0x9000 bytes) 000134[1] 1736985149.999755 trunc from 0x8b2000 to 0x2c701c (0x5eafe3 bytes) 000136[1] 1736985150.036103 mapread 0x109000 thru 0x118fe8 (0xffe9 bytes) 000138[1] 1736985150.091606 read_OD 0x1ff000 thru 0x208fff (0xa000 bytes) 000139[1] 1736985150.098459 read_OD 0x22c000 thru 0x233fff (0x8000 bytes) 000141[0] 1736985150.104187 mapwrite 0x093000 thru 0x09dbef (0xabf0 bytes) 000143[0] 1736985150.199433 write 0x1ca000 thru 0x1d7ab2 (0xdab3 bytes) 000144[0] 1736985150.202724 mapwrite 0x844000 thru 0x84cb78 (0x8b79 bytes) 000145[0] 1736985150.327684 mapwrite 0x12a000 thru 0x12b74c (0x174d bytes) 000147[0] 1736985150.377152 trunc from 0x84cb79 to 0x83b21c (0x1195c bytes) 000151[1] 1736985150.408433 trunc from 0x83b21d to 0x2fcb15 (0x53e707 bytes) 000153[1] 1736985150.447734 mapwrite 0x2a6000 thru 0x2a83f3 (0x23f4 bytes) 000154[1] 1736985150.505891 mapread 0x015000 thru 0x023218 (0xe219 bytes) 000155[0] 1736985150.565856 trunc from 0x2fcb16 to 0x08ff6b (0x26cbaa bytes) 000158[1] 1736985150.582224 mapread 0x08b000 thru 0x08f1d5 (0x41d6 bytes) 000159[1] 1736985150.607528 read_OD 0x00a000 thru 0x011fff (0x8000 bytes) 000161[1] 1736985150.613849 mapwrite 0x331000 thru 0x33a257 (0x9258 bytes) 000162[0] 1736985150.695007 mapwrite 0x61b000 thru 0x625259 (0xa25a bytes) 000169[1] 1736985150.804562 read_OD 0x02a000 thru 0x030fff (0x7000 bytes) 000170[0] 1736985150.820310 trunc from 0x62525a to 0x07f0f6 (0x5a6163 bytes) 000171[0] 1736985150.835697 trunc from 0x07f0f7 to 0x3787bd (0x2f96c7 bytes) 000172[1] 1736985150.843235 write_OD 0x3d2000 thru 0x3defff (0xd000 bytes) 000174[1] 1736985150.883372 read_OD 0x0a0000 thru 0x0a3fff (0x4000 bytes) 000176[1] 1736985150.888597 mapread 0x09e000 thru 0x0a4d2e (0x6d2f bytes) 000177[0] 1736985150.925717 read 0x3a5000 thru 0x3ad616 (0x8617 bytes) 000178[0] 1736985150.931397 read 0x187000 thru 0x192488 (0xb489 bytes) 000179[0] 1736985150.951904 trunc from 0x3df000 to 0x063f3a (0x37b0c5 bytes) 000180[1] 1736985150.977941 trunc from 0x063f3b to 0x6af71c (0x64b7e2 bytes) 000182[1] 1736985150.992717 mapread 0x2ee000 thru 0x2ee43f (0x440 bytes) 000183[0] 1736985151.014379 mapread 0x458000 thru 0x45e7c6 (0x67c7 bytes) 000187[0] 1736985151.045212 write 0x553000 thru 0x55aa2c (0x7a2d bytes) 000188[0] 1736985151.063340 mapwrite 0x6c8000 thru 0x6c8e32 (0xe33 bytes) 000190[0] 1736985151.106894 mapread 0x005000 thru 0x008a08 (0x3a09 bytes) 000193[0] 1736985151.123548 write 0x79d000 thru 0x7a16e0 (0x46e1 bytes) 000194[1] 1736985151.129817 read_OD 0x021000 thru 0x02afff (0xa000 bytes) 000197[0] 1736985151.140836 write 0x300000 thru 0x30635b (0x635c bytes) 000198[1] 1736985151.153890 read_OD 0x5cd000 thru 0x5d7fff (0xb000 bytes) 000200[1] 1736985151.171667 read_OD 0x5fd000 thru 0x5fffff (0x3000 bytes) 000201[0] 1736985151.174193 write 0x64f000 thru 0x65b8ff (0xc900 bytes) 000203[0] 1736985151.189891 read 0x749000 thru 0x7529e8 (0x99e9 bytes) 000204[0] 1736985151.199647 mapread 0x481000 thru 0x4887d2 (0x77d3 bytes) 000205[1] 1736985151.212419 write_OD 0x72d000 thru 0x731fff (0x5000 bytes) 000207[0] 1736985151.256349 read 0x1de000 thru 0x1edf84 (0xff85 bytes) 000213[0] 1736985151.284127 write 0x3a9000 thru 0x3af0a2 (0x60a3 bytes) 000215[0] 1736985151.319534 trunc from 0x7a16e1 to 0x3c4875 (0x3dce6b bytes) 000216[1] 1736985151.328600 mapwrite 0x4ca000 thru 0x4d2e94 (0x8e95 bytes) truncating to largest ever: 0x9f2e6e 000217[0] 1736985151.409712 trunc from 0x4d2e95 to 0x9f2e6d (0x51ffd9 bytes) 000218[0] 1736985151.419772 mapwrite 0x09c000 thru 0x0ab662 (0xf663 bytes) 000219[0] 1736985151.526471 mapwrite 0x97a000 thru 0x97b299 (0x129a bytes) 000220[1] 1736985151.573909 mapread 0x965000 thru 0x96e677 (0x9678 bytes) 000221[0] 1736985151.619167 read 0x416000 thru 0x419d28 (0x3d29 bytes) 000225[1] 1736985151.668151 write_OD 0x03e000 thru 0x047fff (0xa000 bytes) 000226[0] 1736985151.719330 mapwrite 0x630000 thru 0x63b786 (0xb787 bytes) 000230[1] 1736985151.836547 mapread 0x990000 thru 0x99197e (0x197f bytes) 000232[0] 1736985151.858216 mapread 0x53e000 thru 0x544c47 (0x6c48 bytes) 000236[1] 1736985151.883055 mapread 0x18d000 thru 0x18fbe9 (0x2bea bytes) 000241[1] 1736985151.893126 read_OD 0x594000 thru 0x599fff (0x6000 bytes) 000242[1] 1736985151.896669 read_OD 0x731000 thru 0x736fff (0x6000 bytes) 000244[0] 1736985151.900483 read 0x499000 thru 0x49fbe1 (0x6be2 bytes) 000245[1] 1736985151.930208 read_OD 0x9c2000 thru 0x9c4fff (0x3000 bytes) 000246[0] 1736985151.936895 trunc from 0x9f2e6e to 0x1be836 (0x834637 bytes) 000248[0] 1736985151.962369 write 0x744000 thru 0x74741a (0x341b bytes) 000250[1] 1736985151.969374 read_OD 0x34e000 thru 0x357fff (0xa000 bytes) 000254[0] 1736985151.982163 write 0x296000 thru 0x29ece7 (0x8ce8 bytes) 000256[1] 1736985151.989115 mapread 0x69f000 thru 0x6a8e28 (0x9e29 bytes) 000258[0] 1736985152.030994 mapread 0x727000 thru 0x735cb3 (0xecb4 bytes) 000259[1] 1736985152.072916 mapwrite 0x865000 thru 0x86cba7 (0x7ba8 bytes) 000261[1] 1736985152.175964 mapread 0x1fb000 thru 0x1ff362 (0x4363 bytes) 000266[1] 1736985152.216804 write_OD 0x6cc000 thru 0x6d6fff (0xb000 bytes) 000267[0] 1736985152.268824 trunc from 0x86cba8 to 0x22a059 (0x642b4e bytes) 000273[0] 1736985152.329731 mapwrite 0x852000 thru 0x8533b0 (0x13b1 bytes) 000275[0] 1736985152.398590 trunc from 0x8533b1 to 0x7e2219 (0x71197 bytes) 000276[1] 1736985152.414905 mapread 0x3af000 thru 0x3b7cb6 (0x8cb7 bytes) 000277[0] 1736985152.445343 trunc from 0x7e221a to 0x1923b7 (0x64fe62 bytes) 000278[0] 1736985152.461863 mapread 0x067000 thru 0x06e225 (0x7226 bytes) 000281[1] 1736985152.487034 read_OD 0x012000 thru 0x01cfff (0xb000 bytes) 000282[0] 1736985152.505558 read 0x025000 thru 0x030b47 (0xbb48 bytes) 000284[1] 1736985152.522792 read_OD 0x01f000 thru 0x02afff (0xc000 bytes) 000286[1] 1736985152.531267 read_OD 0x17f000 thru 0x186fff (0x8000 bytes) 000287[1] 1736985152.542147 trunc from 0x1923b8 to 0x0743ea (0x11dfcd bytes) 000288[1] 1736985152.570259 trunc from 0x0743eb to 0x89d3f7 (0x82900d bytes) 000294[1] 1736985152.612208 write_OD 0x4aa000 thru 0x4b5fff (0xc000 bytes) 000295[1] 1736985152.653548 mapread 0x718000 thru 0x72390e (0xb90f bytes) 000296[1] 1736985152.705590 mapread 0x5ef000 thru 0x5f70c4 (0x80c5 bytes) 000297[1] 1736985152.706085 read_OD 0x11c000 thru 0x122fff (0x7000 bytes) 000298[1] 1736985152.714600 mapwrite 0x803000 thru 0x808e7c (0x5e7d bytes) 000299[0] 1736985152.805920 write 0x19b000 thru 0x19f878 (0x4879 bytes) 000302[1] 1736985152.835716 write_OD 0x2b7000 thru 0x2c4fff (0xe000 bytes) 000304[1] 1736985152.883114 read_OD 0x4e4000 thru 0x4e9fff (0x6000 bytes) 000305[0] 1736985152.888525 mapwrite 0x8f0000 thru 0x8f78cc (0x78cd bytes) 000306[1] 1736985152.982346 mapread 0x2b0000 thru 0x2bc13e (0xc13f bytes) 000307[1] 1736985153.068227 mapread 0x357000 thru 0x35da1a (0x6a1b bytes) 000309[1] 1736985153.084767 trunc from 0x8f78cd to 0x4e8623 (0x40f2a9 bytes) 000310[0] 1736985153.106731 read 0x059000 thru 0x05c7b6 (0x37b7 bytes) 000312[1] 1736985153.158534 trunc from 0x4e8624 to 0x552afb (0x6a4d8 bytes) 000313[0] 1736985153.195120 mapread 0x30d000 thru 0x3104b3 (0x34b4 bytes) 000316[1] 1736985153.225685 trunc from 0x552afc to 0x35bc75 (0x1f6e86 bytes) 000317[1] 1736985153.241473 mapwrite 0x965000 thru 0x971032 (0xc033 bytes) 000318[1] 1736985153.301486 read_OD 0x42b000 thru 0x42bfff (0x1000 bytes) 000322[0] 1736985153.310494 write 0x3df000 thru 0x3e0274 (0x1275 bytes) 000323[0] 1736985153.342019 trunc from 0x971033 to 0x8b9ef8 (0xb713a bytes) 000324[0] 1736985153.356058 mapwrite 0x338000 thru 0x33b6fe (0x36ff bytes) 000325[1] 1736985153.416643 mapread 0x05b000 thru 0x062e18 (0x7e19 bytes) 000326[0] 1736985153.482810 read 0x840000 thru 0x84cf23 (0xcf24 bytes) 000329[1] 1736985153.491492 read_OD 0x665000 thru 0x66bfff (0x7000 bytes) 000330[1] 1736985153.497718 read_OD 0x5c6000 thru 0x5ccfff (0x7000 bytes) 000332[0] 1736985153.502620 trunc from 0x8b9ef9 to 0x64cfd3 (0x26cf25 bytes) 000335[0] 1736985153.521411 read 0x294000 thru 0x29e6b0 (0xa6b1 bytes) 000336[1] 1736985153.546625 mapwrite 0x1b7000 thru 0x1b76e0 (0x6e1 bytes) 000337[0] 1736985153.605916 trunc from 0x64cfd4 to 0x583417 (0xc9bbc bytes) 000339[1] 1736985153.621964 mapwrite 0x23f000 thru 0x2422a8 (0x32a9 bytes) 000340[1] 1736985153.674664 write_OD 0x7d2000 thru 0x7d6fff (0x5000 bytes) 000341[0] 1736985153.715329 trunc from 0x7d7000 to 0x37e35d (0x458ca2 bytes) 000345[1] 1736985153.738819 mapwrite 0x45a000 thru 0x461355 (0x7356 bytes) 000346[1] 1736985153.819839 mapread 0x189000 thru 0x18e240 (0x5241 bytes) 000348[1] 1736985153.841079 trunc from 0x461356 to 0x3f78e9 (0x69a6c bytes) 000349[1] 1736985153.847908 mapread 0x2a5000 thru 0x2aa758 (0x5759 bytes) 000352[1] 1736985153.875597 write_OD 0x1f2000 thru 0x1fbfff (0xa000 bytes) 000354[1] 1736985153.906558 mapread 0x063000 thru 0x065e92 (0x2e93 bytes) 000356[1] 1736985153.914720 trunc from 0x3f78ea to 0x3fc17a (0x4891 bytes) 000358[0] 1736985153.933265 mapread 0x18f000 thru 0x19bd22 (0xcd23 bytes) 000359[1] 1736985153.980776 write_OD 0x8dd000 thru 0x8eafff (0xe000 bytes) 000360[1] 1736985154.017758 mapwrite 0x146000 thru 0x1460f6 (0xf7 bytes) 000361[1] 1736985154.086860 write_OD 0x370000 thru 0x370fff (0x1000 bytes) 000364[0] 1736985154.127738 mapread 0x8e1000 thru 0x8e48b8 (0x38b9 bytes) 000365[1] 1736985154.147577 mapwrite 0x793000 thru 0x793ed9 (0xeda bytes) 000367[0] 1736985154.213366 mapread 0x612000 thru 0x620761 (0xe762 bytes) 000368[1] 1736985154.265008 read_OD 0x007000 thru 0x009fff (0x3000 bytes) 000372[1] 1736985154.270181 read_OD 0x870000 thru 0x87bfff (0xc000 bytes) 000373[0] 1736985154.276677 trunc from 0x8eb000 to 0x7140f9 (0x1d6f06 bytes) 000379[1] 1736985154.320237 write_OD 0x538000 thru 0x540fff (0x9000 bytes) 000384[1] 1736985154.362588 write_OD 0x50c000 thru 0x510fff (0x5000 bytes) 000385[0] 1736985154.404860 read 0x2ee000 thru 0x2ef171 (0x1172 bytes) 000386[0] 1736985154.432465 mapwrite 0x8fa000 thru 0x8fdf34 (0x3f35 bytes) 000388[0] 1736985154.531985 mapwrite 0x205000 thru 0x211855 (0xc856 bytes) 000389[1] 1736985154.626500 read_OD 0x4ac000 thru 0x4b4fff (0x9000 bytes) 000390[1] 1736985154.639043 write_OD 0x891000 thru 0x89dfff (0xd000 bytes) 000395[1] 1736985154.681535 trunc from 0x8fdf35 to 0x05f059 (0x89eedb bytes) 000396[0] 1736985154.706507 mapwrite 0x668000 thru 0x66e45b (0x645c bytes) 000397[1] 1736985154.789961 read_OD 0x4ed000 thru 0x4f6fff (0xa000 bytes) 000400[1] 1736985154.810544 mapread 0x481000 thru 0x48d6d6 (0xc6d7 bytes) 000401[0] 1736985154.885146 mapwrite 0x1d2000 thru 0x1dfbb1 (0xdbb2 bytes) 000403[0] 1736985154.981945 mapwrite 0x617000 thru 0x61c38d (0x538e bytes) 000406[0] 1736985155.087205 mapread 0x500000 thru 0x5016ca (0x16cb bytes) 000407[0] 1736985155.095655 mapwrite 0x009000 thru 0x014ae7 (0xbae8 bytes) 000408[0] 1736985155.189416 mapread 0x441000 thru 0x450750 (0xf751 bytes) 000411[1] 1736985155.245800 trunc from 0x66e45c to 0x0813ea (0x5ed071 bytes) 000412[0] 1736985155.262120 read 00000000 thru 0x005e2c (0x5e2d bytes) 000414[0] 1736985155.278865 read 0x07e000 thru 0x080fc8 (0x2fc9 bytes) 000416[0] 1736985155.284159 write 0x256000 thru 0x265e03 (0xfe04 bytes) 000417[1] 1736985155.293814 mapread 0x183000 thru 0x185a0d (0x2a0e bytes) 000419[1] 1736985155.322464 write_OD 0x31a000 thru 0x323fff (0xa000 bytes) 000420[1] 1736985155.368235 mapwrite 0x705000 thru 0x7138cd (0xe8ce bytes) 000421[1] 1736985155.458772 trunc from 0x7138ce to 0x4b6491 (0x25d43c bytes) 000422[0] 1736985155.479915 read 0x40f000 thru 0x414f40 (0x5f41 bytes) 000423[0] 1736985155.502171 mapread 0x404000 thru 0x40468c (0x68d bytes) 000424[1] 1736985155.508423 read_OD 0x465000 thru 0x46dfff (0x9000 bytes) 000429[1] 1736985155.516244 mapwrite 0x305000 thru 0x310015 (0xb016 bytes) 000430[1] 1736985155.624012 write_OD 0x13e000 thru 0x144fff (0x7000 bytes) 000431[1] 1736985155.664032 read_OD 0x3e4000 thru 0x3effff (0xc000 bytes) 000433[0] 1736985155.670900 read 0x43a000 thru 0x43a3bf (0x3c0 bytes) 000436[0] 1736985155.678905 write 0x383000 thru 0x38d369 (0xa36a bytes) 000438[0] 1736985155.692948 mapwrite 0x26e000 thru 0x2752d5 (0x72d6 bytes) 000444[1] 1736985155.767943 trunc from 0x4b6492 to 0x9ca306 (0x513e75 bytes) 000445[1] 1736985155.788100 mapread 0x34a000 thru 0x35215c (0x815d bytes) 000446[1] 1736985155.877648 read_OD 0x170000 thru 0x178fff (0x9000 bytes) 000447[0] 1736985155.899465 mapread 0x3cf000 thru 0x3d9061 (0xa062 bytes) 000449[0] 1736985155.977612 mapwrite 0x70c000 thru 0x719e22 (0xde23 bytes) 000450[1] 1736985156.100339 trunc from 0x9ca307 to 0x3833d0 (0x646f36 bytes) 000451[0] 1736985156.135603 mapread 0x1a6000 thru 0x1a938c (0x338d bytes) 000452[1] 1736985156.171570 mapwrite 0x404000 thru 0x4083b0 (0x43b1 bytes) 000457[1] 1736985156.305902 read_OD 0x2b6000 thru 0x2bbfff (0x6000 bytes) 000458[0] 1736985156.317755 write 0x88c000 thru 0x897446 (0xb447 bytes) 000459[0] 1736985156.333842 trunc from 0x897447 to 0x5c3dec (0x2d365a bytes) 000463[0] 1736985156.388564 mapread 0x456000 thru 0x465d30 (0xfd31 bytes) 000464[1] 1736985156.414520 write_OD 0x28c000 thru 0x290fff (0x5000 bytes) 000465[1] 1736985156.468576 mapread 0x432000 thru 0x432fac (0xfad bytes) 000468[0] 1736985156.496215 mapread 0x1cd000 thru 0x1d839e (0xb39f bytes) 000469[0] 1736985156.508055 mapread 0x2a0000 thru 0x2a46eb (0x46ec bytes) 000471[0] 1736985156.515127 trunc from 0x5c3ded to 0x74b8b2 (0x187ac6 bytes) 000472[0] 1736985156.539646 write 0x232000 thru 0x240b29 (0xeb2a bytes) 000474[1] 1736985156.567196 write_OD 0x485000 thru 0x48bfff (0x7000 bytes) 000478[1] 1736985156.626980 mapwrite 0x8df000 thru 0x8eebd3 (0xfbd4 bytes) 000480[0] 1736985156.709887 read 0x3d8000 thru 0x3e2f8a (0xaf8b bytes) 000483[0] 1736985156.727131 read 0x676000 thru 0x677619 (0x161a bytes) 000485[1] 1736985156.744415 write_OD 0x6bd000 thru 0x6cafff (0xe000 bytes) 000486[0] 1736985156.778255 read 0x54f000 thru 0x5594ed (0xa4ee bytes) 000487[1] 1736985156.801170 read_OD 0x6bb000 thru 0x6c6fff (0xc000 bytes) 000488[1] 1736985156.811973 mapwrite 0x063000 thru 0x06b336 (0x8337 bytes) 000490[0] 1736985156.941865 trunc from 0x8eebd4 to 0x58f4f0 (0x35f6e3 bytes) 000491[0] 1736985156.967340 mapread 0x075000 thru 0x07e1ce (0x91cf bytes) 000492[1] 1736985157.002086 mapwrite 0x018000 thru 0x018adf (0xae0 bytes) 000493[0] 1736985157.058917 read 0x27a000 thru 0x27c2a8 (0x22a9 bytes) 000496[0] 1736985157.094078 write 0x532000 thru 0x540389 (0xe38a bytes) 000497[1] 1736985157.109639 trunc from 0x58f4f1 to 0x754c5d (0x1c576d bytes) 000498[0] 1736985157.134226 mapwrite 0x932000 thru 0x93f70e (0xd70f bytes) 000499[0] 1736985157.223046 mapread 0x933000 thru 0x935d03 (0x2d04 bytes) 000500[1] 1736985157.233681 read_OD 0x0eb000 thru 0x0f3fff (0x9000 bytes) All operations completed A-OK! PASS 16a (26s) == sanityn test 16b: 500 iterations of dual-mount fsx at small size ========================================================== 18:52:39 (1736985159) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.145389 s, 14.4 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.165876 s, 12.6 MB/s Chance of close/open is 1 in 50 Seed set to 5160 fd 0: /mnt/lustre/f16b.sanityn fd 1: /mnt/lustre2/f16b.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x6baad9 000002[0] 1736985160.344894 trunc from 00000000 to 0x6baad8 (0x6baad9 bytes) 000005[1] 1736985160.367271 mapread 0x05a721 thru 0x05bae6 (0x13c6 bytes) 000007[0] 1736985160.395558 write 0x3d78f2 thru 0x3d7a5c (0x16b bytes) 000008[1] 1736985160.398359 write 0x703010 thru 0x703f4e (0xf3f bytes) 000012[1] 1736985160.415685 mapwrite 0x29715e thru 0x2979bf (0x862 bytes) 000013[0] 1736985160.492620 mapwrite 0x639e6c thru 0x63a0e0 (0x275 bytes) 000014[0] 1736985160.574461 trunc from 0x703f4f to 0x4751c2 (0x28ed8c bytes) 000017[1] 1736985160.604364 mapread 0x319a49 thru 0x31a037 (0x5ef bytes) truncating to largest ever: 0x9a727a 000020[0] 1736985160.647093 trunc from 0x4751c3 to 0x9a7279 (0x5320b7 bytes) 000021[0] 1736985160.677958 read 0x85f4ef thru 0x85f809 (0x31b bytes) 000023[1] 1736985160.703359 read 0x2e0d52 thru 0x2e262a (0x18d9 bytes) 000028[1] 1736985160.744170 trunc from 0x9a727a to 0x2731b3 (0x7340c6 bytes) 000031[0] 1736985160.780376 write 0x62edd1 thru 0x62fb7f (0xdaf bytes) 000032[0] 1736985160.798005 write 0x93e068 thru 0x93f596 (0x152f bytes) 000033[1] 1736985160.812886 read 0x6f6af5 thru 0x6f7dc1 (0x12cd bytes) 000034[1] 1736985160.828610 write 0x938a4f thru 0x93a9f3 (0x1fa5 bytes) 000035[1] 1736985160.870862 trunc from 0x93f597 to 0x288090 (0x6b7506 bytes) 000036[1] 1736985160.902778 mapwrite 0x16a7ae thru 0x16b142 (0x995 bytes) 000038[0] 1736985160.952617 mapwrite 0x3f5e45 thru 0x3f605c (0x218 bytes) 000040[1] 1736985161.032363 trunc from 0x3f605d to 0x6b4957 (0x2be8fb bytes) 000042[1] 1736985161.073729 trunc from 0x6b4958 to 0x68d413 (0x27544 bytes) 000043[0] 1736985161.091764 write 0x85a3a9 thru 0x85ada6 (0x9fe bytes) 000046[0] 1736985161.137812 write 0x7e6c55 thru 0x7e8973 (0x1d1f bytes) 000047[1] 1736985161.160236 trunc from 0x85ada7 to 0x353d8a (0x50701c bytes) 000048[0] 1736985161.199883 write 0x7eab47 thru 0x7eaff4 (0x4ae bytes) 000051[0] 1736985161.230732 mapwrite 0x48fc69 thru 0x4911ed (0x1585 bytes) 000052[1] 1736985161.272426 mapread 0x11eb9d thru 0x11fac2 (0xf26 bytes) 000056[0] 1736985161.308810 write 0x1a2c74 thru 0x1a4aad (0x1e3a bytes) 000057[1] 1736985161.328532 read 0x5b1015 thru 0x5b17d9 (0x7c5 bytes) 000060[1] 1736985161.360374 mapread 0x75c64a thru 0x75d2bf (0xc76 bytes) 000062[1] 1736985161.372638 read 0x00c342 thru 0x00cdc4 (0xa83 bytes) 000063[0] 1736985161.409450 read 0x74a2d0 thru 0x74b6d2 (0x1403 bytes) 000066[1] 1736985161.420213 mapwrite 0x1dac24 thru 0x1dbb3c (0xf19 bytes) 000067[0] 1736985161.490069 mapread 0x03a3eb thru 0x03ab02 (0x718 bytes) 000069[1] 1736985161.505760 trunc from 0x7eaff5 to 0x7bf8ac (0x2b748 bytes) 000070[1] 1736985161.523155 mapwrite 0x6316ce thru 0x6323eb (0xd1e bytes) 000071[1] 1736985161.572885 write 0x63fcaa thru 0x6419d4 (0x1d2b bytes) 000073[1] 1736985161.596715 mapread 0x74e606 thru 0x74fcdc (0x16d7 bytes) 000075[0] 1736985161.612240 write 0x404e0c thru 0x405fd1 (0x11c6 bytes) 000077[0] 1736985161.643633 read 0x43a500 thru 0x43c36e (0x1e6f bytes) 000079[0] 1736985161.678759 trunc from 0x7bf8ad to 0x155cdb (0x669bd1 bytes) 000080[0] 1736985161.706362 trunc from 0x155cdc to 0x3d4bfb (0x27ef20 bytes) 000083[1] 1736985161.744370 write 0x362f67 thru 0x36468d (0x1727 bytes) 000084[0] 1736985161.762361 write 0x4ef3a9 thru 0x4efc25 (0x87d bytes) 000085[1] 1736985161.771251 mapread 0x298e2d thru 0x29ae27 (0x1ffb bytes) 000086[1] 1736985161.793598 write 0x7b11d1 thru 0x7b26a4 (0x14d4 bytes) 000087[1] 1736985161.803131 read 0x636d7a thru 0x6375b5 (0x83c bytes) 000089[1] 1736985161.830228 mapwrite 0x006858 thru 0x007bc7 (0x1370 bytes) 000090[1] 1736985161.890697 mapwrite 0x751734 thru 0x751c27 (0x4f4 bytes) 000094[0] 1736985161.957137 read 0x607842 thru 0x608bcb (0x138a bytes) 000099[1] 1736985161.995825 read 0x1746fa thru 0x1755bf (0xec6 bytes) 000102[0] 1736985162.035017 mapwrite 0x242f7e thru 0x244e28 (0x1eab bytes) 000105[1] 1736985162.137571 trunc from 0x7b26a5 to 0x445167 (0x36d53d bytes) 000106[0] 1736985162.164248 mapwrite 0x24272c thru 0x2437b5 (0x108a bytes) 000109[0] 1736985162.242635 mapwrite 0x20ec78 thru 0x20f2f2 (0x67b bytes) 000110[0] 1736985162.293933 mapread 0x11f1e3 thru 0x1207cb (0x15e9 bytes) 000111[0] 1736985162.315227 mapwrite 0x934c45 thru 0x93631b (0x16d7 bytes) 000114[0] 1736985162.398456 mapwrite 0x73b54d thru 0x73d006 (0x1aba bytes) 000115[0] 1736985162.426432 write 0x097dc1 thru 0x098210 (0x450 bytes) 000116[1] 1736985162.430709 mapwrite 0x573a7a thru 0x574a4b (0xfd2 bytes) 000117[1] 1736985162.489194 trunc from 0x93631c to 0x53cb0e (0x3f980d bytes) 000122[0] 1736985162.537810 trunc from 0x53cb0f to 0x81a3e3 (0x2dd8d5 bytes) 000123[1] 1736985162.557826 write 0x8f2d21 thru 0x8f306b (0x34b bytes) 000127[0] 1736985162.596036 mapread 0x7f8655 thru 0x7f90eb (0xa97 bytes) 000128[0] 1736985162.609732 write 0x16edb6 thru 0x170676 (0x18c1 bytes) 000130[0] 1736985162.630419 read 0x29ff76 thru 0x2a0628 (0x6b3 bytes) 000132[1] 1736985162.690740 trunc from 0x8f306c to 0x78dc97 (0x1653d4 bytes) 000134[1] 1736985162.724441 trunc from 0x78dc98 to 0x03d49e (0x7507f9 bytes) 000136[1] 1736985162.732528 write 0x74b773 thru 0x74bf1a (0x7a8 bytes) 000140[1] 1736985162.747230 write 0x9e08ad thru 0x9e1024 (0x778 bytes) 000141[0] 1736985162.749432 read 0x83c88a thru 0x83de12 (0x1589 bytes) 000142[1] 1736985162.768618 trunc from 0x9e1025 to 0x85eefa (0x18212a bytes) 000143[0] 1736985162.786080 write 0x8f19d0 thru 0x8f1b41 (0x172 bytes) 000144[0] 1736985162.800147 mapwrite 0x66907a thru 0x66aaac (0x1a33 bytes) 000146[0] 1736985162.870979 trunc from 0x8f1b42 to 0x8bc0d4 (0x35a6d bytes) 000147[0] 1736985162.887949 trunc from 0x8bc0d5 to 0x567c3c (0x354498 bytes) 000148[1] 1736985162.904682 mapwrite 0x3fc094 thru 0x3fcfe7 (0xf54 bytes) 000149[0] 1736985162.966446 trunc from 0x567c3d to 0x35ed8f (0x208ead bytes) 000150[0] 1736985162.981451 mapwrite 0x3fdbd3 thru 0x3fe266 (0x694 bytes) 000152[0] 1736985163.046716 trunc from 0x3fe267 to 0x3087cb (0xf5a9b bytes) 000154[1] 1736985163.078701 write 0x799df7 thru 0x79a928 (0xb32 bytes) 000155[0] 1736985163.095637 mapwrite 0x614f28 thru 0x616b56 (0x1c2f bytes) 000156[0] 1736985163.171208 mapwrite 0x6d1300 thru 0x6d1fde (0xcdf bytes) 000158[1] 1736985163.230787 write 0x318d8e thru 0x31a89e (0x1b11 bytes) 000159[1] 1736985163.246589 mapwrite 0x890cb4 thru 0x8920b2 (0x13ff bytes) 000162[1] 1736985163.341723 mapread 0x80227f thru 0x803a91 (0x1813 bytes) 000163[0] 1736985163.345483 mapwrite 0x26ecdf thru 0x26efa9 (0x2cb bytes) 000165[1] 1736985163.410125 write 0x0a23f5 thru 0x0a3982 (0x158e bytes) 000166[1] 1736985163.420190 read 0x35b45b thru 0x35bf8a (0xb30 bytes) 000167[0] 1736985163.468448 mapread 0x636661 thru 0x637bde (0x157e bytes) 000169[1] 1736985163.502745 write 0x781dbe thru 0x782e98 (0x10db bytes) 000170[0] 1736985163.503223 mapread 0x78ecf6 thru 0x78f16a (0x475 bytes) 000171[0] 1736985163.527272 trunc from 0x8920b3 to 0x5dc1d6 (0x2b5edc bytes) 000173[1] 1736985163.556463 read 0x14ecf7 thru 0x15012a (0x1434 bytes) 000176[1] 1736985163.578565 read 0x416f8f thru 0x418724 (0x1796 bytes) 000177[1] 1736985163.610666 mapread 0x510c17 thru 0x51290a (0x1cf4 bytes) 000178[1] 1736985163.611716 mapread 0x447933 thru 0x448b1b (0x11e9 bytes) 000179[0] 1736985163.612085 mapread 0x403cd4 thru 0x403e38 (0x165 bytes) 000180[1] 1736985163.614628 write 0x82839c thru 0x829d35 (0x199a bytes) 000181[1] 1736985163.624587 trunc from 0x829d36 to 0x4f8ca7 (0x33108e bytes) 000185[0] 1736985163.659371 mapread 0x372f07 thru 0x374751 (0x184b bytes) 000186[0] 1736985163.682407 read 0x42ece0 thru 0x43081d (0x1b3e bytes) 000188[1] 1736985163.709186 write 0x26e05e thru 0x26f348 (0x12eb bytes) 000190[1] 1736985163.739968 mapread 0x072976 thru 0x0743f8 (0x1a83 bytes) 000194[0] 1736985163.762735 trunc from 0x4f8ca8 to 0x7888b3 (0x28fc0c bytes) 000198[1] 1736985163.813599 read 0x206af2 thru 0x20853b (0x1a4a bytes) 000199[1] 1736985163.841996 read 0x546354 thru 0x5463cd (0x7a bytes) 000202[1] 1736985163.874380 write 0x37bdd3 thru 0x37c729 (0x957 bytes) 000203[1] 1736985163.890737 write 0x29427e thru 0x2944bc (0x23f bytes) 000208[1] 1736985163.910213 write 0x5b2940 thru 0x5b4606 (0x1cc7 bytes) 000211[0] 1736985163.937826 mapread 0x3fea14 thru 0x3ff1ba (0x7a7 bytes) 000212[1] 1736985163.978928 write 0x8f426f thru 0x8f5d82 (0x1b14 bytes) 000214[1] 1736985164.001092 mapwrite 0x4c6ccd thru 0x4c892b (0x1c5f bytes) 000215[1] 1736985164.070049 trunc from 0x8f5d83 to 0x8799da (0x7c3a8 bytes) 000216[1] 1736985164.094469 mapwrite 0x129b60 thru 0x12ba56 (0x1ef7 bytes) 000219[0] 1736985164.142619 trunc from 0x8799db to 0x4e262f (0x3973ab bytes) 000220[0] 1736985164.160679 read 0x2c7d0f thru 0x2c989c (0x1b8e bytes) 000221[0] 1736985164.183942 trunc from 0x4e2630 to 0x1a2b05 (0x33fb2a bytes) 000223[0] 1736985164.197702 write 0x06d1f0 thru 0x06ebc5 (0x19d6 bytes) 000224[1] 1736985164.203483 write 0x0e0334 thru 0x0e082c (0x4f9 bytes) 000225[0] 1736985164.229897 write 0x5bb45f thru 0x5bba0d (0x5af bytes) 000226[0] 1736985164.240375 trunc from 0x5bba0e to 0x241474 (0x37a599 bytes) 000227[1] 1736985164.269573 trunc from 0x241475 to 0x6f0b4f (0x4af6db bytes) 000228[0] 1736985164.298455 read 0x0af447 thru 0x0affbe (0xb78 bytes) 000230[1] 1736985164.323099 mapread 0x65f1a0 thru 0x6610cf (0x1f30 bytes) 000233[0] 1736985164.349559 mapwrite 0x53b9f0 thru 0x53bddb (0x3ec bytes) 000234[1] 1736985164.441436 trunc from 0x6f0b50 to 0x4da9fa (0x216155 bytes) 000236[0] 1736985164.461646 write 0x75b4f6 thru 0x75ca38 (0x1543 bytes) 000238[1] 1736985164.479834 write 0x5142f9 thru 0x515c2c (0x1934 bytes) 000244[1] 1736985164.506388 read 0x455aa8 thru 0x4567a4 (0xcfd bytes) 000245[1] 1736985164.532547 write 0x7af4a1 thru 0x7b0d05 (0x1865 bytes) 000248[0] 1736985164.550808 mapwrite 0x59ff13 thru 0x5a01d6 (0x2c4 bytes) 000249[0] 1736985164.607107 mapread 0x5700bf thru 0x571e81 (0x1dc3 bytes) 000251[1] 1736985164.628881 read 0x391a1a thru 0x3930f4 (0x16db bytes) 000252[1] 1736985164.656656 trunc from 0x7b0d06 to 0x0a8113 (0x708bf2 bytes) 000253[0] 1736985164.687178 write 0x48e44f thru 0x48e81e (0x3d0 bytes) 000254[1] 1736985164.701858 read 0x1a707d thru 0x1a8385 (0x1309 bytes) 000255[1] 1736985164.714434 write 0x703b25 thru 0x705023 (0x14ff bytes) 000256[0] 1736985164.721693 mapwrite 0x632ca6 thru 0x634bae (0x1f09 bytes) 000257[0] 1736985164.806362 read 0x0ebe93 thru 0x0edc0d (0x1d7b bytes) 000258[0] 1736985164.818113 trunc from 0x705024 to 0x31088a (0x3f4799 bytes) 000259[0] 1736985164.839490 mapwrite 0x2a2f03 thru 0x2a499b (0x1a99 bytes) 000261[0] 1736985164.908984 mapwrite 0x982a5e thru 0x983fee (0x1591 bytes) 000262[0] 1736985164.960100 mapread 0x410ae9 thru 0x411de1 (0x12f9 bytes) 000263[1] 1736985164.973491 trunc from 0x983fef to 0x72df4d (0x2560a1 bytes) 000265[0] 1736985165.005092 mapread 0x1f4ca2 thru 0x1f6b0f (0x1e6e bytes) 000267[1] 1736985165.021135 read 0x5437f1 thru 0x544ee5 (0x16f5 bytes) 000268[0] 1736985165.050605 write 0x88c6a4 thru 0x88cb2f (0x48c bytes) 000269[0] 1736985165.064165 trunc from 0x88cb30 to 0x53e20b (0x34e924 bytes) 000271[0] 1736985165.075587 trunc from 0x53e20c to 0x8fffed (0x3c1de2 bytes) 000272[1] 1736985165.083429 mapwrite 0x49cb54 thru 0x49e989 (0x1e36 bytes) 000273[1] 1736985165.136759 read 0x46b92b thru 0x46d0bc (0x1792 bytes) 000275[0] 1736985165.162304 trunc from 0x8fffee to 0x8e582e (0x1a7bf bytes) 000279[0] 1736985165.214209 write 0x768108 thru 0x76a0a1 (0x1f9a bytes) 000282[1] 1736985165.239702 write 0x23dd94 thru 0x23e673 (0x8e0 bytes) 000285[0] 1736985165.268639 mapread 0x1709be thru 0x1713b6 (0x9f9 bytes) 000286[0] 1736985165.283071 read 0x7a8f97 thru 0x7a9fa9 (0x1013 bytes) 000288[1] 1736985165.302886 write 0x3ea786 thru 0x3eb9ae (0x1229 bytes) 000289[1] 1736985165.337791 read 0x8bde6e thru 0x8becaa (0xe3d bytes) 000290[1] 1736985165.348471 write 0x6f61e8 thru 0x6f7407 (0x1220 bytes) 000291[0] 1736985165.349044 read 0x05a8fe thru 0x05afdf (0x6e2 bytes) 000293[0] 1736985165.391953 mapread 0x0b78bc thru 0x0b8f28 (0x166d bytes) 000294[0] 1736985165.400573 write 0x0d8c0f thru 0x0d9e41 (0x1233 bytes) 000295[0] 1736985165.417007 write 0x81f4ac thru 0x820e0a (0x195f bytes) 000297[0] 1736985165.435706 trunc from 0x8e582f to 0x17b8ef (0x769f3f bytes) 000298[1] 1736985165.456505 read 0x0861bc thru 0x0880ce (0x1f13 bytes) 000299[1] 1736985165.471430 mapread 0x094b97 thru 0x09615d (0x15c7 bytes) 000300[1] 1736985165.474898 mapwrite 0x9e8563 thru 0x9e9f49 (0x19e7 bytes) 000301[1] 1736985165.538438 trunc from 0x9e9f4a to 0x1c6afb (0x82344e bytes) 000302[0] 1736985165.545513 mapread 0x16e7ef thru 0x16ea11 (0x223 bytes) 000304[1] 1736985165.572431 trunc from 0x1c6afc to 0x857583 (0x690a88 bytes) 000305[0] 1736985165.587890 trunc from 0x857584 to 0x81e867 (0x38d1c bytes) 000306[1] 1736985165.602027 trunc from 0x81e868 to 0x15cc2a (0x6c1c3d bytes) 000307[1] 1736985165.616265 mapread 0x0b151b thru 0x0b21f9 (0xcdf bytes) 000309[0] 1736985165.628506 mapwrite 0x43ff88 thru 0x440ba3 (0xc1c bytes) 000310[1] 1736985165.696935 mapread 0x3fdc14 thru 0x3ffbcb (0x1fb8 bytes) 000312[1] 1736985165.730764 write 0x808300 thru 0x808ea4 (0xba5 bytes) 000313[1] 1736985165.737460 write 0x2e3a04 thru 0x2e51d5 (0x17d2 bytes) 000314[1] 1736985165.749216 mapread 0x3a92fc thru 0x3ab1cf (0x1ed4 bytes) 000316[0] 1736985165.766486 mapwrite 0x89f1e8 thru 0x8a0e47 (0x1c60 bytes) 000317[0] 1736985165.845131 mapread 0x06b27a thru 0x06b844 (0x5cb bytes) 000319[1] 1736985165.849859 mapread 0x093d88 thru 0x0955eb (0x1864 bytes) 000321[1] 1736985165.874649 trunc from 0x8a0e48 to 0x78a980 (0x1164c7 bytes) 000325[1] 1736985165.907307 mapwrite 0x96c08f thru 0x96dad3 (0x1a45 bytes) 000327[0] 1736985165.955136 write 0x14e1ba thru 0x14fd03 (0x1b4a bytes) 000329[1] 1736985165.986133 mapwrite 0x125365 thru 0x1263af (0x104b bytes) 000336[1] 1736985166.045271 read 0x37ac82 thru 0x37ca4a (0x1dc9 bytes) 000337[0] 1736985166.098117 trunc from 0x96dad4 to 0x40461a (0x5694b9 bytes) 000338[1] 1736985166.123010 write 0x9ea7a8 thru 0x9ead46 (0x59f bytes) 000339[0] 1736985166.145734 write 0x778fd6 thru 0x779a2f (0xa5a bytes) 000343[0] 1736985166.164049 write 0x23243e thru 0x234355 (0x1f18 bytes) 000346[0] 1736985166.191545 mapread 0x5d99f0 thru 0x5da67a (0xc8b bytes) 000347[0] 1736985166.207468 write 0x0e29dc thru 0x0e3d56 (0x137b bytes) 000348[0] 1736985166.213581 mapwrite 0x331c5c thru 0x333319 (0x16be bytes) 000349[1] 1736985166.274071 mapread 0x7950a7 thru 0x79605d (0xfb7 bytes) 000351[0] 1736985166.305660 mapread 0x77465d thru 0x7758ee (0x1292 bytes) 000353[1] 1736985166.313733 mapwrite 0x987e38 thru 0x988013 (0x1dc bytes) 000359[0] 1736985166.424739 trunc from 0x9ead47 to 0x15f1c7 (0x88bb7f bytes) 000360[1] 1736985166.442273 mapwrite 0x98919b thru 0x9897bc (0x622 bytes) 000361[1] 1736985166.537706 read 0x694cfa thru 0x695104 (0x40b bytes) 000364[0] 1736985166.583170 read 0x3782e8 thru 0x3791b8 (0xed1 bytes) 000366[0] 1736985166.614202 mapwrite 0x32db6b thru 0x32f398 (0x182e bytes) 000369[1] 1736985166.710757 mapread 0x627b84 thru 0x628818 (0xc95 bytes) 000370[1] 1736985166.738676 mapread 0x2a3212 thru 0x2a51b6 (0x1fa5 bytes) 000373[0] 1736985166.784516 trunc from 0x9897bd to 0x8cb309 (0xbe4b3 bytes) 000374[1] 1736985166.805128 mapread 0x394808 thru 0x396504 (0x1cfd bytes) 000376[0] 1736985166.831275 mapread 0x51f28c thru 0x51f963 (0x6d8 bytes) 000378[1] 1736985166.877446 write 0x616e1f thru 0x616f4c (0x12e bytes) 000379[0] 1736985166.902807 read 0x60994c thru 0x609cfe (0x3b3 bytes) 000381[0] 1736985166.934659 write 0x3a9cb8 thru 0x3a9d10 (0x59 bytes) 000382[1] 1736985166.945845 mapread 0x4f0220 thru 0x4f1aea (0x18cb bytes) 000383[0] 1736985166.956942 trunc from 0x8cb30a to 0x426816 (0x4a4af3 bytes) 000384[1] 1736985166.982917 read 0x2fb221 thru 0x2fc87c (0x165c bytes) 000385[0] 1736985167.006109 mapread 0x240af0 thru 0x24230a (0x181b bytes) 000387[1] 1736985167.043007 mapwrite 0x899f1e thru 0x89b256 (0x1339 bytes) 000388[0] 1736985167.186476 read 0x7b97c5 thru 0x7bb262 (0x1a9e bytes) 000390[0] 1736985167.213088 write 0x2a3feb thru 0x2a4372 (0x388 bytes) 000391[1] 1736985167.243090 mapwrite 0x0c2dbd thru 0x0c3141 (0x385 bytes) 000392[0] 1736985167.319205 read 0x2b0f97 thru 0x2b2132 (0x119c bytes) 000397[0] 1736985167.371826 trunc from 0x89b257 to 0x943ebc (0xa8c66 bytes) 000398[1] 1736985167.416491 read 0x8835c8 thru 0x885510 (0x1f49 bytes) 000400[0] 1736985167.444097 mapread 0x7e985b thru 0x7eac89 (0x142f bytes) 000403[0] 1736985167.479901 read 0x9360a4 thru 0x936fcc (0xf29 bytes) 000409[1] 1736985167.510833 mapwrite 0x897b1f thru 0x899296 (0x1778 bytes) 000412[0] 1736985167.627397 mapwrite 0x098de1 thru 0x099d75 (0xf95 bytes) 000415[1] 1736985167.704559 trunc from 0x943ebd to 0x182e11 (0x7c10ab bytes) 000416[0] 1736985167.742708 mapread 0x15c01f thru 0x15d513 (0x14f5 bytes) 000417[1] 1736985167.760745 mapwrite 0x7e784c thru 0x7e7d77 (0x52c bytes) 000418[0] 1736985167.815449 mapwrite 0x210ad2 thru 0x2110b8 (0x5e7 bytes) 000419[1] 1736985167.884879 read 0x5432af thru 0x543b1d (0x86f bytes) 000420[0] 1736985167.914556 write 0x45daa8 thru 0x45f9ed (0x1f46 bytes) 000421[0] 1736985167.938464 trunc from 0x7e7d78 to 0x18b1a5 (0x65cbd2 bytes) 000422[1] 1736985167.965527 mapread 0x0c101c thru 0x0c1a36 (0xa1b bytes) 000423[1] 1736985167.993551 mapwrite 0x95f1f8 thru 0x9602f8 (0x1101 bytes) 000425[0] 1736985168.129082 read 0x1d1d55 thru 0x1d3950 (0x1bfc bytes) 000426[0] 1736985168.141839 trunc from 0x9602f9 to 0x6e81fa (0x2780fe bytes) 000427[1] 1736985168.169839 read 0x5fc1f8 thru 0x5fd13e (0xf47 bytes) 000428[1] 1736985168.180118 mapread 0x01f29b thru 0x01fe57 (0xbbd bytes) 000429[1] 1736985168.206371 mapwrite 0x12de4b thru 0x12e140 (0x2f6 bytes) 000430[0] 1736985168.267027 read 0x4880fd thru 0x488efe (0xe02 bytes) 000431[1] 1736985168.276928 read 0x05c789 thru 0x05d709 (0xf81 bytes) 000432[1] 1736985168.321503 read 0x01ec42 thru 0x01fb36 (0xef5 bytes) 000434[1] 1736985168.328662 read 0x05f016 thru 0x05fb7e (0xb69 bytes) 000436[1] 1736985168.338493 mapread 0x1867b2 thru 0x187fb5 (0x1804 bytes) 000440[1] 1736985168.351919 mapread 0x0d5f7f thru 0x0d66e4 (0x766 bytes) 000441[1] 1736985168.352404 write 0x081f44 thru 0x082593 (0x650 bytes) 000442[1] 1736985168.374487 read 0x08719c thru 0x088549 (0x13ae bytes) 000443[0] 1736985168.408053 trunc from 0x6e81fb to 0x2db589 (0x40cc71 bytes) 000445[1] 1736985168.436067 mapread 0x08c73c thru 0x08cc9f (0x564 bytes) 000446[0] 1736985168.458041 read 0x2d3208 thru 0x2d3ff6 (0xdef bytes) 000447[0] 1736985168.471670 trunc from 0x2db58a to 0x045984 (0x295c05 bytes) 000448[0] 1736985168.494190 trunc from 0x045985 to 0x6ac53c (0x666bb8 bytes) 000450[0] 1736985168.519359 mapread 0x0a8cca thru 0x0aa3be (0x16f5 bytes) 000451[1] 1736985168.558876 read 0x4ca9a6 thru 0x4cb89c (0xef7 bytes) 000452[0] 1736985168.578988 mapread 0x4684cd thru 0x4694d3 (0x1007 bytes) 000453[0] 1736985168.600271 mapread 0x64f05d thru 0x64f73e (0x6e2 bytes) 000454[0] 1736985168.602964 mapwrite 0x331931 thru 0x332a54 (0x1124 bytes) 000458[0] 1736985168.655050 read 0x0fa980 thru 0x0faa20 (0xa1 bytes) 000461[1] 1736985168.691493 read 0x41b7cf thru 0x41b930 (0x162 bytes) 000462[0] 1736985168.703000 mapread 0x3b9ab7 thru 0x3ba1df (0x729 bytes) 000463[1] 1736985168.705397 mapread 0x561b78 thru 0x561eef (0x378 bytes) 000467[0] 1736985168.741307 read 0x592cb6 thru 0x593951 (0xc9c bytes) 000470[0] 1736985168.751013 mapread 0x20b320 thru 0x20b9c9 (0x6aa bytes) 000471[1] 1736985168.751461 write 0x753072 thru 0x75392e (0x8bd bytes) 000472[0] 1736985168.765994 read 0x1690f7 thru 0x169109 (0x13 bytes) 000473[0] 1736985168.801414 mapread 0x74c19a thru 0x74d22f (0x1096 bytes) 000474[1] 1736985168.809364 trunc from 0x75392f to 0x3c6a75 (0x38ceb9 bytes) 000475[1] 1736985168.844925 mapread 0x103f28 thru 0x1047c2 (0x89b bytes) 000477[0] 1736985168.867686 mapwrite 0x78ed64 thru 0x78fde2 (0x107f bytes) 000478[1] 1736985168.943861 trunc from 0x78fde3 to 0x7df314 (0x4f532 bytes) 000481[0] 1736985168.978302 trunc from 0x7df315 to 0x8c56bc (0xe63a8 bytes) 000482[1] 1736985169.020461 read 0x66de9b thru 0x66e906 (0xa6c bytes) 000483[1] 1736985169.045252 trunc from 0x8c56bd to 0x2e24bd (0x5e31ff bytes) 000484[0] 1736985169.073625 trunc from 0x2e24be to 0x1a9662 (0x138e5b bytes) 000486[0] 1736985169.095553 write 0x790ce7 thru 0x79177a (0xa94 bytes) 000489[1] 1736985169.117044 mapwrite 0x0d4f43 thru 0x0d51de (0x29c bytes) 000490[0] 1736985169.174907 mapwrite 0x29463a thru 0x29626b (0x1c32 bytes) 000493[0] 1736985169.225390 mapwrite 0x3a3209 thru 0x3a46e2 (0x14da bytes) 000495[0] 1736985169.268744 mapread 0x411859 thru 0x411bfb (0x3a3 bytes) 000496[0] 1736985169.280662 mapread 0x263004 thru 0x2633e3 (0x3e0 bytes) 000497[1] 1736985169.282874 mapread 0x1378f9 thru 0x138442 (0xb4a bytes) 000499[1] 1736985169.318975 trunc from 0x79177b to 0x6e0e37 (0xb0943 bytes) 000500[1] 1736985169.361490 read 0x29990c thru 0x29a14e (0x843 bytes) All operations completed A-OK! PASS 16b (12s) == sanityn test 16c: verify data consistency on ldiskfs with cache disabled (b=17397) ========================================================== 18:52:51 (1736985171) SKIP: sanityn test_16c dio on ldiskfs only SKIP 16c (1s) == sanityn test 16d: Verify DIO and buffer IO with two clients ========================================================== 18:52:52 (1736985172) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.158417 s, 13.2 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.121163 s, 17.3 MB/s ldlm.namespaces.MGC192.168.201.137@tcp.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8800a9f48800.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6d0d800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8800a9f48800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d0d800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8800a9f48800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d0d800.lru_size=clear 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.24965 s, 20.0 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.35596 s, 77.3 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.83436 s, 126 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 2.40373 s, 43.6 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.07835 s, 25.7 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.04684 s, 100 MB/s PASS 16d (19s) == sanityn test 16e: Verify size consistency for O_DIRECT write ========================================================== 18:53:12 (1736985192) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0856028 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0592626 s, 17.7 MB/s PASS 16e (3s) == sanityn test 16f: rw sequential consistency vs drop_caches ========================================================== 18:53:14 (1736985194) TIMEOUT PASS 16f (22s) == sanityn test 16g: mmap rw sequential consistency vs drop_caches ========================================================== 18:53:36 (1736985216) TIMEOUT PASS 16g (23s) == sanityn test 16i: read after truncate file ============ 18:53:59 (1736985239) ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16i (2s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 18:54:01 (1736985241) fail_loc=0x8000030a PASS 17 (4s) == sanityn test 18: mmap sanity check =========================================================================================== 18:54:06 (1736985246) mmap test1: basic mmap operation (PASS, 0.025663s) mmap test2: MAP_PRIVATE not write back (PASS, 0.020383s) mmap test3: concurrent mmap ops on two nodes (PASS, 7.031s) mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 2.1187s) mmap test5: read/write file to/from the buffer which mmapped to just this file (PASS, 0.050428s) mmap test6: check mmap write/read content on two nodes (PASS, 0.054796s) mmap test7: file i/o with an unmapped buffer (SKIPPED, 0s) mmap test8: SIGBUS for beyond file size (SKIPPED, 0s) mmap test9: SIGBUS for negative file offset (SKIPPED, 0s) mmap test10: mtime not change for readonly mmap access (PASS, 1.0242s) PASS 18 (13s) == sanityn test 19: test concurrent uncached read races ========================================================================= 18:54:19 (1736985259) oleg137-server: error: get_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory pdsh@oleg137-client: oleg137-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (2s) == sanityn test 20: test extra readahead page left in cache ============================================================== 18:54:21 (1736985261) PASS 20 (2s) == sanityn test 21: Try to remove mountpoint on another dir ============================================================== 18:54:23 (1736985263) rmdir: removing directory, '/mnt/lustre/d21.sanityn' rmdir: failed to remove '/mnt/lustre/d21.sanityn': Device or resource busy rmdir: removing directory, '/mnt/lustre2/d21.sanityn' Removed mounted directory from another mountpoint, needs to be fixed PASS 21 (1s) == sanityn test 23: others should see updated atime while another read============================================================== 18:54:25 (1736985265) now is 1736985265 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.6857 new atime is 1736985326 PASS 23 (63s) == sanityn test 24a: lfs df [-ih] [path] test =================================================================================== 18:55:28 (1736985328) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 7168 3762176 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 13312 7525376 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 7168 3762176 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 13312 7525376 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.5K 368 488.1K 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 115.2K 376 114.9K 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 115.3K 373 114.9K 1% /mnt/lustre[OST:1] filesystem_summary: 230.1K 368 229.8K 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.5K 368 488.1K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.2K 376 114.9K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 115.3K 373 114.9K 1% /mnt/lustre2[OST:1] filesystem_summary: 230.1K 368 229.8K 1% /mnt/lustre2 UUID bytes Used Available Use% Mounted on lustre-MDT0000_UUID 2.1G 3.2M 2.1G 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3.6G 7.0M 3.6G 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3.6G 6.0M 3.6G 1% /mnt/lustre[OST:1] filesystem_summary: 7.2G 13.0M 7.2G 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500203 368 499835 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118008 376 117632 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 118037 373 117664 1% /mnt/lustre2[OST:1] filesystem_summary: 235664 368 235296 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 7168 3762176 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 13312 7525376 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.5K 368 488.1K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.2K 376 114.9K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 115.3K 373 114.9K 1% /mnt/lustre2[OST:1] filesystem_summary: 230.1K 368 229.8K 1% /mnt/lustre2 No device found for name osc: Invalid argument UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500203 368 499835 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 118008 376 117632 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 118037 373 117664 1% /mnt/lustre[OST:1] filesystem_summary: 235664 368 235296 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500203 368 499835 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118008 376 117632 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 118037 373 117664 1% /mnt/lustre2[OST:1] filesystem_summary: 235664 368 235296 1% /mnt/lustre2 No device found for name osc: Invalid argument UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 7168 3762176 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 13312 7525376 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 7168 3762176 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 13312 7525376 1% /mnt/lustre2 PASS 24a (2s) == sanityn test 24b: lfs df should show both filesystems ========================================================================= 18:55:30 (1736985330) PASS 24b (2s) == sanityn test 25a: change ACL on one mountpoint be seen on another ============================================================= 18:55:32 (1736985332) running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] PASS 25a (2s) == sanityn test 25b: change ACL under remote dir on one mountpoint be seen on another ========================================================== 18:55:34 (1736985334) SKIP: sanityn test_25b needs >= 2 MDTs SKIP 25b (1s) == sanityn test 26a: allow mtime to get older ============ 18:55:35 (1736985335) utime: good mknod times 1736985334 <= 1736985335 <= 1736985335 for /mnt/lustre/f26a utime: good mknod times 1736985334 <= 1736985335 <= 1736985335 for /mnt/lustre2/f26a utime: good utime mtimes 100000, atime 200000 utime: updated times for /mnt/lustre2/f26a PASS 26a (3s) == sanityn test 26b: sync mtime between ost and mds ====== 18:55:38 (1736985338) PASS 26b (5s) SKIP: sanityn test_27 skipping excluded test 27 SKIP: sanityn test_28 skipping ALWAYS excluded test 28 == sanityn test 30: recreate file race =================== 18:55:44 (1736985344) 0 PASS 30 (4s) == sanityn test 31a: voluntary cancel / blocking ast race======================================================================== 18:55:48 (1736985348) fail_loc=0x314 PASS 31a (4s) == sanityn test 31b: voluntary OST cancel / blocking ast race======================================================================== 18:55:52 (1736985352) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg137-server mds-ost sync done. sleep 5 for ZFS zfs Waiting for MDT destroys to complete fail_loc=0x314 fail_loc=0x316 fail_loc=0 fail_loc=0 Filesystem 1K-blocks Used Available Use% Mounted on 192.168.201.137@tcp:/lustre 7542784 14336 7524352 1% /mnt/lustre2 PASS 31b (13s) == sanityn test 31r: open-rename(replace) race =========== 18:56:05 (1736985365) -rw-r--r-- 1 root root 0 Jan 15 18:56 /mnt/lustre/f31r.sanityn.target fail_loc=0x1419 fail_val=3 mv: failed to access '/mnt/lustre2/f31r.sanityn.target': Input/output error PASS 31r (5s) SKIP: sanityn test_33a skipping SLOW test 33a == sanityn test 33b: COS: cross create/delete, 2 clients, benchmark under remote dir ========================================================== 18:56:11 (1736985371) SKIP: sanityn test_33b Need two or more clients, have 1 SKIP 33b (1s) == sanityn test 33c: Cancel cross-MDT lock should trigger Sync-Lock-Cancel ========================================================== 18:56:12 (1736985372) SKIP: sanityn test_33c needs >= 2 MDTs SKIP 33c (1s) == sanityn test 33d: DNE distributed operation should trigger COS ========================================================== 18:56:14 (1736985374) SKIP: sanityn test_33d needs >= 2 MDTs SKIP 33d (1s) == sanityn test 33e: DNE local operation shouldn't trigger COS ========================================================== 18:56:15 (1736985375) SKIP: sanityn test_33e Need two or more clients, have 1 SKIP 33e (1s) == sanityn test 34: no lock timeout under IO ============= 18:56:16 (1736985376) fail_loc=0x512 fail_loc=0x512 lock should not expire writing on client1 reading on client2 success fail_loc=0x511 fail_loc=0x511 lock should expire writing on client1 reading on client2 success oleg137-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800a9f48800.ost_server_uuid,osc.lustre-OST0000-osc-ffff8800b6d0d800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff8800a9f48800.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0000-osc-ffff8800b6d0d800.ost_server_uuid in FULL state after 0 sec oleg137-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800a9f48800.ost_server_uuid,osc.lustre-OST0001-osc-ffff8800b6d0d800.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff8800a9f48800.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0001-osc-ffff8800b6d0d800.ost_server_uuid in FULL state after 0 sec oleg137-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800a9f48800.ost_server_uuid,osc.lustre-OST0000-osc-ffff8800b6d0d800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff8800a9f48800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0000-osc-ffff8800b6d0d800.ost_server_uuid in IDLE state after 0 sec oleg137-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800a9f48800.ost_server_uuid,osc.lustre-OST0001-osc-ffff8800b6d0d800.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff8800a9f48800.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0001-osc-ffff8800b6d0d800.ost_server_uuid in IDLE state after 0 sec oleg137-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800a9f48800.ost_server_uuid,osc.lustre-OST0000-osc-ffff8800b6d0d800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff8800a9f48800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0000-osc-ffff8800b6d0d800.ost_server_uuid in IDLE state after 0 sec oleg137-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800a9f48800.ost_server_uuid,osc.lustre-OST0001-osc-ffff8800b6d0d800.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff8800a9f48800.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0001-osc-ffff8800b6d0d800.ost_server_uuid in IDLE state after 0 sec PASS 34 (79s) == sanityn test 35: -EINTR cp_ast vs. bl_ast race does not evict client ========================================================== 18:57:35 (1736985455) fail_loc=0x80000317 Race attempt 0 Wait for 15505 15644 for 60 sec... - open/close 2029 (time 1736985467.86 total 10.00 last 202.88) - open/close 3963 (time 1736985477.86 total 20.00 last 193.39) total: 4000 open/close in 20.16 seconds: 198.38 ops/second fail_loc=0x0 Filesystem Size Used Avail Use% Mounted on 192.168.201.137@tcp:/lustre 7.2G 15M 7.2G 1% /mnt/lustre 192.168.201.137@tcp:/lustre 7.2G 15M 7.2G 1% /mnt/lustre2 PASS 35 (65s) == sanityn test 36: handle ESTALE/open-unlink correctly == 18:58:40 (1736985520) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg137-server mds-ost sync done. Waiting for MDT destroys to complete 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.365705 s, 143 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6857 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(0) *** before(7523328) after_dd(7470080) after(7521280) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.347828 s, 151 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6857 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(1) *** before(7521280) after_dd(7470080) after(7521280) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.383064 s, 137 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6857 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(2) *** before(7521280) after_dd(7468032) after(7519232) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.358489 s, 146 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6857 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(3) *** before(7519232) after_dd(7468032) after(7519232) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.369828 s, 142 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6857 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(4) *** before(7519232) after_dd(7470080) after(7521280) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.385552 s, 136 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6857 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(5) *** before(7521280) after_dd(7470080) after(7521280) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.306439 s, 171 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6857 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(6) *** before(7521280) after_dd(7472128) after(7523328) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.357643 s, 147 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6857 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(7) *** before(7523328) after_dd(7472128) after(7523328) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.331896 s, 158 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6857 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(8) *** before(7523328) after_dd(7472128) after(7523328) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.324887 s, 161 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6857 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(9) *** before(7523328) after_dd(7472128) after(7523328) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.304151 s, 172 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6857 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(10) *** before(7523328) after_dd(7472128) after(7523328) PASS 36 (229s) == sanityn test 37: check i_size is not updated for directory on close (bug 18695) ======================================================================== 19:02:29 (1736985749) multiop /mnt/lustre/d37.sanityn vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.6857 - create 6463 (time 1736985760.48 total 10.00 last 646.24) total: 10000 create in 14.97 seconds: 668.06 ops/second PASS 37 (18s) == sanityn test 39a: test from 11063 ============================================================================================ 19:02:47 (1736985767) repeat after cancel_lru_locks PASS 39a (1s) == sanityn test 39b: 11063 problem 1 ============================================================================================ 19:02:48 (1736985768) repeat after cancel_lru_locks PASS 39b (3s) == sanityn test 39c: check truncate mtime update ================================================================================ 19:02:51 (1736985771) repeat after cancel_lru_locks PASS 39c (3s) == sanityn test 39d: sync write should update mtime ====== 19:02:54 (1736985774) fail_loc=0x411 fail_loc=0 PASS 39d (1s) == sanityn test 40a: pdirops: create vs others ======================================================================== 19:02:55 (1736985775) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40a (8s) == sanityn test 40b: pdirops: open|create and others ======================================================================== 19:03:03 (1736985783) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40b (7s) == sanityn test 40c: pdirops: link and others ======================================================================== 19:03:10 (1736985790) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40c (7s) == sanityn test 40d: pdirops: unlink and others ======================================================================== 19:03:17 (1736985797) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40d (7s) == sanityn test 40e: pdirops: rename and others ======================================================================== 19:03:24 (1736985804) No conflict No conflict No conflict No conflict No conflict No conflict PASS 40e (7s) == sanityn test 41a: pdirops: create vs mkdir ======================================================================== 19:03:31 (1736985811) mkdir: cannot create directory '/mnt/lustre2/f41a.sanityn': File exists Conflict PASS 41a (4s) == sanityn test 41b: pdirops: create vs create ======================================================================== 19:03:35 (1736985815) open: File exists Conflict PASS 41b (5s) == sanityn test 41c: pdirops: create vs link ======================================================================== 19:03:40 (1736985820) link: cannot create link '/mnt/lustre2/f41c.sanityn' to '/mnt/lustre2/f41c.sanityn-2': File exists Conflict PASS 41c (4s) == sanityn test 41d: pdirops: create vs unlink ======================================================================== 19:03:44 (1736985824) Conflict PASS 41d (4s) == sanityn test 41e: pdirops: create and rename (tgt) ======================================================================== 19:03:48 (1736985828) Conflict PASS 41e (4s) == sanityn test 41f: pdirops: create and rename (src) ======================================================================== 19:03:52 (1736985832) Conflict PASS 41f (4s) == sanityn test 41g: pdirops: create vs getattr ======================================================================== 19:03:56 (1736985836) Conflict PASS 41g (4s) == sanityn test 41h: pdirops: create vs readdir ======================================================================== 19:04:00 (1736985840) Conflict PASS 41h (5s) == sanityn test 41i: reint_open: create vs create ======== 19:04:05 (1736985845) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 41i (647s) == sanityn test 42a: pdirops: mkdir vs mkdir ======================================================================== 19:14:52 (1736986492) mkdir: cannot create directory '/mnt/lustre2/f42a.sanityn': File exists Conflict PASS 42a (4s) == sanityn test 42b: pdirops: mkdir vs create ======================================================================== 19:14:56 (1736986496) open: File exists Conflict PASS 42b (5s) == sanityn test 42c: pdirops: mkdir vs link ======================================================================== 19:15:01 (1736986501) link: cannot create link '/mnt/lustre2/f42c.sanityn' to '/mnt/lustre2/f42c.sanityn-2': File exists Conflict PASS 42c (4s) == sanityn test 42d: pdirops: mkdir vs unlink ======================================================================== 19:15:05 (1736986505) Conflict PASS 42d (4s) == sanityn test 42e: pdirops: mkdir and rename (tgt) ======================================================================== 19:15:09 (1736986509) mv: cannot overwrite directory '/mnt/lustre2/f42e.sanityn' with non-directory Conflict PASS 42e (5s) == sanityn test 42f: pdirops: mkdir and rename (src) ======================================================================== 19:15:14 (1736986514) Conflict PASS 42f (4s) == sanityn test 42g: pdirops: mkdir vs getattr ======================================================================== 19:15:18 (1736986518) Conflict PASS 42g (4s) == sanityn test 42h: pdirops: mkdir vs readdir ======================================================================== 19:15:22 (1736986522) Conflict PASS 42h (4s) == sanityn test 43a: rmdir,mkdir doesn't return -EEXIST ======================================================================== 19:15:26 (1736986526) PASS 43a (12s) == sanityn test 43b: pdirops: unlink vs create ======================================================================== 19:15:38 (1736986538) Conflict PASS 43b (4s) == sanityn test 43c: pdirops: unlink vs link ======================================================================== 19:15:42 (1736986542) Conflict PASS 43c (5s) == sanityn test 43d: pdirops: unlink vs unlink ======================================================================== 19:15:47 (1736986547) rm: cannot remove '/mnt/lustre2/f43d.sanityn': No such file or directory Conflict PASS 43d (4s) == sanityn test 43e: pdirops: unlink and rename (tgt) ======================================================================== 19:15:51 (1736986551) Conflict PASS 43e (4s) == sanityn test 43f: pdirops: unlink and rename (src) ======================================================================== 19:15:55 (1736986555) mv: cannot stat '/mnt/lustre2/f43f.sanityn': No such file or directory Conflict PASS 43f (4s) == sanityn test 43g: pdirops: unlink vs getattr ======================================================================== 19:15:59 (1736986559) stat: cannot stat '/mnt/lustre2/f43g.sanityn': No such file or directory Conflict PASS 43g (4s) == sanityn test 43h: pdirops: unlink vs readdir ======================================================================== 19:16:03 (1736986563) Conflict PASS 43h (4s) == sanityn test 43i: pdirops: unlink vs remote mkdir ===== 19:16:07 (1736986567) SKIP: sanityn test_43i needs >= 2 MDTs SKIP 43i (1s) == sanityn test 43j: racy mkdir return EEXIST ======================================================================== 19:16:08 (1736986568) mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists PASS 43j (34s) == sanityn test 43k: unlink vs create ==================== 19:16:42 (1736986602) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 43k (354s) == sanityn test 44a: pdirops: rename tgt vs mkdir ======================================================================== 19:22:36 (1736986956) mkdir: cannot create directory '/mnt/lustre2/f44a.sanityn': File exists Conflict Wed Jan 15 19:22:39 EST 2025 PASS 44a (4s) == sanityn test 44b: pdirops: rename tgt vs create ======================================================================== 19:22:40 (1736986960) open: File exists Conflict PASS 44b (4s) == sanityn test 44c: pdirops: rename tgt vs link ======================================================================== 19:22:44 (1736986964) link: cannot create link '/mnt/lustre2/f44c.sanityn' to '/mnt/lustre2/f44c.sanityn-3': File exists Conflict PASS 44c (4s) == sanityn test 44d: pdirops: rename tgt vs unlink ======================================================================== 19:22:48 (1736986968) Conflict PASS 44d (5s) == sanityn test 44e: pdirops: rename tgt and rename (tgt) ======================================================================== 19:22:53 (1736986973) Conflict PASS 44e (4s) == sanityn test 44f: pdirops: rename tgt and rename (src) ======================================================================== 19:22:57 (1736986977) Conflict PASS 44f (4s) == sanityn test 44g: pdirops: rename tgt vs getattr ======================================================================== 19:23:01 (1736986981) Conflict PASS 44g (4s) == sanityn test 44h: pdirops: rename tgt vs readdir ======================================================================== 19:23:06 (1736986986) Conflict PASS 44h (4s) == sanityn test 44i: pdirops: rename tgt vs remote mkdir ========================================================== 19:23:10 (1736986990) SKIP: sanityn test_44i needs >= 2 MDTs SKIP 44i (0s) == sanityn test 45a: rename,mkdir doesn't return -EEXIST ======================================================================== 19:23:10 (1736986990) PASS 45a (19s) == sanityn test 45b: pdirops: rename src vs create ======================================================================== 19:23:29 (1736987009) Conflict PASS 45b (4s) == sanityn test 45c: pdirops: rename src vs link ======================================================================== 19:23:33 (1736987013) Conflict PASS 45c (4s) == sanityn test 45d: pdirops: rename src vs unlink ======================================================================== 19:23:37 (1736987017) rm: cannot remove '/mnt/lustre2/f45d.sanityn': No such file or directory Conflict PASS 45d (5s) == sanityn test 45e: pdirops: rename src and rename (tgt) ======================================================================== 19:23:42 (1736987022) Conflict PASS 45e (4s) == sanityn test 45f: pdirops: rename src and rename (src) ======================================================================== 19:23:46 (1736987026) mv: cannot stat '/mnt/lustre2/f45f.sanityn': No such file or directory Conflict PASS 45f (4s) == sanityn test 45g: pdirops: rename src vs getattr ======================================================================== 19:23:50 (1736987030) stat: cannot stat '/mnt/lustre2/f45g.sanityn': No such file or directory Conflict PASS 45g (5s) == sanityn test 45h: pdirops: unlink vs readdir ======================================================================== 19:23:55 (1736987035) Conflict PASS 45h (4s) == sanityn test 45i: pdirops: rename src vs remote mkdir ========================================================== 19:23:59 (1736987039) SKIP: sanityn test_45i needs >= 2 MDTs SKIP 45i (0s) == sanityn test 45j: read vs rename ====================== 19:23:59 (1736987039) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 45j (355s) == sanityn test 46a: pdirops: link vs mkdir ======================================================================== 19:29:54 (1736987394) mkdir: cannot create directory '/mnt/lustre2/f46a.sanityn': File exists Conflict PASS 46a (4s) == sanityn test 46b: pdirops: link vs create ======================================================================== 19:29:58 (1736987398) open: File exists Conflict PASS 46b (4s) == sanityn test 46c: pdirops: link vs link ======================================================================== 19:30:02 (1736987402) link: cannot create link '/mnt/lustre2/f46c.sanityn' to '/mnt/lustre2/f46c.sanityn': File exists Conflict PASS 46c (4s) == sanityn test 46d: pdirops: link vs unlink ======================================================================== 19:30:06 (1736987406) Conflict PASS 46d (5s) == sanityn test 46e: pdirops: link and rename (tgt) ======================================================================== 19:30:11 (1736987411) Conflict PASS 46e (4s) == sanityn test 46f: pdirops: link and rename (src) ======================================================================== 19:30:15 (1736987415) Conflict PASS 46f (4s) == sanityn test 46g: pdirops: link vs getattr ======================================================================== 19:30:19 (1736987419) Conflict PASS 46g (4s) == sanityn test 46h: pdirops: link vs readdir ======================================================================== 19:30:23 (1736987423) Conflict PASS 46h (5s) == sanityn test 46i: pdirops: link vs remote mkdir ======= 19:30:28 (1736987428) SKIP: sanityn test_46i needs >= 2 MDTs SKIP 46i (0s) == sanityn test 47a: pdirops: remote mkdir vs mkdir ====== 19:30:28 (1736987428) SKIP: sanityn test_47a needs >= 2 MDTs SKIP 47a (1s) == sanityn test 47b: pdirops: remote mkdir vs create ===== 19:30:29 (1736987429) SKIP: sanityn test_47b needs >= 2 MDTs SKIP 47b (1s) == sanityn test 47c: pdirops: remote mkdir vs link ======= 19:30:30 (1736987430) SKIP: sanityn test_47c needs >= 2 MDTs SKIP 47c (1s) == sanityn test 47d: pdirops: remote mkdir vs unlink ===== 19:30:31 (1736987431) SKIP: sanityn test_47d needs >= 2 MDTs SKIP 47d (0s) == sanityn test 47e: pdirops: remote mkdir and rename (tgt) ========================================================== 19:30:32 (1736987432) SKIP: sanityn test_47e needs >= 2 MDTs SKIP 47e (1s) == sanityn test 47f: pdirops: remote mkdir and rename (src) ========================================================== 19:30:32 (1736987432) SKIP: sanityn test_47f needs >= 2 MDTs SKIP 47f (1s) == sanityn test 47g: pdirops: remote mkdir vs getattr ==== 19:30:33 (1736987433) SKIP: sanityn test_47g needs >= 2 MDTs SKIP 47g (1s) == sanityn test 50: osc lvb attrs: enqueue vs. CP AST ======================================================================== 19:30:34 (1736987434) 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.00381683 s, 2.7 MB/s fail_loc=0x410 fail_loc=0x0 PASS 50 (6s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 19:30:40 (1736987440) 0+1 records in 0+1 records out 159 bytes (159 B) copied, 0.00293839 s, 54.1 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3146: kill: (24232) - No such process PASS 51a (4s) == sanityn test 51b: layout lock: glimpse should be able to restart if layout changed ========================================================== 19:30:44 (1736987444) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00249533 s, 410 kB/s fail_loc=0x1404 fail_val=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0167625 s, 62.6 MB/s 3145728 PASS 51b (13s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 19:30:57 (1736987457) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00322565 s, 317 kB/s PASS 51c (6s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 19:31:03 (1736987463) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00858823 s, 122 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (3s) == sanityn test 51e: lfs getstripe does not break leases, part 2 ========================================================== 19:31:06 (1736987466) /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2433 0x981 0 write lease(2) has applied. /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2433 0x981 0 read lease(1) has applied. PASS 51e (3s) == sanityn test 54: rename locking ======================= 19:31:09 (1736987469) llite.lustre-ffff8800a9f48800.xattr_cache=1 llite.lustre-ffff8800b6d0d800.xattr_cache=1 ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 512 Blocks: 1 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504963 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-01-15 19:31:10.000000000 -0500 Modify: 2025-01-15 19:31:10.000000000 -0500 Change: 2025-01-15 19:31:10.000000000 -0500 Birth: - ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000154 File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504966 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-01-15 19:31:15.000000000 -0500 Modify: 2025-01-15 19:31:15.000000000 -0500 Change: 2025-01-15 19:31:15.000000000 -0500 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504969 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-01-15 19:31:20.000000000 -0500 Modify: 2025-01-15 19:31:20.000000000 -0500 Change: 2025-01-15 19:31:20.000000000 -0500 Birth: - open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504968 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-01-15 19:31:20.000000000 -0500 Modify: 2025-01-15 19:31:21.000000000 -0500 Change: 2025-01-15 19:31:21.000000000 -0500 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000154 open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504972 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-01-15 19:31:26.000000000 -0500 Modify: 2025-01-15 19:31:26.000000000 -0500 Change: 2025-01-15 19:31:26.000000000 -0500 Birth: - File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504971 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-01-15 19:31:26.000000000 -0500 Modify: 2025-01-15 19:31:26.000000000 -0500 Change: 2025-01-15 19:31:26.000000000 -0500 Birth: - PASS 54 (23s) == sanityn test 55a: rename vs unlink target dir ========= 19:31:32 (1736987492) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55a.sanityn/d1/d2' to '/mnt/lustre/d55a.sanityn/d3/d2': No such file or directory PASS 55a (7s) == sanityn test 55b: rename vs unlink source dir ========= 19:31:39 (1736987499) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55b.sanityn/d1/d2' to '/mnt/lustre/d55b.sanityn/d3/d2': No such file or directory PASS 55b (7s) == sanityn test 55c: rename vs unlink orphan target dir == 19:31:46 (1736987506) fail_loc=0x156 mv: cannot move '/mnt/lustre/d55c.sanityn/d1/d2' to '/mnt/lustre/d55c.sanityn/d3/d2': No such file or directory PASS 55c (12s) == sanityn test 55d: rename file vs link ================= 19:31:58 (1736987518) fail_loc=0x155 mv: cannot move '/mnt/lustre/d55d.sanityn/f1' to '/mnt/lustre/d55d.sanityn/d55d.sanityn': Is a directory PASS 55d (9s) == sanityn test 60: Verify data_version behaviour ======== 19:32:07 (1736987527) PASS 60 (2s) == sanityn test 70a: cd directory && rm directory ======== 19:32:09 (1736987529) PASS 70a (1s) == sanityn test 70b: remove files after calling rm_entry ========================================================== 19:32:10 (1736987530) PASS 70b (2s) == sanityn test 71a: correct file map just after write operation is finished ========================================================== 19:32:12 (1736987532) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00303423 s, 21.6 MB/s SKIP: sanityn test_71a ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71a (1s) == sanityn test 71b: check fiemap support for stripecount > 1 ========================================================== 19:32:13 (1736987533) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00333035 s, 19.7 MB/s SKIP: sanityn test_71b ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71b (1s) == sanityn test 71c: check FIEMAP_EXTENT_LAST flag with different extents number ========================================================== 19:32:14 (1736987534) SKIP: sanityn test_71c support only ldiskfs ost SKIP 71c (0s) == sanityn test 71d: fiemap corruption test with fm_extent_count=0 ========================================================== 19:32:15 (1736987535) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00325264 s, 20.1 MB/s SKIP: sanityn test_71d ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71d (0s) == sanityn test 72: getxattr/setxattr cache should be consistent between nodes ========================================================== 19:32:15 (1736987535) llite.lustre-ffff8800a9f48800.xattr_cache=1 llite.lustre-ffff8800b6d0d800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names user.attr1="value1" getfattr: Removing leading '/' from absolute path names user.attr1="value2" getfattr: Removing leading '/' from absolute path names getfattr: Removing leading '/' from absolute path names b362740ad371eae580e7f85452e8830b - 870e072da1ebfc20ea8c0cd3d6bdf3b6 - PASS 72 (2s) == sanityn test 73: getxattr should not cause xattr lock cancellation ========================================================== 19:32:17 (1736987537) llite.lustre-ffff8800a9f48800.xattr_cache=1 llite.lustre-ffff8800b6d0d800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" PASS 73 (2s) == sanityn test 74: flock deadlock: different mounts ======================================================================== 19:32:19 (1736987539) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00246942 s, 415 kB/s 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00260442 s, 393 kB/s 2879: get lock2 2880: get lock1 2880: done 2880: get lock2 2879: done 2879: get lock1 fcntl cmd 7 failed: Resource deadlock avoided 2879: cannot get lock1: Resource deadlock avoided fcntl cmd 7 failed: Resource deadlock avoided 2880: cannot get lock2: Resource deadlock avoided 2880: exit rc=0 2879: done 2879: exit rc=0 PASS 74 (5s) == sanityn test 75: osc: upcall after unuse lock============================================================================= 19:32:24 (1736987544) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0182676 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102119 s, 103 MB/s fail_loc=0x31d /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3714: 3514 Killed stat -c %s $DIR1/$tfile fail_loc=0 PASS 75 (7s) == sanityn test 76: Verify MDT open_files listing ======== 19:32:31 (1736987551) opening files: ........ closing files: ........ PASS 76 (14s) == sanityn test 77a: check FIFO NRS policy =============== 19:32:45 (1736987565) ost.OSS.ost.nrs_policies=fifo ost.OSS.ost_create.nrs_policies=fifo ost.OSS.ost_io.nrs_policies=fifo ost.OSS.ost_out.nrs_policies=fifo ost.OSS.ost_seq.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0932417 s, 180 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121697 s, 86.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110681 s, 94.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0319119 s, 32.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0313925 s, 33.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0283918 s, 36.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0300162 s, 34.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0427434 s, 24.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0401901 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0401444 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0323227 s, 32.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0408967 s, 25.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0365832 s, 28.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0383984 s, 27.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0472306 s, 22.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0393029 s, 26.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0529091 s, 19.8 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d0d800.lock_unused_count=7 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d0d800.lock_unused_count=4 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00855431 s, 123 MB/s , 0.00843051 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00794988 s, 132 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00259474 s, 404 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115489 s, 90.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00412752 s, 254 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00138071 s, 759 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102734 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011311 s, 92.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107894 s, 97.2 MB/s , 0.0110619 s, 94.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102064 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131284 s, 79.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124179 s, 84.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113701 s, 92.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0139592 s, 75.1 MB/s removed '/mnt/lustre/d77a.sanityn/nrs_r_oleg137-client.virtnet' removed '/mnt/lustre/d77a.sanityn/nrs_w_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77a.sanityn' PASS 77a (2s) == sanityn test 77b: check CRR-N NRS policy ============== 19:32:47 (1736987567) ost.OSS.ost.nrs_policies=crrn ost.OSS.ost_create.nrs_policies=crrn ost.OSS.ost_io.nrs_policies=crrn ost.OSS.ost_out.nrs_policies=crrn ost.OSS.ost_seq.nrs_policies=crrn ost.OSS.ost.nrs_crrn_quantum=1 ost.OSS.ost_create.nrs_crrn_quantum=1 ost.OSS.ost_io.nrs_crrn_quantum=1 ost.OSS.ost_out.nrs_crrn_quantum=1 ost.OSS.ost_seq.nrs_crrn_quantum=1 policy: crr-n, crrn_quantum 1 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0895328 s, 187 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00904112 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111195 s, 94.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0184765 s, 56.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0225967 s, 46.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0221985 s, 47.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0189469 s, 55.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0221086 s, 47.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0279516 s, 37.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0381906 s, 27.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0237814 s, 44.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0196692 s, 53.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0161553 s, 64.9 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d0d800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0324269 s, 32.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0516533 s, 20.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0664674 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0164574 s, 63.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00273072 s, 384 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0163019 s, 64.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0174144 s, 60.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0639644 s, 16.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d0d800.lock_unused_count=4 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00171843 s, 610 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0211445 s, 49.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102837 s, 102 MB/s 1048576 bytes (1.0 MB) copied, 0.0167095 s, 62.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00838888 s, 125 MB/s 1048576 bytes (1.0 MB) copied, 0.0187265 s, 56.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0090977 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00589465 s, 178 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00909438 s, 115 MB/s 1048576 bytes (1.0 MB) copied, 0.00549429 s, 191 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00166647 s, 629 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00122308 s, 857 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg137-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost.nrs_crrn_quantum=64 ost.OSS.ost_create.nrs_crrn_quantum=64 ost.OSS.ost_io.nrs_crrn_quantum=64 ost.OSS.ost_out.nrs_crrn_quantum=64 ost.OSS.ost_seq.nrs_crrn_quantum=64 policy: crr-n, crrn_quantum 64 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0845781 s, 198 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00658846 s, 159 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0078668 s, 133 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128878 s, 81.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0237561 s, 44.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203854 s, 51.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0184442 s, 56.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103153 s, 102 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0305946 s, 34.3 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0228191 s, 46.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0353467 s, 29.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0210484 s, 49.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.030427 s, 34.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0171464 s, 61.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0193803 s, 54.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0213036 s, 49.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0257835 s, 40.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00257496 s, 407 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00730911 s, 143 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00317537 s, 330 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107614 s, 97.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00167784 s, 625 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00279492 s, 375 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00989716 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00518015 s, 202 MB/s 1048576 bytes (1.0 MB) copied, 0.00308427 s, 340 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011746 s, 89.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126603 s, 82.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0126568 s, 82.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0125307 s, 83.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115702 s, 90.6 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d0d800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151219 s, 69.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.013463 s, 77.9 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg137-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77b (3s) == sanityn test 77c: check ORR NRS policy ================ 19:32:50 (1736987570) ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_orr_quantum=1 ost.OSS.ost_io.nrs_orr_offset_type=physical ost.OSS.ost_io.nrs_orr_supported=reads policy: orr, orr_quantum 1, orr_offset_type physical, orr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.127919 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00760788 s, 138 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012418 s, 84.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0259467 s, 40.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0225105 s, 46.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0273779 s, 38.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0175143 s, 59.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0325965 s, 32.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0282138 s, 37.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0265628 s, 39.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0395479 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0289398 s, 36.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0311185 s, 33.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0301399 s, 34.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0193405 s, 54.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0190779 s, 55.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0232557 s, 45.1 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d0d800.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d0d800.lock_unused_count=1 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00700295 s, 150 MB/s , 0.00829724 s, 126 MB/s , 0.00774789 s, 135 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102132 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00705679 s, 149 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00731996 s, 143 MB/s 1048576 bytes (1.0 MB) copied, 0.00834283 s, 126 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00872956 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00894391 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00925148 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00935426 s, 112 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d0d800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100178 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00968684 s, 108 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102618 s, 102 MB/s 1048576 bytes (1.0 MB) copied, 0.00961956 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112541 s, 93.2 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg137-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=writes ost.OSS.ost_io.nrs_orr_quantum=64 policy: orr, orr_quantum 64, orr_offset_type physical, orr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0831555 s, 202 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00891903 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0150211 s, 69.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0166309 s, 63.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.022508 s, 46.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.030079 s, 34.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0280982 s, 37.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0270244 s, 38.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0367948 s, 28.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0269609 s, 38.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0325018 s, 32.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0305358 s, 34.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.031726 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0377074 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0357558 s, 29.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0395691 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0443113 s, 23.7 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d0d800.lock_unused_count=7 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d0d800.lock_unused_count=7 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00824497 s, 127 MB/s , 0.00152853 s, 686 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00767435 s, 137 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107566 s, 97.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100001 s, 105 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d0d800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010665 s, 98.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111895 s, 93.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107366 s, 97.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106409 s, 98.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00927628 s, 113 MB/s , 0.0108622 s, 96.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117753 s, 89.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00970692 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01037 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104721 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110437 s, 94.9 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg137-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=reads_and_writes ost.OSS.ost_io.nrs_orr_offset_type=logical policy: orr, orr_quantum 64, orr_offset_type logical, orr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.08506 s, 197 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00777225 s, 135 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012422 s, 84.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103462 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114352 s, 91.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0190993 s, 54.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106776 s, 98.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146685 s, 71.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0227971 s, 46.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128831 s, 81.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0190821 s, 55.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0357488 s, 29.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.031329 s, 33.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0264894 s, 39.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0408043 s, 25.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0188653 s, 55.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0242841 s, 43.2 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d0d800.lock_unused_count=6 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00925994 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0064417 s, 163 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00134108 s, 782 MB/s 1+0 records in 1+0 records out ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d0d800.lock_unused_count=1 1048576 bytes (1.0 MB) copied, 0.00396986 s, 264 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00839516 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0095392 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00998809 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00962699 s, 109 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00970305 s, 108 MB/s , 0.00514881 s, 204 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101424 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103076 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106974 s, 98.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110307 s, 95.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107372 s, 97.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113547 s, 92.3 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg137-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77c (4s) == sanityn test 77d: check TRR nrs policy ================ 19:32:54 (1736987574) ost.OSS.ost_io.nrs_policies=trr ost.OSS.ost_io.nrs_trr_quantum=1 ost.OSS.ost_io.nrs_trr_offset_type=physical ost.OSS.ost_io.nrs_trr_supported=reads policy: trr, trr_quantum 1, trr_offset_type physical, trr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.138702 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124285 s, 84.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143782 s, 72.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0230722 s, 45.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0196963 s, 53.2 MB/s 1048576 bytes (1.0 MB) copied, 0.026237 s, 40.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0166131 s, 63.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0184343 s, 56.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143917 s, 72.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00873851 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.040729 s, 25.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0464369 s, 22.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.048175 s, 21.8 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d0d800.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d0d800.lock_unused_count=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0573986 s, 18.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0438517 s, 23.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0536908 s, 19.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.065792 s, 15.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00681933 s, 154 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00844521 s, 124 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00816068 s, 128 MB/s 1048576 bytes (1.0 MB) copied, 0.00852671 s, 123 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0132473 s, 79.2 MB/s 1048576 bytes (1.0 MB) copied, 0.006917 s, 152 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00931498 s, 113 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00905386 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00904537 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00944585 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00965168 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108589 s, 96.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00956301 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108748 s, 96.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0120114 s, 87.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110042 s, 95.3 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg137-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=writes ost.OSS.ost_io.nrs_trr_quantum=64 policy: trr, trr_quantum 64, trr_offset_type physical, trr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.090921 s, 185 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00627098 s, 167 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00794095 s, 132 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00660731 s, 159 MB/s , 0.00666546 s, 157 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0178947 s, 58.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00958146 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00685337 s, 153 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.018839 s, 55.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0168797 s, 62.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0209899 s, 50.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0303335 s, 34.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0295232 s, 35.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0164882 s, 63.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141517 s, 74.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152677 s, 68.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.014383 s, 72.9 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d0d800.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d0d800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00913307 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00845407 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00731649 s, 143 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00896088 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00791041 s, 133 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0097169 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00842978 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00134526 s, 779 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100376 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103279 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105286 s, 99.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0017311 s, 606 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00532689 s, 197 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00170971 s, 613 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00164743 s, 636 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117541 s, 89.2 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg137-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=reads_and_writes ost.OSS.ost_io.nrs_trr_offset_type=logical policy: trr, trr_quantum 64, trr_offset_type logical, trr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0930834 s, 180 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0083614 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102179 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0149562 s, 70.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152761 s, 68.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0265338 s, 39.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0254259 s, 41.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0216607 s, 48.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0296633 s, 35.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0361595 s, 29.0 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d0d800.lock_unused_count=2 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d0d800.lock_unused_count=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0427314 s, 24.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0340067 s, 30.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0356126 s, 29.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0440429 s, 23.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.048912 s, 21.4 MB/s , 0.0378106 s, 27.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0423844 s, 24.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00815218 s, 129 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0091272 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00167212 s, 627 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00721487 s, 145 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00920244 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00163356 s, 642 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00825482 s, 127 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00734014 s, 143 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00897107 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00167093 s, 628 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00951564 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00885157 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00155722 s, 673 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114657 s, 91.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107935 s, 97.1 MB/s 1048576 bytes (1.0 MB) copied, 0.00249281 s, 421 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d0d800.lock_unused_count=1 removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg137-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77d (3s) == sanityn test 77e: check TBF NID nrs policy ============ 19:32:57 (1736987577) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_tbf_rule=start localhost nid={0@lo} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start clients nid={192.168.201.37@tcp} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start others nid={*.*.*.*@tcp} rate=50 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0991196 s, 169 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00916104 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00954456 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00693584 s, 151 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0072476 s, 145 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0210427 s, 49.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0233365 s, 44.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0270027 s, 38.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0287791 s, 36.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0285651 s, 36.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0280485 s, 37.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0331239 s, 31.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0398711 s, 26.3 MB/s , 0.0471985 s, 22.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0412157 s, 25.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0496043 s, 21.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0559037 s, 18.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00725658 s, 145 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00741804 s, 141 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00985394 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00757314 s, 138 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100314 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00931983 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0132189 s, 79.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00985865 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010959 s, 95.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106556 s, 98.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116472 s, 90.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113854 s, 92.1 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.012152 s, 86.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0117693 s, 89.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116068 s, 90.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129051 s, 81.3 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg137-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change localhost rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change clients rate=101 ost.OSS.ost_io.nrs_tbf_rule=change others rate=51 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.107711 s, 156 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109221 s, 96.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110466 s, 94.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131619 s, 79.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.017294 s, 60.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0250953 s, 41.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128725 s, 81.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136545 s, 76.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0281086 s, 37.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0194038 s, 54.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206397 s, 50.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0286746 s, 36.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0198875 s, 52.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0330754 s, 31.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0260667 s, 40.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.030792 s, 34.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0260267 s, 40.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00790645 s, 133 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00865499 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124233 s, 84.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104978 s, 99.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00980693 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103159 s, 102 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109866 s, 95.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111065 s, 94.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011211 s, 93.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0118075 s, 88.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122154 s, 85.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123288 s, 85.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124242 s, 84.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125858 s, 83.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.013839 s, 75.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133425 s, 78.6 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg137-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop localhost ost.OSS.ost_io.nrs_tbf_rule=stop clients ost.OSS.ost_io.nrs_tbf_rule=stop others 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0930739 s, 180 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126127 s, 83.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012447 s, 84.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148744 s, 70.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0279852 s, 37.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.032161 s, 32.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0279238 s, 37.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0312783 s, 33.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0365783 s, 28.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0377014 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0309163 s, 33.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0390628 s, 26.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0321824 s, 32.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0392851 s, 26.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0448217 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0416824 s, 25.2 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d0d800.lock_unused_count=7 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d0d800.lock_unused_count=7 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0375874 s, 27.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103801 s, 101 MB/s , 0.00736293 s, 142 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00157093 s, 667 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00408427 s, 257 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115377 s, 90.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00513454 s, 204 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d0d800.lock_unused_count=1 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0119679 s, 87.6 MB/s , 0.0118974 s, 88.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010636 s, 98.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115328 s, 90.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00132791 s, 790 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0013801 s, 760 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124409 s, 84.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123092 s, 85.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00273883 s, 383 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142437 s, 73.6 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg137-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0912113 s, 184 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0078473 s, 134 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129494 s, 81.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0150634 s, 69.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011087 s, 94.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0283513 s, 37.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0311699 s, 33.6 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0235224 s, 44.6 MB/s , 0.0246579 s, 42.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0186507 s, 56.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0305178 s, 34.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0296003 s, 35.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0158994 s, 66.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0280383 s, 37.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111167 s, 94.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0241777 s, 43.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0358008 s, 29.3 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d0d800.lock_unused_count=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0089268 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00734352 s, 143 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00725478 s, 145 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117349 s, 89.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0073014 s, 144 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00906291 s, 116 MB/s 1048576 bytes (1.0 MB) copied, 0.00728923 s, 144 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00892578 s, 117 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0087135 s, 120 MB/s , 0.00845679 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123113 s, 85.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129687 s, 80.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010355 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104407 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108898 s, 96.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119955 s, 87.4 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg137-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' PASS 77e (7s) == sanityn test 77f: check TBF JobID nrs policy ========== 19:33:04 (1736987584) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start runas jobid={iozone.500 dd.500 tiotest.500} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start iozone_runas jobid={iozone.500} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg137-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.153919 s, 109 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133 s, 78.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0159135 s, 65.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206044 s, 50.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0275038 s, 38.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0329627 s, 31.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0388624 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0351877 s, 29.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0342994 s, 30.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.030995 s, 33.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0511544 s, 20.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.039026 s, 26.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0440785 s, 23.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0478945 s, 21.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0458329 s, 22.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0410894 s, 25.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0526485 s, 19.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00874691 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00983092 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00863204 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00897257 s, 117 MB/s , 0.0092804 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124794 s, 84.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102461 s, 102 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01078 s, 97.3 MB/s , 0.010788 s, 97.2 MB/s , 0.0103151 s, 102 MB/s 1048576 bytes (1.0 MB) copied, 0.0112481 s, 93.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119872 s, 87.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109618 s, 95.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123403 s, 85.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126679 s, 82.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110076 s, 95.3 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg137-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change runas rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change iozone_runas rate=101 ost.OSS.ost_io.nrs_tbf_rule=change dd_runas rate=51 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg137-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.123888 s, 135 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107607 s, 97.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0149245 s, 70.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126259 s, 83.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138534 s, 75.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0270168 s, 38.8 MB/s , 0.0205125 s, 51.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0278409 s, 37.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0341376 s, 30.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0345544 s, 30.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0322021 s, 32.6 MB/s 1048576 bytes (1.0 MB) copied, 0.040825 s, 25.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0385688 s, 27.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0429433 s, 24.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0334618 s, 31.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0374984 s, 28.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0532628 s, 19.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00878672 s, 119 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00845973 s, 124 MB/s , 0.0108446 s, 96.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00885022 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101096 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0118248 s, 88.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110576 s, 94.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113172 s, 92.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0118417 s, 88.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120745 s, 86.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0118116 s, 88.8 MB/s , 0.013642 s, 76.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.013828 s, 75.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128284 s, 81.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125279 s, 83.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120133 s, 87.3 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg137-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop runas ost.OSS.ost_io.nrs_tbf_rule=stop iozone_runas ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg137-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.093187 s, 180 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00891145 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0118242 s, 88.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0137208 s, 76.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0224862 s, 46.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0248121 s, 42.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0259034 s, 40.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116065 s, 90.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0194154 s, 54.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00930992 s, 113 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0330264 s, 31.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0308552 s, 34.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.027764 s, 37.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.023132 s, 45.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.017841 s, 58.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0336944 s, 31.1 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d0d800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0243308 s, 43.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0092921 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116193 s, 90.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117275 s, 89.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00809124 s, 130 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00843097 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106165 s, 98.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121516 s, 86.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102793 s, 102 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d0d800.lock_unused_count=2 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0103688 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107961 s, 97.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110979 s, 94.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105216 s, 99.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0132206 s, 79.3 MB/s , 0.0132333 s, 79.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138192 s, 75.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123674 s, 84.8 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg137-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_policies=fifo running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg137-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0891403 s, 188 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0134019 s, 78.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135359 s, 77.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0197994 s, 53.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0252637 s, 41.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0272244 s, 38.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0251855 s, 41.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0228173 s, 46.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0397085 s, 26.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0343849 s, 30.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0420851 s, 24.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0400942 s, 26.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0289859 s, 36.2 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d0d800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0303604 s, 34.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0300375 s, 34.9 MB/s , 0.0347143 s, 30.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.018003 s, 58.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00881829 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00879284 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115382 s, 90.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00967084 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00915934 s, 114 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00916964 s, 114 MB/s , 0.012905 s, 81.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00881663 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135566 s, 77.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0176202 s, 59.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011975 s, 87.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113311 s, 92.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121908 s, 86.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0125016 s, 83.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.014123 s, 74.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136453 s, 76.8 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg137-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' PASS 77f (5s) == sanityn test 77g: Change TBF type directly ============ 19:33:09 (1736987589) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 ost.OSS.ost_io.nrs_policies=fifo PASS 77g (3s) == sanityn test 77h: Wrong policy name should report error, not LBUG ========================================================== 19:33:12 (1736987592) oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=abc: No such file or directory pdsh@oleg137-client: oleg137-server: ssh exited with exit code 2 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc: Unknown error 524 pdsh@oleg137-client: oleg137-server: ssh exited with exit code 12 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf reg abc: Unknown error 524 pdsh@oleg137-client: oleg137-server: ssh exited with exit code 12 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc efg: Unknown error 524 pdsh@oleg137-client: oleg137-server: ssh exited with exit code 12 PASS 77h (3s) == sanityn test 77i: Change rank of TBF rule ============= 19:33:15 (1736987595) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start before jobid={jobid} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start after jobid={jobid} rate=1000 rank=default ost.OSS.ost_io.nrs_tbf_rule=start target jobid={jobid} rate=1000 rank=after Move before itself ost.OSS.ost_io.nrs_tbf_rule=change target rank=target Move to higher rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=before Move to lower rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=after Move before default ost.OSS.ost_io.nrs_tbf_rule=change target rank=default ost.OSS.ost_io.nrs_policies=fifo PASS 77i (6s) == sanityn test 77j: check TBF-OPCode NRS policy ========= 19:33:21 (1736987601) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf opcode ost.OSS.ost_io.nrs_tbf_rule=start ost_r opcode={ost_read} rate=5 ost.OSS.ost_io.nrs_tbf_rule=start ost_w opcode={ost_write} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0826867 s, 203 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00703678 s, 149 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115606 s, 90.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122208 s, 85.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0199776 s, 52.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0216943 s, 48.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146393 s, 71.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0214753 s, 48.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203595 s, 51.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011201 s, 93.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0161654 s, 64.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.019502 s, 53.8 MB/s , 0.0204093 s, 51.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0233476 s, 44.9 MB/s 1048576 bytes (1.0 MB) copied, 0.00711639 s, 147 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0235934 s, 44.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0294526 s, 35.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00716779 s, 146 MB/s , 0.00722267 s, 145 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00773958 s, 135 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00690769 s, 152 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105086 s, 99.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00975548 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00852135 s, 123 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00903064 s, 116 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00973317 s, 108 MB/s , 0.00976119 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00969151 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112068 s, 93.6 MB/s , 0.0102002 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010532 s, 99.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105279 s, 99.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114325 s, 91.7 MB/s removed '/mnt/lustre/d77j.sanityn/nrs_r_oleg137-client.virtnet' removed '/mnt/lustre/d77j.sanityn/nrs_w_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77j.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 5 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.93709 s, 21.2 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.4317 s, 5.4 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77j.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_r ost.OSS.ost_io.nrs_tbf_rule=stop ost_w ost.OSS.ost_io.nrs_policies=fifo PASS 77j (50s) == sanityn test 77ja: check TBF-UID/GID NRS policy ======= 19:34:11 (1736987651) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg137-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.64635 s, 26.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.169682 s, 6.2 MB/s , 0.172757 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.17829 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.180894 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.176784 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.177323 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.179009 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.183424 s, 5.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.370046 s, 2.8 MB/s , 0.373192 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.383514 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.391109 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.395804 s, 2.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.38939 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.406359 s, 2.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.397002 s, 2.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.153716 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.155177 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.155924 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.157559 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.153824 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.155231 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.154939 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.155019 s, 6.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.155746 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.155454 s, 6.7 MB/s , 0.157222 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.156252 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.155833 s, 6.7 MB/s 1048576 bytes (1.0 MB) copied, 0.157655 s, 6.7 MB/s , 0.155406 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.159893 s, 6.6 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg137-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.8311 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9691 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg137-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.638582 s, 26.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.168697 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.172577 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.182047 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.174438 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.181512 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.1853 s, 5.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.187491 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.186395 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.368938 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.375961 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.383314 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.3805 s, 2.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.381222 s, 2.8 MB/s 1048576 bytes (1.0 MB) copied, 0.392519 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.392632 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.392806 s, 2.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.144181 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.146149 s, 7.2 MB/s , 0.143834 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.145301 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.145045 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.145367 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.145497 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.145985 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.146099 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.148525 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.148539 s, 7.1 MB/s 1048576 bytes (1.0 MB) copied, 0.148737 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.148416 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.149315 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.149348 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.151209 s, 6.9 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg137-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.8305 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9602 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77ja (132s) == sanityn test 77k: check TBF policy with NID/JobID/OPCode expression ========================================================== 19:36:23 (1736987783) ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_tbf_rule=start ext_w jobid={dd.500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r jobid={dd.500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg137-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.18865 s, 88.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0153842 s, 68.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0194111 s, 54.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0347021 s, 30.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0403369 s, 26.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0309785 s, 33.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0446386 s, 23.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0405743 s, 25.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0436952 s, 24.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.069243 s, 15.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0743092 s, 14.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0878814 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0902358 s, 11.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0962585 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0992396 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0938221 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0975964 s, 10.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.008898 s, 118 MB/s , 0.0111965 s, 93.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00753929 s, 139 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00761504 s, 138 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121084 s, 86.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0051783 s, 202 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110406 s, 95.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107254 s, 97.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0127203 s, 82.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0122351 s, 85.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123336 s, 85.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124187 s, 84.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135922 s, 77.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0132388 s, 79.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.014911 s, 70.3 MB/s , 0.0139033 s, 75.4 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg137-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.94367 s, 21.2 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.73124 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext_w nid={0@lo 192.168.201.37@tcp}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r nid={0@lo 192.168.201.37@tcp}&opcode={ost_read} rate=10 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.140513 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00743119 s, 141 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0154237 s, 68.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0197798 s, 53.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.028621 s, 36.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0272031 s, 38.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0081874 s, 128 MB/s 1048576 bytes (1.0 MB) copied, 0.0258728 s, 40.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0255246 s, 41.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0693174 s, 15.1 MB/s , 0.0679981 s, 15.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.160917 s, 6.5 MB/s , 0.157747 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.257294 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.261275 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.362043 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.340553 s, 3.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00841299 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00780137 s, 134 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00808434 s, 130 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00806579 s, 130 MB/s 1048576 bytes (1.0 MB) copied, 0.0105649 s, 99.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00841084 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00855929 s, 123 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00993883 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100473 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00897894 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102512 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00977825 s, 107 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0104313 s, 101 MB/s , 0.00995749 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012167 s, 86.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122958 s, 85.3 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg137-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.91561 s, 21.3 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.73213 s, 10.8 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext nid={0@lo 192.168.201.37@tcp}&jobid={dd.500} rate=20 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg137-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.144939 s, 116 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106724 s, 98.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143262 s, 73.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0127572 s, 82.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0192941 s, 54.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0339415 s, 30.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0188007 s, 55.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0286964 s, 36.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0397901 s, 26.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0585032 s, 17.9 MB/s , 0.0575829 s, 18.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0732531 s, 14.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0670185 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0633898 s, 16.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0634927 s, 16.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0810023 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0785393 s, 13.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00708751 s, 148 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00870547 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00704422 s, 149 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00784991 s, 134 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00906773 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115282 s, 91.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00884747 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00887305 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0102766 s, 102 MB/s 1048576 bytes (1.0 MB) copied, 0.0103148 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101241 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00959104 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106152 s, 98.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111195 s, 94.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010266 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108077 s, 97.0 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg137-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.94297 s, 21.2 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.88318 s, 21.5 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext ost.OSS.ost_io.nrs_tbf_rule=start ext_a jobid={dd.500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b jobid={dd.500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg137-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.249507 s, 67.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00913955 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0236936 s, 44.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0249929 s, 42.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0291284 s, 36.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0262414 s, 40.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0222163 s, 47.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0262249 s, 40.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.024068 s, 43.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.162703 s, 6.4 MB/s , 0.16678 s, 6.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.309889 s, 3.4 MB/s , 0.315344 s, 3.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.361853 s, 2.9 MB/s , 0.35313 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.342612 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.358834 s, 2.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00797623 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00906051 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110474 s, 94.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00727631 s, 144 MB/s 1048576 bytes (1.0 MB) copied, 0.00991392 s, 106 MB/s , 0.00794274 s, 132 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113174 s, 92.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112858 s, 92.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0145298 s, 72.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0121385 s, 86.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112084 s, 93.6 MB/s , 0.011424 s, 91.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0126028 s, 83.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146075 s, 71.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0132846 s, 78.9 MB/s , 0.0110786 s, 94.6 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg137-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.76453 s, 10.7 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.73176 s, 10.8 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.94002 s, 21.2 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.73079 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_tbf_rule=start ext_ug uid={500}&gid={1000} rate=5 running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg137-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.453293 s, 37.0 MB/s running as uid/gid/euid/egid 500/1000/500/1000, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0137773 s, 76.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120839 s, 86.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0198524 s, 52.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.026122 s, 40.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203586 s, 51.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0356951 s, 29.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0158674 s, 66.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0201762 s, 52.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.355436 s, 3.0 MB/s , 0.357283 s, 2.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.362377 s, 2.9 MB/s , 0.347961 s, 3.0 MB/s 1048576 bytes (1.0 MB) copied, 0.352663 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.362402 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.370136 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.370818 s, 2.8 MB/s running as uid/gid/euid/egid 500/1000/500/1000, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00686739 s, 153 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00602982 s, 174 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00740601 s, 142 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117953 s, 88.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00854099 s, 123 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00887394 s, 118 MB/s 1048576 bytes (1.0 MB) copied, 0.0115094 s, 91.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00941589 s, 111 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0101851 s, 103 MB/s , 0.0100827 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104866 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010816 s, 96.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119994 s, 87.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012846 s, 81.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0127431 s, 82.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0130252 s, 80.5 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg137-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.8313 s, 5.3 MB/s Write runtime is 20 s, speed is 5.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.4305 s, 5.4 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_ug ost.OSS.ost_io.nrs_tbf_rule=start ext_uw uid={500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_ur uid={500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg137-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.149581 s, 112 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148274 s, 70.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0267376 s, 39.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0315542 s, 33.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0373265 s, 28.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0288242 s, 36.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212878 s, 49.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0295968 s, 35.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00940543 s, 111 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0595659 s, 17.6 MB/s , 0.0578858 s, 18.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0518767 s, 20.2 MB/s , 0.0616491 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.057025 s, 18.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0560746 s, 18.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0740975 s, 14.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0578085 s, 18.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00877064 s, 120 MB/s , 0.00802018 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00741016 s, 142 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00867035 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110249 s, 95.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00935025 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106806 s, 98.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103098 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00957039 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00903758 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00710682 s, 148 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0111746 s, 93.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0105731 s, 99.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107535 s, 97.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107138 s, 97.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123905 s, 84.6 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg137-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.92919 s, 21.3 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.73338 s, 10.8 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_uw ost.OSS.ost_io.nrs_tbf_rule=stop ext_ur ost.OSS.ost_io.nrs_tbf_rule=start ext_a uid={500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b uid={500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg137-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.365994 s, 45.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0474252 s, 22.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0683989 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0732441 s, 14.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0645076 s, 16.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.120209 s, 8.7 MB/s , 0.110295 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.146978 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.134304 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.144219 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.152575 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.149543 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.157861 s, 6.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.344421 s, 3.0 MB/s , 0.331474 s, 3.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.400244 s, 2.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.393124 s, 2.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00912892 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00837264 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00747254 s, 140 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00774256 s, 135 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00850526 s, 123 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010549 s, 99.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00956577 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00967865 s, 108 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103212 s, 102 MB/s 1048576 bytes (1.0 MB) copied, 0.00985643 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100816 s, 104 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0119961 s, 87.4 MB/s , 0.01105 s, 94.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117583 s, 89.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108768 s, 96.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138907 s, 75.5 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg137-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.79356 s, 10.7 MB/s Write runtime is 10 s, speed is 10.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.74578 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.79119 s, 10.7 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.7453 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_policies=fifo PASS 77k (347s) == sanityn test 77l: check the output of NRS policies for generic TBF ========================================================== 19:42:10 (1736988130) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_policies=fifo PASS 77l (3s) == sanityn test 77m: check NRS Delay slows write RPC processing ========================================================== 19:42:13 (1736988133) ost.OSS.ost_io.nrs_policies=delay ost.OSS.ost_io.nrs_delay_min=4 ost.OSS.ost_io.nrs_delay_max=4 ost.OSS.ost_io.nrs_delay_pct=100 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg137-client.virtnet] [bs=1M] [count=1] [oflag=direct] [conv=fdatasync] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 3.64355 s, 288 kB/s running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg137-client.virtnet] [bs=1M] [count=10] [oflag=direct] [conv=fdatasync] 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 40.0089 s, 262 kB/s ost.OSS.ost_io.nrs_policies=fifo PASS 77m (50s) == sanityn test 77n: check wildcard support for TBF JobID NRS policy ========================================================== 19:43:03 (1736988183) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={*.500} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0902529 s, 186 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00709715 s, 148 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00802307 s, 131 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01348 s, 77.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0135076 s, 77.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136368 s, 76.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105041 s, 99.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00921531 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0183271 s, 57.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.014668 s, 71.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155934 s, 67.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116238 s, 90.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0265677 s, 39.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00546011 s, 192 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135824 s, 77.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0191699 s, 54.7 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d0d800.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d0d800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0237027 s, 44.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00956215 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00893177 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00744508 s, 141 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00776992 s, 135 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00988471 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00950707 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00927457 s, 113 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101392 s, 103 MB/s 1048576 bytes (1.0 MB) copied, 0.00889635 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109317 s, 95.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128539 s, 81.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0099309 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0092174 s, 114 MB/s 1048576 bytes (1.0 MB) copied, 0.0107435 s, 97.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115596 s, 90.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010226 s, 103 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg137-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77n.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.9254 s, 21.3 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77n.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.97208 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.*} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.186534 s, 89.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107737 s, 97.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142594 s, 73.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206601 s, 50.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0213144 s, 49.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114364 s, 91.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0205218 s, 51.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00918505 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0158789 s, 66.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0703773 s, 14.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0844506 s, 12.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0704851 s, 14.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.089061 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.165957 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.169228 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.255557 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.248181 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121121 s, 86.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105734 s, 99.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119703 s, 87.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146401 s, 71.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122856 s, 85.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122736 s, 85.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0126486 s, 82.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128024 s, 81.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.013931 s, 75.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0130651 s, 80.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0132823 s, 78.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136032 s, 77.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142627 s, 73.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.014572 s, 72.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148307 s, 70.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148099 s, 70.8 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg137-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg137-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.9106 s, 21.4 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.97092 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_policies=fifo PASS 77n (64s) == sanityn test 77o: Changing rank should not panic ====== 19:44:07 (1736988247) mds.MDS.mdt.nrs_policies=tbf nid mds.MDS.mdt.nrs_tbf_rule=start name nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=start name1 nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=change name1 rank=name mds.MDS.mdt.nrs_tbf_rule=stop name mds.MDS.mdt.nrs_policies=fifo PASS 77o (4s) == sanityn test 77q: Parallel TBF rule definitions should not panic ========================================================== 19:44:11 (1736988251) mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_policies=fifo PASS 77q (30s) == sanityn test 77p: Check validity of rule names for TBF policies ========================================================== 19:44:41 (1736988281) mds.MDS.mdt.nrs_policies=tbf oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_overflo uid={500} rate=500: File name too long pdsh@oleg137-client: oleg137-server: ssh exited with exit code 36 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_empty: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p@spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p.spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p~spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p#spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p/spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p^spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p%spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p*spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p;spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p,spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p?spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77pspec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p:spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p+spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p=spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p)spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p(spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p{spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p}spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p|spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p[spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p]spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p!spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p&spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p$spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p`spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p\spec uid={500} rate=500: Invalid argument pdsh@oleg137-client: oleg137-server: ssh exited with exit code 22 mds.MDS.mdt.nrs_policies=fifo PASS 77p (12s) == sanityn test 78: Enable policy and specify tunings right away ========================================================== 19:44:53 (1736988293) oleg137-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_orr_quantum=1: Resource temporarily unavailable pdsh@oleg137-client: oleg137-server: ssh exited with exit code 11 ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_policies=fifo PASS 78 (3s) == sanityn test 79: xattr: intent error ================== 19:44:56 (1736988296) File: '/mnt/lustre/d79.sanityn' Size: 512 Blocks: 1 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272505431 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-01-15 19:44:56.000000000 -0500 Modify: 2025-01-15 19:44:56.000000000 -0500 Change: 2025-01-15 19:44:56.000000000 -0500 Birth: - fail_val=0 fail_loc=0x80000160 fail_val=0 fail_loc=0x80000131 # file: mnt/lustre/d79.sanityn trusted.name1="value1" PASS 79 (12s) == sanityn test 80a: migrate directory when some children is being opened ========================================================== 19:45:08 (1736988308) SKIP: sanityn test_80a needs >= 2 MDTs SKIP 80a (0s) == sanityn test 80b: Accessing directory during migration ========================================================== 19:45:09 (1736988309) SKIP: sanityn test_80b needs >= 2 MDTs SKIP 80b (1s) == sanityn test 81a: rename and stat under striped directory ========================================================== 19:45:09 (1736988309) SKIP: sanityn test_81a needs >= 2 MDTs SKIP 81a (1s) == sanityn test 81b: rename under striped directory doesn't deadlock ========================================================== 19:45:10 (1736988310) SKIP: sanityn test_81b We need at least 2 MDTs for this test SKIP 81b (1s) == sanityn test 81c: rename revoke LOOKUP lock for remote object ========================================================== 19:45:11 (1736988311) SKIP: sanityn test_81c needs >= 4 MDTs SKIP 81c (1s) == sanityn test 82: fsetxattr and fgetxattr on orphan files ========================================================== 19:45:12 (1736988312) multiop /mnt/lustre/f82.sanityn vO_ac TMPPIPE=/tmp/multiop_open_wait_pipe.6857 multiop /mnt/lustre2/f82.sanityn vo_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.6857 PASS 82 (2s) == sanityn test 83: access striped directory while it is being created/unlinked ========================================================== 19:45:14 (1736988314) SKIP: sanityn test_83 needs >= 2 MDTs SKIP 83 (1s) == sanityn test 84: 0-nlink race in lu_object_find() ===== 19:45:15 (1736988315) fail_loc=0x8000060b PASS 84 (7s) == sanityn test 90: open/create and unlink striped directory ========================================================== 19:45:22 (1736988322) SKIP: sanityn test_90 needs >= 2 MDTs SKIP 90 (1s) == sanityn test 91: chmod and unlink striped directory === 19:45:23 (1736988323) SKIP: sanityn test_91 needs >= 2 MDTs SKIP 91 (1s) == sanityn test 92: create remote directory under orphan directory ========================================================== 19:45:24 (1736988324) SKIP: sanityn test_92 needs >= 2 MDTs SKIP 92 (1s) == sanityn test 93: alloc_rr should not allocate on same ost ========================================================== 19:45:25 (1736988325) fail_loc=0x00000163 fail_loc=0x0 /mnt/lustre/f93.sanityn-1/file1 lmm_stripe_count: 2 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2628 0xa44 0 0 2646 0xa56 0 /mnt/lustre2/f93.sanityn-2/file2 lmm_stripe_count: 2 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2647 0xa57 0 1 2629 0xa45 0 rc1=0 and rc2=0 PASS 93 (9s) == sanityn test 94: signal vs CP callback race =========== 19:45:34 (1736988334) osc.lustre-OST0000-osc-ffff8800a9f48800.idle_timeout=0 osc.lustre-OST0000-osc-ffff8800b6d0d800.idle_timeout=0 osc.lustre-OST0001-osc-ffff8800a9f48800.idle_timeout=0 osc.lustre-OST0001-osc-ffff8800b6d0d800.idle_timeout=0 2+0 records in 2+0 records out 8192 bytes (8.2 kB) copied, 0.0371031 s, 221 kB/s fail_val=5 fail_loc=0x80000312 fail_val=6 fail_loc=0x80000329 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 3.00236 s, 1.4 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 5135: 4075 Alarm clock dd if=/dev/zero of=$DIR/$tfile conv=notrunc oflag=append bs=4k count=1 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0119886 s, 342 kB/s osc.lustre-OST0000-osc-ffff8800a9f48800.idle_timeout=debug osc.lustre-OST0000-osc-ffff8800b6d0d800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800a9f48800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6d0d800.idle_timeout=debug PASS 94 (10s) == sanityn test 95b: Check readpage() on a page that is no longer uptodate ========================================================== 19:45:44 (1736988344) llite.lustre-ffff8800a9f48800.fast_read=0 llite.lustre-ffff8800b6d0d800.fast_read=0 1+0 records in 1+0 records out 12288 bytes (12 kB) copied, 0.00281563 s, 4.4 MB/s fail_loc=0x80001424 fail_val=5 fail_loc=0 llite.lustre-ffff8800a9f48800.fast_read=1 llite.lustre-ffff8800b6d0d800.fast_read=1 PASS 95b (8s) == sanityn test 100a: DoM: glimpse RPCs for stat without IO lock (DoM only file) ========================================================== 19:45:52 (1736988352) SKIP: sanityn test_100a Reserved for glimpse-ahead SKIP 100a (1s) == sanityn test 100b: DoM: no glimpse RPC for stat with IO lock (DoM only file) ========================================================== 19:45:53 (1736988353) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00137192 s, 3.0 MB/s /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK PASS 100b (2s) == sanityn test 100c: DoM: write vs stat without IO lock (combined file) ========================================================== 19:45:55 (1736988355) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0196652 s, 107 MB/s /mnt/lustre/d100c.sanityn/dom has type file OK /mnt/lustre/d100c.sanityn/dom has size 2097152 OK PASS 100c (2s) == sanityn test 100d: DoM: write+truncate vs stat without IO lock (combined file) ========================================================== 19:45:57 (1736988357) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0232057 s, 90.4 MB/s /mnt/lustre/d100d.sanityn/dom has type file OK /mnt/lustre/d100d.sanityn/dom has size 4096 OK PASS 100d (2s) == sanityn test 100e: DoM: read on open and file size ==== 19:45:59 (1736988359) 1+0 records in 1+0 records out 12000 bytes (12 kB) copied, 0.00151906 s, 7.9 MB/s PASS 100e (2s) == sanityn test 101a: Discard DoM data on unlink ========= 19:46:01 (1736988361) /mnt/lustre/f101a.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.000791166 s, 5.2 MB/s PASS 101a (2s) == sanityn test 101b: Discard DoM data on rename ========= 19:46:03 (1736988363) /mnt/lustre/f101b.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.000415688 s, 9.9 MB/s PASS 101b (2s) == sanityn test 101c: Discard DoM data on close-unlink === 19:46:05 (1736988365) /mnt/lustre/f101c.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.000848786 s, 4.8 MB/s PASS 101c (2s) SKIP: sanityn test_102 skipping ALWAYS excluded test 102 == sanityn test 103: Test size correctness with lockahead ========================================================== 19:46:08 (1736988368) fail_loc=0x415 fail_loc=0x415 fail_val=2 Incorrect size expected (no glimpse fix): Starting test test23 at 1736988369 lockahead_test: lockahead_test.c:1186: test23: assertion 'sb.st_size == sb2.st_size' failed: size on /mnt/lustre/d103.sanityn/f103.sanityn and /mnt/lustre2/d103.sanityn/f103.sanityn differs: 0 vs 1048576 fail_loc=0 fail_loc=0x214 fail_val=2 Starting test test23 at 1736988372 Finishing test test23 at 1736988372 PASS 103 (7s) == sanityn test 104: Verify that MDS stores atime/mtime/ctime during close ========================================================== 19:46:15 (1736988375) SKIP: sanityn test_104 ldiskfs only test SKIP 104 (1s) == sanityn test 105: Glimpse and lock cancel race ======== 19:46:16 (1736988376) fail_loc=0x416 PASS 105 (47s) == sanityn test 106a: Verify the btime via statx() ======= 19:47:03 (1736988423) SKIP: sanityn test_106a Test only for ldiskfs and statx() supported SKIP 106a (1s) == sanityn test 106b: Glimpse RPCs test for statx ======== 19:47:04 (1736988424) SKIP: sanityn test_106b statx() only test SKIP 106b (1s) == sanityn test 106c: Verify statx attributes mask ======= 19:47:05 (1736988425) SKIP: sanityn test_106c statx() only test SKIP 106c (0s) == sanityn test 107a: Basic grouplock conflict =========== 19:47:05 (1736988425) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0542777 s, 193 MB/s /mnt/lustre/f107a.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2654 0xa5e 0 multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.6857 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.6857 First grouplock blocks second one PASS 107a (4s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 19:47:09 (1736988429) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0702889 s, 149 MB/s /mnt/lustre/f107b.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2633 0xa49 0 multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.6857 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (8s) == sanityn test 108a: lseek: parallel updates ============ 19:47:17 (1736988437) 1+0 records in 1+0 records out 10000 bytes (10 kB) copied, 0.00227555 s, 4.4 MB/s fail_val=4 fail_loc=0x80000414 1+0 records in 1+0 records out 8388608 bytes (8.4 MB) copied, 4.12509 s, 2.0 MB/s PASS 108a (6s) == sanityn test 109: Race with several mount instances on 1 node ========================================================== 19:47:23 (1736988443) 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) Starting race between client mount instances (50 iterations): Iteration 1 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg137-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 2 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions oleg137-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 3 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 4 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions oleg137-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 5 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions oleg137-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 6 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg137-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 7 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg137-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 8 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 9 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 10 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg137-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 11 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg137-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 12 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions oleg137-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 13 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 14 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 15 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg137-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 16 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg137-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 17 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 18 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg137-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 19 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions oleg137-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 20 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 21 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg137-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 22 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 23 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg137-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 24 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg137-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions oleg137-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 25 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 26 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 27 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 28 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg137-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 29 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg137-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 30 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg137-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 31 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions oleg137-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 32 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 33 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg137-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 34 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions oleg137-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 35 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 36 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 37 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg137-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 38 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg137-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 39 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions oleg137-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 40 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 41 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 42 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 43 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 44 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions oleg137-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 45 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 46 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 47 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions oleg137-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 48 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg137-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions oleg137-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 49 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg137-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Iteration 50 Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 192.168.201.137@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.137@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg137-client.virtnet /mnt/lustre (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg137-server' oleg137-server: oleg137-server.virtnet: executing load_modules_local oleg137-server: Loading modules from /home/green/git/lustre-release/lustre oleg137-server: detected 4 online CPUs by sysfs oleg137-server: Force libcfs to create 2 CPU partitions Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre Starting client: oleg137-client.virtnet: -o user_xattr,flock oleg137-server@tcp:/lustre /mnt/lustre2 PASS 109 (422s) == sanityn test 110: do not grant another lock on resend ========================================================== 19:54:25 (1736988865) fail_loc=0x525 fail_val=3 fail_loc=0x534 File: '/mnt/lustre/f110.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205306056707 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-01-15 19:54:26.000000000 -0500 Modify: 2025-01-15 19:54:26.000000000 -0500 Change: 2025-01-15 19:54:26.000000000 -0500 Birth: - fail_loc=0 fail_val=0 Connected clients: oleg137-client.virtnet oleg137-client.virtnet PASS 110 (89s) == sanityn test 111: A racy rename/link an open file should not cause fs corruption ========================================================== 19:55:54 (1736988954) SKIP: sanityn test_111 needs >= 2 MDTs SKIP 111 (1s) == sanityn test 112: update max-inherit in default LMV === 19:55:55 (1736988955) SKIP: sanityn test_112 We need at least 2 MDTs for this test SKIP 112 (1s) == sanityn test 113: check servers of specified fs ======= 19:55:56 (1736988956) lustre-OST0000-osc-ffff8800b6024000 active. lustre-OST0001-osc-ffff8800b6024000 active. lustre-OST0000-osc-ffff8800b6024000 active. lustre-OST0001-osc-ffff8800b6024000 active. MGC192.168.201.137@tcp active. PASS 113 (2s) cleanup: ====================================================== == sanityn test complete, duration 4079 sec ============== 19:55:59 (1736988959) Stopping clients: oleg137-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg137-client.virtnet /mnt/lustre2 opts: