-----============= acceptance-small: sanityn ============----- Wed May 21 07:51:35 EDT 2025 oleg105-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/sanityn.*ex: No such file or directory excepting tests: 27 28 102 skipping tests SLOW=no: 33a Starting client oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 Started clients oleg105-client.virtnet: 192.168.201.105@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt) oleg105-client.virtnet: executing check_config_client /mnt/lustre oleg105-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg105-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800aa2ef000.idle_timeout=debug osc.lustre-OST0000-osc-ffff8800b6d09800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800aa2ef000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6d09800.idle_timeout=debug disable quota as required oleg105-server: oleg105-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119042 s, 88.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6853] == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 07:51:44 (1747828304) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (2s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 07:51:46 (1747828306) -rw-r--r-- 1 root root 0 May 21 07:51 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (1s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 07:51:47 (1747828307) -rw-r--r-- 1 root root 0 May 21 07:51 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (2s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 07:51:49 (1747828309) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (1s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 07:51:50 (1747828310) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (2s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 07:51:52 (1747828312) total 1 -rwxrwxrwx 1 root root 0 May 21 07:51 f2a -rwxrwxrwx 1 root root 0 May 21 07:51 f2b total 1 -rwxrwxrwx 1 root root 0 May 21 07:51 f2a -rwxrwxrwx 1 root root 0 May 21 07:51 f2b running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes (512 B) copied, 0.00502087 s, 102 kB/s PASS 2e (2s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 07:51:54 (1747828314) SKIP: sanityn test_2f needs >= 2 MDTs SKIP 2f (1s) == sanityn test 2g: check blocks update on sync write ==== 07:51:55 (1747828315) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0992575 s, 21.1 MB/s /mnt/lustre/f2g.sanityn has 4103 blocks /mnt/lustre2/f2g.sanityn has 4103 blocks PASS 2g (2s) == sanityn test 3: symlink on one mtpt, readlink on another ===================================================================== 07:51:57 (1747828317) PASS 3 (1s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 07:51:58 (1747828318) PASS 4 (3s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 07:52:01 (1747828321) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (1s) == sanityn test 6: remove of open file on other node ============================================================================ 07:52:02 (1747828322) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (1s) == sanityn test 7: remove of open directory on other node ======================================================================= 07:52:03 (1747828323) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (2s) == sanityn test 8: remove of open special file on other node ==================================================================== 07:52:05 (1747828325) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (1s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 07:52:07 (1747828327) PASS 9a (1s) == sanityn test 9b: append to striped sparse file ======== 07:52:08 (1747828328) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0150706 s, 69.6 MB/s 3+0 records in 3+0 records out 3 bytes (3 B) copied, 0.0153891 s, 0.2 kB/s Data read (expecting 'foo'): foo PASS 9b (2s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 07:52:10 (1747828330) 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00207991 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00210853 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00192868 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00191271 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00302121 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00205538 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00185564 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0019418 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00341225 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00166872 s, 0.6 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00140103 s, 0.7 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0017314 s, 0.6 kB/s PASS 10a (2s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 07:52:12 (1747828332) 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00255082 s, 1.2 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0100272 s, 408 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.000240982 s, 12.7 MB/s PASS 10b (1s) == sanityn test 11: execution of file opened for write should return error ============================================================== 07:52:13 (1747828333) multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.6853 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 273: /mnt/lustre2/d11/f: Text file busy PASS 11 (2s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 07:52:15 (1747828335) warning: '-runtime' deprecated, use '-t runtime' instead - link 2050 (time 1747828346.00 total 10.01 last 204.86) - link 4070 (time 1747828356.01 total 20.01 last 201.97) - link 6074 (time 1747828366.01 total 30.01 last 200.32) - link 8082 (time 1747828376.02 total 40.02 last 200.69) - link 10000 (time 1747828385.53 total 49.53 last 201.63) - link 12149 (time 1747828395.53 total 59.53 last 214.84) - link 14328 (time 1747828405.53 total 69.53 last 217.86) - link 16147 (time 1747828415.54 total 79.54 last 181.81) - link 18111 (time 1747828425.54 total 89.54 last 196.34) - link 19915 (time 1747828435.54 total 99.55 last 180.36) total: 20009 link in 100.00 seconds: 200.09 ops/second using seed 1256603932 running for 100 seconds - stat 10000 (time 1747828340 ; total 3 ; last 3) - stat 20000 (time 1747828343 ; total 6 ; last 3) - stat 30000 (time 1747828346 ; total 9 ; last 3) - stat 40000 (time 1747828349 ; total 12 ; last 3) - stat 50000 (time 1747828352 ; total 15 ; last 3) - stat 60000 (time 1747828356 ; total 19 ; last 4) - stat 70000 (time 1747828359 ; total 22 ; last 3) - stat 80000 (time 1747828362 ; total 25 ; last 3) - stat 90000 (time 1747828365 ; total 28 ; last 3) - stat 100000 (time 1747828369 ; total 32 ; last 4) - stat 110000 (time 1747828372 ; total 35 ; last 3) - stat 120000 (time 1747828375 ; total 38 ; last 3) - stat 130000 (time 1747828378 ; total 41 ; last 3) - stat 140000 (time 1747828381 ; total 44 ; last 3) - stat 150000 (time 1747828384 ; total 47 ; last 3) - stat 160000 (time 1747828389 ; total 52 ; last 5) - stat 170000 (time 1747828397 ; total 60 ; last 8) - stat 180000 (time 1747828404 ; total 67 ; last 7) - stat 190000 (time 1747828413 ; total 76 ; last 9) - stat 200000 (time 1747828421 ; total 84 ; last 8) - stat 210000 (time 1747828430 ; total 93 ; last 9) total: 219164 stats in 100 seconds: 2191.639893 stats/second - unlinked 0 (time 1747828387 ; total 0 ; last 0) - unlinked 10000 (time 1747828447 ; total 60 ; last 60) - unlinked 20000 (time 1747828470 ; total 83 ; last 23) unlink(/mnt/lustre2/lockdir/lockfile20009) error: No such file or directory total: 20008 unlinks in 83 seconds: 241.060242 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (20541) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (20544) - No such process PASS 12 (136s) == sanityn test 13: test directory page revocation ======= 07:54:31 (1747828471) f13 f13 PASS 13 (1s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 07:54:32 (1747828472) multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.6853 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 308: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4279: 21915 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (2s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 07:54:34 (1747828474) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4279: 22542 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (1s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 07:54:35 (1747828475) truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 323: 23168 Terminated $DIR1/$tdir/sleep 60 PASS 14b (2s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 07:54:37 (1747828477) cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 335: 23797 Terminated $DIR1/$tdir/sleep 60 PASS 14c (1s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 07:54:38 (1747828478) chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 346: 24425 Terminated $DIR1/$tdir/sleep 60 PASS 14d (2s) == sanityn test 15: test out-of-space with multiple writers ===================================================================== 07:54:40 (1747828480) PATH=/opt/iozone/bin:/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin: STRIPECOUNT=2 ORIGFREE=7519232 MAXFREE=800000 SKIP: oos2 test_15 oos2.sh: 7519232kB free gt MAXFREE 800000kB, increase 800000 (or reduce test fs size) to proceed sleep 5 for ZFS zfs Waiting for MDT destroys to complete SKIP 15 (10s) == sanityn test 16a: 500 iterations of dual-mount fsx ==== 07:54:50 (1747828490) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0670296 s, 31.3 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0502979 s, 41.7 MB/s Chance of close/open is 1 in 50 Seed set to 8491 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000003[1] 1747828491.332815 mapwrite 0x8e1130 thru 0x8e2d28 (0x1bf9 bytes) 000008[1] 1747828491.377658 mapread 0x640269 thru 0x64b20b (0xafa3 bytes) 000012[1] 1747828491.390564 mapwrite 0x3266f4 thru 0x332686 (0xbf93 bytes) truncating to largest ever: 0x45c409 000015[1] 1747828491.418224 trunc from 0x8e2d29 to 0x45c408 (0x486920 bytes) 000016[0] 1747828491.422338 mapwrite 0x23c48f thru 0x247b1d (0xb68f bytes) 000017[1] 1747828491.451398 mapread 0x3c86a3 thru 0x3cf0c4 (0x6a22 bytes) 000018[0] 1747828491.458457 mapread 0x03fc25 thru 0x04ae97 (0xb273 bytes) truncating to largest ever: 0x840b1a 000019[0] 1747828491.469407 trunc from 0x45c409 to 0x840b19 (0x3e4711 bytes) 000021[0] 1747828491.476468 trunc from 0x840b1a to 0x38f71c (0x4b13fd bytes) 000023[0] 1747828491.483173 write 0x2d292e thru 0x2de45f (0xbb32 bytes) 000026[1] 1747828491.489286 write 0x14ead7 thru 0x14ff2f (0x1459 bytes) 000027[0] 1747828491.496928 mapwrite 0x2a6dee thru 0x2ae006 (0x7219 bytes) 000028[1] 1747828491.517215 read 0x1e6c95 thru 0x1ede77 (0x71e3 bytes) 000029[1] 1747828491.521790 mapread 0x157066 thru 0x15ea54 (0x79ef bytes) 000032[1] 1747828491.540276 mapwrite 0x725af6 thru 0x72a860 (0x4d6b bytes) 000034[1] 1747828491.576842 mapread 0x158003 thru 0x1606bf (0x86bd bytes) 000035[0] 1747828491.579994 write 0x8e9ec5 thru 0x8ede62 (0x3f9e bytes) truncating to largest ever: 0x9fbe83 000037[1] 1747828491.589066 trunc from 0x8ede63 to 0x9fbe82 (0x10e020 bytes) 000038[0] 1747828491.597482 mapwrite 0x30b77b thru 0x313836 (0x80bc bytes) 000039[1] 1747828491.624696 mapread 0x4cf981 thru 0x4d841d (0x8a9d bytes) 000040[0] 1747828491.633411 mapread 0x5684e8 thru 0x5779e8 (0xf501 bytes) 000041[0] 1747828491.643780 mapread 0x250d48 thru 0x25c17b (0xb434 bytes) 000042[1] 1747828491.657912 trunc from 0x9fbe83 to 0x8912b4 (0x16abce bytes) 000043[0] 1747828491.666057 mapread 0x221f14 thru 0x228e0e (0x6efb bytes) 000045[1] 1747828491.678412 mapwrite 0x38e578 thru 0x39d5e5 (0xf06e bytes) 000046[1] 1747828491.698988 trunc from 0x8912b5 to 0x5d0776 (0x2c0b3e bytes) 000049[0] 1747828491.714806 trunc from 0x5d0777 to 0x5a2054 (0x2e722 bytes) 000050[1] 1747828491.721529 read 0x1a7285 thru 0x1abedd (0x4c59 bytes) 000052[0] 1747828491.731977 mapread 0x271655 thru 0x2744e7 (0x2e93 bytes) 000054[1] 1747828491.734641 mapwrite 0x7085c6 thru 0x712faf (0xa9ea bytes) 000055[1] 1747828491.778780 mapread 0x16bf83 thru 0x1714a9 (0x5527 bytes) 000056[0] 1747828491.789393 trunc from 0x712fb0 to 0x42421e (0x2eed91 bytes) 000057[1] 1747828491.802242 trunc from 0x42421f to 0x26ed85 (0x1b5499 bytes) 000058[0] 1747828491.814924 write 0x84fe47 thru 0x852a32 (0x2bec bytes) 000059[1] 1747828491.821782 read 0x5ffca9 thru 0x602854 (0x2bac bytes) 000060[1] 1747828491.840069 mapread 0x17ebcc thru 0x184fd5 (0x640a bytes) 000064[0] 1747828491.850795 mapread 0x2da758 thru 0x2e860b (0xdeb4 bytes) 000065[1] 1747828491.859511 trunc from 0x852a33 to 0x6a8b13 (0x1a9f1f bytes) 000069[0] 1747828491.877996 mapread 0x31d718 thru 0x31e1a8 (0xa91 bytes) 000070[1] 1747828491.883991 read 0x3a02b5 thru 0x3aaddf (0xab2b bytes) 000073[0] 1747828491.900051 write 0x4c5cb4 thru 0x4d1d87 (0xc0d4 bytes) 000076[0] 1747828491.909371 trunc from 0x6a8b14 to 0x93a14c (0x291639 bytes) 000077[0] 1747828491.919694 write 0x9e4eb1 thru 0x9eabbc (0x5d0c bytes) 000079[0] 1747828491.924898 trunc from 0x9eabbd to 0x63187a (0x3b9342 bytes) 000081[1] 1747828491.932651 mapwrite 0x0d517c thru 0x0e2fcb (0xde50 bytes) 000082[1] 1747828491.982071 mapwrite 0x6e8d29 thru 0x6ec013 (0x32eb bytes) 000083[0] 1747828492.014180 trunc from 0x6ec014 to 0x83d9eb (0x1519d8 bytes) 000084[1] 1747828492.024124 mapread 0x1319f4 thru 0x1350ae (0x36bb bytes) 000085[1] 1747828492.035480 mapwrite 0x24f294 thru 0x24f8e4 (0x651 bytes) 000086[1] 1747828492.056273 mapwrite 0x00cbad thru 0x01625d (0x96b1 bytes) 000087[1] 1747828492.079748 write 0x82b618 thru 0x831fdb (0x69c4 bytes) 000089[0] 1747828492.086605 mapread 0x015000 thru 0x01d654 (0x8655 bytes) 000090[1] 1747828492.099559 mapwrite 0x155313 thru 0x15ac72 (0x5960 bytes) 000093[0] 1747828492.128115 read 0x34d483 thru 0x353830 (0x63ae bytes) 000094[0] 1747828492.132501 mapwrite 0x0438e4 thru 0x046c13 (0x3330 bytes) 000096[0] 1747828492.155462 read 0x579b11 thru 0x585e2e (0xc31e bytes) 000099[0] 1747828492.173367 mapwrite 0x8ae389 thru 0x8b5913 (0x758b bytes) 000100[1] 1747828492.199307 read 0x247644 thru 0x2570e2 (0xfa9f bytes) 000103[1] 1747828492.215085 trunc from 0x8b5914 to 0x292ee9 (0x622a2a bytes) 000104[1] 1747828492.225817 trunc from 0x292eea to 0x0204d2 (0x272a17 bytes) 000108[1] 1747828492.229778 write 0x3616d8 thru 0x367e24 (0x674d bytes) 000110[1] 1747828492.234791 mapread 0x34bf53 thru 0x34c51f (0x5cd bytes) 000111[0] 1747828492.240161 read 0x23b644 thru 0x245694 (0xa051 bytes) 000113[0] 1747828492.253226 write 0x35bdba thru 0x366374 (0xa5bb bytes) 000114[1] 1747828492.266687 mapread 0x1b3a87 thru 0x1bbbc2 (0x813c bytes) 000115[0] 1747828492.280118 mapread 0x219398 thru 0x221fec (0x8c55 bytes) 000116[1] 1747828492.288789 mapwrite 0x98cb9a thru 0x9929b4 (0x5e1b bytes) 000117[1] 1747828492.326934 mapwrite 0x61f69d thru 0x62b228 (0xbb8c bytes) 000118[0] 1747828492.359371 mapread 0x404c31 thru 0x40c712 (0x7ae2 bytes) 000126[1] 1747828492.386872 mapwrite 0x137940 thru 0x13fb9f (0x8260 bytes) 000127[1] 1747828492.414865 mapread 0x8e58ed thru 0x8f1ef0 (0xc604 bytes) 000129[1] 1747828492.436288 write 0x7677fe thru 0x76e9fd (0x7200 bytes) 000130[0] 1747828492.441681 mapwrite 0x85daaa thru 0x86400f (0x6566 bytes) 000131[0] 1747828492.468083 trunc from 0x9929b5 to 0x184bdc (0x80ddd8 bytes) 000133[0] 1747828492.476075 trunc from 0x184bdd to 0x0f43c1 (0x9081b bytes) 000134[0] 1747828492.478989 write 0x7a3871 thru 0x7a8727 (0x4eb7 bytes) 000136[1] 1747828492.486769 mapwrite 0x92f900 thru 0x93c418 (0xcb19 bytes) 000138[1] 1747828492.527490 trunc from 0x93c419 to 0x8438c4 (0xf8b54 bytes) 000139[1] 1747828492.532042 write 0x06f82e thru 0x0759b4 (0x6187 bytes) 000140[1] 1747828492.538235 read 0x0c2a1b thru 0x0cbbcd (0x91b3 bytes) 000141[0] 1747828492.557873 trunc from 0x8438c5 to 0x1f6e24 (0x64caa0 bytes) 000143[1] 1747828492.575724 trunc from 0x1f6e25 to 0x8e065c (0x6e9838 bytes) 000144[1] 1747828492.584056 read 0x32a4a5 thru 0x32a60b (0x167 bytes) 000145[1] 1747828492.609522 read 0x53eed3 thru 0x5424ca (0x35f8 bytes) 000146[1] 1747828492.612730 read 0x44a07c thru 0x457612 (0xd597 bytes) 000147[1] 1747828492.615807 mapwrite 0x8dbaa2 thru 0x8e07e2 (0x4d41 bytes) 000148[1] 1747828492.632971 trunc from 0x8e07e3 to 0x1e74d9 (0x6f9309 bytes) 000154[0] 1747828492.659518 trunc from 0x1e74da to 0x86ce8f (0x6859b6 bytes) 000155[0] 1747828492.670055 mapwrite 0x8a9a38 thru 0x8aefa8 (0x5571 bytes) 000156[0] 1747828492.711122 trunc from 0x8aefa9 to 0x1ecfae (0x6c1ffa bytes) 000157[1] 1747828492.724922 mapwrite 0x77a6d1 thru 0x7881b1 (0xdae1 bytes) 000158[1] 1747828492.758907 mapread 0x112e62 thru 0x122297 (0xf436 bytes) 000159[0] 1747828492.774946 trunc from 0x7881b2 to 0x7be4fc (0x3634b bytes) 000160[1] 1747828492.782673 write 0x92844c thru 0x9357fa (0xd3af bytes) 000161[0] 1747828492.787893 write 0x8a48f2 thru 0x8aec55 (0xa364 bytes) 000167[0] 1747828492.805826 trunc from 0x9357fb to 0x7e36b1 (0x152149 bytes) 000170[0] 1747828492.816201 mapwrite 0x31cddf thru 0x3277ef (0xaa11 bytes) 000171[1] 1747828492.844971 trunc from 0x7e36b2 to 0x5de8df (0x204dd2 bytes) 000172[1] 1747828492.852398 read 0x1903e2 thru 0x1913c7 (0xfe6 bytes) 000173[0] 1747828492.864713 read 0x09ffba thru 0x0ab2dc (0xb323 bytes) 000174[1] 1747828492.879788 trunc from 0x5de8e0 to 0x4b68ed (0x127ff2 bytes) 000175[1] 1747828492.888051 trunc from 0x4b68ee to 0x3e37ab (0xd3142 bytes) 000177[0] 1747828492.895701 mapwrite 0x2006fa thru 0x2084e7 (0x7dee bytes) 000178[1] 1747828492.922874 mapread 0x05c207 thru 0x069a84 (0xd87e bytes) 000179[1] 1747828492.938398 mapread 0x0773a8 thru 0x0860a5 (0xecfe bytes) 000181[0] 1747828492.955189 read 0x00ffef thru 0x0153bc (0x53ce bytes) 000184[0] 1747828492.964488 read 0x27f860 thru 0x28bc03 (0xc3a4 bytes) 000185[0] 1747828492.968309 mapwrite 0x15e97b thru 0x16aa86 (0xc10c bytes) 000188[1] 1747828493.005870 write 0x9c8a04 thru 0x9d13fa (0x89f7 bytes) 000189[1] 1747828493.010739 mapread 0x147208 thru 0x155357 (0xe150 bytes) 000191[1] 1747828493.036530 mapread 0x9bf722 thru 0x9c4372 (0x4c51 bytes) 000194[0] 1747828493.043036 read 0x2e5cb6 thru 0x2e7f69 (0x22b4 bytes) 000196[0] 1747828493.043523 write 0x737ec4 thru 0x73fb01 (0x7c3e bytes) 000198[0] 1747828493.057356 read 0x25f6f4 thru 0x2604a4 (0xdb1 bytes) 000204[0] 1747828493.068588 trunc from 0x9d13fb to 0x30ce44 (0x6c45b6 bytes) 000205[0] 1747828493.077915 trunc from 0x30ce45 to 0x799c1c (0x48cdd8 bytes) 000207[0] 1747828493.087403 trunc from 0x799c1d to 0x6ceb1c (0xcb100 bytes) 000208[0] 1747828493.091115 trunc from 0x6ceb1d to 0x8cc03c (0x1fd520 bytes) 000210[0] 1747828493.100809 write 0x812aab thru 0x8210b3 (0xe609 bytes) 000213[0] 1747828493.134786 read 0x5b3e46 thru 0x5c1b70 (0xdd2b bytes) 000214[0] 1747828493.135060 write 0x45afcc thru 0x46983c (0xe871 bytes) 000216[1] 1747828493.138722 read 0x168497 thru 0x16f9bb (0x7525 bytes) 000217[0] 1747828493.147759 mapwrite 0x89ed05 thru 0x8a60d4 (0x73d0 bytes) 000218[0] 1747828493.164037 trunc from 0x8cc03d to 0x22ff6a (0x69c0d2 bytes) 000219[1] 1747828493.176989 read 0x225c7e thru 0x22ff6a (0xa2ed bytes) 000220[0] 1747828493.182031 mapwrite 0x82b274 thru 0x82d856 (0x25e3 bytes) 000221[0] 1747828493.203237 write 0x869e35 thru 0x86eb8a (0x4d56 bytes) 000223[0] 1747828493.210055 write 0x085e16 thru 0x08982d (0x3a18 bytes) 000226[0] 1747828493.214759 write 0x86b9e6 thru 0x8710cc (0x56e7 bytes) 000227[1] 1747828493.215298 mapread 0x6c78ec thru 0x6d292b (0xb040 bytes) 000228[0] 1747828493.235508 mapwrite 0x66a873 thru 0x6735e6 (0x8d74 bytes) 000229[0] 1747828493.260112 read 0x30ec17 thru 0x314599 (0x5983 bytes) 000231[1] 1747828493.279104 write 0x89be69 thru 0x8a69db (0xab73 bytes) 000232[0] 1747828493.287741 read 0x69bcfa thru 0x69ebaf (0x2eb6 bytes) 000233[1] 1747828493.298364 trunc from 0x8a69dc to 0x8431ea (0x637f1 bytes) 000237[1] 1747828493.315113 mapwrite 0x346339 thru 0x34e23c (0x7f04 bytes) 000238[0] 1747828493.345317 read 0x442030 thru 0x44ed2d (0xccfe bytes) 000239[0] 1747828493.363203 read 0x359763 thru 0x368242 (0xeae0 bytes) 000241[1] 1747828493.390483 read 0x686b92 thru 0x68ac52 (0x40c1 bytes) 000242[1] 1747828493.400931 trunc from 0x8431eb to 0x0beebd (0x78432d bytes) 000243[1] 1747828493.413928 trunc from 0x0beebe to 0x62a8fc (0x56ba3f bytes) 000244[0] 1747828493.421865 trunc from 0x62a8fd to 0x0e974a (0x5411b2 bytes) 000245[1] 1747828493.427983 read 0x0bdf2a thru 0x0cb29a (0xd371 bytes) 000246[1] 1747828493.435436 mapread 0x06be76 thru 0x06f11c (0x32a7 bytes) 000248[1] 1747828493.445850 mapwrite 0x87a298 thru 0x886a39 (0xc7a2 bytes) 000249[0] 1747828493.493971 mapread 0x56da2b thru 0x57d530 (0xfb06 bytes) 000253[0] 1747828493.523604 trunc from 0x886a3a to 0x9eca74 (0x16603b bytes) 000255[1] 1747828493.538799 mapread 0x114cbf thru 0x119ead (0x51ef bytes) 000261[0] 1747828493.556367 trunc from 0x9eca75 to 0x3b1cab (0x63adc9 bytes) 000262[0] 1747828493.563695 mapread 0x363ffc thru 0x367150 (0x3155 bytes) 000263[1] 1747828493.570016 write 0x4ceec7 thru 0x4de9a6 (0xfae0 bytes) 000264[1] 1747828493.575427 read 0x25324b thru 0x25b180 (0x7f36 bytes) 000265[0] 1747828493.583456 trunc from 0x4de9a7 to 0x09432d (0x44a679 bytes) 000266[1] 1747828493.590908 mapwrite 0x302688 thru 0x311b81 (0xf4fa bytes) 000267[1] 1747828493.614839 read 0x26fe4b thru 0x278635 (0x87eb bytes) 000268[0] 1747828493.622854 mapwrite 0x44c8bf thru 0x4597f5 (0xcf37 bytes) 000270[1] 1747828493.659559 mapread 0x2872ae thru 0x291e3f (0xab92 bytes) 000271[1] 1747828493.674897 mapread 0x1d0997 thru 0x1d855d (0x7bc7 bytes) 000274[0] 1747828493.691121 trunc from 0x4597f6 to 0x4c4438 (0x6ac43 bytes) 000275[0] 1747828493.699062 read 0x1dde51 thru 0x1ded31 (0xee1 bytes) 000278[1] 1747828493.708948 read 0x12c661 thru 0x1370d1 (0xaa71 bytes) 000282[0] 1747828493.725931 trunc from 0x4c4439 to 0x388f2f (0x13b509 bytes) 000286[0] 1747828493.741660 mapwrite 0x9ed5da thru 0x9f171f (0x4146 bytes) 000290[1] 1747828493.780597 read 0x6dd109 thru 0x6e8dbe (0xbcb6 bytes) 000291[1] 1747828493.790309 trunc from 0x9f1720 to 0x0d4eb6 (0x91c869 bytes) 000294[1] 1747828493.807745 write 0x56b3bb thru 0x57a807 (0xf44d bytes) 000295[0] 1747828493.809597 mapwrite 0x2491dc thru 0x24f1fd (0x6022 bytes) 000298[1] 1747828493.859240 mapwrite 0x075179 thru 0x079bef (0x4a77 bytes) 000299[1] 1747828493.879500 trunc from 0x57a808 to 0x81ecb2 (0x2a44ab bytes) 000301[1] 1747828493.883483 mapwrite 0x1a83e8 thru 0x1b1060 (0x8c79 bytes) 000302[1] 1747828493.916178 read 0x221821 thru 0x22516e (0x394e bytes) 000303[1] 1747828493.936132 write 0x97ccf7 thru 0x986a8a (0x9d94 bytes) 000304[0] 1747828493.939885 mapread 0x8d29c2 thru 0x8d365d (0xc9c bytes) 000305[1] 1747828493.951266 read 0x2b8897 thru 0x2bc9be (0x4128 bytes) 000307[1] 1747828493.968609 mapread 0x02922b thru 0x03008d (0x6e63 bytes) 000309[1] 1747828493.979329 mapread 0x1a28b7 thru 0x1a4799 (0x1ee3 bytes) 000310[1] 1747828493.984757 mapread 0x7264df thru 0x728894 (0x23b6 bytes) 000311[1] 1747828493.988269 mapwrite 0x053603 thru 0x05b3f8 (0x7df6 bytes) 000314[1] 1747828494.019387 mapwrite 0x633d31 thru 0x6395cf (0x589f bytes) 000316[0] 1747828494.046182 mapread 0x53a6f6 thru 0x542cbf (0x85ca bytes) 000318[1] 1747828494.072395 trunc from 0x986a8b to 0x5d09cc (0x3b60be bytes) 000320[1] 1747828494.078527 mapwrite 0x9b45a8 thru 0x9b8dc8 (0x4821 bytes) 000322[0] 1747828494.099993 write 0x30989e thru 0x30c1d5 (0x2938 bytes) 000326[0] 1747828494.118114 read 0x9b7e9d thru 0x9b8dc8 (0xf2c bytes) 000328[1] 1747828494.125374 read 0x356cd4 thru 0x3668c6 (0xfbf3 bytes) 000330[1] 1747828494.150789 mapread 0x242312 thru 0x250458 (0xe147 bytes) 000332[1] 1747828494.165295 write 0x21e93b thru 0x22b8e8 (0xcfae bytes) 000333[0] 1747828494.167975 trunc from 0x9b8dc9 to 0x2470ce (0x771cfa bytes) 000337[0] 1747828494.183919 trunc from 0x2470cf to 0x00d878 (0x239856 bytes) 000338[0] 1747828494.186611 mapread 0x00b2b7 thru 0x00d878 (0x25c2 bytes) 000339[1] 1747828494.193593 write 0x449e36 thru 0x44af0a (0x10d5 bytes) 000342[0] 1747828494.205681 write 0x273520 thru 0x274cfc (0x17dd bytes) 000343[1] 1747828494.210676 mapwrite 0x625625 thru 0x629ca3 (0x467f bytes) 000344[0] 1747828494.237119 write 0x8a8d11 thru 0x8b52ca (0xc5ba bytes) 000345[1] 1747828494.242972 mapwrite 0x7d5301 thru 0x7d86fd (0x33fd bytes) 000346[1] 1747828494.278135 mapwrite 0x3fb224 thru 0x401491 (0x626e bytes) 000347[0] 1747828494.308543 trunc from 0x8b52cb to 0x173665 (0x741c65 bytes) 000348[0] 1747828494.317216 read 0x0dbfdc thru 0x0e3a68 (0x7a8d bytes) 000350[0] 1747828494.325681 mapwrite 0x1011d4 thru 0x10cf90 (0xbdbd bytes) 000351[1] 1747828494.339871 read 0x0fb4f5 thru 0x1020d8 (0x6be4 bytes) 000352[1] 1747828494.349150 mapread 0x0e9f04 thru 0x0f765b (0xd758 bytes) 000353[1] 1747828494.361701 read 0x13589f thru 0x13f791 (0x9ef3 bytes) 000354[1] 1747828494.362013 read 0x00fde3 thru 0x01e17a (0xe398 bytes) 000358[0] 1747828494.369148 trunc from 0x173666 to 0x21a206 (0xa6ba1 bytes) 000359[1] 1747828494.380573 trunc from 0x21a207 to 0x82848c (0x60e286 bytes) 000365[0] 1747828494.396730 read 0x15857f thru 0x15a3d2 (0x1e54 bytes) 000366[1] 1747828494.403171 read 0x1f4aa1 thru 0x20109a (0xc5fa bytes) 000371[0] 1747828494.427862 mapread 0x192f64 thru 0x194265 (0x1302 bytes) 000372[1] 1747828494.429743 trunc from 0x82848d to 0x35cacd (0x4cb9bf bytes) 000374[0] 1747828494.445666 mapwrite 0x9b67c4 thru 0x9c5c11 (0xf44e bytes) 000376[1] 1747828494.485912 mapwrite 0x4082af thru 0x4159ce (0xd720 bytes) 000378[1] 1747828494.534485 mapread 0x3aa387 thru 0x3adb7f (0x37f9 bytes) 000380[1] 1747828494.557523 write 0x0a01ca thru 0x0a84c3 (0x82fa bytes) 000381[0] 1747828494.564140 trunc from 0x9c5c12 to 0x7a1773 (0x22449e bytes) 000384[0] 1747828494.581488 read 0x4170ed thru 0x41fc56 (0x8b6a bytes) 000385[0] 1747828494.596251 read 0x2eb84e thru 0x2f38ca (0x807d bytes) 000391[0] 1747828494.617980 write 0x85729d thru 0x85c15e (0x4ec2 bytes) 000392[1] 1747828494.622302 trunc from 0x85c15f to 0x35a3c2 (0x501d9c bytes) 000393[0] 1747828494.638503 mapread 0x042811 thru 0x05156b (0xed5b bytes) 000399[0] 1747828494.669527 write 0x3f7e29 thru 0x3fbb3a (0x3d12 bytes) 000401[0] 1747828494.675943 mapwrite 0x9556a4 thru 0x9570af (0x1a0c bytes) 000402[0] 1747828494.703526 write 0x4036c9 thru 0x407e37 (0x476f bytes) 000403[1] 1747828494.714325 mapread 0x3e078c thru 0x3e703e (0x68b3 bytes) 000404[1] 1747828494.730664 read 0x1356a1 thru 0x13d2bd (0x7c1d bytes) 000405[0] 1747828494.736699 trunc from 0x9570b0 to 0x056f54 (0x90015b bytes) 000408[1] 1747828494.760865 read 0x02849a thru 0x033398 (0xaeff bytes) 000409[1] 1747828494.769914 mapwrite 0x65d99c thru 0x6617f0 (0x3e55 bytes) 000410[0] 1747828494.816908 trunc from 0x6617f1 to 0x001851 (0x65ff9f bytes) 000412[1] 1747828494.836732 trunc from 0x001852 to 0x1fa1c1 (0x1f8970 bytes) 000416[1] 1747828494.857527 read 0x09db6e thru 0x0a29d8 (0x4e6b bytes) 000418[1] 1747828494.870044 mapwrite 0x5565ff thru 0x55e6da (0x80dc bytes) 000419[0] 1747828494.910760 read 0x0163e7 thru 0x01b216 (0x4e30 bytes) 000421[0] 1747828494.929947 write 0x278760 thru 0x288562 (0xfe03 bytes) 000422[1] 1747828494.938730 mapread 0x421fe7 thru 0x426262 (0x427c bytes) 000423[1] 1747828494.950126 mapread 0x3a36b9 thru 0x3a7a29 (0x4371 bytes) 000425[0] 1747828494.950668 write 0x54df93 thru 0x557416 (0x9484 bytes) 000426[1] 1747828494.963914 mapwrite 0x344d7a thru 0x3518a9 (0xcb30 bytes) 000430[1] 1747828495.000478 mapread 0x4a4235 thru 0x4a8248 (0x4014 bytes) 000431[1] 1747828495.010271 trunc from 0x55e6db to 0x9c85cf (0x469ef5 bytes) 000433[0] 1747828495.023252 mapwrite 0x30ee52 thru 0x31a228 (0xb3d7 bytes) 000434[1] 1747828495.056145 mapread 0x82d30b thru 0x838ef3 (0xbbe9 bytes) 000435[1] 1747828495.071985 mapwrite 0x40d6e0 thru 0x4106ac (0x2fcd bytes) 000438[1] 1747828495.100893 read 0x87e439 thru 0x8817ba (0x3382 bytes) 000439[0] 1747828495.110795 write 0x1ccf26 thru 0x1d0438 (0x3513 bytes) 000440[0] 1747828495.116891 write 0x838d13 thru 0x8458a4 (0xcb92 bytes) 000441[0] 1747828495.154462 read 0x14d944 thru 0x150173 (0x2830 bytes) 000443[0] 1747828495.169094 trunc from 0x9c85d0 to 0x24555f (0x783070 bytes) 000444[1] 1747828495.181015 write 0x8cb598 thru 0x8d357c (0x7fe5 bytes) 000445[0] 1747828495.191164 write 0x35ae86 thru 0x365e71 (0xafec bytes) 000446[0] 1747828495.195085 mapread 0x6cbedb thru 0x6d5a09 (0x9b2f bytes) 000447[0] 1747828495.211618 mapwrite 0x89ec4c thru 0x8ad116 (0xe4cb bytes) 000448[1] 1747828495.248381 write 0x03dbb2 thru 0x03e84c (0xc9b bytes) 000449[1] 1747828495.256317 mapread 0x2fb16e thru 0x2fd3dd (0x2270 bytes) 000450[0] 1747828495.264437 read 0x133bbf thru 0x136e03 (0x3245 bytes) 000452[0] 1747828495.273112 mapread 0x1e86a3 thru 0x1ed987 (0x52e5 bytes) 000453[1] 1747828495.277577 read 0x33cda3 thru 0x34c31a (0xf578 bytes) 000454[1] 1747828495.294936 mapwrite 0x1d4d08 thru 0x1e00e0 (0xb3d9 bytes) 000455[1] 1747828495.326581 read 0x089fa7 thru 0x092d71 (0x8dcb bytes) 000456[1] 1747828495.346436 write 0x5c7622 thru 0x5c9285 (0x1c64 bytes) 000458[0] 1747828495.353538 read 0x4e47ca thru 0x4f19b1 (0xd1e8 bytes) 000460[0] 1747828495.377236 trunc from 0x8d357d to 0x86920b (0x6a371 bytes) 000463[1] 1747828495.403959 mapread 0x639922 thru 0x63c274 (0x2953 bytes) 000464[0] 1747828495.414506 mapwrite 0x383a4f thru 0x38b327 (0x78d9 bytes) 000465[1] 1747828495.456188 mapread 0x03299f thru 0x040e67 (0xe4c9 bytes) 000467[0] 1747828495.478875 read 0x50463e thru 0x50e6d0 (0xa093 bytes) 000468[1] 1747828495.479219 mapwrite 0x099712 thru 0x09b1f6 (0x1ae5 bytes) 000469[1] 1747828495.505129 trunc from 0x86920c to 0x775110 (0xf40fb bytes) 000470[0] 1747828495.516764 mapread 0x680c42 thru 0x68609a (0x5459 bytes) 000472[1] 1747828495.529081 write 0x5722ee thru 0x57efc3 (0xccd6 bytes) 000476[0] 1747828495.535218 mapread 0x32a2a2 thru 0x32c4e5 (0x2244 bytes) 000477[1] 1747828495.543862 write 0x7a6179 thru 0x7ac56e (0x63f6 bytes) 000478[1] 1747828495.549892 trunc from 0x7ac56f to 0x27512b (0x537443 bytes) 000479[1] 1747828495.558845 mapwrite 0x588758 thru 0x5977ad (0xf056 bytes) 000484[1] 1747828495.609504 trunc from 0x5977ae to 0x309f87 (0x28d826 bytes) 000485[1] 1747828495.618575 read 0x1e7ab8 thru 0x1f0216 (0x875f bytes) 000486[0] 1747828495.624982 read 0x06735a thru 0x06dac4 (0x676b bytes) 000487[1] 1747828495.634399 write 0x252da8 thru 0x25d041 (0xa29a bytes) 000489[1] 1747828495.641861 mapwrite 0x5e60b7 thru 0x5f00e7 (0xa031 bytes) 000490[0] 1747828495.673660 trunc from 0x5f00e8 to 0x20bf8b (0x3e415c bytes) 000492[1] 1747828495.688286 read 0x0db67b thru 0x0e4a66 (0x93ec bytes) 000494[0] 1747828495.700965 read 0x15b98e thru 0x1629b3 (0x7026 bytes) 000495[0] 1747828495.710690 write 0x43c346 thru 0x446a78 (0xa733 bytes) 000499[1] 1747828495.721829 trunc from 0x446a79 to 0x6a3a2e (0x25cfb6 bytes) 000500[0] 1747828495.737210 mapread 0x2d2721 thru 0x2e153b (0xee1b bytes) All operations completed A-OK! Chance of close/open is 1 in 50 Seed set to 8495 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000004[0] 1747828495.959920 mapwrite 0x47e000 thru 0x480335 (0x2336 bytes) 000005[1] 1747828495.996801 mapwrite 0x28a000 thru 0x297b13 (0xdb14 bytes) 000008[1] 1747828496.026190 read 0x3b2000 thru 0x3b6f90 (0x4f91 bytes) 000009[1] 1747828496.033116 write 0x212000 thru 0x221de6 (0xfde7 bytes) 000012[0] 1747828496.035161 write_OD 0x374000 thru 0x375fff (0x2000 bytes) 000014[1] 1747828496.053295 write 0x134000 thru 0x13dfbf (0x9fc0 bytes) truncating to largest ever: 0x42e631 000015[0] 1747828496.058425 trunc from 0x480336 to 0x42e630 (0x51d05 bytes) 000016[0] 1747828496.073106 write_OD 0x37e000 thru 0x384fff (0x7000 bytes) 000018[0] 1747828496.095105 write_OD 0x8a8000 thru 0x8b2fff (0xb000 bytes) 000020[1] 1747828496.115423 read 0x397000 thru 0x39c3a8 (0x53a9 bytes) 000021[1] 1747828496.140448 mapwrite 0x0b6000 thru 0x0c567d (0xf67e bytes) 000022[1] 1747828496.173673 mapwrite 0x71c000 thru 0x7269cb (0xa9cc bytes) 000024[1] 1747828496.200542 trunc from 0x8b3000 to 0x1cb032 (0x6e7fcd bytes) 000026[1] 1747828496.210494 mapwrite 0x3f4000 thru 0x3f67b3 (0x27b4 bytes) 000028[1] 1747828496.234811 mapread 0x2d9000 thru 0x2dbef9 (0x2efa bytes) 000029[0] 1747828496.242063 write_OD 0x071000 thru 0x07ffff (0xf000 bytes) 000030[0] 1747828496.254604 mapread 0x00a000 thru 0x014d08 (0xad09 bytes) 000032[1] 1747828496.260763 write 0x602000 thru 0x6080c1 (0x60c2 bytes) 000034[0] 1747828496.270686 mapread 0x186000 thru 0x18c7b0 (0x67b1 bytes) 000039[0] 1747828496.283111 trunc from 0x6080c2 to 0x05ca5a (0x5ab667 bytes) truncating to largest ever: 0x73a687 000040[0] 1747828496.289788 trunc from 0x05ca5b to 0x73a686 (0x6ddc2c bytes) 000042[1] 1747828496.298879 read 0x014000 thru 0x015e48 (0x1e49 bytes) 000044[0] 1747828496.329630 read_OD 0x0df000 thru 0x0e0fff (0x2000 bytes) 000046[1] 1747828496.332415 mapread 0x23a000 thru 0x23afb8 (0xfb9 bytes) 000048[1] 1747828496.333154 read 0x3d1000 thru 0x3db848 (0xa849 bytes) 000049[1] 1747828496.333440 write 0x55e000 thru 0x55e8ca (0x8cb bytes) 000053[0] 1747828496.349161 trunc from 0x73a687 to 0x09f5d7 (0x69b0af bytes) 000054[0] 1747828496.359525 write_OD 0x9a5000 thru 0x9b1fff (0xd000 bytes) 000055[0] 1747828496.376674 read_OD 0x379000 thru 0x384fff (0xc000 bytes) 000058[1] 1747828496.379298 write 0x6ed000 thru 0x6f885b (0xb85c bytes) 000059[0] 1747828496.382925 trunc from 0x9b2000 to 0x517d43 (0x49a2bc bytes) 000060[0] 1747828496.395160 write_OD 0x25d000 thru 0x262fff (0x6000 bytes) 000063[1] 1747828496.408387 read 0x470000 thru 0x47edd2 (0xedd3 bytes) 000064[1] 1747828496.413749 write 0x0df000 thru 0x0e0e79 (0x1e7a bytes) 000065[1] 1747828496.417588 mapread 0x12e000 thru 0x1365c1 (0x85c2 bytes) 000066[0] 1747828496.432405 write_OD 0x449000 thru 0x455fff (0xd000 bytes) 000069[1] 1747828496.448770 mapread 0x219000 thru 0x227b13 (0xeb14 bytes) 000073[0] 1747828496.464160 mapread 0x411000 thru 0x41f9a1 (0xe9a2 bytes) 000077[1] 1747828496.473512 mapwrite 0x4d0000 thru 0x4dce8c (0xce8d bytes) 000079[1] 1747828496.506377 write 0x165000 thru 0x167610 (0x2611 bytes) 000081[1] 1747828496.510682 mapwrite 0x263000 thru 0x26f0ff (0xc100 bytes) 000085[0] 1747828496.553471 read_OD 0x189000 thru 0x192fff (0xa000 bytes) 000086[1] 1747828496.560668 mapwrite 0x5ce000 thru 0x5d67e4 (0x87e5 bytes) 000087[0] 1747828496.588887 mapwrite 0x9dd000 thru 0x9e82eb (0xb2ec bytes) 000091[1] 1747828496.653595 write 0x1c6000 thru 0x1d4a53 (0xea54 bytes) 000094[0] 1747828496.668089 write_OD 0x7ef000 thru 0x7f7fff (0x9000 bytes) 000095[0] 1747828496.686511 trunc from 0x9e82ec to 0x20f7c2 (0x7d8b29 bytes) 000097[1] 1747828496.700201 read 0x203000 thru 0x20eca5 (0xbca6 bytes) 000098[1] 1747828496.705788 read 0x110000 thru 0x116f9b (0x6f9c bytes) 000099[1] 1747828496.713957 mapread 0x19e000 thru 0x1a3e50 (0x5e51 bytes) 000100[1] 1747828496.714322 read 0x052000 thru 0x058f3c (0x6f3d bytes) 000101[1] 1747828496.720312 write 0x681000 thru 0x68f147 (0xe148 bytes) 000102[1] 1747828496.727605 write 0x57f000 thru 0x58b78a (0xc78b bytes) 000106[1] 1747828496.743593 mapwrite 0x0db000 thru 0x0e3ccb (0x8ccc bytes) 000108[1] 1747828496.770192 read 0x1cf000 thru 0x1d0c05 (0x1c06 bytes) 000114[0] 1747828496.793182 read_OD 0x50b000 thru 0x519fff (0xf000 bytes) 000115[0] 1747828496.808097 trunc from 0x68f148 to 0x40c81f (0x282928 bytes) 000116[1] 1747828496.822613 write 0x2ac000 thru 0x2b4606 (0x8607 bytes) 000117[0] 1747828496.831244 mapread 0x20e000 thru 0x21822e (0xa22f bytes) 000119[1] 1747828496.850649 mapread 0x2e4000 thru 0x2ed053 (0x9054 bytes) 000123[1] 1747828496.863771 write 0x703000 thru 0x708378 (0x5379 bytes) 000125[0] 1747828496.869730 mapwrite 0x61a000 thru 0x627b85 (0xdb86 bytes) 000126[1] 1747828496.900282 mapwrite 0x503000 thru 0x50c9be (0x99bf bytes) 000127[0] 1747828496.934710 trunc from 0x708379 to 0x0d23d4 (0x635fa4 bytes) 000128[1] 1747828496.940799 read 0x027000 thru 0x0278b9 (0x8ba bytes) 000129[1] 1747828496.948997 mapread 0x0cf000 thru 0x0d20a7 (0x30a8 bytes) 000130[0] 1747828496.950294 mapwrite 0x469000 thru 0x4764e2 (0xd4e3 bytes) 000133[1] 1747828496.993851 read 0x3bf000 thru 0x3c7875 (0x8876 bytes) 000134[0] 1747828497.002016 write_OD 0x1c0000 thru 0x1c7fff (0x8000 bytes) 000137[0] 1747828497.016159 mapread 0x047000 thru 0x052647 (0xb648 bytes) 000139[1] 1747828497.031587 trunc from 0x4764e3 to 0x282b88 (0x1f395a bytes) 000140[1] 1747828497.038838 trunc from 0x282b89 to 0x14c4d6 (0x1366b2 bytes) 000141[0] 1747828497.042140 mapwrite 0x8ee000 thru 0x8f7499 (0x949a bytes) 000142[1] 1747828497.071605 mapwrite 0x895000 thru 0x898404 (0x3405 bytes) 000147[1] 1747828497.104877 read 0x267000 thru 0x2761b8 (0xf1b9 bytes) 000150[0] 1747828497.110483 mapwrite 0x7d6000 thru 0x7dac9b (0x4c9c bytes) 000151[1] 1747828497.132732 read 0x172000 thru 0x180c4e (0xec4f bytes) 000152[1] 1747828497.150687 mapread 0x20d000 thru 0x215bd2 (0x8bd3 bytes) 000154[1] 1747828497.152500 trunc from 0x8f749a to 0x31ccb6 (0x5da7e3 bytes) 000155[1] 1747828497.168908 mapwrite 0x205000 thru 0x212c91 (0xdc92 bytes) 000156[0] 1747828497.197300 write_OD 0x8e7000 thru 0x8edfff (0x7000 bytes) truncating to largest ever: 0x7b60f3 000159[0] 1747828497.214327 trunc from 0x8ee000 to 0x7b60f2 (0x137f0d bytes) 000160[0] 1747828497.222326 mapwrite 0x478000 thru 0x47ef9e (0x6f9f bytes) 000166[0] 1747828497.251666 write_OD 0x5fa000 thru 0x5fbfff (0x2000 bytes) 000167[1] 1747828497.263417 write 0x43b000 thru 0x445fd7 (0xafd8 bytes) 000168[0] 1747828497.270336 mapread 0x2f9000 thru 0x2f9724 (0x725 bytes) 000169[0] 1747828497.277658 mapwrite 0x2c8000 thru 0x2d5043 (0xd044 bytes) 000170[0] 1747828497.310027 trunc from 0x7b60f3 to 0x23de42 (0x5782b0 bytes) 000171[0] 1747828497.314515 write_OD 0x4ce000 thru 0x4dafff (0xd000 bytes) 000172[1] 1747828497.328194 read 0x0bb000 thru 0x0bd9b2 (0x29b3 bytes) 000173[0] 1747828497.344855 write_OD 0x874000 thru 0x87dfff (0xa000 bytes) 000174[1] 1747828497.360509 write 0x3f6000 thru 0x40041b (0xa41c bytes) 000176[1] 1747828497.377441 read 0x2fb000 thru 0x301732 (0x6733 bytes) 000177[0] 1747828497.389678 trunc from 0x87e000 to 0x6c8a7e (0x1b5581 bytes) 000178[0] 1747828497.400591 write_OD 0x3d2000 thru 0x3ddfff (0xc000 bytes) 000179[0] 1747828497.414026 read_OD 0x44f000 thru 0x453fff (0x5000 bytes) 000180[0] 1747828497.416324 mapwrite 0x600000 thru 0x602e1c (0x2e1d bytes) 000181[0] 1747828497.446640 mapwrite 0x6ba000 thru 0x6c8968 (0xe969 bytes) 000184[1] 1747828497.466744 write 0x389000 thru 0x38f48d (0x648e bytes) 000186[0] 1747828497.472217 write_OD 0x027000 thru 0x02dfff (0x7000 bytes) 000190[0] 1747828497.489945 read_OD 0x1e9000 thru 0x1f4fff (0xc000 bytes) 000195[0] 1747828497.492582 mapwrite 0x3b9000 thru 0x3c0ca6 (0x7ca7 bytes) 000200[1] 1747828497.533427 mapwrite 0x7e2000 thru 0x7e86f3 (0x66f4 bytes) 000204[1] 1747828497.566614 mapwrite 0x5fe000 thru 0x60a328 (0xc329 bytes) 000205[1] 1747828497.592930 read 0x160000 thru 0x16c269 (0xc26a bytes) 000206[1] 1747828497.618021 write 0x087000 thru 0x0940b6 (0xd0b7 bytes) 000208[1] 1747828497.622374 read 0x1a8000 thru 0x1ae698 (0x6699 bytes) 000209[0] 1747828497.622630 mapwrite 0x0ff000 thru 0x100901 (0x1902 bytes) truncating to largest ever: 0x957202 000210[0] 1747828497.654256 trunc from 0x7e86f4 to 0x957201 (0x16eb0e bytes) 000211[1] 1747828497.661026 mapwrite 0x7f3000 thru 0x800509 (0xd50a bytes) 000213[1] 1747828497.699019 mapwrite 0x871000 thru 0x87e257 (0xd258 bytes) 000215[0] 1747828497.726021 mapread 0x813000 thru 0x81d03a (0xa03b bytes) 000217[1] 1747828497.736848 read 0x3d7000 thru 0x3e3723 (0xc724 bytes) 000220[0] 1747828497.755329 trunc from 0x957202 to 0x53e89f (0x418962 bytes) 000223[0] 1747828497.773877 mapwrite 0x6b2000 thru 0x6b5b40 (0x3b41 bytes) 000225[0] 1747828497.793899 write_OD 0x0ad000 thru 0x0b3fff (0x7000 bytes) 000227[1] 1747828497.808842 read 0x4cd000 thru 0x4d23b8 (0x53b9 bytes) 000231[1] 1747828497.818899 read 0x17a000 thru 0x187f04 (0xdf05 bytes) 000235[1] 1747828497.832797 write 0x3d1000 thru 0x3dde73 (0xce74 bytes) 000238[1] 1747828497.840223 mapread 0x308000 thru 0x30f888 (0x7889 bytes) 000239[0] 1747828497.847452 mapread 0x162000 thru 0x1654f7 (0x34f8 bytes) 000240[1] 1747828497.857819 write 0x83c000 thru 0x846062 (0xa063 bytes) 000241[1] 1747828497.860880 mapwrite 0x950000 thru 0x95edbf (0xedc0 bytes) 000244[0] 1747828497.896273 mapwrite 0x9dd000 thru 0x9e52cc (0x82cd bytes) 000246[1] 1747828497.930714 trunc from 0x9e52cd to 0x1ad645 (0x837c87 bytes) 000251[0] 1747828497.942423 mapwrite 0x8fc000 thru 0x8fc246 (0x247 bytes) 000252[1] 1747828497.963694 mapread 0x18e000 thru 0x196d87 (0x8d88 bytes) 000254[0] 1747828497.976661 trunc from 0x8fc247 to 0x29cfa9 (0x65f29d bytes) 000255[1] 1747828497.984741 mapwrite 0x428000 thru 0x42e93d (0x693e bytes) 000256[1] 1747828498.009296 trunc from 0x42e93e to 0x917a19 (0x4e90dc bytes) 000257[0] 1747828498.016889 mapread 0x47f000 thru 0x48ee4a (0xfe4b bytes) 000259[1] 1747828498.035310 write 0x4fa000 thru 0x50917e (0xf17f bytes) 000260[1] 1747828498.042720 read 0x39e000 thru 0x3a2afd (0x4afe bytes) 000262[0] 1747828498.071372 mapread 0x1f1000 thru 0x1f39c0 (0x29c1 bytes) 000263[1] 1747828498.084689 mapread 0x886000 thru 0x892e3c (0xce3d bytes) 000265[1] 1747828498.104325 read 0x4d3000 thru 0x4da6c0 (0x76c1 bytes) 000266[1] 1747828498.121098 read 0x4cb000 thru 0x4d6f5e (0xbf5f bytes) 000270[0] 1747828498.124392 write_OD 0x977000 thru 0x97cfff (0x6000 bytes) 000271[0] 1747828498.142061 mapread 0x034000 thru 0x036c03 (0x2c04 bytes) 000274[0] 1747828498.147323 trunc from 0x97d000 to 0x419976 (0x563689 bytes) 000275[0] 1747828498.155048 mapwrite 0x377000 thru 0x378ebd (0x1ebe bytes) 000278[0] 1747828498.176784 write_OD 0x6a0000 thru 0x6aafff (0xb000 bytes) 000279[0] 1747828498.190110 write_OD 0x416000 thru 0x424fff (0xf000 bytes) 000280[0] 1747828498.206283 write_OD 0x902000 thru 0x90dfff (0xc000 bytes) 000281[0] 1747828498.223019 trunc from 0x90e000 to 0x42d020 (0x4e0fdf bytes) 000282[1] 1747828498.229903 mapread 0x41a000 thru 0x4245b8 (0xa5b9 bytes) 000287[0] 1747828498.260920 trunc from 0x42d021 to 0x276c6f (0x1b63b1 bytes) 000291[0] 1747828498.279430 mapread 0x037000 thru 0x03ece3 (0x7ce4 bytes) 000292[1] 1747828498.287965 trunc from 0x276c70 to 0x08d4a8 (0x1e97c7 bytes) 000294[0] 1747828498.301127 mapwrite 0x915000 thru 0x917f7d (0x2f7e bytes) 000296[1] 1747828498.323143 mapwrite 0x57d000 thru 0x58aa15 (0xda16 bytes) 000297[1] 1747828498.348598 read 0x0e5000 thru 0x0f3e38 (0xee39 bytes) truncating to largest ever: 0x990453 000298[1] 1747828498.354483 trunc from 0x917f7e to 0x990452 (0x784d5 bytes) 000299[1] 1747828498.361637 read 0x13f000 thru 0x13fd73 (0xd74 bytes) 000300[1] 1747828498.395911 write 0x49d000 thru 0x4a5c79 (0x8c7a bytes) 000302[0] 1747828498.399106 trunc from 0x990453 to 0x4013d5 (0x58f07d bytes) 000304[1] 1747828498.417792 read 0x3bb000 thru 0x3bbf90 (0xf91 bytes) 000306[1] 1747828498.423417 mapwrite 0x6df000 thru 0x6ed2fc (0xe2fd bytes) 000307[0] 1747828498.458454 trunc from 0x6ed2fd to 0x342fbf (0x3aa33d bytes) 000308[1] 1747828498.472010 read 0x027000 thru 0x0325b9 (0xb5ba bytes) 000309[0] 1747828498.488836 write_OD 0x539000 thru 0x539fff (0x1000 bytes) 000310[0] 1747828498.507425 trunc from 0x53a000 to 0x655db9 (0x11bdba bytes) 000312[1] 1747828498.514385 trunc from 0x655dba to 0x3fcda3 (0x259016 bytes) 000314[1] 1747828498.524796 mapread 0x1b2000 thru 0x1b6d6e (0x4d6f bytes) 000315[1] 1747828498.534660 write 0x9f3000 thru 0x9f8bfc (0x5bfd bytes) 000317[0] 1747828498.536371 mapread 0x5de000 thru 0x5e8665 (0xa666 bytes) 000318[0] 1747828498.560637 write_OD 0x2ef000 thru 0x2fafff (0xc000 bytes) 000321[0] 1747828498.573930 read_OD 0x1c9000 thru 0x1d3fff (0xb000 bytes) 000323[1] 1747828498.576678 mapread 0x804000 thru 0x81372c (0xf72d bytes) 000336[0] 1747828498.596407 mapwrite 0x538000 thru 0x53e076 (0x6077 bytes) 000338[1] 1747828498.649650 read 0x8fc000 thru 0x90508e (0x908f bytes) 000339[1] 1747828498.665014 read 0x1b4000 thru 0x1b9dbe (0x5dbf bytes) 000340[0] 1747828498.690956 read_OD 0x877000 thru 0x880fff (0xa000 bytes) 000341[1] 1747828498.692906 mapwrite 0x53b000 thru 0x53d636 (0x2637 bytes) 000344[1] 1747828498.736535 write 0x531000 thru 0x5364c0 (0x54c1 bytes) 000345[1] 1747828498.746735 write 0x246000 thru 0x25224b (0xc24c bytes) 000348[1] 1747828498.750603 mapread 0x44e000 thru 0x459e9a (0xbe9b bytes) 000350[1] 1747828498.769774 trunc from 0x9f8bfd to 0x669f96 (0x38ec66 bytes) 000351[1] 1747828498.776826 mapwrite 0x834000 thru 0x838104 (0x4105 bytes) 000353[0] 1747828498.808421 write_OD 0x67d000 thru 0x683fff (0x7000 bytes) 000356[1] 1747828498.823801 mapwrite 0x052000 thru 0x05b022 (0x9023 bytes) 000357[0] 1747828498.854144 write_OD 0x842000 thru 0x850fff (0xf000 bytes) 000361[1] 1747828498.870989 read 0x671000 thru 0x673efd (0x2efe bytes) 000363[0] 1747828498.880786 trunc from 0x851000 to 0x44e658 (0x4029a7 bytes) 000365[0] 1747828498.893703 read_OD 0x1ed000 thru 0x1f4fff (0x8000 bytes) 000366[0] 1747828498.897519 mapwrite 0x1fa000 thru 0x200168 (0x6169 bytes) 000367[0] 1747828498.926911 read_OD 0x3a3000 thru 0x3a7fff (0x5000 bytes) 000369[1] 1747828498.933862 mapwrite 0x89b000 thru 0x8a98a6 (0xe8a7 bytes) 000370[0] 1747828498.962741 read_OD 0x8a3000 thru 0x8a7fff (0x5000 bytes) 000371[1] 1747828498.970090 write 0x92f000 thru 0x9343f3 (0x53f4 bytes) 000372[0] 1747828498.973039 trunc from 0x9343f4 to 0x89b5f4 (0x98dff bytes) 000373[1] 1747828498.980522 mapwrite 0x9d5000 thru 0x9d5207 (0x208 bytes) 000374[0] 1747828498.998322 trunc from 0x9d5208 to 0x642500 (0x392d07 bytes) 000376[1] 1747828499.008063 read 0x635000 thru 0x6373f2 (0x23f3 bytes) 000380[1] 1747828499.013662 write 0x364000 thru 0x36ecce (0xaccf bytes) 000381[1] 1747828499.020486 mapwrite 0x97d000 thru 0x987697 (0xa698 bytes) 000382[0] 1747828499.053036 mapread 0x572000 thru 0x57f3cf (0xd3d0 bytes) 000383[1] 1747828499.077998 trunc from 0x987698 to 0x66ef09 (0x31878e bytes) 000384[0] 1747828499.089487 trunc from 0x66ef0a to 0x98e117 (0x31f20e bytes) 000389[0] 1747828499.114954 write_OD 0x42c000 thru 0x433fff (0x8000 bytes) 000397[1] 1747828499.131894 mapwrite 0x7a7000 thru 0x7b572c (0xe72d bytes) 000402[0] 1747828499.171703 mapwrite 0x3f8000 thru 0x3fc478 (0x4479 bytes) 000403[1] 1747828499.202151 read 0x073000 thru 0x075f5a (0x2f5b bytes) 000404[1] 1747828499.227037 mapread 0x882000 thru 0x8843e9 (0x23ea bytes) 000406[0] 1747828499.230001 trunc from 0x98e118 to 0x826db5 (0x167362 bytes) 000408[1] 1747828499.255396 mapread 0x01f000 thru 0x020321 (0x1322 bytes) 000410[1] 1747828499.263254 trunc from 0x826db6 to 0x05a76d (0x7cc648 bytes) 000411[1] 1747828499.269401 read 0x038000 thru 0x039e41 (0x1e42 bytes) 000413[1] 1747828499.275774 write 0x7b4000 thru 0x7c3d96 (0xfd97 bytes) 000414[0] 1747828499.277851 trunc from 0x7c3d97 to 0x83a5ea (0x76854 bytes) 000415[0] 1747828499.289082 write_OD 0x8f3000 thru 0x900fff (0xe000 bytes) 000416[0] 1747828499.302281 read_OD 0x5cc000 thru 0x5d8fff (0xd000 bytes) 000417[1] 1747828499.306020 trunc from 0x901000 to 0x5fa955 (0x3066aa bytes) 000418[0] 1747828499.312040 write_OD 0x9e9000 thru 0x9f5fff (0xd000 bytes) 000419[0] 1747828499.324752 mapwrite 0x633000 thru 0x63e229 (0xb22a bytes) 000420[1] 1747828499.362165 mapread 0x19b000 thru 0x1a36af (0x86b0 bytes) 000421[0] 1747828499.399941 mapwrite 0x4d0000 thru 0x4d7538 (0x7539 bytes) 000422[1] 1747828499.431844 trunc from 0x9f6000 to 0x177eb2 (0x87e14d bytes) 000423[0] 1747828499.438808 mapread 0x0e2000 thru 0x0ee2ea (0xc2eb bytes) 000424[0] 1747828499.455648 trunc from 0x177eb3 to 0x1dc401 (0x6454f bytes) 000425[0] 1747828499.466481 mapwrite 0x78b000 thru 0x799d0a (0xed0b bytes) 000427[0] 1747828499.512660 trunc from 0x799d0b to 0x704177 (0x95b93 bytes) 000429[0] 1747828499.524946 read_OD 0x5e4000 thru 0x5e8fff (0x5000 bytes) 000430[0] 1747828499.531750 mapwrite 0x7a3000 thru 0x7b0e7d (0xde7e bytes) 000433[0] 1747828499.573686 trunc from 0x7b0e7e to 0x9207a2 (0x16f925 bytes) 000435[0] 1747828499.586227 mapread 0x412000 thru 0x416140 (0x4141 bytes) 000436[1] 1747828499.597024 mapread 0x548000 thru 0x549011 (0x1012 bytes) 000437[1] 1747828499.604986 mapread 0x5c8000 thru 0x5d37ac (0xb7ad bytes) 000438[1] 1747828499.622689 write 0x767000 thru 0x7721e7 (0xb1e8 bytes) 000439[0] 1747828499.626702 mapread 0x722000 thru 0x72424e (0x224f bytes) 000440[1] 1747828499.637804 mapread 0x7a5000 thru 0x7b0342 (0xb343 bytes) 000441[0] 1747828499.650496 mapwrite 0x995000 thru 0x995cc9 (0xcca bytes) 000442[1] 1747828499.673428 write 0x86d000 thru 0x8739ec (0x69ed bytes) 000444[1] 1747828499.684251 read 0x038000 thru 0x03c212 (0x4213 bytes) 000445[1] 1747828499.715478 mapwrite 0x505000 thru 0x505d8f (0xd90 bytes) 000449[0] 1747828499.734918 write_OD 0x2a2000 thru 0x2b0fff (0xf000 bytes) 000452[0] 1747828499.758442 trunc from 0x995cca to 0x822832 (0x173497 bytes) 000453[1] 1747828499.764250 trunc from 0x822833 to 0x5dc0bb (0x246777 bytes) 000454[0] 1747828499.773735 trunc from 0x5dc0bc to 0x95a4bc (0x37e401 bytes) 000455[1] 1747828499.782754 trunc from 0x95a4bd to 0x53df63 (0x41c559 bytes) 000457[1] 1747828499.789000 write 0x154000 thru 0x15f4e3 (0xb4e4 bytes) 000458[0] 1747828499.790933 read_OD 0x02c000 thru 0x02cfff (0x1000 bytes) 000459[0] 1747828499.799943 write_OD 0x58a000 thru 0x595fff (0xc000 bytes) 000460[0] 1747828499.813862 trunc from 0x596000 to 0x559c58 (0x3c3a7 bytes) 000464[0] 1747828499.828410 trunc from 0x559c59 to 0x75d3ff (0x2037a7 bytes) 000465[0] 1747828499.833720 mapwrite 0x109000 thru 0x110495 (0x7496 bytes) 000467[1] 1747828499.874891 write 0x834000 thru 0x83b3fd (0x73fe bytes) 000468[0] 1747828499.888694 trunc from 0x83b3fe to 0x723a25 (0x1179d8 bytes) 000470[1] 1747828499.900299 write 0x1e2000 thru 0x1ed61e (0xb61f bytes) 000472[0] 1747828499.907663 write_OD 0x574000 thru 0x581fff (0xe000 bytes) 000474[1] 1747828499.927116 write 0x76b000 thru 0x774dd1 (0x9dd2 bytes) 000476[1] 1747828499.933379 mapread 0x660000 thru 0x663939 (0x393a bytes) 000478[0] 1747828499.940579 mapwrite 0x90f000 thru 0x912b5d (0x3b5e bytes) 000481[0] 1747828499.979242 read_OD 0x1fb000 thru 0x202fff (0x8000 bytes) 000482[0] 1747828499.984846 read_OD 0x292000 thru 0x29dfff (0xc000 bytes) 000486[1] 1747828499.992844 mapwrite 0x643000 thru 0x64b099 (0x809a bytes) 000487[0] 1747828500.026618 read_OD 0x1cb000 thru 0x1d5fff (0xb000 bytes) 000488[1] 1747828500.032938 mapwrite 0x6ef000 thru 0x6faf2a (0xbf2b bytes) 000490[0] 1747828500.062897 mapread 0x71c000 thru 0x729ecc (0xdecd bytes) 000491[1] 1747828500.098156 read 0x57e000 thru 0x586874 (0x8875 bytes) 000493[1] 1747828500.111839 mapread 0x2d3000 thru 0x2d6aa9 (0x3aaa bytes) 000497[1] 1747828500.116249 trunc from 0x912b5e to 0x68d503 (0x28565a bytes) 000500[0] 1747828500.135894 mapwrite 0x0c8000 thru 0x0d4908 (0xc909 bytes) All operations completed A-OK! PASS 16a (11s) == sanityn test 16b: 500 iterations of dual-mount fsx at small size ========================================================== 07:55:01 (1747828501) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0683302 s, 30.7 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.061336 s, 34.2 MB/s Chance of close/open is 1 in 50 Seed set to 8501 fd 0: /mnt/lustre/f16b.sanityn fd 1: /mnt/lustre2/f16b.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001[1] 1747828501.914499 write 0x47d0ca thru 0x47e620 (0x1557 bytes) 000005[0] 1747828501.923501 write 0x7d9e31 thru 0x7dbd38 (0x1f08 bytes) 000006[1] 1747828501.931935 read 0x443dda thru 0x444d86 (0xfad bytes) 000007[1] 1747828501.939537 mapwrite 0x337ac2 thru 0x338869 (0xda8 bytes) 000009[1] 1747828501.971594 mapread 0x74b7f1 thru 0x74d0e9 (0x18f9 bytes) 000010[1] 1747828501.979518 mapread 0x6efae6 thru 0x6f0782 (0xc9d bytes) 000011[1] 1747828501.982179 mapwrite 0x116e37 thru 0x117e0d (0xfd7 bytes) 000012[1] 1747828501.998890 write 0x32cc66 thru 0x32de00 (0x119b bytes) 000014[1] 1747828502.004989 read 0x6f0a23 thru 0x6f0ed6 (0x4b4 bytes) 000015[0] 1747828502.008339 read 0x58e3e1 thru 0x58eebb (0xadb bytes) 000017[1] 1747828502.019658 mapread 0x353c99 thru 0x354e34 (0x119c bytes) 000021[1] 1747828502.028657 mapwrite 0x1c7f24 thru 0x1c9670 (0x174d bytes) 000023[1] 1747828502.051276 mapread 0x619f55 thru 0x61b62c (0x16d8 bytes) 000024[1] 1747828502.057801 mapwrite 0x38de05 thru 0x38f00e (0x120a bytes) 000026[1] 1747828502.079689 read 0x3d9137 thru 0x3d92b0 (0x17a bytes) 000027[1] 1747828502.096317 read 0x3ccbfc thru 0x3ce10e (0x1513 bytes) 000028[1] 1747828502.099606 mapwrite 0x143e18 thru 0x143fa4 (0x18d bytes) 000029[0] 1747828502.118403 mapwrite 0x895e37 thru 0x897da7 (0x1f71 bytes) truncating to largest ever: 0x80e54d 000035[0] 1747828502.178588 trunc from 0x897da8 to 0x80e54c (0x8985b bytes) 000036[0] 1747828502.182955 read 0x1a6529 thru 0x1a79b5 (0x148d bytes) 000038[0] 1747828502.208138 write 0x115760 thru 0x116255 (0xaf6 bytes) truncating to largest ever: 0x90166c 000039[0] 1747828502.213557 trunc from 0x80e54d to 0x90166b (0xf311f bytes) 000041[0] 1747828502.225575 write 0x9c4c0a thru 0x9c4c79 (0x70 bytes) 000043[0] 1747828502.230576 mapread 0x63cf88 thru 0x63d031 (0xaa bytes) 000045[0] 1747828502.239823 trunc from 0x9c4c7a to 0x24094e (0x78432b bytes) 000047[0] 1747828502.254698 mapwrite 0x1e6bd8 thru 0x1e7c7e (0x10a7 bytes) 000048[0] 1747828502.271383 trunc from 0x24094f to 0x41eebd (0x1de56f bytes) 000049[0] 1747828502.275802 mapread 0x01e217 thru 0x01fa9e (0x1888 bytes) 000050[0] 1747828502.282006 trunc from 0x41eebe to 0x5f8954 (0x1d9a97 bytes) 000051[0] 1747828502.286312 read 0x0978f2 thru 0x0983cc (0xadb bytes) 000053[0] 1747828502.303026 read 0x1c768b thru 0x1c8089 (0x9ff bytes) 000055[1] 1747828502.307838 write 0x895d9c thru 0x895fc2 (0x227 bytes) 000057[1] 1747828502.322098 mapread 0x4b4d4b thru 0x4b5156 (0x40c bytes) 000059[1] 1747828502.332650 write 0x7df71f thru 0x7e0552 (0xe34 bytes) 000060[0] 1747828502.339824 trunc from 0x895fc3 to 0x0782bb (0x81dd07 bytes) 000061[1] 1747828502.364632 read 0x02a969 thru 0x02a9dd (0x75 bytes) 000063[0] 1747828502.380231 mapwrite 0x1e0794 thru 0x1e193d (0x11aa bytes) 000064[0] 1747828502.412134 trunc from 0x1e193e to 0x35dd3a (0x17c3fd bytes) 000065[0] 1747828502.420140 mapread 0x328a46 thru 0x329ddf (0x139a bytes) 000066[0] 1747828502.427037 read 0x1a0943 thru 0x1a1f3b (0x15f9 bytes) 000068[1] 1747828502.440720 read 0x1b81a7 thru 0x1b99e4 (0x183e bytes) 000069[0] 1747828502.448852 trunc from 0x35dd3b to 0x2bc7c3 (0xa1577 bytes) 000071[1] 1747828502.465405 trunc from 0x2bc7c4 to 0x38416b (0xc79a8 bytes) 000072[0] 1747828502.477934 read 0x287ed3 thru 0x288d0c (0xe3a bytes) 000073[0] 1747828502.485851 mapread 0x01aa77 thru 0x01aeee (0x478 bytes) 000074[0] 1747828502.488824 write 0x65276e thru 0x653244 (0xad7 bytes) 000075[1] 1747828502.494657 read 0x2d04f4 thru 0x2d2278 (0x1d85 bytes) 000076[0] 1747828502.508634 write 0x9f2192 thru 0x9f3b19 (0x1988 bytes) 000079[0] 1747828502.514963 mapread 0x56bf3d thru 0x56d161 (0x1225 bytes) 000080[1] 1747828502.534799 read 0x2a9830 thru 0x2aaaf6 (0x12c7 bytes) 000081[0] 1747828502.538410 trunc from 0x9f3b1a to 0x5e4997 (0x40f182 bytes) 000082[1] 1747828502.552148 write 0x9b4603 thru 0x9b5919 (0x1317 bytes) 000083[1] 1747828502.560092 mapread 0x8c8985 thru 0x8c966a (0xce6 bytes) 000084[1] 1747828502.589152 trunc from 0x9b591a to 0x726d1e (0x28ebfb bytes) 000087[1] 1747828502.607327 mapread 0x4106d8 thru 0x410769 (0x92 bytes) 000090[1] 1747828502.610171 mapwrite 0x643ff8 thru 0x645951 (0x195a bytes) 000091[1] 1747828502.630304 mapread 0x507576 thru 0x508adc (0x1567 bytes) 000093[0] 1747828502.630915 read 0x4c6381 thru 0x4c7f25 (0x1ba5 bytes) 000097[0] 1747828502.643450 write 0x40be01 thru 0x40c0dc (0x2dc bytes) 000098[0] 1747828502.650485 mapwrite 0x31f396 thru 0x320137 (0xda2 bytes) 000101[1] 1747828502.681685 read 0x720b45 thru 0x7227bb (0x1c77 bytes) 000102[1] 1747828502.687503 read 0x6eafe4 thru 0x6eb4cf (0x4ec bytes) 000103[0] 1747828502.693954 write 0x9e6357 thru 0x9e6604 (0x2ae bytes) 000104[1] 1747828502.700197 write 0x8a3fa3 thru 0x8a491b (0x979 bytes) 000106[0] 1747828502.708523 trunc from 0x9e6605 to 0x4793fd (0x56d207 bytes) 000107[0] 1747828502.720120 read 0x36eccf thru 0x370b1c (0x1e4e bytes) 000111[1] 1747828502.734538 write 0x68fc6a thru 0x6910d9 (0x1470 bytes) 000112[0] 1747828502.740518 trunc from 0x6910da to 0x630ea9 (0x60230 bytes) 000113[0] 1747828502.750727 read 0x2159c3 thru 0x21771b (0x1d59 bytes) 000114[1] 1747828502.766341 mapwrite 0x166569 thru 0x168499 (0x1f31 bytes) 000115[0] 1747828502.788291 write 0x2e2b86 thru 0x2e4593 (0x1a0e bytes) 000116[1] 1747828502.791194 write 0x6bdb87 thru 0x6be65f (0xad9 bytes) 000119[1] 1747828502.796375 mapread 0x43fa30 thru 0x43fe84 (0x455 bytes) 000121[1] 1747828502.800461 mapread 0x21c9ab thru 0x21e0be (0x1714 bytes) 000124[1] 1747828502.812431 write 0x4d3be9 thru 0x4d45da (0x9f2 bytes) 000126[0] 1747828502.814642 write 0x54dccf thru 0x54e990 (0xcc2 bytes) 000127[1] 1747828502.821342 write 0x9abb90 thru 0x9abc4f (0xc0 bytes) 000130[1] 1747828502.831138 mapwrite 0x27c7b8 thru 0x27d647 (0xe90 bytes) truncating to largest ever: 0x9fe689 000131[0] 1747828502.845817 trunc from 0x9abc50 to 0x9fe688 (0x52a39 bytes) 000132[0] 1747828502.856893 mapwrite 0x17d662 thru 0x17d6ec (0x8b bytes) 000133[0] 1747828502.889917 mapwrite 0x324598 thru 0x325ae7 (0x1550 bytes) 000134[1] 1747828502.903731 mapwrite 0x5135e2 thru 0x51375f (0x17e bytes) 000135[0] 1747828502.923663 mapwrite 0x674efc thru 0x6757ac (0x8b1 bytes) 000136[0] 1747828502.939171 trunc from 0x9fe689 to 0x014b86 (0x9e9b02 bytes) 000140[0] 1747828502.954132 read 0x005964 thru 0x005e1c (0x4b9 bytes) 000141[0] 1747828502.958578 read 0x0123b8 thru 0x012abf (0x708 bytes) 000143[1] 1747828502.963833 read 0x002a96 thru 0x00460a (0x1b75 bytes) 000145[0] 1747828502.970299 trunc from 0x014b87 to 0x1901bf (0x17b639 bytes) 000147[1] 1747828502.976416 read 0x044f7e thru 0x046772 (0x17f5 bytes) 000149[1] 1747828502.984762 read 0x11b3c1 thru 0x11bf3a (0xb7a bytes) 000151[0] 1747828502.993835 mapread 0x0f3ccd thru 0x0f5916 (0x1c4a bytes) 000152[0] 1747828502.996640 read 0x0df9fe thru 0x0e0cc0 (0x12c3 bytes) 000153[0] 1747828503.000208 mapread 0x0cafb0 thru 0x0cb313 (0x364 bytes) 000156[0] 1747828503.002651 mapread 0x0d2a73 thru 0x0d3231 (0x7bf bytes) 000157[1] 1747828503.004715 read 0x0d7e30 thru 0x0d94c9 (0x169a bytes) 000160[1] 1747828503.005087 write 0x906c3a thru 0x907454 (0x81b bytes) 000164[0] 1747828503.009324 write 0x5009e4 thru 0x502957 (0x1f74 bytes) 000167[1] 1747828503.035438 mapread 0x68fed4 thru 0x68ff8a (0xb7 bytes) 000168[0] 1747828503.040275 write 0x4981d9 thru 0x499dc0 (0x1be8 bytes) 000169[0] 1747828503.048660 read 0x382051 thru 0x38309c (0x104c bytes) 000170[0] 1747828503.052157 read 0x46d1a3 thru 0x46e2b4 (0x1112 bytes) 000172[0] 1747828503.062015 write 0x798003 thru 0x79992b (0x1929 bytes) 000175[0] 1747828503.068716 mapwrite 0x240783 thru 0x240f89 (0x807 bytes) 000176[0] 1747828503.081535 trunc from 0x907455 to 0x91fb33 (0x186df bytes) 000177[0] 1747828503.085380 mapwrite 0x93e980 thru 0x940351 (0x19d2 bytes) 000178[0] 1747828503.107430 mapwrite 0x9fde97 thru 0x9ff8be (0x1a28 bytes) 000180[0] 1747828503.130409 read 0x68b9fe thru 0x68cb6d (0x1170 bytes) 000182[1] 1747828503.130836 mapwrite 0x2b1c02 thru 0x2b2677 (0xa76 bytes) 000184[1] 1747828503.163605 mapread 0x1fde9a thru 0x1ff845 (0x19ac bytes) 000186[1] 1747828503.200207 trunc from 0x9ff8bf to 0x9180db (0xe77e3 bytes) 000190[0] 1747828503.216097 read 0x219a9b thru 0x21acaf (0x1215 bytes) 000192[0] 1747828503.230262 trunc from 0x9180dc to 0x7f13d7 (0x126d04 bytes) 000194[0] 1747828503.237498 write 0x71813d thru 0x718307 (0x1cb bytes) 000196[0] 1747828503.255686 read 0x33e597 thru 0x33e6ac (0x116 bytes) 000197[1] 1747828503.256177 mapwrite 0x55a98a thru 0x55c3c3 (0x1a3a bytes) 000198[0] 1747828503.280705 read 0x5651e2 thru 0x565da0 (0xbbf bytes) 000200[0] 1747828503.292985 mapread 0x179387 thru 0x179695 (0x30f bytes) 000201[0] 1747828503.294300 write 0x03bb28 thru 0x03c488 (0x961 bytes) 000202[0] 1747828503.296310 read 0x11e404 thru 0x11f20b (0xe08 bytes) 000203[0] 1747828503.309803 read 0x4115e1 thru 0x41278e (0x11ae bytes) 000206[0] 1747828503.325601 write 0x004b98 thru 0x00698f (0x1df8 bytes) 000209[0] 1747828503.331976 trunc from 0x7f13d8 to 0x213026 (0x5de3b1 bytes) 000212[1] 1747828503.351275 read 0x02bf7e thru 0x02c6c6 (0x749 bytes) 000215[1] 1747828503.366197 mapread 0x172114 thru 0x173b27 (0x1a14 bytes) 000218[1] 1747828503.378531 mapwrite 0x5605a7 thru 0x5606c5 (0x11f bytes) 000223[1] 1747828503.412077 mapwrite 0x90e6d8 thru 0x910084 (0x19ad bytes) 000224[0] 1747828503.434200 write 0x2ab691 thru 0x2ad239 (0x1ba9 bytes) 000225[1] 1747828503.440620 write 0x917ac5 thru 0x9199b2 (0x1eee bytes) 000226[1] 1747828503.444486 mapwrite 0x8637dc thru 0x86413b (0x960 bytes) 000229[1] 1747828503.472782 write 0x995c24 thru 0x9976d8 (0x1ab5 bytes) 000237[0] 1747828503.479700 trunc from 0x9976d9 to 0x1660e5 (0x8315f3 bytes) 000239[1] 1747828503.488205 write 0x346451 thru 0x346d80 (0x930 bytes) 000242[0] 1747828503.499175 trunc from 0x346d81 to 0x7f6bc2 (0x4afe42 bytes) 000243[0] 1747828503.509370 mapread 0x0044aa thru 0x004947 (0x49e bytes) 000245[0] 1747828503.515988 mapread 0x423321 thru 0x425274 (0x1f54 bytes) 000246[1] 1747828503.523508 trunc from 0x7f6bc3 to 0x1a0821 (0x6563a1 bytes) 000249[1] 1747828503.536424 mapread 0x051b13 thru 0x0534fe (0x19ec bytes) 000251[0] 1747828503.539234 write 0x725ebc thru 0x7275eb (0x1730 bytes) 000252[0] 1747828503.544375 write 0x848ff3 thru 0x849e58 (0xe66 bytes) 000253[0] 1747828503.546436 mapread 0x47dcd5 thru 0x47ecb8 (0xfe4 bytes) 000254[1] 1747828503.548159 read 0x1f6987 thru 0x1f6eca (0x544 bytes) 000257[1] 1747828503.556126 mapread 0x806987 thru 0x808875 (0x1eef bytes) 000258[1] 1747828503.576976 mapwrite 0x432d83 thru 0x4347aa (0x1a28 bytes) 000260[1] 1747828503.600691 read 0x5d6136 thru 0x5d7fd7 (0x1ea2 bytes) 000261[1] 1747828503.603246 trunc from 0x849e59 to 0x04b58d (0x7fe8cb bytes) 000263[0] 1747828503.616795 read 0x0243bc thru 0x025849 (0x148e bytes) 000264[1] 1747828503.622020 mapread 0x025ebb thru 0x02770f (0x1855 bytes) 000265[0] 1747828503.625476 mapread 0x00b5e9 thru 0x00d123 (0x1b3b bytes) 000266[0] 1747828503.634535 read 0x02048d thru 0x020cb8 (0x82c bytes) 000269[1] 1747828503.640400 trunc from 0x04b58e to 0x23898c (0x1ed3ff bytes) 000271[0] 1747828503.649604 mapwrite 0x55ea89 thru 0x55eed5 (0x44d bytes) 000274[0] 1747828503.686524 write 0x45c507 thru 0x45e098 (0x1b92 bytes) 000276[1] 1747828503.689838 mapwrite 0x9fa339 thru 0x9fc04f (0x1d17 bytes) 000277[0] 1747828503.719521 write 0x13c049 thru 0x13d2a4 (0x125c bytes) 000279[1] 1747828503.732676 read 0x67d577 thru 0x67d594 (0x1e bytes) 000280[1] 1747828503.739882 mapread 0x72727c thru 0x727c36 (0x9bb bytes) 000283[0] 1747828503.760558 mapwrite 0x9472e5 thru 0x94749c (0x1b8 bytes) 000285[1] 1747828503.784489 read 0x0527e4 thru 0x053076 (0x893 bytes) 000286[1] 1747828503.792664 mapwrite 0x421361 thru 0x42255a (0x11fa bytes) 000287[1] 1747828503.812509 read 0x527209 thru 0x527f73 (0xd6b bytes) 000288[1] 1747828503.831535 write 0x083d7b thru 0x085218 (0x149e bytes) 000291[0] 1747828503.834730 mapread 0x0d2cd5 thru 0x0d408b (0x13b7 bytes) 000292[1] 1747828503.860545 write 0x53d236 thru 0x53d8c9 (0x694 bytes) 000293[0] 1747828503.868863 mapwrite 0x62c323 thru 0x62e190 (0x1e6e bytes) 000294[1] 1747828503.902063 trunc from 0x9fc050 to 0x4bfbbd (0x53c492 bytes) 000298[1] 1747828503.914988 trunc from 0x4bfbbe to 0x1c2ab1 (0x2fd10c bytes) 000300[0] 1747828503.922248 mapread 0x141291 thru 0x143191 (0x1f01 bytes) 000301[1] 1747828503.929492 mapread 0x0480cb thru 0x049126 (0x105c bytes) 000304[1] 1747828503.940011 trunc from 0x1c2ab2 to 0x2bdc65 (0xfb1b4 bytes) 000305[0] 1747828503.948574 write 0x585e23 thru 0x587d1d (0x1efb bytes) 000310[1] 1747828503.968263 mapwrite 0x7da59e thru 0x7db0e5 (0xb48 bytes) 000311[0] 1747828503.990229 write 0x7bf5cb thru 0x7c13d9 (0x1e0f bytes) 000312[0] 1747828503.995763 mapwrite 0x38ac4d thru 0x38ca38 (0x1dec bytes) 000315[1] 1747828504.021153 read 0x005680 thru 0x006c68 (0x15e9 bytes) 000319[0] 1747828504.041153 mapread 0x51b923 thru 0x51cf1b (0x15f9 bytes) 000321[1] 1747828504.050761 mapwrite 0x9ab4d2 thru 0x9ac357 (0xe86 bytes) 000323[0] 1747828504.096331 write 0x66f48b thru 0x66fda1 (0x917 bytes) 000324[1] 1747828504.105094 read 0x07b588 thru 0x07ca3e (0x14b7 bytes) 000326[0] 1747828504.130791 trunc from 0x9ac358 to 0x5c3e25 (0x3e8532 bytes) 000328[0] 1747828504.143831 trunc from 0x5c3e26 to 0x3debe1 (0x1e5244 bytes) 000329[0] 1747828504.146360 read 0x0e6414 thru 0x0e74d7 (0x10c4 bytes) 000330[1] 1747828504.158372 mapwrite 0x83ce3c thru 0x83e14d (0x1312 bytes) 000331[0] 1747828504.180699 trunc from 0x83e14e to 0x940a57 (0x10290a bytes) 000332[1] 1747828504.187224 trunc from 0x940a58 to 0x48c238 (0x4b481f bytes) 000334[1] 1747828504.198287 write 0x63567a thru 0x63614c (0xad3 bytes) 000335[0] 1747828504.201384 trunc from 0x63614d to 0x727bb6 (0xf1a6a bytes) 000340[1] 1747828504.216282 mapread 0x27b99e thru 0x27cf86 (0x15e9 bytes) 000341[1] 1747828504.223841 trunc from 0x727bb7 to 0x0b06aa (0x67750c bytes) 000348[1] 1747828504.242084 mapread 0x0a18f8 thru 0x0a1f04 (0x60d bytes) 000350[1] 1747828504.248264 mapwrite 0x2156bb thru 0x2157e2 (0x128 bytes) 000351[0] 1747828504.264126 write 0x23edbd thru 0x23f4fb (0x73f bytes) 000352[1] 1747828504.269828 write 0x7652ca thru 0x765970 (0x6a7 bytes) 000354[1] 1747828504.276050 read 0x572b9f thru 0x573e64 (0x12c6 bytes) 000356[0] 1747828504.284160 mapread 0x6a323e thru 0x6a3825 (0x5e8 bytes) 000357[0] 1747828504.290689 read 0x3d3912 thru 0x3d4d59 (0x1448 bytes) 000358[0] 1747828504.311545 mapread 0x225c92 thru 0x226688 (0x9f7 bytes) 000363[1] 1747828504.314674 mapwrite 0x393c75 thru 0x394dcc (0x1158 bytes) 000365[1] 1747828504.338746 write 0x420fac thru 0x421981 (0x9d6 bytes) 000368[0] 1747828504.349174 trunc from 0x765971 to 0x0767af (0x6ef1c1 bytes) 000374[1] 1747828504.370696 read 0x056e17 thru 0x05835e (0x1548 bytes) 000375[0] 1747828504.377661 mapread 0x00091f thru 0x001ef9 (0x15db bytes) 000378[1] 1747828504.386118 read 0x07465b thru 0x074c67 (0x60d bytes) 000379[0] 1747828504.389105 read 0x0388f3 thru 0x03a547 (0x1c55 bytes) 000381[1] 1747828504.394864 trunc from 0x0767b0 to 0x487911 (0x411162 bytes) 000382[0] 1747828504.403134 write 0x391490 thru 0x3918d3 (0x444 bytes) 000386[1] 1747828504.418387 write 0x1cd3f6 thru 0x1cefdc (0x1be7 bytes) 000387[0] 1747828504.423397 trunc from 0x487912 to 0x9beecb (0x5375ba bytes) 000388[1] 1747828504.435841 write 0x0599c9 thru 0x05aa26 (0x105e bytes) 000389[0] 1747828504.441953 write 0x9aa196 thru 0x9ab10d (0xf78 bytes) 000390[0] 1747828504.446186 mapwrite 0x3e13a4 thru 0x3e2a95 (0x16f2 bytes) 000391[1] 1747828504.463642 read 0x7d1098 thru 0x7d125a (0x1c3 bytes) 000392[0] 1747828504.475745 mapwrite 0x561945 thru 0x563126 (0x17e2 bytes) 000393[1] 1747828504.494836 write 0x0b9f2a thru 0x0ba73b (0x812 bytes) 000395[1] 1747828504.501143 mapread 0x88ea21 thru 0x8907da (0x1dba bytes) 000396[1] 1747828504.505091 read 0x39ea1c thru 0x39fec0 (0x14a5 bytes) 000397[0] 1747828504.526627 write 0x6e0be9 thru 0x6e1f8d (0x13a5 bytes) 000398[0] 1747828504.542061 trunc from 0x9beecc to 0x80a5dd (0x1b48ee bytes) 000402[0] 1747828504.566174 mapread 0x3abf7c thru 0x3ad05b (0x10e0 bytes) 000406[1] 1747828504.596075 mapread 0x6e14e9 thru 0x6e326e (0x1d86 bytes) 000407[0] 1747828504.606595 read 0x356f96 thru 0x358587 (0x15f2 bytes) 000409[0] 1747828504.609588 write 0x9e78ff thru 0x9e7ffb (0x6fd bytes) 000410[0] 1747828504.610559 read 0x4920ae thru 0x49251f (0x472 bytes) 000411[0] 1747828504.617804 trunc from 0x9e7ffc to 0x769090 (0x27ef6b bytes) 000412[1] 1747828504.628105 trunc from 0x769091 to 0x43abd9 (0x32e4b7 bytes) 000413[1] 1747828504.639687 mapwrite 0x65266c thru 0x653bcd (0x1562 bytes) 000415[0] 1747828504.660156 mapread 0x0e2c87 thru 0x0e30de (0x458 bytes) 000420[1] 1747828504.671815 mapwrite 0x04ac62 thru 0x04cc3f (0x1fde bytes) 000421[0] 1747828504.690011 mapread 0x098625 thru 0x099bb7 (0x1593 bytes) 000424[1] 1747828504.701445 mapread 0x41996c thru 0x41a116 (0x7ab bytes) 000425[1] 1747828504.706057 write 0x52c44c thru 0x52dada (0x168f bytes) 000427[0] 1747828504.708055 write 0x5edd14 thru 0x5efa8b (0x1d78 bytes) 000428[1] 1747828504.714549 mapread 0x230b94 thru 0x23229f (0x170c bytes) 000429[1] 1747828504.718454 mapread 0x0b8b61 thru 0x0b9eaa (0x134a bytes) 000430[1] 1747828504.721625 write 0x6d6da3 thru 0x6d891f (0x1b7d bytes) 000432[1] 1747828504.728983 trunc from 0x6d8920 to 0x82a8f1 (0x151fd2 bytes) 000434[1] 1747828504.738787 write 0x61b11e thru 0x61cc65 (0x1b48 bytes) 000435[0] 1747828504.740741 read 0x410ea9 thru 0x411bc4 (0xd1c bytes) 000436[1] 1747828504.752789 trunc from 0x82a8f2 to 0x6f8ca0 (0x131c51 bytes) 000437[0] 1747828504.758735 mapread 0x371edf thru 0x372128 (0x24a bytes) 000439[1] 1747828504.774531 trunc from 0x6f8ca1 to 0x809ccb (0x11102b bytes) 000440[1] 1747828504.784159 trunc from 0x809ccc to 0x8da2a4 (0xd05d9 bytes) 000441[0] 1747828504.790154 write 0x61eb0f thru 0x61f2cd (0x7bf bytes) 000442[0] 1747828504.801874 trunc from 0x8da2a5 to 0x326e07 (0x5b349d bytes) 000445[0] 1747828504.813431 mapread 0x1f76f0 thru 0x1f8fff (0x1910 bytes) 000446[1] 1747828504.815460 mapread 0x02e809 thru 0x02ed86 (0x57e bytes) 000448[0] 1747828504.822320 mapwrite 0x2f4907 thru 0x2f634e (0x1a48 bytes) 000451[1] 1747828504.840514 mapwrite 0x146dc4 thru 0x147885 (0xac2 bytes) 000452[1] 1747828504.859473 trunc from 0x326e08 to 0x051c92 (0x2d5175 bytes) 000454[1] 1747828504.864560 read 0x0320ba thru 0x033541 (0x1488 bytes) 000458[1] 1747828504.873423 mapwrite 0x391147 thru 0x392d28 (0x1be2 bytes) 000459[0] 1747828504.901830 write 0x4e4392 thru 0x4e4a06 (0x675 bytes) 000462[0] 1747828504.913674 mapwrite 0x338680 thru 0x339cc2 (0x1643 bytes) 000464[0] 1747828504.932362 mapread 0x43d273 thru 0x43e429 (0x11b7 bytes) 000467[1] 1747828504.943098 read 0x12d2f3 thru 0x12e506 (0x1214 bytes) 000471[0] 1747828504.958312 write 0x18b753 thru 0x18d37d (0x1c2b bytes) 000473[0] 1747828504.967537 write 0x6c215d thru 0x6c2986 (0x82a bytes) 000475[0] 1747828504.970722 mapread 0x4fe9f3 thru 0x4fef31 (0x53f bytes) 000476[0] 1747828504.974333 trunc from 0x6c2987 to 0x5c8ded (0xf9b99 bytes) 000488[0] 1747828504.998263 write 0x993954 thru 0x993a29 (0xd6 bytes) 000489[1] 1747828505.001623 read 0x2bcaa6 thru 0x2bcb74 (0xcf bytes) 000490[1] 1747828505.008884 mapread 0x3ca45d thru 0x3cba00 (0x15a4 bytes) 000491[0] 1747828505.027559 write 0x5ddf0e thru 0x5de127 (0x21a bytes) 000494[0] 1747828505.045495 mapwrite 0x55c5b5 thru 0x55c84b (0x297 bytes) 000495[0] 1747828505.065780 trunc from 0x993a2a to 0x402882 (0x5911a7 bytes) 000496[0] 1747828505.076500 mapread 0x3f49c6 thru 0x3f5d52 (0x138d bytes) 000497[0] 1747828505.079193 mapread 0x0ef51a thru 0x0f0ee2 (0x19c9 bytes) 000498[0] 1747828505.083563 mapread 0x242e73 thru 0x2446f7 (0x1885 bytes) 000499[1] 1747828505.086138 mapread 0x13aa1c thru 0x13b4fe (0xae3 bytes) 000500[0] 1747828505.091100 mapwrite 0x172d8f thru 0x174c3f (0x1eb1 bytes) All operations completed A-OK! PASS 16b (5s) == sanityn test 16c: verify data consistency on ldiskfs with cache disabled (b=17397) ========================================================== 07:55:06 (1747828506) SKIP: sanityn test_16c dio on ldiskfs only SKIP 16c (1s) == sanityn test 16d: Verify DIO and buffer IO with two clients ========================================================== 07:55:07 (1747828507) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0677221 s, 31.0 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0500104 s, 41.9 MB/s ldlm.namespaces.MGC192.168.201.105@tcp.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8800aa2ef000.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6d09800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8800aa2ef000.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d09800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8800aa2ef000.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d09800.lru_size=clear 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 2.5955 s, 40.4 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.669169 s, 157 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.53992 s, 194 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.24243 s, 84.4 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.67052 s, 62.8 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.753412 s, 139 MB/s PASS 16d (10s) == sanityn test 16e: Verify size consistency for O_DIRECT write ========================================================== 07:55:17 (1747828517) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0606014 s, 173 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0331596 s, 31.6 MB/s PASS 16e (1s) == sanityn test 16f: rw sequential consistency vs drop_caches ========================================================== 07:55:18 (1747828518) TIMEOUT PASS 16f (22s) == sanityn test 16g: mmap rw sequential consistency vs drop_caches ========================================================== 07:55:40 (1747828540) TIMEOUT PASS 16g (21s) == sanityn test 16i: read after truncate file ============ 07:56:02 (1747828562) ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16i (2s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 07:56:03 (1747828563) fail_loc=0x8000030a PASS 17 (4s) == sanityn test 18: mmap sanity check =========================================================================================== 07:56:07 (1747828567) mmap test1: basic mmap operation (PASS, 0.016817s) mmap test2: MAP_PRIVATE not write back (PASS, 0.012633s) mmap test3: concurrent mmap ops on two nodes (PASS, 11.265s) mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 2.0688s) mmap test5: read/write file to/from the buffer which mmapped to just this file (PASS, 0.02031s) mmap test6: check mmap write/read content on two nodes (PASS, 0.025087s) mmap test7: file i/o with an unmapped buffer (SKIPPED, 0s) mmap test8: SIGBUS for beyond file size (SKIPPED, 0s) mmap test9: SIGBUS for negative file offset (SKIPPED, 0s) mmap test10: mtime not change for readonly mmap access (PASS, 1.0107s) PASS 18 (17s) == sanityn test 19: test concurrent uncached read races ========================================================================= 07:56:24 (1747828584) oleg105-server: error: get_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory pdsh@oleg105-client: oleg105-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (1s) == sanityn test 20: test extra readahead page left in cache ============================================================== 07:56:25 (1747828585) PASS 20 (1s) == sanityn test 21: Try to remove mountpoint on another dir ============================================================== 07:56:26 (1747828586) rmdir: removing directory, '/mnt/lustre/d21.sanityn' rmdir: failed to remove '/mnt/lustre/d21.sanityn': Device or resource busy rmdir: removing directory, '/mnt/lustre2/d21.sanityn' Removed mounted directory from another mountpoint, needs to be fixed PASS 21 (2s) == sanityn test 23: others should see updated atime while another read============================================================== 07:56:28 (1747828588) now is 1747828588 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.6853 new atime is 1747828649 PASS 23 (62s) == sanityn test 24a: lfs df [-ih] [path] test =================================================================================== 07:57:30 (1747828650) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 5120 3764224 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 13312 7525376 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 5120 3764224 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 13312 7525376 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.6K 369 488.3K 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 115.2K 374 114.8K 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 115.3K 375 114.9K 1% /mnt/lustre[OST:1] filesystem_summary: 230.1K 369 229.8K 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.6K 369 488.3K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.2K 374 114.8K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 115.3K 375 114.9K 1% /mnt/lustre2[OST:1] filesystem_summary: 230.1K 369 229.8K 1% /mnt/lustre2 UUID bytes Used Available Use% Mounted on lustre-MDT0000_UUID 2.1G 3.2M 2.1G 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3.6G 8.0M 3.6G 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3.6G 5.0M 3.6G 1% /mnt/lustre[OST:1] filesystem_summary: 7.2G 13.0M 7.2G 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500339 369 499970 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 117974 374 117600 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 118071 375 117696 1% /mnt/lustre2[OST:1] filesystem_summary: 235665 369 235296 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 5120 3764224 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 13312 7525376 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.6K 369 488.3K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.2K 374 114.8K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 115.3K 375 114.9K 1% /mnt/lustre2[OST:1] filesystem_summary: 230.1K 369 229.8K 1% /mnt/lustre2 No device found for name osc: Invalid argument UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500339 369 499970 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 117974 374 117600 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 118071 375 117696 1% /mnt/lustre[OST:1] filesystem_summary: 235665 369 235296 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500339 369 499970 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 117974 374 117600 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 118071 375 117696 1% /mnt/lustre2[OST:1] filesystem_summary: 235665 369 235296 1% /mnt/lustre2 No device found for name osc: Invalid argument UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 5120 3764224 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 13312 7525376 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 8192 3761152 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 5120 3764224 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 13312 7525376 1% /mnt/lustre2 PASS 24a (2s) == sanityn test 24b: lfs df should show both filesystems ========================================================================= 07:57:32 (1747828652) PASS 24b (1s) == sanityn test 25a: change ACL on one mountpoint be seen on another ============================================================= 07:57:33 (1747828653) running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] PASS 25a (2s) == sanityn test 25b: change ACL under remote dir on one mountpoint be seen on another ========================================================== 07:57:35 (1747828655) SKIP: sanityn test_25b needs >= 2 MDTs SKIP 25b (0s) == sanityn test 26a: allow mtime to get older ============ 07:57:35 (1747828655) utime: good mknod times 1747828655 <= 1747828656 <= 1747828656 for /mnt/lustre/f26a utime: good mknod times 1747828655 <= 1747828656 <= 1747828656 for /mnt/lustre2/f26a utime: good utime mtimes 100000, atime 200000 utime: updated times for /mnt/lustre2/f26a PASS 26a (3s) == sanityn test 26b: sync mtime between ost and mds ====== 07:57:38 (1747828658) PASS 26b (3s) SKIP: sanityn test_27 skipping excluded test 27 SKIP: sanityn test_28 skipping ALWAYS excluded test 28 == sanityn test 30: recreate file race =================== 07:57:42 (1747828662) 0 PASS 30 (3s) == sanityn test 31a: voluntary cancel / blocking ast race======================================================================== 07:57:45 (1747828665) fail_loc=0x314 PASS 31a (2s) == sanityn test 31b: voluntary OST cancel / blocking ast race======================================================================== 07:57:47 (1747828667) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg105-server mds-ost sync done. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete fail_loc=0x314 fail_loc=0x316 fail_loc=0 fail_loc=0 Filesystem 1K-blocks Used Available Use% Mounted on 192.168.201.105@tcp:/lustre 7542784 14336 7524352 1% /mnt/lustre2 PASS 31b (18s) == sanityn test 31r: open-rename(replace) race =========== 07:58:05 (1747828685) -rw-r--r-- 1 root root 0 May 21 07:58 /mnt/lustre/f31r.sanityn.target fail_loc=0x1419 fail_val=3 mv: cannot stat '/mnt/lustre2/f31r.sanityn.source': Input/output error PASS 31r (5s) SKIP: sanityn test_33a skipping SLOW test 33a == sanityn test 33b: COS: cross create/delete, 2 clients, benchmark under remote dir ========================================================== 07:58:10 (1747828690) SKIP: sanityn test_33b Need two or more clients, have 1 SKIP 33b (1s) == sanityn test 33c: Cancel cross-MDT lock should trigger Sync-Lock-Cancel ========================================================== 07:58:11 (1747828691) SKIP: sanityn test_33c needs >= 2 MDTs SKIP 33c (0s) == sanityn test 33d: DNE distributed operation should trigger COS ========================================================== 07:58:12 (1747828692) SKIP: sanityn test_33d needs >= 2 MDTs SKIP 33d (0s) == sanityn test 33e: DNE local operation shouldn't trigger COS ========================================================== 07:58:12 (1747828692) SKIP: sanityn test_33e Need two or more clients, have 1 SKIP 33e (1s) == sanityn test 34: no lock timeout under IO ============= 07:58:13 (1747828693) fail_loc=0x512 fail_loc=0x512 lock should not expire writing on client1 reading on client2 success fail_loc=0x511 fail_loc=0x511 lock should expire writing on client1 reading on client2 success oleg105-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800aa2ef000.ost_server_uuid,osc.lustre-OST0000-osc-ffff8800b6d09800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff8800aa2ef000.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0000-osc-ffff8800b6d09800.ost_server_uuid in FULL state after 0 sec oleg105-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800aa2ef000.ost_server_uuid,osc.lustre-OST0001-osc-ffff8800b6d09800.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff8800aa2ef000.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0001-osc-ffff8800b6d09800.ost_server_uuid in FULL state after 0 sec oleg105-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800aa2ef000.ost_server_uuid,osc.lustre-OST0000-osc-ffff8800b6d09800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff8800aa2ef000.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0000-osc-ffff8800b6d09800.ost_server_uuid in FULL state after 0 sec oleg105-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800aa2ef000.ost_server_uuid,osc.lustre-OST0001-osc-ffff8800b6d09800.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff8800aa2ef000.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0001-osc-ffff8800b6d09800.ost_server_uuid in IDLE state after 0 sec oleg105-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800aa2ef000.ost_server_uuid,osc.lustre-OST0000-osc-ffff8800b6d09800.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff8800aa2ef000.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0000-osc-ffff8800b6d09800.ost_server_uuid in IDLE state after 0 sec oleg105-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800aa2ef000.ost_server_uuid,osc.lustre-OST0001-osc-ffff8800b6d09800.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff8800aa2ef000.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0001-osc-ffff8800b6d09800.ost_server_uuid in IDLE state after 0 sec PASS 34 (70s) == sanityn test 35: -EINTR cp_ast vs. bl_ast race does not evict client ========================================================== 07:59:23 (1747828763) fail_loc=0x80000317 Race attempt 0 Wait for 15650 15794 for 60 sec... total: 4000 open/close in 7.49 seconds: 533.86 ops/second fail_loc=0x0 Filesystem Size Used Avail Use% Mounted on 192.168.201.105@tcp:/lustre 7.2G 15M 7.2G 1% /mnt/lustre 192.168.201.105@tcp:/lustre 7.2G 15M 7.2G 1% /mnt/lustre2 PASS 35 (63s) == sanityn test 36: handle ESTALE/open-unlink correctly == 08:00:26 (1747828826) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg105-server mds-ost sync done. Waiting for MDT destroys to complete 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.279441 s, 188 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6853 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(0) *** before(7523328) after_dd(7472128) after(7523328) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.27381 s, 191 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6853 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(1) *** before(7523328) after_dd(7472128) after(7523328) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.273846 s, 191 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6853 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(2) *** before(7523328) after_dd(7472128) after(7523328) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.28206 s, 186 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6853 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(3) *** before(7523328) after_dd(7472128) after(7523328) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.290385 s, 181 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6853 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(4) *** before(7523328) after_dd(7472128) after(7523328) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.254575 s, 206 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6853 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(5) *** before(7523328) after_dd(7472128) after(7523328) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.279681 s, 187 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6853 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(6) *** before(7523328) after_dd(7472128) after(7523328) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.264401 s, 198 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6853 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(7) *** before(7523328) after_dd(7472128) after(7523328) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.288027 s, 182 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6853 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(8) *** before(7523328) after_dd(7472128) after(7523328) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.285393 s, 184 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6853 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(9) *** before(7523328) after_dd(7472128) after(7523328) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.249033 s, 211 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6853 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(10) *** before(7523328) after_dd(7472128) after(7523328) PASS 36 (228s) == sanityn test 37: check i_size is not updated for directory on close (bug 18695) ======================================================================== 08:04:14 (1747829054) multiop /mnt/lustre/d37.sanityn vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.6853 total: 10000 create in 9.21 seconds: 1086.11 ops/second PASS 37 (12s) == sanityn test 39a: test from 11063 ============================================================================================ 08:04:26 (1747829066) repeat after cancel_lru_locks PASS 39a (1s) == sanityn test 39b: 11063 problem 1 ============================================================================================ 08:04:27 (1747829067) repeat after cancel_lru_locks PASS 39b (3s) == sanityn test 39c: check truncate mtime update ================================================================================ 08:04:30 (1747829070) repeat after cancel_lru_locks PASS 39c (3s) == sanityn test 39d: sync write should update mtime ====== 08:04:33 (1747829073) fail_loc=0x411 fail_loc=0 PASS 39d (2s) == sanityn test 40a: pdirops: create vs others ======================================================================== 08:04:35 (1747829075) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40a (7s) == sanityn test 40b: pdirops: open|create and others ======================================================================== 08:04:42 (1747829082) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40b (8s) == sanityn test 40c: pdirops: link and others ======================================================================== 08:04:50 (1747829090) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40c (7s) == sanityn test 40d: pdirops: unlink and others ======================================================================== 08:04:57 (1747829097) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40d (7s) == sanityn test 40e: pdirops: rename and others ======================================================================== 08:05:04 (1747829104) No conflict No conflict No conflict No conflict No conflict No conflict PASS 40e (7s) == sanityn test 41a: pdirops: create vs mkdir ======================================================================== 08:05:11 (1747829111) mkdir: cannot create directory '/mnt/lustre2/f41a.sanityn': File exists Conflict PASS 41a (4s) == sanityn test 41b: pdirops: create vs create ======================================================================== 08:05:15 (1747829115) open: File exists Conflict PASS 41b (4s) == sanityn test 41c: pdirops: create vs link ======================================================================== 08:05:19 (1747829119) link: cannot create link '/mnt/lustre2/f41c.sanityn' to '/mnt/lustre2/f41c.sanityn-2': File exists Conflict PASS 41c (4s) == sanityn test 41d: pdirops: create vs unlink ======================================================================== 08:05:23 (1747829123) Conflict PASS 41d (5s) == sanityn test 41e: pdirops: create and rename (tgt) ======================================================================== 08:05:28 (1747829128) Conflict PASS 41e (4s) == sanityn test 41f: pdirops: create and rename (src) ======================================================================== 08:05:32 (1747829132) Conflict PASS 41f (4s) == sanityn test 41g: pdirops: create vs getattr ======================================================================== 08:05:36 (1747829136) Conflict PASS 41g (4s) == sanityn test 41h: pdirops: create vs readdir ======================================================================== 08:05:40 (1747829140) Conflict PASS 41h (5s) == sanityn test 41i: reint_open: create vs create ======== 08:05:45 (1747829145) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 41i (688s) == sanityn test 42a: pdirops: mkdir vs mkdir ======================================================================== 08:17:13 (1747829833) mkdir: cannot create directory '/mnt/lustre2/f42a.sanityn': File exists Conflict PASS 42a (5s) == sanityn test 42b: pdirops: mkdir vs create ======================================================================== 08:17:18 (1747829838) open: File exists Conflict PASS 42b (5s) == sanityn test 42c: pdirops: mkdir vs link ======================================================================== 08:17:23 (1747829843) link: cannot create link '/mnt/lustre2/f42c.sanityn' to '/mnt/lustre2/f42c.sanityn-2': File exists Conflict PASS 42c (6s) == sanityn test 42d: pdirops: mkdir vs unlink ======================================================================== 08:17:29 (1747829849) Conflict PASS 42d (5s) == sanityn test 42e: pdirops: mkdir and rename (tgt) ======================================================================== 08:17:34 (1747829854) mv: cannot overwrite directory '/mnt/lustre2/f42e.sanityn' with non-directory Conflict PASS 42e (4s) == sanityn test 42f: pdirops: mkdir and rename (src) ======================================================================== 08:17:38 (1747829858) Conflict PASS 42f (5s) == sanityn test 42g: pdirops: mkdir vs getattr ======================================================================== 08:17:43 (1747829863) Conflict PASS 42g (4s) == sanityn test 42h: pdirops: mkdir vs readdir ======================================================================== 08:17:47 (1747829867) Conflict PASS 42h (6s) == sanityn test 43a: rmdir,mkdir doesn't return -EEXIST ======================================================================== 08:17:53 (1747829873) PASS 43a (16s) == sanityn test 43b: pdirops: unlink vs create ======================================================================== 08:18:09 (1747829889) Conflict PASS 43b (5s) == sanityn test 43c: pdirops: unlink vs link ======================================================================== 08:18:14 (1747829894) Conflict PASS 43c (4s) == sanityn test 43d: pdirops: unlink vs unlink ======================================================================== 08:18:18 (1747829898) rm: cannot remove '/mnt/lustre2/f43d.sanityn': No such file or directory Conflict PASS 43d (5s) == sanityn test 43e: pdirops: unlink and rename (tgt) ======================================================================== 08:18:23 (1747829903) Conflict PASS 43e (5s) == sanityn test 43f: pdirops: unlink and rename (src) ======================================================================== 08:18:29 (1747829909) mv: cannot stat '/mnt/lustre2/f43f.sanityn': No such file or directory Conflict PASS 43f (5s) == sanityn test 43g: pdirops: unlink vs getattr ======================================================================== 08:18:34 (1747829914) stat: cannot stat '/mnt/lustre2/f43g.sanityn': No such file or directory Conflict PASS 43g (6s) == sanityn test 43h: pdirops: unlink vs readdir ======================================================================== 08:18:40 (1747829920) Conflict PASS 43h (5s) == sanityn test 43i: pdirops: unlink vs remote mkdir ===== 08:18:45 (1747829925) SKIP: sanityn test_43i needs >= 2 MDTs SKIP 43i (1s) == sanityn test 43j: racy mkdir return EEXIST ======================================================================== 08:18:46 (1747829926) mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists PASS 43j (49s) == sanityn test 43k: unlink vs create ==================== 08:19:35 (1747829975) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 43k (469s) == sanityn test 44a: pdirops: rename tgt vs mkdir ======================================================================== 08:27:24 (1747830444) mkdir: cannot create directory '/mnt/lustre2/f44a.sanityn': File exists Conflict Wed May 21 08:27:27 EDT 2025 PASS 44a (5s) == sanityn test 44b: pdirops: rename tgt vs create ======================================================================== 08:27:29 (1747830449) open: File exists Conflict PASS 44b (6s) == sanityn test 44c: pdirops: rename tgt vs link ======================================================================== 08:27:35 (1747830455) link: cannot create link '/mnt/lustre2/f44c.sanityn' to '/mnt/lustre2/f44c.sanityn-3': File exists Conflict PASS 44c (4s) == sanityn test 44d: pdirops: rename tgt vs unlink ======================================================================== 08:27:39 (1747830459) Conflict PASS 44d (4s) == sanityn test 44e: pdirops: rename tgt and rename (tgt) ======================================================================== 08:27:43 (1747830463) Conflict PASS 44e (5s) == sanityn test 44f: pdirops: rename tgt and rename (src) ======================================================================== 08:27:48 (1747830468) Conflict PASS 44f (5s) == sanityn test 44g: pdirops: rename tgt vs getattr ======================================================================== 08:27:53 (1747830473) Conflict PASS 44g (5s) == sanityn test 44h: pdirops: rename tgt vs readdir ======================================================================== 08:27:58 (1747830478) Conflict PASS 44h (5s) == sanityn test 44i: pdirops: rename tgt vs remote mkdir ========================================================== 08:28:04 (1747830484) SKIP: sanityn test_44i needs >= 2 MDTs SKIP 44i (1s) == sanityn test 45a: rename,mkdir doesn't return -EEXIST ======================================================================== 08:28:05 (1747830485) PASS 45a (24s) == sanityn test 45b: pdirops: rename src vs create ======================================================================== 08:28:29 (1747830509) Conflict PASS 45b (6s) == sanityn test 45c: pdirops: rename src vs link ======================================================================== 08:28:35 (1747830515) Conflict PASS 45c (5s) == sanityn test 45d: pdirops: rename src vs unlink ======================================================================== 08:28:40 (1747830520) rm: cannot remove '/mnt/lustre2/f45d.sanityn': No such file or directory Conflict PASS 45d (6s) == sanityn test 45e: pdirops: rename src and rename (tgt) ======================================================================== 08:28:46 (1747830526) Conflict PASS 45e (5s) == sanityn test 45f: pdirops: rename src and rename (src) ======================================================================== 08:28:51 (1747830531) mv: cannot stat '/mnt/lustre2/f45f.sanityn': No such file or directory Conflict PASS 45f (6s) == sanityn test 45g: pdirops: rename src vs getattr ======================================================================== 08:28:57 (1747830537) stat: cannot stat '/mnt/lustre2/f45g.sanityn': No such file or directory Conflict PASS 45g (6s) == sanityn test 45h: pdirops: unlink vs readdir ======================================================================== 08:29:03 (1747830543) Conflict PASS 45h (5s) == sanityn test 45i: pdirops: rename src vs remote mkdir ========================================================== 08:29:08 (1747830548) SKIP: sanityn test_45i needs >= 2 MDTs SKIP 45i (1s) == sanityn test 45j: read vs rename ====================== 08:29:09 (1747830549) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 45j (441s) == sanityn test 46a: pdirops: link vs mkdir ======================================================================== 08:36:30 (1747830990) mkdir: cannot create directory '/mnt/lustre2/f46a.sanityn': File exists Conflict PASS 46a (6s) == sanityn test 46b: pdirops: link vs create ======================================================================== 08:36:36 (1747830996) open: File exists Conflict PASS 46b (5s) == sanityn test 46c: pdirops: link vs link ======================================================================== 08:36:41 (1747831001) link: cannot create link '/mnt/lustre2/f46c.sanityn' to '/mnt/lustre2/f46c.sanityn': File exists Conflict PASS 46c (5s) == sanityn test 46d: pdirops: link vs unlink ======================================================================== 08:36:46 (1747831006) Conflict PASS 46d (6s) == sanityn test 46e: pdirops: link and rename (tgt) ======================================================================== 08:36:52 (1747831012) Conflict PASS 46e (5s) == sanityn test 46f: pdirops: link and rename (src) ======================================================================== 08:36:57 (1747831017) Conflict PASS 46f (6s) == sanityn test 46g: pdirops: link vs getattr ======================================================================== 08:37:03 (1747831023) Conflict PASS 46g (5s) == sanityn test 46h: pdirops: link vs readdir ======================================================================== 08:37:08 (1747831028) Conflict PASS 46h (5s) == sanityn test 46i: pdirops: link vs remote mkdir ======= 08:37:13 (1747831033) SKIP: sanityn test_46i needs >= 2 MDTs SKIP 46i (1s) == sanityn test 47a: pdirops: remote mkdir vs mkdir ====== 08:37:14 (1747831034) SKIP: sanityn test_47a needs >= 2 MDTs SKIP 47a (1s) == sanityn test 47b: pdirops: remote mkdir vs create ===== 08:37:15 (1747831035) SKIP: sanityn test_47b needs >= 2 MDTs SKIP 47b (1s) == sanityn test 47c: pdirops: remote mkdir vs link ======= 08:37:16 (1747831036) SKIP: sanityn test_47c needs >= 2 MDTs SKIP 47c (1s) == sanityn test 47d: pdirops: remote mkdir vs unlink ===== 08:37:17 (1747831037) SKIP: sanityn test_47d needs >= 2 MDTs SKIP 47d (1s) == sanityn test 47e: pdirops: remote mkdir and rename (tgt) ========================================================== 08:37:18 (1747831038) SKIP: sanityn test_47e needs >= 2 MDTs SKIP 47e (1s) == sanityn test 47f: pdirops: remote mkdir and rename (src) ========================================================== 08:37:19 (1747831039) SKIP: sanityn test_47f needs >= 2 MDTs SKIP 47f (1s) == sanityn test 47g: pdirops: remote mkdir vs getattr ==== 08:37:20 (1747831040) SKIP: sanityn test_47g needs >= 2 MDTs SKIP 47g (1s) == sanityn test 50: osc lvb attrs: enqueue vs. CP AST ======================================================================== 08:37:21 (1747831041) 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.00851215 s, 1.2 MB/s fail_loc=0x410 fail_loc=0x0 PASS 50 (8s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 08:37:29 (1747831049) 0+1 records in 0+1 records out 159 bytes (159 B) copied, 0.00703832 s, 22.6 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3146: kill: (24878) - No such process PASS 51a (4s) == sanityn test 51b: layout lock: glimpse should be able to restart if layout changed ========================================================== 08:37:33 (1747831053) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00471611 s, 217 kB/s fail_loc=0x1404 fail_val=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0216572 s, 48.4 MB/s 3145728 PASS 51b (14s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 08:37:47 (1747831067) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00708203 s, 145 kB/s PASS 51c (7s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 08:37:54 (1747831074) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0163814 s, 64.0 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (4s) == sanityn test 51e: lfs getstripe does not break leases, part 2 ========================================================== 08:37:58 (1747831078) /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2434 0x982 0 write lease(2) has applied. /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2434 0x982 0 read lease(1) has applied. PASS 51e (4s) == sanityn test 54: rename locking ======================= 08:38:02 (1747831082) llite.lustre-ffff8800aa2ef000.xattr_cache=1 llite.lustre-ffff8800b6d09800.xattr_cache=1 ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504963 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-21 08:38:03.000000000 -0400 Modify: 2025-05-21 08:38:03.000000000 -0400 Change: 2025-05-21 08:38:03.000000000 -0400 Birth: - ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000154 File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504966 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-21 08:38:08.000000000 -0400 Modify: 2025-05-21 08:38:08.000000000 -0400 Change: 2025-05-21 08:38:08.000000000 -0400 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 512 Blocks: 1 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504969 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-21 08:38:14.000000000 -0400 Modify: 2025-05-21 08:38:14.000000000 -0400 Change: 2025-05-21 08:38:14.000000000 -0400 Birth: - open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504968 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-21 08:38:14.000000000 -0400 Modify: 2025-05-21 08:38:14.000000000 -0400 Change: 2025-05-21 08:38:14.000000000 -0400 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000154 open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504972 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-21 08:38:19.000000000 -0400 Modify: 2025-05-21 08:38:20.000000000 -0400 Change: 2025-05-21 08:38:20.000000000 -0400 Birth: - File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504971 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-21 08:38:19.000000000 -0400 Modify: 2025-05-21 08:38:20.000000000 -0400 Change: 2025-05-21 08:38:20.000000000 -0400 Birth: - PASS 54 (24s) == sanityn test 55a: rename vs unlink target dir ========= 08:38:26 (1747831106) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55a.sanityn/d1/d2' to '/mnt/lustre/d55a.sanityn/d3/d2': No such file or directory PASS 55a (8s) == sanityn test 55b: rename vs unlink source dir ========= 08:38:34 (1747831114) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55b.sanityn/d1/d2' to '/mnt/lustre/d55b.sanityn/d3/d2': No such file or directory PASS 55b (8s) == sanityn test 55c: rename vs unlink orphan target dir == 08:38:42 (1747831122) fail_loc=0x156 mv: cannot move '/mnt/lustre/d55c.sanityn/d1/d2' to '/mnt/lustre/d55c.sanityn/d3/d2': No such file or directory PASS 55c (13s) == sanityn test 55d: rename file vs link ================= 08:38:55 (1747831135) fail_loc=0x155 mv: cannot move '/mnt/lustre/d55d.sanityn/f1' to '/mnt/lustre/d55d.sanityn/d55d.sanityn': Is a directory PASS 55d (9s) == sanityn test 60: Verify data_version behaviour ======== 08:39:04 (1747831144) PASS 60 (3s) == sanityn test 70a: cd directory && rm directory ======== 08:39:07 (1747831147) PASS 70a (2s) == sanityn test 70b: remove files after calling rm_entry ========================================================== 08:39:09 (1747831149) PASS 70b (3s) == sanityn test 71a: correct file map just after write operation is finished ========================================================== 08:39:12 (1747831152) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00455983 s, 14.4 MB/s SKIP: sanityn test_71a ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71a (1s) == sanityn test 71b: check fiemap support for stripecount > 1 ========================================================== 08:39:13 (1747831153) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00654396 s, 10.0 MB/s SKIP: sanityn test_71b ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71b (1s) == sanityn test 71c: check FIEMAP_EXTENT_LAST flag with different extents number ========================================================== 08:39:14 (1747831154) SKIP: sanityn test_71c support only ldiskfs ost SKIP 71c (1s) == sanityn test 71d: fiemap corruption test with fm_extent_count=0 ========================================================== 08:39:15 (1747831155) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00657645 s, 10.0 MB/s SKIP: sanityn test_71d ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71d (2s) == sanityn test 72: getxattr/setxattr cache should be consistent between nodes ========================================================== 08:39:17 (1747831157) llite.lustre-ffff8800aa2ef000.xattr_cache=1 llite.lustre-ffff8800b6d09800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names user.attr1="value1" getfattr: Removing leading '/' from absolute path names user.attr1="value2" getfattr: Removing leading '/' from absolute path names getfattr: Removing leading '/' from absolute path names b362740ad371eae580e7f85452e8830b - 870e072da1ebfc20ea8c0cd3d6bdf3b6 - PASS 72 (2s) == sanityn test 73: getxattr should not cause xattr lock cancellation ========================================================== 08:39:19 (1747831159) llite.lustre-ffff8800aa2ef000.xattr_cache=1 llite.lustre-ffff8800b6d09800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" PASS 73 (3s) == sanityn test 74: flock deadlock: different mounts ======================================================================== 08:39:22 (1747831162) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00438865 s, 233 kB/s 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00447154 s, 229 kB/s 3547: get lock2 3548: get lock1 3547: done 3547: get lock1 3548: done 3548: get lock2 fcntl cmd 7 failed: Resource deadlock avoided 3547: cannot get lock1: Resource deadlock avoided fcntl cmd 7 failed: Resource deadlock avoided 3548: cannot get lock2: Resource deadlock avoided 3548: exit rc=0 3547: done 3547: exit rc=0 PASS 74 (6s) == sanityn test 75: osc: upcall after unuse lock============================================================================= 08:39:28 (1747831168) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.02373 s, 88.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114813 s, 91.3 MB/s fail_loc=0x31d /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3714: 4183 Killed stat -c %s $DIR1/$tfile fail_loc=0 PASS 75 (7s) == sanityn test 76: Verify MDT open_files listing ======== 08:39:35 (1747831175) opening files: ........ closing files: ........ PASS 76 (21s) == sanityn test 77a: check FIFO NRS policy =============== 08:39:56 (1747831196) ost.OSS.ost.nrs_policies=fifo ost.OSS.ost_create.nrs_policies=fifo ost.OSS.ost_io.nrs_policies=fifo ost.OSS.ost_out.nrs_policies=fifo ost.OSS.ost_seq.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.104896 s, 160 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133815 s, 78.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0159662 s, 65.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0186083 s, 56.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126871 s, 82.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141605 s, 74.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106506 s, 98.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129404 s, 81.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112228 s, 93.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0285817 s, 36.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0373163 s, 28.1 MB/s , 0.0245406 s, 42.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0418058 s, 25.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0207963 s, 50.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0289746 s, 36.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0237911 s, 44.1 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d09800.lock_unused_count=7 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d09800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0295467 s, 35.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00757299 s, 138 MB/s , 0.0123787 s, 84.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103042 s, 102 MB/s , 0.00763561 s, 137 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00911413 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00931022 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105245 s, 99.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00973457 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111635 s, 93.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109937 s, 95.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126597 s, 82.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012671 s, 82.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0135511 s, 77.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0136808 s, 76.6 MB/s , 0.0136312 s, 76.9 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d09800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0153603 s, 68.3 MB/s removed '/mnt/lustre/d77a.sanityn/nrs_r_oleg105-client.virtnet' removed '/mnt/lustre/d77a.sanityn/nrs_w_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77a.sanityn' PASS 77a (3s) == sanityn test 77b: check CRR-N NRS policy ============== 08:39:59 (1747831199) ost.OSS.ost.nrs_policies=crrn ost.OSS.ost_create.nrs_policies=crrn ost.OSS.ost_io.nrs_policies=crrn ost.OSS.ost_out.nrs_policies=crrn ost.OSS.ost_seq.nrs_policies=crrn ost.OSS.ost.nrs_crrn_quantum=1 ost.OSS.ost_create.nrs_crrn_quantum=1 ost.OSS.ost_io.nrs_crrn_quantum=1 ost.OSS.ost_out.nrs_crrn_quantum=1 ost.OSS.ost_seq.nrs_crrn_quantum=1 policy: crr-n, crrn_quantum 1 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.144115 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0140736 s, 74.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146914 s, 71.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206472 s, 50.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0242695 s, 43.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0164891 s, 63.6 MB/s 1048576 bytes (1.0 MB) copied, 0.020308 s, 51.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0280973 s, 37.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142911 s, 73.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0192595 s, 54.4 MB/s , 0.0204041 s, 51.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0340532 s, 30.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151592 s, 69.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0158917 s, 66.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0072786 s, 144 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0270654 s, 38.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0145223 s, 72.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109584 s, 95.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.013117 s, 79.9 MB/s , 0.013124 s, 79.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0118353 s, 88.6 MB/s , 0.0123446 s, 84.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0164151 s, 63.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133482 s, 78.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0134085 s, 78.2 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d09800.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d09800.lock_unused_count=3 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0139336 s, 75.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0150773 s, 69.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0150581 s, 69.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0153929 s, 68.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0147928 s, 70.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152417 s, 68.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0165413 s, 63.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156516 s, 67.0 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg105-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost.nrs_crrn_quantum=64 ost.OSS.ost_create.nrs_crrn_quantum=64 ost.OSS.ost_io.nrs_crrn_quantum=64 ost.OSS.ost_out.nrs_crrn_quantum=64 ost.OSS.ost_seq.nrs_crrn_quantum=64 policy: crr-n, crrn_quantum 64 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.100229 s, 167 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106899 s, 98.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0186101 s, 56.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0208164 s, 50.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0275543 s, 38.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0205935 s, 50.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0271481 s, 38.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0226587 s, 46.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156734 s, 66.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0296602 s, 35.4 MB/s 1048576 bytes (1.0 MB) copied, 0.024317 s, 43.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0139765 s, 75.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0387305 s, 27.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0234119 s, 44.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0349642 s, 30.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0317921 s, 33.0 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d09800.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d09800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.024217 s, 43.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00841522 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00417818 s, 251 MB/s , 0.0111388 s, 94.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00768638 s, 136 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00508803 s, 206 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0081036 s, 129 MB/s 1048576 bytes (1.0 MB) copied, 0.00879498 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00654472 s, 160 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00696303 s, 151 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00900946 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00761538 s, 138 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00916352 s, 114 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00910711 s, 115 MB/s 1048576 bytes (1.0 MB) copied, 0.0101274 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102265 s, 103 MB/s 1048576 bytes (1.0 MB) copied, 0.0105028 s, 99.8 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d09800.lock_unused_count=1 removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg105-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77b (4s) == sanityn test 77c: check ORR NRS policy ================ 08:40:03 (1747831203) ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_orr_quantum=1 ost.OSS.ost_io.nrs_orr_offset_type=physical ost.OSS.ost_io.nrs_orr_supported=reads policy: orr, orr_quantum 1, orr_offset_type physical, orr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.165873 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122545 s, 85.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.022644 s, 46.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0157031 s, 66.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0302494 s, 34.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0227069 s, 46.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0372197 s, 28.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0273558 s, 38.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0395423 s, 26.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0375148 s, 28.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.030612 s, 34.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0343004 s, 30.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0329811 s, 31.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0277519 s, 37.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0245759 s, 42.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0294327 s, 35.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0417931 s, 25.1 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d09800.lock_unused_count=6 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d09800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110539 s, 94.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0137273 s, 76.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100544 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103611 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112509 s, 93.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113671 s, 92.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125647 s, 83.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0126451 s, 82.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0207293 s, 50.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.02125 s, 49.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0225764 s, 46.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0211089 s, 49.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0222428 s, 47.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0227913 s, 46.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0228496 s, 45.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.024966 s, 42.0 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg105-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=writes ost.OSS.ost_io.nrs_orr_quantum=64 policy: orr, orr_quantum 64, orr_offset_type physical, orr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.117588 s, 143 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148919 s, 70.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0168527 s, 62.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0167508 s, 62.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0387562 s, 27.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0331246 s, 31.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.031791 s, 33.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0391364 s, 26.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0396832 s, 26.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0410251 s, 25.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0436307 s, 24.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0484021 s, 21.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.035213 s, 29.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0418656 s, 25.0 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d09800.lock_unused_count=5 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d09800.lock_unused_count=5 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0397475 s, 26.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0343616 s, 30.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0456187 s, 23.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100029 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128771 s, 81.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00683114 s, 153 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0035741 s, 293 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0097244 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00778031 s, 135 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102382 s, 102 MB/s , 0.00417708 s, 251 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00717246 s, 146 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0058581 s, 179 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00769855 s, 136 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0089682 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00910731 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00937238 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00916013 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206067 s, 50.9 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg105-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=reads_and_writes ost.OSS.ost_io.nrs_orr_offset_type=logical policy: orr, orr_quantum 64, orr_offset_type logical, orr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.142342 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0196642 s, 53.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148897 s, 70.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0189795 s, 55.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0183168 s, 57.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0234196 s, 44.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0220213 s, 47.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187059 s, 56.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0404409 s, 25.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0362782 s, 28.9 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d09800.lock_unused_count=3 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0713613 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0550749 s, 19.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0604286 s, 17.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0634882 s, 16.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0548279 s, 19.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0669711 s, 15.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0796287 s, 13.2 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d09800.lock_unused_count=2 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d09800.lock_unused_count=5 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.013389 s, 78.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0145654 s, 72.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108941 s, 96.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0121844 s, 86.1 MB/s , 0.0112184 s, 93.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0164895 s, 63.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0129765 s, 80.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128319 s, 81.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012875 s, 81.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131405 s, 79.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138883 s, 75.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124305 s, 84.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126892 s, 82.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131709 s, 79.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0132522 s, 79.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141628 s, 74.0 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg105-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77c (5s) == sanityn test 77d: check TRR nrs policy ================ 08:40:09 (1747831209) ost.OSS.ost_io.nrs_policies=trr ost.OSS.ost_io.nrs_trr_quantum=1 ost.OSS.ost_io.nrs_trr_offset_type=physical ost.OSS.ost_io.nrs_trr_supported=reads policy: trr, trr_quantum 1, trr_offset_type physical, trr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.135537 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129428 s, 81.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0159521 s, 65.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0186656 s, 56.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107452 s, 97.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156489 s, 67.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0244078 s, 43.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.034289 s, 30.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0268821 s, 39.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0173204 s, 60.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0349653 s, 30.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0324584 s, 32.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0273877 s, 38.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0214866 s, 48.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0249652 s, 42.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0266993 s, 39.3 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d09800.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d09800.lock_unused_count=6 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0241499 s, 43.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0094788 s, 111 MB/s , 0.012115 s, 86.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0130854 s, 80.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111364 s, 94.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010173 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00896211 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117576 s, 89.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011777 s, 89.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0106738 s, 98.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0106533 s, 98.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0123274 s, 85.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0122474 s, 85.6 MB/s , 0.0141114 s, 74.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113831 s, 92.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101485 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119251 s, 87.9 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d09800.lock_unused_count=2 removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg105-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=writes ost.OSS.ost_io.nrs_trr_quantum=64 policy: trr, trr_quantum 64, trr_offset_type physical, trr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.113175 s, 148 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0207201 s, 50.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0215772 s, 48.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0338364 s, 31.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0343962 s, 30.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0283579 s, 37.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0263079 s, 39.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0330555 s, 31.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0270726 s, 38.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0332082 s, 31.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0252754 s, 41.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0222938 s, 47.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.020036 s, 52.3 MB/s 1048576 bytes (1.0 MB) copied, 0.029273 s, 35.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0437902 s, 23.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0225174 s, 46.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0335221 s, 31.3 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d09800.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d09800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00843025 s, 124 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146657 s, 71.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00828239 s, 127 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00844588 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0140561 s, 74.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120785 s, 86.8 MB/s 1048576 bytes (1.0 MB) copied, 0.00919546 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0164354 s, 63.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0170596 s, 61.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0189914 s, 55.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0192339 s, 54.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0200066 s, 52.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212615 s, 49.3 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d09800.lock_unused_count=5 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0220298 s, 47.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.022277 s, 47.1 MB/s , 0.0223151 s, 47.0 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg105-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=reads_and_writes ost.OSS.ost_io.nrs_trr_offset_type=logical policy: trr, trr_quantum 64, trr_offset_type logical, trr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.117421 s, 143 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146082 s, 71.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.017226 s, 60.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0210517 s, 49.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0127321 s, 82.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114587 s, 91.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0423582 s, 24.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0289501 s, 36.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0395059 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0377379 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0229945 s, 45.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0431812 s, 24.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0294493 s, 35.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0357644 s, 29.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0295144 s, 35.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0386378 s, 27.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.037133 s, 28.2 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d09800.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d09800.lock_unused_count=7 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00754957 s, 139 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123795 s, 84.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00144342 s, 726 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011037 s, 95.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0084167 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00132712 s, 790 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00352316 s, 298 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00615076 s, 170 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00926466 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110565 s, 94.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0078528 s, 134 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00331752 s, 316 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121538 s, 86.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00959407 s, 109 MB/s 1048576 bytes (1.0 MB) copied, 0.00147843 s, 709 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0012239 s, 857 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d09800.lock_unused_count=2 removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg105-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77d (4s) == sanityn test 77e: check TBF NID nrs policy ============ 08:40:13 (1747831213) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_tbf_rule=start localhost nid={0@lo} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start clients nid={192.168.201.5@tcp} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start others nid={*.*.*.*@tcp} rate=50 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.138262 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151342 s, 69.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0190154 s, 55.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0251576 s, 41.7 MB/s , 0.0210882 s, 49.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203827 s, 51.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0315535 s, 33.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0270006 s, 38.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146453 s, 71.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144549 s, 72.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0228341 s, 45.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0272755 s, 38.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0400813 s, 26.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0328258 s, 31.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0264217 s, 39.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0521226 s, 20.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0241402 s, 43.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0334394 s, 31.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0349563 s, 30.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0335549 s, 31.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0404573 s, 25.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0353011 s, 29.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0359539 s, 29.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0366762 s, 28.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0369007 s, 28.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0357211 s, 29.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0351541 s, 29.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0382761 s, 27.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0365621 s, 28.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0392451 s, 26.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0409517 s, 25.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.037944 s, 27.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0414649 s, 25.3 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg105-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change localhost rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change clients rate=101 ost.OSS.ost_io.nrs_tbf_rule=change others rate=51 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.133913 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0225029 s, 46.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.028396 s, 36.9 MB/s , 0.0284202 s, 36.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0316021 s, 33.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0364196 s, 28.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0229375 s, 45.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0341273 s, 30.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0199618 s, 52.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126966 s, 82.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0194371 s, 53.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0335468 s, 31.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0155249 s, 67.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.030217 s, 34.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0334094 s, 31.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.037646 s, 27.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0275959 s, 38.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156317 s, 67.1 MB/s , 0.0188994 s, 55.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0183015 s, 57.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.014806 s, 70.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0139296 s, 75.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144871 s, 72.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.019244 s, 54.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0200982 s, 52.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0177431 s, 59.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0178347 s, 58.8 MB/s , 0.0191073 s, 54.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0194762 s, 53.8 MB/s , 0.0199908 s, 52.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0188054 s, 55.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.018447 s, 56.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0217622 s, 48.2 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg105-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop localhost ost.OSS.ost_io.nrs_tbf_rule=stop clients ost.OSS.ost_io.nrs_tbf_rule=stop others 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.13608 s, 123 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00672109 s, 156 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00764982 s, 137 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0140917 s, 74.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0157543 s, 66.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0201743 s, 52.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.008972 s, 117 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0274438 s, 38.2 MB/s , 0.0290396 s, 36.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0384644 s, 27.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.018961 s, 55.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0254951 s, 41.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0299641 s, 35.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.018855 s, 55.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.021526 s, 48.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0177708 s, 59.0 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d09800.lock_unused_count=5 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d09800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0354971 s, 29.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00821268 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106676 s, 98.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00568792 s, 184 MB/s , 0.00756948 s, 139 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101443 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00871752 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011744 s, 89.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0077102 s, 136 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00760939 s, 138 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00199197 s, 526 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102564 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107179 s, 97.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00919792 s, 114 MB/s , 0.00970732 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117444 s, 89.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0127001 s, 82.6 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d09800.lock_unused_count=1 removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg105-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.140324 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126283 s, 83.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0197267 s, 53.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0215581 s, 48.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0280095 s, 37.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0270922 s, 38.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0348336 s, 30.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.020943 s, 50.1 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0442611 s, 23.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0439336 s, 23.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0274228 s, 38.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0384236 s, 27.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0244048 s, 43.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0313834 s, 33.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0252923 s, 41.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119201 s, 88.0 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d09800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0253773 s, 41.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101446 s, 103 MB/s , 0.00816001 s, 129 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00911504 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00840793 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00965772 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00836487 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101604 s, 103 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00938734 s, 112 MB/s , 0.00922827 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012988 s, 80.7 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d09800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00973892 s, 108 MB/s 1048576 bytes (1.0 MB) copied, 0.00940585 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0049358 s, 212 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0101376 s, 103 MB/s 1048576 bytes (1.0 MB) copied, 0.00969551 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107339 s, 97.7 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg105-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' PASS 77e (9s) == sanityn test 77f: check TBF JobID nrs policy ========== 08:40:22 (1747831222) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start runas jobid={iozone.500 dd.500 tiotest.500} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start iozone_runas jobid={iozone.500} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg105-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.120741 s, 139 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00970958 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.013354 s, 78.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0140617 s, 74.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0247926 s, 42.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203389 s, 51.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0153322 s, 68.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010375 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0240676 s, 43.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0287624 s, 36.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0140261 s, 74.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0282822 s, 37.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0137206 s, 76.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0274067 s, 38.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0239433 s, 43.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00565257 s, 186 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0665261 s, 15.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120692 s, 86.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0154268 s, 68.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0134932 s, 77.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0137105 s, 76.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143647 s, 73.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144948 s, 72.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203935 s, 51.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0141224 s, 74.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0145593 s, 72.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144827 s, 72.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151131 s, 69.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152928 s, 68.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142367 s, 73.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0172437 s, 60.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0172337 s, 60.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187215 s, 56.0 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg105-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change runas rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change iozone_runas rate=101 ost.OSS.ost_io.nrs_tbf_rule=change dd_runas rate=51 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg105-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.110904 s, 151 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107977 s, 97.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141777 s, 74.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126015 s, 83.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0159801 s, 65.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136957 s, 76.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0073922 s, 142 MB/s , 0.0120707 s, 86.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015475 s, 67.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0224454 s, 46.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0238019 s, 44.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0352423 s, 29.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.028511 s, 36.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0208772 s, 50.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0398976 s, 26.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.023076 s, 45.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.034803 s, 30.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0163506 s, 64.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133363 s, 78.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124899 s, 84.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0163173 s, 64.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0167704 s, 62.5 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0168654 s, 62.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0167825 s, 62.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0175816 s, 59.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00190102 s, 552 MB/s , 0.0163331 s, 64.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156262 s, 67.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129729 s, 80.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0133842 s, 78.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0133797 s, 78.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143564 s, 73.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0165429 s, 63.4 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg105-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop runas ost.OSS.ost_io.nrs_tbf_rule=stop iozone_runas ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg105-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.155241 s, 108 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0181883 s, 57.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0215235 s, 48.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0242095 s, 43.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141087 s, 74.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0305029 s, 34.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0349687 s, 30.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0329093 s, 31.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0222672 s, 47.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0267052 s, 39.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0398941 s, 26.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0326104 s, 32.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0202011 s, 51.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0139253 s, 75.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0331699 s, 31.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0249364 s, 42.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.039466 s, 26.6 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d09800.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d09800.lock_unused_count=1 running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00597751 s, 175 MB/s 1048576 bytes (1.0 MB) copied, 0.0109257 s, 96.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00612056 s, 171 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00689258 s, 152 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100079 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.017882 s, 58.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144132 s, 72.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151235 s, 69.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152782 s, 68.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0164216 s, 63.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144056 s, 72.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0167862 s, 62.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0170971 s, 61.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0170393 s, 61.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0151147 s, 69.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187592 s, 55.9 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d09800.lock_unused_count=1 removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg105-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_policies=fifo running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg105-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.122711 s, 137 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00972777 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103934 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0140067 s, 74.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0167751 s, 62.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.018292 s, 57.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0292704 s, 35.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0356494 s, 29.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0316704 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0270313 s, 38.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0307732 s, 34.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0326835 s, 32.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0476081 s, 22.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0374183 s, 28.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.040991 s, 25.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0374434 s, 28.0 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d09800.lock_unused_count=2 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d09800.lock_unused_count=6 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0435285 s, 24.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0060279 s, 174 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00495038 s, 212 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00521109 s, 201 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00144413 s, 726 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0064334 s, 163 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010495 s, 99.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00695694 s, 151 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00124974 s, 839 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0066479 s, 158 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00858938 s, 122 MB/s 1048576 bytes (1.0 MB) copied, 0.00682429 s, 154 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00718698 s, 146 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00202012 s, 519 MB/s , 0.00196068 s, 535 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00474577 s, 221 MB/s 1048576 bytes (1.0 MB) copied, 0.0012043 s, 871 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d09800.lock_unused_count=1 removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg105-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' PASS 77f (7s) == sanityn test 77g: Change TBF type directly ============ 08:40:29 (1747831229) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 ost.OSS.ost_io.nrs_policies=fifo PASS 77g (4s) == sanityn test 77h: Wrong policy name should report error, not LBUG ========================================================== 08:40:33 (1747831233) oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=abc: No such file or directory pdsh@oleg105-client: oleg105-server: ssh exited with exit code 2 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc: Unknown error 524 pdsh@oleg105-client: oleg105-server: ssh exited with exit code 12 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf reg abc: Unknown error 524 pdsh@oleg105-client: oleg105-server: ssh exited with exit code 12 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc efg: Unknown error 524 pdsh@oleg105-client: oleg105-server: ssh exited with exit code 12 PASS 77h (4s) == sanityn test 77i: Change rank of TBF rule ============= 08:40:37 (1747831237) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start before jobid={jobid} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start after jobid={jobid} rate=1000 rank=default ost.OSS.ost_io.nrs_tbf_rule=start target jobid={jobid} rate=1000 rank=after Move before itself ost.OSS.ost_io.nrs_tbf_rule=change target rank=target Move to higher rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=before Move to lower rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=after Move before default ost.OSS.ost_io.nrs_tbf_rule=change target rank=default ost.OSS.ost_io.nrs_policies=fifo PASS 77i (9s) == sanityn test 77j: check TBF-OPCode NRS policy ========= 08:40:46 (1747831246) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf opcode ost.OSS.ost_io.nrs_tbf_rule=start ost_r opcode={ost_read} rate=5 ost.OSS.ost_io.nrs_tbf_rule=start ost_w opcode={ost_write} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.136976 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0251881 s, 41.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0284544 s, 36.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0288877 s, 36.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.024062 s, 43.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0232876 s, 45.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0161772 s, 64.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125891 s, 83.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0181656 s, 57.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0237769 s, 44.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0240904 s, 43.5 MB/s , 0.0411404 s, 25.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0330397 s, 31.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0414569 s, 25.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.037896 s, 27.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0488332 s, 21.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0283071 s, 37.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131723 s, 79.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155524 s, 67.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123012 s, 85.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0150988 s, 69.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00571176 s, 184 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0154168 s, 68.0 MB/s , 0.0197058 s, 53.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0163677 s, 64.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0157393 s, 66.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0177984 s, 58.9 MB/s , 0.0176644 s, 59.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0176634 s, 59.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0177221 s, 59.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0186905 s, 56.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0193315 s, 54.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0204772 s, 51.2 MB/s removed '/mnt/lustre/d77j.sanityn/nrs_w_oleg105-client.virtnet' removed '/mnt/lustre/d77j.sanityn/nrs_r_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77j.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 5 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.95181 s, 21.2 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.445 s, 5.4 MB/s Read runtime is 20 s, speed is 5.000000 IOPS cleanup_tbf /mnt/lustre/d77j.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_r ost.OSS.ost_io.nrs_tbf_rule=stop ost_w ost.OSS.ost_io.nrs_policies=fifo PASS 77j (51s) == sanityn test 77ja: check TBF-UID/GID NRS policy ======= 08:41:37 (1747831297) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg105-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.674346 s, 24.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.142403 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.139417 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.140824 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.145332 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.158555 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.153674 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.144544 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.143301 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.342108 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.360527 s, 2.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.37128 s, 2.8 MB/s , 0.351229 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.359346 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.365746 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.357277 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.371743 s, 2.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.1215 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.124417 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.116905 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.121172 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.123569 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.12695 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.120632 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.118791 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.129184 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.120352 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.121315 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.121265 s, 8.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.122538 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.124471 s, 8.4 MB/s 1048576 bytes (1.0 MB) copied, 0.121706 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.124077 s, 8.5 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg105-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.7338 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9331 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg105-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.467637 s, 35.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0194701 s, 53.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0378105 s, 27.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0322969 s, 32.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0397279 s, 26.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0471832 s, 22.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0472443 s, 22.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0351575 s, 29.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0378444 s, 27.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.342141 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.352792 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.367482 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.361836 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.379538 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.377646 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.378036 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.37605 s, 2.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.129765 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.12688 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.133743 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.132731 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130119 s, 8.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.130221 s, 8.1 MB/s , 0.130278 s, 8.0 MB/s 1048576 bytes (1.0 MB) copied, 0.130814 s, 8.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.130992 s, 8.0 MB/s , 0.130925 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.128874 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.129253 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.131622 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.131762 s, 8.0 MB/s 1048576 bytes (1.0 MB) copied, 0.131326 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.132351 s, 7.9 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg105-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.7407 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9205 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77ja (134s) == sanityn test 77k: check TBF policy with NID/JobID/OPCode expression ========================================================== 08:43:51 (1747831431) ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_tbf_rule=start ext_w jobid={dd.500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r jobid={dd.500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg105-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.21519 s, 78.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0164758 s, 63.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0130437 s, 80.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.037329 s, 28.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.046156 s, 22.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.045896 s, 22.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0377561 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0444501 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0505027 s, 20.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.078954 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0733748 s, 14.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0990832 s, 10.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.110753 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.12178 s, 8.6 MB/s 1048576 bytes (1.0 MB) copied, 0.124296 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.125373 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.122441 s, 8.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00869877 s, 121 MB/s 1048576 bytes (1.0 MB) copied, 0.025779 s, 40.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0196825 s, 53.3 MB/s , 0.0144445 s, 72.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0276332 s, 37.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0190511 s, 55.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00298601 s, 351 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0281818 s, 37.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00611411 s, 172 MB/s 1048576 bytes (1.0 MB) copied, 0.00205852 s, 509 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.030448 s, 34.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0314143 s, 33.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0225369 s, 46.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0167181 s, 62.7 MB/s , 0.0194877 s, 53.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0175311 s, 59.8 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg105-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.07001 s, 20.7 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.77622 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext_w nid={0@lo 192.168.201.5@tcp}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r nid={0@lo 192.168.201.5@tcp}&opcode={ost_read} rate=10 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.152547 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00833112 s, 126 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0286621 s, 36.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.033679 s, 31.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0364329 s, 28.8 MB/s , 0.0292862 s, 35.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0259631 s, 40.4 MB/s , 0.0319742 s, 32.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0377815 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0629584 s, 16.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0818441 s, 12.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0846793 s, 12.4 MB/s , 0.0827628 s, 12.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.164074 s, 6.4 MB/s 1048576 bytes (1.0 MB) copied, 0.155277 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.258315 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.256585 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0210921 s, 49.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0198482 s, 52.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0220968 s, 47.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.021887 s, 47.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.017329 s, 60.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0229545 s, 45.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0214613 s, 48.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0261369 s, 40.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0196598 s, 53.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0249474 s, 42.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0201163 s, 52.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0184743 s, 56.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0237575 s, 44.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0259751 s, 40.4 MB/s , 0.0231862 s, 45.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0193665 s, 54.1 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg105-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.97578 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.75127 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext nid={0@lo 192.168.201.5@tcp}&jobid={dd.500} rate=20 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg105-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.145814 s, 115 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00573096 s, 183 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101064 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00687455 s, 153 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015972 s, 65.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102216 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136299 s, 76.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00754759 s, 139 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116827 s, 89.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0652501 s, 16.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0822719 s, 12.7 MB/s , 0.06805 s, 15.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0752404 s, 13.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0873773 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0849411 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0918343 s, 11.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0963727 s, 10.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0137452 s, 76.3 MB/s , 0.0124376 s, 84.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136581 s, 76.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111041 s, 94.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0120849 s, 86.8 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.012208 s, 85.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0121524 s, 86.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125937 s, 83.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0127029 s, 82.5 MB/s 1+0 records in 1+0 records out , 0.0137905 s, 76.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0125245 s, 83.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131288 s, 79.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0149819 s, 70.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0158663 s, 66.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0177147 s, 59.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0176797 s, 59.3 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg105-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.98014 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.88401 s, 21.5 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext ost.OSS.ost_io.nrs_tbf_rule=start ext_a jobid={dd.500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b jobid={dd.500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg105-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.238344 s, 70.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00724109 s, 145 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102461 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121402 s, 86.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00919548 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00812081 s, 129 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00970271 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212012 s, 49.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00731177 s, 143 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.17316 s, 6.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.180419 s, 5.8 MB/s 1048576 bytes (1.0 MB) copied, 0.19105 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.192709 s, 5.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.365658 s, 2.9 MB/s , 0.358854 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.363929 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.38005 s, 2.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0106088 s, 98.8 MB/s , 0.00819266 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00817478 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100452 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104875 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0085366 s, 123 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011484 s, 91.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00959807 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104923 s, 99.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117359 s, 89.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119738 s, 87.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0123714 s, 84.8 MB/s , 0.0112395 s, 93.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0139981 s, 74.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012996 s, 80.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131004 s, 80.0 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg105-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.82862 s, 10.7 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.78776 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.04296 s, 20.8 MB/s Write runtime is 7 s, speed is 14.285714 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.77284 s, 10.7 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_tbf_rule=start ext_ug uid={500}&gid={1000} rate=5 running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg105-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.456011 s, 36.8 MB/s running as uid/gid/euid/egid 500/1000/500/1000, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143453 s, 73.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0360087 s, 29.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0342071 s, 30.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0421823 s, 24.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.035075 s, 29.9 MB/s , 0.0431963 s, 24.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0423095 s, 24.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0441378 s, 23.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.352135 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.373925 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.368693 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.376533 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.385571 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.38997 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.389436 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.393366 s, 2.7 MB/s running as uid/gid/euid/egid 500/1000/500/1000, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151207 s, 69.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0145214 s, 72.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00181213 s, 579 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148687 s, 70.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133584 s, 78.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00192754 s, 544 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111932 s, 93.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00180924 s, 580 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00212082 s, 494 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.030949 s, 33.9 MB/s 1+0 records in 1+0 records out , 0.0257112 s, 40.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0257936 s, 40.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0258655 s, 40.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0265603 s, 39.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0176774 s, 59.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0249254 s, 42.1 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg105-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.7043 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.4425 s, 5.4 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_ug ost.OSS.ost_io.nrs_tbf_rule=start ext_uw uid={500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_ur uid={500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg105-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.167412 s, 100 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0147492 s, 71.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0308827 s, 34.0 MB/s , 0.0335186 s, 31.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0288923 s, 36.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0368612 s, 28.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0412287 s, 25.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0404411 s, 25.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.034473 s, 30.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0642428 s, 16.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0824801 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0764049 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0860141 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0943882 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0940485 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.101968 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.10353 s, 10.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00194163 s, 540 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0366843 s, 28.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0256199 s, 40.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.032007 s, 32.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0401394 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00182567 s, 574 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0248527 s, 42.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0221997 s, 47.2 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0197131 s, 53.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0167563 s, 62.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138698 s, 75.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108634 s, 96.5 MB/s , 0.0255797 s, 41.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00962888 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00801558 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0302302 s, 34.7 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg105-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.18785 s, 20.2 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.78344 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_uw ost.OSS.ost_io.nrs_tbf_rule=stop ext_ur ost.OSS.ost_io.nrs_tbf_rule=start ext_a uid={500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b uid={500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg105-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.24854 s, 67.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101443 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0241601 s, 43.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0255178 s, 41.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0192763 s, 54.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0291634 s, 36.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0260583 s, 40.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0328461 s, 31.9 MB/s , 0.0277204 s, 37.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.158209 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.174408 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.166469 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.179399 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.309666 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.311031 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.353355 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.352977 s, 3.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00798478 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00776657 s, 135 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00855536 s, 123 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101404 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122526 s, 85.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015119 s, 69.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00999667 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108923 s, 96.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110739 s, 94.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122576 s, 85.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0139566 s, 75.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0140916 s, 74.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0145694 s, 72.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0145328 s, 72.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0136932 s, 76.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0149913 s, 69.9 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg105-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.79079 s, 10.7 MB/s Write runtime is 10 s, speed is 10.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.73806 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.7769 s, 10.7 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.72942 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_policies=fifo PASS 77k (356s) == sanityn test 77l: check the output of NRS policies for generic TBF ========================================================== 08:49:47 (1747831787) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_policies=fifo PASS 77l (3s) == sanityn test 77m: check NRS Delay slows write RPC processing ========================================================== 08:49:50 (1747831790) ost.OSS.ost_io.nrs_policies=delay ost.OSS.ost_io.nrs_delay_min=4 ost.OSS.ost_io.nrs_delay_max=4 ost.OSS.ost_io.nrs_delay_pct=100 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg105-client.virtnet] [bs=1M] [count=1] [oflag=direct] [conv=fdatasync] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 3.85322 s, 272 kB/s running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg105-client.virtnet] [bs=1M] [count=10] [oflag=direct] [conv=fdatasync] 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 40.0107 s, 262 kB/s ost.OSS.ost_io.nrs_policies=fifo PASS 77m (50s) == sanityn test 77n: check wildcard support for TBF JobID NRS policy ========================================================== 08:50:40 (1747831840) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={*.500} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0815887 s, 206 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00745961 s, 141 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00881326 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100877 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113 s, 92.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0251607 s, 41.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0147214 s, 71.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0273766 s, 38.3 MB/s , 0.0258789 s, 40.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0237172 s, 44.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0368618 s, 28.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0324047 s, 32.4 MB/s , 0.0284558 s, 36.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0272102 s, 38.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0310128 s, 33.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0340909 s, 30.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0362745 s, 28.9 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d09800.lock_unused_count=5 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6d09800.lock_unused_count=3 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00880487 s, 119 MB/s , 0.00143524 s, 731 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00800789 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00789361 s, 133 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6d09800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0115445 s, 90.8 MB/s 1048576 bytes (1.0 MB) copied, 0.00921017 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00848374 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105342 s, 99.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00898832 s, 117 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0097044 s, 108 MB/s , 0.0096805 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00996589 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010086 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100836 s, 104 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117272 s, 89.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0100317 s, 105 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg105-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77n.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.93062 s, 21.3 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77n.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.97073 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.*} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.19063 s, 88.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0193865 s, 54.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187824 s, 55.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0226468 s, 46.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.032548 s, 32.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0360096 s, 29.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.016414 s, 63.9 MB/s , 0.0331729 s, 31.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0180588 s, 58.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0643466 s, 16.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0721933 s, 14.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.162388 s, 6.5 MB/s , 0.169518 s, 6.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.264111 s, 4.0 MB/s , 0.264115 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.367291 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.368373 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0197446 s, 53.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0190784 s, 55.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0208604 s, 50.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0189888 s, 55.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0221519 s, 47.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0234786 s, 44.7 MB/s , 0.0211018 s, 49.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out , 0.0201579 s, 52.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0217453 s, 48.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0230565 s, 45.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0242118 s, 43.3 MB/s 1+0 records in 1+0 records out , 0.023425 s, 44.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0224694 s, 46.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0237261 s, 44.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0226718 s, 46.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0225605 s, 46.5 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg105-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg105-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.91228 s, 21.3 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.97459 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_policies=fifo PASS 77n (64s) == sanityn test 77o: Changing rank should not panic ====== 08:51:44 (1747831904) mds.MDS.mdt.nrs_policies=tbf nid mds.MDS.mdt.nrs_tbf_rule=start name nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=start name1 nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=change name1 rank=name mds.MDS.mdt.nrs_tbf_rule=stop name mds.MDS.mdt.nrs_policies=fifo PASS 77o (3s) == sanityn test 77q: Parallel TBF rule definitions should not panic ========================================================== 08:51:47 (1747831907) mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_policies=fifo PASS 77q (26s) == sanityn test 77p: Check validity of rule names for TBF policies ========================================================== 08:52:13 (1747831933) mds.MDS.mdt.nrs_policies=tbf oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_overflo uid={500} rate=500: File name too long pdsh@oleg105-client: oleg105-server: ssh exited with exit code 36 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_empty: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p@spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p.spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p~spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p#spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p/spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p^spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p%spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p*spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p;spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p,spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p?spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77pspec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p:spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p+spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p=spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p)spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p(spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p{spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p}spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p|spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p[spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p]spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p!spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p&spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p$spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p`spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p\spec uid={500} rate=500: Invalid argument pdsh@oleg105-client: oleg105-server: ssh exited with exit code 22 mds.MDS.mdt.nrs_policies=fifo PASS 77p (9s) == sanityn test 78: Enable policy and specify tunings right away ========================================================== 08:52:22 (1747831942) oleg105-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_orr_quantum=1: Resource temporarily unavailable pdsh@oleg105-client: oleg105-server: ssh exited with exit code 11 ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_policies=fifo PASS 78 (3s) == sanityn test 79: xattr: intent error ================== 08:52:25 (1747831945) File: '/mnt/lustre/d79.sanityn' Size: 512 Blocks: 1 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272505431 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-21 08:52:25.000000000 -0400 Modify: 2025-05-21 08:52:25.000000000 -0400 Change: 2025-05-21 08:52:25.000000000 -0400 Birth: - fail_val=0 fail_loc=0x80000160 fail_val=0 fail_loc=0x80000131 # file: mnt/lustre/d79.sanityn trusted.name1="value1" PASS 79 (12s) == sanityn test 80a: migrate directory when some children is being opened ========================================================== 08:52:37 (1747831957) SKIP: sanityn test_80a needs >= 2 MDTs SKIP 80a (0s) == sanityn test 80b: Accessing directory during migration ========================================================== 08:52:37 (1747831957) SKIP: sanityn test_80b needs >= 2 MDTs SKIP 80b (1s) == sanityn test 81a: rename and stat under striped directory ========================================================== 08:52:38 (1747831958) SKIP: sanityn test_81a needs >= 2 MDTs SKIP 81a (1s) == sanityn test 81b: rename under striped directory doesn't deadlock ========================================================== 08:52:39 (1747831959) SKIP: sanityn test_81b We need at least 2 MDTs for this test SKIP 81b (1s) == sanityn test 81c: rename revoke LOOKUP lock for remote object ========================================================== 08:52:40 (1747831960) SKIP: sanityn test_81c needs >= 4 MDTs SKIP 81c (0s) == sanityn test 82: fsetxattr and fgetxattr on orphan files ========================================================== 08:52:41 (1747831961) multiop /mnt/lustre/f82.sanityn vO_ac TMPPIPE=/tmp/multiop_open_wait_pipe.6853 multiop /mnt/lustre2/f82.sanityn vo_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.6853 PASS 82 (1s) == sanityn test 83: access striped directory while it is being created/unlinked ========================================================== 08:52:42 (1747831962) SKIP: sanityn test_83 needs >= 2 MDTs SKIP 83 (1s) == sanityn test 84: 0-nlink race in lu_object_find() ===== 08:52:43 (1747831963) fail_loc=0x8000060b PASS 84 (7s) == sanityn test 90: open/create and unlink striped directory ========================================================== 08:52:50 (1747831970) SKIP: sanityn test_90 needs >= 2 MDTs SKIP 90 (1s) == sanityn test 91: chmod and unlink striped directory === 08:52:51 (1747831971) SKIP: sanityn test_91 needs >= 2 MDTs SKIP 91 (1s) == sanityn test 92: create remote directory under orphan directory ========================================================== 08:52:52 (1747831972) SKIP: sanityn test_92 needs >= 2 MDTs SKIP 92 (0s) == sanityn test 93: alloc_rr should not allocate on same ost ========================================================== 08:52:53 (1747831973) fail_loc=0x00000163 fail_loc=0x0 /mnt/lustre/f93.sanityn-1/file1 lmm_stripe_count: 2 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2643 0xa53 0 1 2630 0xa46 0 /mnt/lustre2/f93.sanityn-2/file2 lmm_stripe_count: 2 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2644 0xa54 0 1 2631 0xa47 0 rc1=0 and rc2=0 PASS 93 (9s) == sanityn test 94: signal vs CP callback race =========== 08:53:01 (1747831981) osc.lustre-OST0000-osc-ffff8800aa2ef000.idle_timeout=0 osc.lustre-OST0000-osc-ffff8800b6d09800.idle_timeout=0 osc.lustre-OST0001-osc-ffff8800aa2ef000.idle_timeout=0 osc.lustre-OST0001-osc-ffff8800b6d09800.idle_timeout=0 2+0 records in 2+0 records out 8192 bytes (8.2 kB) copied, 0.0517951 s, 158 kB/s fail_val=5 fail_loc=0x80000312 fail_val=6 fail_loc=0x80000329 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 3.00048 s, 1.4 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 5135: 4777 Alarm clock dd if=/dev/zero of=$DIR/$tfile conv=notrunc oflag=append bs=4k count=1 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0134598 s, 304 kB/s osc.lustre-OST0000-osc-ffff8800aa2ef000.idle_timeout=debug osc.lustre-OST0000-osc-ffff8800b6d09800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800aa2ef000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6d09800.idle_timeout=debug PASS 94 (9s) == sanityn test 95b: Check readpage() on a page that is no longer uptodate ========================================================== 08:53:10 (1747831990) llite.lustre-ffff8800aa2ef000.fast_read=0 llite.lustre-ffff8800b6d09800.fast_read=0 1+0 records in 1+0 records out 12288 bytes (12 kB) copied, 0.00218552 s, 5.6 MB/s fail_loc=0x80001424 fail_val=5 fail_loc=0 llite.lustre-ffff8800aa2ef000.fast_read=1 llite.lustre-ffff8800b6d09800.fast_read=1 PASS 95b (8s) == sanityn test 100a: DoM: glimpse RPCs for stat without IO lock (DoM only file) ========================================================== 08:53:18 (1747831998) SKIP: sanityn test_100a Reserved for glimpse-ahead SKIP 100a (0s) == sanityn test 100b: DoM: no glimpse RPC for stat with IO lock (DoM only file) ========================================================== 08:53:18 (1747831998) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00135668 s, 3.0 MB/s /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK PASS 100b (2s) == sanityn test 100c: DoM: write vs stat without IO lock (combined file) ========================================================== 08:53:20 (1747832000) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0173356 s, 121 MB/s /mnt/lustre/d100c.sanityn/dom has type file OK /mnt/lustre/d100c.sanityn/dom has size 2097152 OK PASS 100c (1s) == sanityn test 100d: DoM: write+truncate vs stat without IO lock (combined file) ========================================================== 08:53:22 (1747832002) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0161231 s, 130 MB/s /mnt/lustre/d100d.sanityn/dom has type file OK /mnt/lustre/d100d.sanityn/dom has size 4096 OK PASS 100d (2s) == sanityn test 100e: DoM: read on open and file size ==== 08:53:23 (1747832003) 1+0 records in 1+0 records out 12000 bytes (12 kB) copied, 0.0012228 s, 9.8 MB/s PASS 100e (1s) == sanityn test 101a: Discard DoM data on unlink ========= 08:53:25 (1747832005) /mnt/lustre/f101a.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.000572331 s, 7.2 MB/s PASS 101a (2s) == sanityn test 101b: Discard DoM data on rename ========= 08:53:26 (1747832006) /mnt/lustre/f101b.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00044645 s, 9.2 MB/s PASS 101b (1s) == sanityn test 101c: Discard DoM data on close-unlink === 08:53:27 (1747832007) /mnt/lustre/f101c.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.000441045 s, 9.3 MB/s PASS 101c (3s) SKIP: sanityn test_102 skipping ALWAYS excluded test 102 == sanityn test 103: Test size correctness with lockahead ========================================================== 08:53:30 (1747832010) fail_loc=0x415 fail_loc=0x415 fail_val=2 Incorrect size expected (no glimpse fix): Starting test test23 at 1747832011 lockahead_test: lockahead_test.c:1186: test23: assertion 'sb.st_size == sb2.st_size' failed: size on /mnt/lustre/d103.sanityn/f103.sanityn and /mnt/lustre2/d103.sanityn/f103.sanityn differs: 0 vs 1048576 fail_loc=0 fail_loc=0x214 fail_val=2 Starting test test23 at 1747832014 Finishing test test23 at 1747832014 PASS 103 (7s) == sanityn test 104: Verify that MDS stores atime/mtime/ctime during close ========================================================== 08:53:37 (1747832017) SKIP: sanityn test_104 ldiskfs only test SKIP 104 (1s) == sanityn test 105: Glimpse and lock cancel race ======== 08:53:38 (1747832018) fail_loc=0x416 PASS 105 (48s) == sanityn test 106a: Verify the btime via statx() ======= 08:54:27 (1747832067) SKIP: sanityn test_106a Test only for ldiskfs and statx() supported SKIP 106a (1s) == sanityn test 106b: Glimpse RPCs test for statx ======== 08:54:28 (1747832068) SKIP: sanityn test_106b statx() only test SKIP 106b (2s) == sanityn test 106c: Verify statx attributes mask ======= 08:54:30 (1747832070) SKIP: sanityn test_106c statx() only test SKIP 106c (2s) == sanityn test 107a: Basic grouplock conflict =========== 08:54:32 (1747832072) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.191615 s, 54.7 MB/s /mnt/lustre/f107a.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2651 0xa5b 0 multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.6853 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.6853 First grouplock blocks second one PASS 107a (6s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 08:54:38 (1747832078) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.138955 s, 75.5 MB/s /mnt/lustre/f107b.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2635 0xa4b 0 multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.6853 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (9s) == sanityn test 108a: lseek: parallel updates ============ 08:54:47 (1747832087) 1+0 records in 1+0 records out 10000 bytes (10 kB) copied, 0.00386458 s, 2.6 MB/s fail_val=4 fail_loc=0x80000414 1+0 records in 1+0 records out 8388608 bytes (8.4 MB) copied, 4.47611 s, 1.9 MB/s PASS 108a (9s) == sanityn test 109: Race with several mount instances on 1 node ========================================================== 08:54:56 (1747832096) 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) Starting race between client mount instances (50 iterations): Iteration 1 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 2 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg105-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 3 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg105-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 4 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 5 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 6 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 7 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg105-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 8 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg105-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 9 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 10 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 11 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 12 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 13 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 14 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 15 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 16 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg105-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 17 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg105-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 18 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 19 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg105-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 20 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg105-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 21 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg105-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 22 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 23 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 24 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 25 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg105-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 26 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 27 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 28 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg105-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 29 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 30 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 31 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 32 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg105-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 33 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 34 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg105-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 35 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 36 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 37 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 38 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg105-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 39 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 40 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg105-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 41 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 42 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg105-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 43 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 44 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 45 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg105-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 46 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions oleg105-server: libkmod: kmod_module_get_refcnt: could not read integer from '/sys/module/acpi_cpufreq/refcnt': 'No such device' Iteration 47 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 48 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg105-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Iteration 49 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions oleg105-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 50 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre 192.168.201.105@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.201.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg105-client.virtnet /mnt/lustre (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg105-server' oleg105-server: oleg105-server.virtnet: executing load_modules_local oleg105-server: Loading modules from /home/green/git/lustre-release/lustre oleg105-server: detected 4 online CPUs by sysfs oleg105-server: Force libcfs to create 2 CPU partitions Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre Starting client: oleg105-client.virtnet: -o user_xattr,flock oleg105-server@tcp:/lustre /mnt/lustre2 PASS 109 (651s) == sanityn test 110: do not grant another lock on resend ========================================================== 09:05:47 (1747832747) fail_loc=0x525 fail_val=3 fail_loc=0x534 File: '/mnt/lustre/f110.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205306056707 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-21 09:05:48.000000000 -0400 Modify: 2025-05-21 09:05:48.000000000 -0400 Change: 2025-05-21 09:05:48.000000000 -0400 Birth: - fail_loc=0 fail_val=0 Connected clients: oleg105-client.virtnet oleg105-client.virtnet PASS 110 (38s) == sanityn test 111: A racy rename/link an open file should not cause fs corruption ========================================================== 09:06:25 (1747832785) SKIP: sanityn test_111 needs >= 2 MDTs SKIP 111 (1s) == sanityn test 112: update max-inherit in default LMV === 09:06:26 (1747832786) SKIP: sanityn test_112 We need at least 2 MDTs for this test SKIP 112 (2s) == sanityn test 113: check servers of specified fs ======= 09:06:28 (1747832788) lustre-OST0000-osc-ffff88012aba6000 active. lustre-OST0001-osc-ffff88012aba6000 active. lustre-OST0000-osc-ffff88012aba6000 active. lustre-OST0001-osc-ffff88012aba6000 active. MGC192.168.201.105@tcp active. PASS 113 (3s) cleanup: ====================================================== == sanityn test complete, duration 4498 sec ============== 09:06:33 (1747832793) Stopping clients: oleg105-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg105-client.virtnet /mnt/lustre2 opts: