-----============= acceptance-small: sanityn ============----- Wed Jul 31 23:12:09 EDT 2024 excepting tests: 27 28 102 skipping tests SLOW=no: 33a Starting client oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 Started clients oleg255-client.virtnet: 192.168.202.155@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt) oleg255-client.virtnet: executing check_config_client /mnt/lustre oleg255-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg255-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800b6ccc800.idle_timeout=debug osc.lustre-OST0000-osc-ffff88012da53000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6ccc800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012da53000.idle_timeout=debug disable quota as required oleg255-server: oleg255-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 8 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00998264 s, 105 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6848] == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 23:12:20 (1722481940) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (1s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 23:12:21 (1722481941) -rw-r--r-- 1 root root 0 Jul 31 23:12 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (2s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 23:12:23 (1722481943) -rw-r--r-- 1 root root 0 Jul 31 23:12 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (1s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 23:12:24 (1722481944) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (2s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 23:12:26 (1722481946) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (1s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 23:12:27 (1722481947) total 1 -rwxrwxrwx 1 root root 0 Jul 31 23:12 f2a -rwxrwxrwx 1 root root 0 Jul 31 23:12 f2b total 1 -rwxrwxrwx 1 root root 0 Jul 31 23:12 f2a -rwxrwxrwx 1 root root 0 Jul 31 23:12 f2b running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes (512 B) copied, 0.00291598 s, 176 kB/s PASS 2e (2s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 23:12:29 (1722481949) SKIP: sanityn test_2f needs >= 2 MDTs SKIP 2f (1s) == sanityn test 2g: check blocks update on sync write ==== 23:12:30 (1722481950) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0831986 s, 25.2 MB/s /mnt/lustre/f2g.sanityn has 4103 blocks /mnt/lustre2/f2g.sanityn has 4103 blocks PASS 2g (1s) == sanityn test 3: symlink on one mtpt, readlink on another ===================================================================== 23:12:31 (1722481951) PASS 3 (2s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 23:12:33 (1722481953) PASS 4 (2s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 23:12:35 (1722481955) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (2s) == sanityn test 6: remove of open file on other node ============================================================================ 23:12:37 (1722481957) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (1s) == sanityn test 7: remove of open directory on other node ======================================================================= 23:12:38 (1722481958) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (2s) == sanityn test 8: remove of open special file on other node ==================================================================== 23:12:40 (1722481960) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (1s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 23:12:42 (1722481962) PASS 9a (1s) == sanityn test 9b: append to striped sparse file ======== 23:12:43 (1722481963) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129518 s, 81.0 MB/s 3+0 records in 3+0 records out 3 bytes (3 B) copied, 0.0109989 s, 0.3 kB/s Data read (expecting 'foo'): foo PASS 9b (2s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 23:12:45 (1722481965) 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00199961 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00152986 s, 0.7 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00148858 s, 0.7 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00154466 s, 0.6 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00168764 s, 0.6 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00139222 s, 0.7 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00139124 s, 0.7 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00161798 s, 0.6 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00125058 s, 0.8 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0013457 s, 0.7 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00159701 s, 0.6 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00162047 s, 0.6 kB/s PASS 10a (1s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 23:12:46 (1722481966) 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00284961 s, 1.1 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00784169 s, 522 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.000273264 s, 11.2 MB/s PASS 10b (2s) == sanityn test 11: execution of file opened for write should return error ============================================================== 23:12:48 (1722481968) multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.6848 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 273: /mnt/lustre2/d11/f: Text file busy PASS 11 (2s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 23:12:50 (1722481970) warning: '-runtime' deprecated, use '-t runtime' instead - link 2617 (time 1722481980.74 total 10.00 last 261.69) - link 5388 (time 1722481990.74 total 20.00 last 277.06) - link 7901 (time 1722482000.74 total 30.00 last 251.25) - link 10000 (time 1722482007.71 total 36.97 last 301.35) - link 13176 (time 1722482017.71 total 46.97 last 317.57) - link 16474 (time 1722482027.72 total 56.98 last 329.63) - link 19309 (time 1722482037.72 total 66.98 last 283.36) - link 20000 (time 1722482040.42 total 69.68 last 256.28) - link 22864 (time 1722482050.42 total 79.68 last 286.35) - link 25727 (time 1722482060.42 total 89.68 last 286.28) - link 28442 (time 1722482070.42 total 99.68 last 271.45) total: 28533 link in 100.00 seconds: 285.32 ops/second using seed 1487292345 running for 100 seconds - stat 10000 (time 1722481974 ; total 3 ; last 3) - stat 20000 (time 1722481977 ; total 6 ; last 3) - stat 30000 (time 1722481981 ; total 10 ; last 4) - stat 40000 (time 1722481984 ; total 13 ; last 3) - stat 50000 (time 1722481987 ; total 16 ; last 3) - stat 60000 (time 1722481990 ; total 19 ; last 3) - stat 70000 (time 1722481993 ; total 22 ; last 3) - stat 80000 (time 1722481996 ; total 25 ; last 3) - stat 90000 (time 1722481999 ; total 28 ; last 3) - stat 100000 (time 1722482002 ; total 31 ; last 3) - stat 110000 (time 1722482005 ; total 34 ; last 3) - stat 120000 (time 1722482008 ; total 37 ; last 3) - stat 130000 (time 1722482011 ; total 40 ; last 3) - stat 140000 (time 1722482013 ; total 42 ; last 2) - stat 150000 (time 1722482016 ; total 45 ; last 3) - stat 160000 (time 1722482019 ; total 48 ; last 3) - stat 170000 (time 1722482022 ; total 51 ; last 3) - stat 180000 (time 1722482028 ; total 57 ; last 6) - stat 190000 (time 1722482034 ; total 63 ; last 6) - stat 200000 (time 1722482040 ; total 69 ; last 6) - stat 210000 (time 1722482046 ; total 75 ; last 6) - stat 220000 (time 1722482052 ; total 81 ; last 6) - stat 230000 (time 1722482058 ; total 87 ; last 6) - stat 240000 (time 1722482064 ; total 93 ; last 6) total: 249783 stats in 100 seconds: 2497.830078 stats/second - unlinked 0 (time 1722482021 ; total 0 ; last 0) - unlinked 10000 (time 1722482072 ; total 51 ; last 51) - unlinked 20000 (time 1722482094 ; total 73 ; last 22) unlink(/mnt/lustre2/lockdir/lockfile28533) error: No such file or directory total: 28532 unlinks in 90 seconds: 317.022217 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (20442) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (20445) - No such process PASS 12 (142s) == sanityn test 13: test directory page revocation ======= 23:15:12 (1722482112) f13 f13 PASS 13 (2s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 23:15:14 (1722482114) multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.6848 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 308: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4253: 21820 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (1s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 23:15:15 (1722482115) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4253: 22448 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (2s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 23:15:17 (1722482117) truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 323: 23074 Terminated $DIR1/$tdir/sleep 60 PASS 14b (1s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 23:15:18 (1722482118) cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 335: 23702 Terminated $DIR1/$tdir/sleep 60 PASS 14c (2s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 23:15:20 (1722482120) chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 346: 24331 Terminated $DIR1/$tdir/sleep 60 PASS 14d (1s) == sanityn test 15: test out-of-space with multiple writers ===================================================================== 23:15:21 (1722482121) PATH=/opt/iozone/bin:/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin: STRIPECOUNT=2 ORIGFREE=7517184 MAXFREE=800000 SKIP: oos2 test_15 oos2.sh: 7517184kB free gt MAXFREE 800000kB, increase 800000 (or reduce test fs size) to proceed sleep 5 for ZFS zfs Waiting for MDT destroys to complete SKIP 15 (11s) == sanityn test 16a: 500 iterations of dual-mount fsx ==== 23:15:32 (1722482132) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0819995 s, 25.6 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0603808 s, 34.7 MB/s Chance of close/open is 1 in 50 Seed set to 2132 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001[1] 1722482133.044430 mapwrite 0x7a40da thru 0x7ae435 (0xa35c bytes) 000003[0] 1722482133.079347 mapread 0x73ad9a thru 0x74a698 (0xf8ff bytes) truncating to largest ever: 0x757837 000004[1] 1722482133.096133 trunc from 0x7ae436 to 0x757836 (0x56bff bytes) 000005[0] 1722482133.107152 trunc from 0x757837 to 0x0488cf (0x70ef67 bytes) 000006[1] 1722482133.117658 read 0x005921 thru 0x00dac8 (0x81a8 bytes) 000007[1] 1722482133.124172 mapwrite 0x1e9342 thru 0x1ef145 (0x5e04 bytes) 000008[0] 1722482133.154602 trunc from 0x1ef146 to 0x4b6b7c (0x2c7a37 bytes) 000009[1] 1722482133.166591 mapwrite 0x816ac5 thru 0x81b677 (0x4bb3 bytes) 000011[0] 1722482133.200458 read 0x2900f8 thru 0x29a714 (0xa61d bytes) 000013[0] 1722482133.209960 write 0x4b407e thru 0x4b4b22 (0xaa5 bytes) 000014[1] 1722482133.217294 mapread 0x189d91 thru 0x18a265 (0x4d5 bytes) 000015[1] 1722482133.226132 mapwrite 0x4b27d9 thru 0x4b520a (0x2a32 bytes) 000018[1] 1722482133.257696 mapread 0x25cff1 thru 0x26c575 (0xf585 bytes) 000021[0] 1722482133.276266 mapwrite 0x7a70bb thru 0x7b0646 (0x958c bytes) 000022[1] 1722482133.303907 mapread 0x6c6f04 thru 0x6ca718 (0x3815 bytes) 000023[1] 1722482133.314500 mapwrite 0x034f73 thru 0x03b163 (0x61f1 bytes) 000025[0] 1722482133.344336 write 0x7ab7c2 thru 0x7b1a35 (0x6274 bytes) 000028[1] 1722482133.355739 read 0x1130f2 thru 0x11a6d9 (0x75e8 bytes) 000029[1] 1722482133.388855 read 0x21b48c thru 0x225fe2 (0xab57 bytes) truncating to largest ever: 0x87ed69 000030[1] 1722482133.389326 trunc from 0x81b678 to 0x87ed68 (0x636f1 bytes) 000031[0] 1722482133.399711 mapread 0x3fd30b thru 0x401e40 (0x4b36 bytes) 000035[0] 1722482133.418502 mapread 0x7e51fb thru 0x7eb97a (0x6780 bytes) 000037[1] 1722482133.424101 mapwrite 0x28c5f7 thru 0x28e68d (0x2097 bytes) 000040[1] 1722482133.443914 mapread 0x3d4cd5 thru 0x3dcdcc (0x80f8 bytes) 000042[1] 1722482133.457370 mapwrite 0x183b8f thru 0x184775 (0xbe7 bytes) 000043[0] 1722482133.475350 mapread 0x13b26e thru 0x140288 (0x501b bytes) 000046[0] 1722482133.491260 write 0x720abb thru 0x72c61e (0xbb64 bytes) 000048[0] 1722482133.501821 write 0x2f8bea thru 0x2f9ec8 (0x12df bytes) 000050[1] 1722482133.506300 read 0x5c494e thru 0x5ccf6d (0x8620 bytes) 000055[0] 1722482133.527314 trunc from 0x87ed69 to 0x498f43 (0x3e5e25 bytes) 000057[1] 1722482133.540690 mapread 0x40ceee thru 0x41ab69 (0xdc7c bytes) 000059[1] 1722482133.564850 mapwrite 0x9f8ce6 thru 0x9fffff (0x731a bytes) 000060[0] 1722482133.608475 mapread 0x3fd9e9 thru 0x4075b6 (0x9bce bytes) 000061[0] 1722482133.625287 trunc from 0xa00000 to 0x70bec2 (0x2f413d bytes) 000064[1] 1722482133.637082 mapwrite 0x329886 thru 0x332eaa (0x9625 bytes) 000070[0] 1722482133.684958 mapread 0x62cf25 thru 0x62e28a (0x1366 bytes) 000071[1] 1722482133.694122 mapwrite 0x919b7e thru 0x928ac5 (0xef48 bytes) 000072[0] 1722482133.733506 read 0x3ad741 thru 0x3afb5a (0x241a bytes) 000075[0] 1722482133.745221 trunc from 0x928ac6 to 0x4f6874 (0x432251 bytes) 000078[0] 1722482133.757677 trunc from 0x4f6875 to 0x3bfa94 (0x136de0 bytes) 000082[0] 1722482133.762045 mapread 0x2f6478 thru 0x2f8513 (0x209c bytes) 000083[1] 1722482133.769635 read 0x398f3b thru 0x39c553 (0x3619 bytes) 000084[0] 1722482133.775173 read 0x00dff7 thru 0x01091f (0x2929 bytes) 000085[0] 1722482133.790619 write 0x869b26 thru 0x86f067 (0x5542 bytes) 000087[0] 1722482133.795551 read 0x153bb2 thru 0x1560fe (0x254d bytes) 000088[1] 1722482133.803215 mapread 0x2407c2 thru 0x241c44 (0x1483 bytes) 000089[1] 1722482133.826733 mapread 0x61cbc3 thru 0x621d7f (0x51bd bytes) 000090[1] 1722482133.828664 mapread 0x47fcb9 thru 0x480efe (0x1246 bytes) 000091[0] 1722482133.829106 mapread 0x6e29c5 thru 0x6ea1cf (0x780b bytes) 000092[0] 1722482133.839585 write 0x915380 thru 0x917673 (0x22f4 bytes) 000096[0] 1722482133.850171 write 0x4cc695 thru 0x4d25a1 (0x5f0d bytes) 000099[1] 1722482133.863274 read 0x842c16 thru 0x843e51 (0x123c bytes) 000100[0] 1722482133.872744 trunc from 0x917674 to 0x5321da (0x3e5499 bytes) 000102[1] 1722482133.883131 read 0x3ddf83 thru 0x3e400f (0x608d bytes) 000104[1] 1722482133.891202 trunc from 0x5321db to 0x422c01 (0x10f5d9 bytes) 000105[0] 1722482133.901916 read 0x1a8714 thru 0x1b679f (0xe08c bytes) 000107[1] 1722482133.913602 trunc from 0x422c02 to 0x609bec (0x1e6feb bytes) 000110[1] 1722482133.921483 mapwrite 0x147662 thru 0x152e44 (0xb7e3 bytes) 000111[0] 1722482133.961006 read 0x367fe9 thru 0x373242 (0xb25a bytes) 000112[0] 1722482133.969652 mapwrite 0x8b9df4 thru 0x8c7e38 (0xe045 bytes) 000113[0] 1722482134.014280 read 0x47ee1b thru 0x480dac (0x1f92 bytes) 000116[1] 1722482134.019492 read 0x306a1e thru 0x30ff49 (0x952c bytes) 000117[1] 1722482134.033193 mapread 0x0eeef7 thru 0x0f4bbb (0x5cc5 bytes) 000118[0] 1722482134.065824 trunc from 0x8c7e39 to 0x4f5dff (0x3d2039 bytes) 000119[0] 1722482134.078802 write 0x773fa2 thru 0x77a6f2 (0x6751 bytes) 000121[0] 1722482134.083796 mapwrite 0x3b0241 thru 0x3b2cf8 (0x2ab8 bytes) 000122[1] 1722482134.100440 mapread 0x42f761 thru 0x43931b (0x9bbb bytes) 000123[0] 1722482134.116399 mapread 0x459698 thru 0x45b5da (0x1f43 bytes) 000124[0] 1722482134.123173 mapwrite 0x54bee3 thru 0x54c62a (0x748 bytes) 000125[0] 1722482134.142010 write 0x7ea52e thru 0x7f2b41 (0x8614 bytes) 000126[1] 1722482134.145565 mapread 0x7c4c22 thru 0x7c743b (0x281a bytes) 000128[1] 1722482134.156890 write 0x83942e thru 0x839747 (0x31a bytes) 000130[0] 1722482134.162371 write 0x139638 thru 0x13d680 (0x4049 bytes) 000131[1] 1722482134.169636 trunc from 0x839748 to 0x121488 (0x7182bf bytes) 000132[1] 1722482134.178379 trunc from 0x121489 to 0x574f38 (0x453ab0 bytes) 000136[0] 1722482134.190342 read 0x2c0d10 thru 0x2c7e0b (0x70fc bytes) 000137[1] 1722482134.199423 mapwrite 0x07d84d thru 0x07ff40 (0x26f4 bytes) 000138[0] 1722482134.217940 write 0x6fa7d8 thru 0x6fc76f (0x1f98 bytes) 000139[0] 1722482134.223681 trunc from 0x6fc770 to 0x41695b (0x2e5e14 bytes) 000143[0] 1722482134.233871 mapread 0x07ee8c thru 0x081836 (0x29ab bytes) 000144[0] 1722482134.241491 mapread 0x15e92e thru 0x16282d (0x3f00 bytes) 000145[0] 1722482134.249884 mapread 0x37fad4 thru 0x382b67 (0x3094 bytes) 000146[0] 1722482134.250278 trunc from 0x41695c to 0x636d17 (0x2203bc bytes) 000148[1] 1722482134.261801 trunc from 0x636d18 to 0x21a08a (0x41cc8d bytes) 000150[0] 1722482134.269498 mapread 0x17fa67 thru 0x18b29f (0xb839 bytes) 000153[1] 1722482134.291731 read 0x099312 thru 0x0a8473 (0xf162 bytes) 000159[0] 1722482134.310107 mapwrite 0x0122c8 thru 0x01db35 (0xb86e bytes) 000161[1] 1722482134.344608 read 0x14333b thru 0x14f045 (0xbd0b bytes) 000162[0] 1722482134.344900 trunc from 0x21a08b to 0x22ea06 (0x1497c bytes) 000169[0] 1722482134.363620 mapwrite 0x3e90e5 thru 0x3e924e (0x16a bytes) 000170[1] 1722482134.381448 read 0x0e4d47 thru 0x0e53ef (0x6a9 bytes) 000171[0] 1722482134.386955 trunc from 0x3e924f to 0x1d8cd9 (0x210575 bytes) 000173[1] 1722482134.397911 write 0x60410c thru 0x6062ad (0x21a2 bytes) 000174[1] 1722482134.404468 write 0x202e7e thru 0x205ca0 (0x2e23 bytes) 000177[1] 1722482134.415644 read 0x4b4ef7 thru 0x4b93d6 (0x44e0 bytes) 000178[1] 1722482134.421367 write 0x246243 thru 0x24d631 (0x73ef bytes) 000182[1] 1722482134.434850 mapwrite 0x315b44 thru 0x31dd38 (0x81f5 bytes) 000183[0] 1722482134.466213 read 0x519619 thru 0x5220b1 (0x8a99 bytes) 000185[1] 1722482134.483882 mapwrite 0x6b1bf5 thru 0x6b7cdb (0x60e7 bytes) 000186[0] 1722482134.511401 read 0x0e04f1 thru 0x0e5e65 (0x5975 bytes) 000187[1] 1722482134.519566 write 0x388d91 thru 0x39316e (0xa3de bytes) 000190[0] 1722482134.530827 mapwrite 0x0e6b7c thru 0x0ec0c1 (0x5546 bytes) 000192[1] 1722482134.571656 write 0x1b8bef thru 0x1b98b1 (0xcc3 bytes) 000193[0] 1722482134.576736 read 0x188f4c thru 0x197ba2 (0xec57 bytes) 000197[1] 1722482134.598627 write 0x6451a3 thru 0x650bba (0xba18 bytes) 000199[0] 1722482134.609978 mapwrite 0x987a17 thru 0x9944dc (0xcac6 bytes) 000204[1] 1722482134.659975 mapwrite 0x190da5 thru 0x19444a (0x36a6 bytes) 000206[1] 1722482134.692607 trunc from 0x9944dd to 0x1f06b4 (0x7a3e28 bytes) 000208[0] 1722482134.704202 mapread 0x1017f9 thru 0x10a9cb (0x91d3 bytes) truncating to largest ever: 0x978338 000209[0] 1722482134.718667 trunc from 0x1f06b5 to 0x978337 (0x787c83 bytes) 000210[1] 1722482134.728402 read 0x5bfc21 thru 0x5c8884 (0x8c64 bytes) 000211[0] 1722482134.734540 mapread 0x750536 thru 0x75bbca (0xb695 bytes) 000212[0] 1722482134.753442 trunc from 0x978338 to 0x54bbcb (0x42c76c bytes) 000214[0] 1722482134.764703 trunc from 0x54bbcc to 0x265e9d (0x2e5d2e bytes) 000216[0] 1722482134.768941 read 0x198638 thru 0x1a76a4 (0xf06d bytes) 000221[0] 1722482134.783895 mapwrite 0x837e89 thru 0x843b7a (0xbcf2 bytes) 000224[0] 1722482134.828584 read 0x615b4e thru 0x61b39b (0x584e bytes) 000225[1] 1722482134.831897 write 0x49bedb thru 0x4a96cc (0xd7f2 bytes) 000226[0] 1722482134.849836 read 0x5f612d thru 0x5ffc13 (0x9ae7 bytes) 000227[0] 1722482134.853337 write 0x5c20b5 thru 0x5c523f (0x318b bytes) 000228[0] 1722482134.857082 trunc from 0x843b7b to 0x41c649 (0x427531 bytes) 000232[0] 1722482134.880507 trunc from 0x41c64a to 0x719afc (0x2fd4b3 bytes) 000236[0] 1722482134.890008 trunc from 0x719afd to 0x00c6e0 (0x70d41c bytes) 000237[0] 1722482134.896301 read 0x00c23d thru 0x00c6e0 (0x4a4 bytes) 000238[0] 1722482134.897764 read 0x006df9 thru 0x00c6e0 (0x58e8 bytes) 000239[0] 1722482134.904196 read 0x004eac thru 0x00910a (0x425f bytes) 000244[1] 1722482134.915589 write 0x866497 thru 0x873d4c (0xd8b6 bytes) 000245[0] 1722482134.923109 mapwrite 0x2b03ec thru 0x2b64f3 (0x6108 bytes) 000247[1] 1722482134.968494 mapwrite 0x67fc39 thru 0x68b5b1 (0xb979 bytes) 000249[0] 1722482135.010188 read 0x70ce40 thru 0x711996 (0x4b57 bytes) 000251[0] 1722482135.016485 read 0x81df32 thru 0x81dfbe (0x8d bytes) 000252[1] 1722482135.025129 trunc from 0x873d4d to 0x2ac71d (0x5c762f bytes) 000254[0] 1722482135.040429 mapwrite 0x1463ed thru 0x14ce2e (0x6a42 bytes) 000255[1] 1722482135.070318 mapwrite 0x2babec thru 0x2bf57d (0x4992 bytes) 000256[1] 1722482135.097946 mapwrite 0x087727 thru 0x0934c9 (0xbda3 bytes) 000261[1] 1722482135.142490 mapread 0x1433f9 thru 0x1484e7 (0x50ef bytes) 000263[0] 1722482135.155048 mapread 0x14a487 thru 0x14bb12 (0x168c bytes) 000264[1] 1722482135.163429 write 0x9526fe thru 0x953522 (0xe25 bytes) 000265[1] 1722482135.167195 trunc from 0x953523 to 0x5ec109 (0x367419 bytes) 000273[1] 1722482135.181512 read 0x156c5c thru 0x15c870 (0x5c15 bytes) 000276[1] 1722482135.202733 mapread 0x3d313f thru 0x3df015 (0xbed7 bytes) 000277[0] 1722482135.203289 mapread 0x00cef9 thru 0x00f8ef (0x29f7 bytes) 000280[1] 1722482135.219463 write 0x1e16c4 thru 0x1e1c0c (0x549 bytes) 000281[0] 1722482135.222649 trunc from 0x5ec10a to 0x0626e8 (0x589a21 bytes) 000284[1] 1722482135.240869 mapread 0x0609d5 thru 0x0626e8 (0x1d14 bytes) 000286[0] 1722482135.256466 mapread 0x00dd87 thru 0x01c634 (0xe8ae bytes) 000288[1] 1722482135.277320 mapread 0x016eb2 thru 0x01e777 (0x78c6 bytes) 000292[0] 1722482135.291686 mapread 0x005951 thru 0x012c5a (0xd30a bytes) 000298[0] 1722482135.310106 write 0x44dc80 thru 0x454cc8 (0x7049 bytes) 000301[0] 1722482135.323231 write 0x08a346 thru 0x092a68 (0x8723 bytes) 000302[0] 1722482135.328828 mapread 0x2fc424 thru 0x2febcf (0x27ac bytes) 000303[1] 1722482135.332508 mapwrite 0x101164 thru 0x10ab7c (0x9a19 bytes) 000304[0] 1722482135.396952 read 0x38b6ff thru 0x399dea (0xe6ec bytes) 000312[1] 1722482135.409995 trunc from 0x454cc9 to 0x26eeb2 (0x1e5e16 bytes) 000314[1] 1722482135.426963 read 0x090f47 thru 0x0941bc (0x3276 bytes) 000315[1] 1722482135.438097 mapwrite 0x352720 thru 0x352b4c (0x42d bytes) 000316[1] 1722482135.461437 mapwrite 0x8b684f thru 0x8c52de (0xea90 bytes) 000317[1] 1722482135.498419 mapread 0x68270f thru 0x68f8a8 (0xd19a bytes) 000318[1] 1722482135.498862 trunc from 0x8c52df to 0x3a5c34 (0x51f6aa bytes) 000319[0] 1722482135.509837 trunc from 0x3a5c35 to 0x781af7 (0x3dbec3 bytes) 000320[1] 1722482135.523972 read 0x77ef21 thru 0x781af7 (0x2bd7 bytes) 000321[1] 1722482135.531069 mapread 0x43f74a thru 0x44f02d (0xf8e4 bytes) 000322[1] 1722482135.552343 mapwrite 0x187d7c thru 0x187f52 (0x1d7 bytes) 000326[0] 1722482135.578225 mapwrite 0x5ba366 thru 0x5c4ef3 (0xab8e bytes) 000327[1] 1722482135.611386 mapwrite 0x7fdf18 thru 0x8019f2 (0x3adb bytes) truncating to largest ever: 0x99e425 000329[1] 1722482135.645269 trunc from 0x8019f3 to 0x99e424 (0x19ca32 bytes) 000331[0] 1722482135.648889 write 0x5b8f24 thru 0x5c8bd0 (0xfcad bytes) 000333[1] 1722482135.664309 mapwrite 0x2d2951 thru 0x2d655e (0x3c0e bytes) 000336[1] 1722482135.699169 mapread 0x0ff131 thru 0x10f009 (0xfed9 bytes) 000337[0] 1722482135.730674 trunc from 0x99e425 to 0x113864 (0x88abc0 bytes) 000340[0] 1722482135.748039 trunc from 0x113865 to 0x62e85d (0x51aff9 bytes) 000341[1] 1722482135.753392 mapread 0x2dfa2e thru 0x2e45aa (0x4b7d bytes) 000343[0] 1722482135.770914 mapwrite 0x8c2b64 thru 0x8ce981 (0xbe1e bytes) 000344[1] 1722482135.801768 mapwrite 0x8e3276 thru 0x8eb58e (0x8319 bytes) 000345[1] 1722482135.838114 trunc from 0x8eb58f to 0x08fef1 (0x85b69d bytes) 000346[0] 1722482135.842925 mapread 0x08bc58 thru 0x08fef1 (0x429a bytes) 000349[0] 1722482135.856034 write 0x70ce07 thru 0x71c575 (0xf76f bytes) 000350[1] 1722482135.861474 mapwrite 0x0d064b thru 0x0d1b98 (0x154e bytes) 000351[1] 1722482135.889599 mapwrite 0x3b8551 thru 0x3c3635 (0xb0e5 bytes) 000352[0] 1722482135.924393 trunc from 0x71c576 to 0x6e4223 (0x38352 bytes) 000353[0] 1722482135.935660 write 0x919d9d thru 0x91ba7c (0x1ce0 bytes) 000354[1] 1722482135.937709 read 0x53c6ad thru 0x548023 (0xb977 bytes) 000356[1] 1722482135.951738 mapwrite 0x107b7e thru 0x10bbae (0x4031 bytes) 000358[0] 1722482135.982813 read 0x176f49 thru 0x178811 (0x18c9 bytes) 000359[1] 1722482136.011759 mapwrite 0x11c84d thru 0x121275 (0x4a29 bytes) 000361[1] 1722482136.044864 read 0x2466ae thru 0x24cd8f (0x66e2 bytes) 000363[0] 1722482136.075129 mapread 0x5a0577 thru 0x5abe80 (0xb90a bytes) 000364[0] 1722482136.099854 write 0x660693 thru 0x665df5 (0x5763 bytes) 000365[0] 1722482136.111432 mapread 0x50f712 thru 0x51a903 (0xb1f2 bytes) 000368[0] 1722482136.128372 trunc from 0x91ba7d to 0x11b6ec (0x800390 bytes) 000369[1] 1722482136.137848 mapwrite 0x227880 thru 0x23694e (0xf0cf bytes) 000370[1] 1722482136.180449 mapread 0x07283d thru 0x07da00 (0xb1c4 bytes) 000372[0] 1722482136.197714 mapread 0x20f1ed thru 0x213db6 (0x4bca bytes) 000373[1] 1722482136.207056 mapwrite 0x671b18 thru 0x67ffab (0xe494 bytes) 000375[1] 1722482136.253231 mapread 0x4cdfa7 thru 0x4d8d52 (0xadac bytes) 000376[1] 1722482136.267963 mapread 0x4b8af1 thru 0x4c70aa (0xe5ba bytes) 000377[1] 1722482136.284288 write 0x566875 thru 0x56c161 (0x58ed bytes) 000380[0] 1722482136.287037 mapread 0x322212 thru 0x32337a (0x1169 bytes) 000381[1] 1722482136.297912 mapread 0x3268b4 thru 0x33552c (0xec79 bytes) 000384[0] 1722482136.321273 mapwrite 0x7fb44c thru 0x7fd969 (0x251e bytes) 000385[1] 1722482136.351297 mapwrite 0x79c14f thru 0x7a01a3 (0x4055 bytes) 000386[0] 1722482136.379689 mapread 0x081134 thru 0x08920e (0x80db bytes) 000387[0] 1722482136.393211 write 0x6c3a67 thru 0x6ca278 (0x6812 bytes) 000388[0] 1722482136.398812 read 0x67389b thru 0x6799d0 (0x6136 bytes) 000390[0] 1722482136.409161 mapread 0x5e9dcb thru 0x5ece4b (0x3081 bytes) 000392[0] 1722482136.422461 mapwrite 0x782636 thru 0x79160a (0xefd5 bytes) 000395[0] 1722482136.467390 trunc from 0x7fd96a to 0x042cfa (0x7bac6f bytes) 000397[1] 1722482136.476543 write 0x08986d thru 0x08eada (0x526e bytes) 000399[0] 1722482136.485120 trunc from 0x08eadb to 0x2f72d1 (0x2687f7 bytes) 000400[0] 1722482136.496626 mapread 0x247b71 thru 0x255794 (0xdc24 bytes) 000402[1] 1722482136.517103 read 0x1e78f1 thru 0x1e8c28 (0x1338 bytes) 000403[0] 1722482136.524515 write 0x92d6a3 thru 0x938157 (0xaab5 bytes) 000405[0] 1722482136.528869 trunc from 0x938158 to 0x885c3b (0xb251c bytes) 000407[0] 1722482136.533172 mapread 0x407498 thru 0x408085 (0xbee bytes) 000408[1] 1722482136.535563 mapread 0x5cdd42 thru 0x5dbda9 (0xe068 bytes) 000409[0] 1722482136.558504 write 0x69856a thru 0x6a4b70 (0xc607 bytes) 000410[1] 1722482136.564723 write 0x55752f thru 0x563d96 (0xc868 bytes) 000412[1] 1722482136.575445 mapwrite 0x65337a thru 0x654ea9 (0x1b30 bytes) 000415[0] 1722482136.624132 mapwrite 0x6d0272 thru 0x6d614c (0x5edb bytes) 000416[1] 1722482136.655598 write 0x77bf1b thru 0x786364 (0xa44a bytes) 000419[0] 1722482136.665863 read 0x6359e6 thru 0x637712 (0x1d2d bytes) 000420[1] 1722482136.674857 mapwrite 0x3dd357 thru 0x3eb0e6 (0xdd90 bytes) 000421[0] 1722482136.695765 mapread 0x2a4c42 thru 0x2a7709 (0x2ac8 bytes) 000422[1] 1722482136.704508 trunc from 0x885c3c to 0x9127e6 (0x8cbab bytes) 000424[1] 1722482136.717778 mapread 0x4fad87 thru 0x4ff463 (0x46dd bytes) 000428[0] 1722482136.736542 mapwrite 0x759101 thru 0x764d70 (0xbc70 bytes) 000431[1] 1722482136.772776 mapwrite 0x714a0e thru 0x71cc3d (0x8230 bytes) 000433[1] 1722482136.809324 write 0x56c67f thru 0x56f4ee (0x2e70 bytes) 000434[0] 1722482136.815150 trunc from 0x9127e7 to 0x489609 (0x4891dd bytes) 000435[0] 1722482136.827952 mapread 0x045a2e thru 0x0483a8 (0x297b bytes) 000439[1] 1722482136.837354 read 0x3f93eb thru 0x3ff05d (0x5c73 bytes) 000440[1] 1722482136.842313 write 0x5960b2 thru 0x598c28 (0x2b77 bytes) 000442[0] 1722482136.850862 trunc from 0x598c29 to 0x16a5f8 (0x42e630 bytes) 000443[0] 1722482136.861463 mapread 0x0feebf thru 0x1032c5 (0x4407 bytes) 000445[1] 1722482136.869225 mapread 0x1360ea thru 0x14063e (0xa555 bytes) 000448[1] 1722482136.887948 mapwrite 0x72b4ed thru 0x7334d6 (0x7fea bytes) 000449[0] 1722482136.924260 read 0x311725 thru 0x31d216 (0xbaf2 bytes) 000450[1] 1722482136.937797 read 0x5286f6 thru 0x537845 (0xf150 bytes) 000452[0] 1722482136.949618 read 0x65480c thru 0x661b7e (0xd373 bytes) 000456[0] 1722482136.961557 mapread 0x6c417f thru 0x6cf91e (0xb7a0 bytes) 000460[1] 1722482136.962533 mapwrite 0x9de770 thru 0x9eaaf9 (0xc38a bytes) 000462[0] 1722482137.005006 write 0x193189 thru 0x19fbf3 (0xca6b bytes) 000464[0] 1722482137.019542 write 0x6b4cfa thru 0x6c170c (0xca13 bytes) 000467[0] 1722482137.029258 mapwrite 0x05117f thru 0x055ee4 (0x4d66 bytes) 000468[0] 1722482137.049564 mapread 0x9060f0 thru 0x91342b (0xd33c bytes) 000471[1] 1722482137.071410 read 0x4833b0 thru 0x48e524 (0xb175 bytes) 000472[1] 1722482137.081163 read 0x8d649c thru 0x8dd129 (0x6c8e bytes) 000473[1] 1722482137.084905 trunc from 0x9eaafa to 0x75283b (0x2982be bytes) 000475[1] 1722482137.101783 trunc from 0x75283c to 0x79afa1 (0x48766 bytes) 000476[0] 1722482137.109200 mapread 0x130f7c thru 0x137511 (0x6596 bytes) 000477[1] 1722482137.125302 write 0x9573fe thru 0x962bb5 (0xb7b8 bytes) 000479[0] 1722482137.135292 mapread 0x4e51ff thru 0x4ee19a (0x8f9c bytes) 000481[0] 1722482137.154994 trunc from 0x962bb6 to 0x87731b (0xeb89a bytes) 000482[0] 1722482137.167575 trunc from 0x87731c to 0x10e07f (0x76929c bytes) 000483[1] 1722482137.171707 mapwrite 0x5b4360 thru 0x5c17a1 (0xd442 bytes) 000487[1] 1722482137.225697 trunc from 0x5c17a2 to 0x261dd0 (0x35f9d1 bytes) 000489[0] 1722482137.235129 write 0x32889d thru 0x32a770 (0x1ed4 bytes) 000491[0] 1722482137.245502 read 0x279c71 thru 0x27b62c (0x19bc bytes) 000493[0] 1722482137.260222 mapread 0x1742be thru 0x176b23 (0x2866 bytes) 000495[1] 1722482137.264388 write 0x1008c0 thru 0x109bd5 (0x9316 bytes) 000496[0] 1722482137.270545 trunc from 0x32a771 to 0x538f11 (0x20e7a1 bytes) 000500[1] 1722482137.282786 mapread 0x1e2e68 thru 0x1e6211 (0x33aa bytes) All operations completed A-OK! Chance of close/open is 1 in 50 Seed set to 2137 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read 000004[0] 1722482137.564129 write_OD 0x49a000 thru 0x4a4fff (0xb000 bytes) 000005[0] 1722482137.581766 mapread 0x012000 thru 0x019a00 (0x7a01 bytes) truncating to largest ever: 0x169f38 000006[0] 1722482137.588357 trunc from 0x4a5000 to 0x169f37 (0x33b0c8 bytes) 000011[1] 1722482137.607690 mapwrite 0x89d000 thru 0x8a984c (0xc84d bytes) 000013[0] 1722482137.656518 read_OD 0x239000 thru 0x241fff (0x9000 bytes) 000014[0] 1722482137.663335 mapwrite 0x5ef000 thru 0x5fd76e (0xe76f bytes) truncating to largest ever: 0x1b8b16 000015[1] 1722482137.691720 trunc from 0x8a984d to 0x1b8b15 (0x6f0d37 bytes) 000020[1] 1722482137.707392 mapwrite 0x99f000 thru 0x9adc61 (0xec62 bytes) 000021[1] 1722482137.740919 write_OD 0x20c000 thru 0x212fff (0x7000 bytes) 000022[0] 1722482137.759648 mapwrite 0x0d9000 thru 0x0e458c (0xb58d bytes) 000026[1] 1722482137.791085 mapread 0x6d2000 thru 0x6d75cc (0x55cd bytes) 000029[0] 1722482137.803783 mapread 0x1a3000 thru 0x1a8e0e (0x5e0f bytes) 000030[1] 1722482137.807117 read_OD 0x244000 thru 0x251fff (0xe000 bytes) 000032[1] 1722482137.809744 read_OD 0x304000 thru 0x304fff (0x1000 bytes) 000034[0] 1722482137.811343 write_OD 0x9b2000 thru 0x9b7fff (0x6000 bytes) truncating to largest ever: 0x9adee4 000035[1] 1722482137.828800 trunc from 0x9b8000 to 0x9adee3 (0xa11c bytes) 000036[1] 1722482137.838752 read_OD 0x865000 thru 0x86afff (0x6000 bytes) truncating to largest ever: 0x9f6218 000037[0] 1722482137.844176 trunc from 0x9adee4 to 0x9f6217 (0x48334 bytes) 000038[1] 1722482137.854253 trunc from 0x9f6218 to 0x5fbd60 (0x3fa4b7 bytes) 000049[1] 1722482137.881298 write_OD 0x8cd000 thru 0x8d8fff (0xc000 bytes) 000050[1] 1722482137.898763 write_OD 0x433000 thru 0x434fff (0x2000 bytes) 000051[0] 1722482137.912412 mapwrite 0x9de000 thru 0x9e6e9f (0x8ea0 bytes) 000052[1] 1722482137.940593 write_OD 0x60e000 thru 0x613fff (0x6000 bytes) 000054[0] 1722482137.959077 write_OD 0x4f1000 thru 0x4f6fff (0x6000 bytes) 000055[0] 1722482137.977795 write_OD 0x985000 thru 0x98bfff (0x7000 bytes) 000056[0] 1722482137.994445 read_OD 0x2f8000 thru 0x306fff (0xf000 bytes) 000057[0] 1722482137.996889 read_OD 0x550000 thru 0x55efff (0xf000 bytes) 000058[0] 1722482138.000304 trunc from 0x9e6ea0 to 0x52aa31 (0x4bc46e bytes) 000059[1] 1722482138.007586 write_OD 0x1c9000 thru 0x1d0fff (0x8000 bytes) 000060[1] 1722482138.022600 mapread 0x32d000 thru 0x33010a (0x310b bytes) 000061[0] 1722482138.028131 trunc from 0x52aa32 to 0x58ee9f (0x6446e bytes) 000062[0] 1722482138.036289 trunc from 0x58eea0 to 0x9c7517 (0x438678 bytes) 000063[0] 1722482138.044553 trunc from 0x9c7518 to 0x0d7161 (0x8f03b6 bytes) 000064[0] 1722482138.051675 read_OD 0x061000 thru 0x068fff (0x8000 bytes) 000065[1] 1722482138.056563 trunc from 0x0d7162 to 0x6a642d (0x5cf2cc bytes) 000069[1] 1722482138.074811 mapwrite 0x2be000 thru 0x2c13b4 (0x33b5 bytes) 000070[1] 1722482138.094273 mapread 0x0cb000 thru 0x0d4c23 (0x9c24 bytes) 000071[1] 1722482138.106121 mapwrite 0x6c1000 thru 0x6cca4c (0xba4d bytes) 000074[0] 1722482138.148223 mapread 0x62c000 thru 0x633f53 (0x7f54 bytes) 000075[0] 1722482138.176861 write_OD 0x30d000 thru 0x318fff (0xc000 bytes) 000077[0] 1722482138.198364 mapwrite 0x446000 thru 0x4529f3 (0xc9f4 bytes) 000078[0] 1722482138.230068 mapwrite 0x508000 thru 0x5137f7 (0xb7f8 bytes) 000079[1] 1722482138.264588 write_OD 0x36c000 thru 0x372fff (0x7000 bytes) 000080[1] 1722482138.282378 mapread 0x579000 thru 0x581678 (0x8679 bytes) 000081[0] 1722482138.294914 trunc from 0x6cca4d to 0x88414f (0x1b7703 bytes) 000082[0] 1722482138.305597 write_OD 0x963000 thru 0x96dfff (0xb000 bytes) 000083[0] 1722482138.324243 mapwrite 0x5ff000 thru 0x607b59 (0x8b5a bytes) 000086[0] 1722482138.361485 write_OD 0x42e000 thru 0x431fff (0x4000 bytes) 000087[0] 1722482138.379254 read_OD 0x5ee000 thru 0x5f2fff (0x5000 bytes) 000088[0] 1722482138.381522 mapread 0x65e000 thru 0x6664ef (0x84f0 bytes) 000090[0] 1722482138.397674 mapwrite 0x7c0000 thru 0x7c7e07 (0x7e08 bytes) 000092[1] 1722482138.444617 mapread 0x478000 thru 0x47ac39 (0x2c3a bytes) 000095[0] 1722482138.461342 mapread 0x7d6000 thru 0x7db0a7 (0x50a8 bytes) 000097[0] 1722482138.469498 mapread 0x402000 thru 0x40618b (0x418c bytes) 000099[0] 1722482138.475623 trunc from 0x96e000 to 0x0320fe (0x93bf01 bytes) 000102[0] 1722482138.493642 trunc from 0x0320ff to 0x14e7fe (0x11c700 bytes) 000103[1] 1722482138.502521 mapwrite 0x528000 thru 0x53052c (0x852d bytes) 000104[0] 1722482138.538939 write_OD 0x305000 thru 0x30afff (0x6000 bytes) 000106[0] 1722482138.555630 mapread 0x512000 thru 0x515b4a (0x3b4b bytes) 000108[1] 1722482138.561150 mapwrite 0x98b000 thru 0x99221e (0x721f bytes) 000109[0] 1722482138.589782 write_OD 0x520000 thru 0x52efff (0xf000 bytes) 000114[1] 1722482138.607855 mapwrite 0x24b000 thru 0x2597bb (0xe7bc bytes) 000115[1] 1722482138.647884 write_OD 0x04b000 thru 0x058fff (0xe000 bytes) 000116[0] 1722482138.665546 trunc from 0x99221f to 0x297057 (0x6fb1c7 bytes) 000117[1] 1722482138.676171 read_OD 0x179000 thru 0x179fff (0x1000 bytes) 000120[0] 1722482138.683254 write_OD 0x95a000 thru 0x967fff (0xe000 bytes) 000121[1] 1722482138.701638 read_OD 0x478000 thru 0x484fff (0xd000 bytes) 000123[1] 1722482138.704280 write_OD 0x6f2000 thru 0x6f9fff (0x8000 bytes) 000124[1] 1722482138.722183 mapwrite 0x838000 thru 0x83bfc0 (0x3fc1 bytes) 000128[1] 1722482138.780067 trunc from 0x968000 to 0x6a574c (0x2c28b3 bytes) 000130[1] 1722482138.794147 trunc from 0x6a574d to 0x0433a2 (0x6623aa bytes) 000132[1] 1722482138.809844 trunc from 0x0433a3 to 0x6a5bb6 (0x662814 bytes) 000137[1] 1722482138.829408 mapread 0x264000 thru 0x27146a (0xd46b bytes) 000139[1] 1722482138.852364 trunc from 0x6a5bb7 to 0x0c463a (0x5e157c bytes) 000140[1] 1722482138.863622 mapwrite 0x9a2000 thru 0x9aebab (0xcbac bytes) 000141[0] 1722482138.894555 trunc from 0x9aebac to 0x148e22 (0x865d89 bytes) 000143[0] 1722482138.912422 mapread 0x067000 thru 0x074d7b (0xdd7c bytes) 000144[1] 1722482138.931406 mapwrite 0x9e4000 thru 0x9eead6 (0xaad7 bytes) 000145[1] 1722482138.960134 read_OD 0x34c000 thru 0x350fff (0x5000 bytes) 000146[0] 1722482138.966939 read_OD 0x2bd000 thru 0x2befff (0x2000 bytes) 000148[0] 1722482138.970437 mapread 0x1c5000 thru 0x1c951a (0x451b bytes) 000151[1] 1722482139.010982 mapwrite 0x0b4000 thru 0x0c2c6e (0xec6f bytes) 000153[0] 1722482139.093561 trunc from 0x9eead7 to 0x7937a9 (0x25b32d bytes) 000154[1] 1722482139.112992 write_OD 0x1db000 thru 0x1ddfff (0x3000 bytes) 000156[0] 1722482139.131387 read_OD 0x19b000 thru 0x1a9fff (0xf000 bytes) 000158[0] 1722482139.135270 mapread 0x214000 thru 0x21e8e5 (0xa8e6 bytes) 000162[1] 1722482139.159245 mapwrite 0x5dc000 thru 0x5ebdfc (0xfdfd bytes) 000165[1] 1722482139.208539 mapread 0x747000 thru 0x749af7 (0x2af8 bytes) 000167[1] 1722482139.217966 write_OD 0x1f4000 thru 0x201fff (0xe000 bytes) 000168[1] 1722482139.235903 trunc from 0x7937aa to 0x635b5b (0x15dc4e bytes) 000171[1] 1722482139.252880 mapwrite 0x65b000 thru 0x66777a (0xc77b bytes) 000172[1] 1722482139.296262 mapwrite 0x598000 thru 0x59a3fa (0x23fb bytes) 000174[1] 1722482139.326536 read_OD 0x565000 thru 0x568fff (0x4000 bytes) 000176[1] 1722482139.332002 mapwrite 0x4b9000 thru 0x4bcdcb (0x3dcc bytes) 000177[1] 1722482139.370006 write_OD 0x14e000 thru 0x153fff (0x6000 bytes) 000178[0] 1722482139.397813 trunc from 0x66777b to 0x76fc1f (0x1084a5 bytes) 000179[0] 1722482139.412219 trunc from 0x76fc20 to 0x457142 (0x318add bytes) 000184[1] 1722482139.440224 read_OD 0x348000 thru 0x353fff (0xc000 bytes) 000187[1] 1722482139.449227 read_OD 0x1a6000 thru 0x1a9fff (0x4000 bytes) 000190[1] 1722482139.450994 write_OD 0x03d000 thru 0x03dfff (0x1000 bytes) 000192[0] 1722482139.470615 mapwrite 0x825000 thru 0x82888e (0x388f bytes) 000193[1] 1722482139.499459 mapwrite 0x201000 thru 0x20e01b (0xd01c bytes) 000194[1] 1722482139.538994 trunc from 0x82888f to 0x6dc4c3 (0x14c3cb bytes) 000195[0] 1722482139.546652 mapread 0x5af000 thru 0x5af80a (0x80b bytes) 000197[1] 1722482139.560412 write_OD 0x99d000 thru 0x9abfff (0xf000 bytes) 000199[1] 1722482139.578707 mapwrite 0x8ad000 thru 0x8b3df6 (0x6df7 bytes) 000200[1] 1722482139.605603 read_OD 0x8e9000 thru 0x8eafff (0x2000 bytes) 000201[1] 1722482139.608929 trunc from 0x9ac000 to 0x2f108b (0x6baf74 bytes) 000202[0] 1722482139.617768 write_OD 0x04f000 thru 0x052fff (0x4000 bytes) 000205[0] 1722482139.636873 mapread 0x242000 thru 0x2470d9 (0x50da bytes) 000206[0] 1722482139.644826 read_OD 0x056000 thru 0x05dfff (0x8000 bytes) 000208[0] 1722482139.647681 write_OD 0x212000 thru 0x218fff (0x7000 bytes) 000210[1] 1722482139.665316 mapwrite 0x1cf000 thru 0x1dba16 (0xca17 bytes) 000211[1] 1722482139.703043 read_OD 0x061000 thru 0x06cfff (0xc000 bytes) 000215[0] 1722482139.709106 mapread 0x0fc000 thru 0x103918 (0x7919 bytes) 000218[0] 1722482139.720991 mapread 0x0ff000 thru 0x102a1e (0x3a1f bytes) 000219[1] 1722482139.721334 mapread 0x207000 thru 0x216eee (0xfeef bytes) 000220[0] 1722482139.732754 write_OD 0x254000 thru 0x25bfff (0x8000 bytes) 000221[0] 1722482139.754610 write_OD 0x07c000 thru 0x081fff (0x6000 bytes) 000224[0] 1722482139.775340 write_OD 0x2f6000 thru 0x2f7fff (0x2000 bytes) 000225[1] 1722482139.792506 mapread 0x1e0000 thru 0x1ec955 (0xc956 bytes) 000226[0] 1722482139.808815 mapread 0x108000 thru 0x113705 (0xb706 bytes) 000231[1] 1722482139.824553 write_OD 0x395000 thru 0x39afff (0x6000 bytes) 000234[0] 1722482139.845120 mapread 0x063000 thru 0x06450b (0x150c bytes) 000236[1] 1722482139.848009 mapread 0x33a000 thru 0x33c762 (0x2763 bytes) 000237[1] 1722482139.851671 trunc from 0x39b000 to 0x26a976 (0x130689 bytes) 000241[1] 1722482139.866751 mapwrite 0x616000 thru 0x62241c (0xc41d bytes) 000243[1] 1722482139.904427 read_OD 0x1d6000 thru 0x1d7fff (0x2000 bytes) 000246[1] 1722482139.909503 mapwrite 0x0f7000 thru 0x102c20 (0xbc21 bytes) 000247[1] 1722482139.957157 read_OD 0x5bb000 thru 0x5c9fff (0xf000 bytes) 000248[1] 1722482139.966648 trunc from 0x62241d to 0x02c3a3 (0x5f6079 bytes) 000249[1] 1722482139.975852 mapread 0x00f000 thru 0x012b82 (0x3b83 bytes) 000252[1] 1722482139.985853 read_OD 0x007000 thru 0x009fff (0x3000 bytes) 000254[0] 1722482139.990991 read_OD 0x005000 thru 0x00ffff (0xb000 bytes) 000256[1] 1722482139.993736 trunc from 0x02c3a4 to 0x280523 (0x254180 bytes) 000262[1] 1722482140.008204 write_OD 0x42f000 thru 0x435fff (0x7000 bytes) 000263[1] 1722482140.028089 read_OD 0x0db000 thru 0x0e0fff (0x6000 bytes) 000265[1] 1722482140.030584 mapwrite 0x8de000 thru 0x8e6bee (0x8bef bytes) 000266[0] 1722482140.081960 mapread 0x3b6000 thru 0x3c056c (0xa56d bytes) 000268[1] 1722482140.129150 read_OD 0x053000 thru 0x054fff (0x2000 bytes) 000270[1] 1722482140.132155 mapwrite 0x937000 thru 0x941a0c (0xaa0d bytes) 000271[0] 1722482140.200589 read_OD 0x089000 thru 0x08efff (0x6000 bytes) 000272[0] 1722482140.216922 trunc from 0x941a0d to 0x66edef (0x2d2c1d bytes) 000274[1] 1722482140.224203 mapwrite 0x7ed000 thru 0x7f3ba3 (0x6ba4 bytes) 000277[0] 1722482140.268648 mapwrite 0x65a000 thru 0x6651b8 (0xb1b9 bytes) 000280[0] 1722482140.322990 read_OD 0x73c000 thru 0x741fff (0x6000 bytes) 000281[1] 1722482140.333236 mapwrite 0x8ca000 thru 0x8d9c98 (0xfc99 bytes) 000287[0] 1722482140.391707 mapread 0x5f9000 thru 0x5ff7e4 (0x67e5 bytes) 000293[0] 1722482140.415471 mapread 0x5bd000 thru 0x5c1cd8 (0x4cd9 bytes) 000296[0] 1722482140.422070 mapwrite 0x51a000 thru 0x51aa5b (0xa5c bytes) 000298[1] 1722482140.444454 read_OD 0x448000 thru 0x449fff (0x2000 bytes) 000299[1] 1722482140.449693 trunc from 0x8d9c99 to 0x27d294 (0x65ca04 bytes) 000300[0] 1722482140.459327 read_OD 0x1da000 thru 0x1e2fff (0x9000 bytes) 000301[0] 1722482140.466117 write_OD 0x839000 thru 0x845fff (0xd000 bytes) 000302[0] 1722482140.484386 write_OD 0x529000 thru 0x529fff (0x1000 bytes) 000303[0] 1722482140.503855 trunc from 0x846000 to 0x0849fd (0x7c1602 bytes) 000305[0] 1722482140.512517 write_OD 0x010000 thru 0x019fff (0xa000 bytes) 000308[0] 1722482140.536218 write_OD 0x2f0000 thru 0x2f8fff (0x9000 bytes) 000312[0] 1722482140.553596 mapwrite 0x608000 thru 0x610ff2 (0x8ff3 bytes) 000315[1] 1722482140.600241 mapread 0x3d9000 thru 0x3e28dc (0x98dd bytes) 000316[1] 1722482140.627955 mapread 0x3aa000 thru 0x3b34b1 (0x94b2 bytes) 000318[1] 1722482140.640395 trunc from 0x610ff3 to 0x023ba4 (0x5ed44e bytes) 000319[0] 1722482140.648905 write_OD 0x2fb000 thru 0x300fff (0x6000 bytes) 000321[0] 1722482140.666731 mapwrite 0x717000 thru 0x71fc44 (0x8c45 bytes) 000322[1] 1722482140.703383 mapwrite 0x8ee000 thru 0x8f9a6f (0xba70 bytes) 000324[1] 1722482140.748118 mapread 0x604000 thru 0x61084d (0xc84e bytes) 000325[0] 1722482140.763970 write_OD 0x3dd000 thru 0x3e9fff (0xd000 bytes) 000326[1] 1722482140.785225 mapwrite 0x29e000 thru 0x2ab3b9 (0xd3ba bytes) 000327[0] 1722482140.820270 mapread 0x040000 thru 0x040cad (0xcae bytes) 000328[0] 1722482140.825361 mapread 0x70f000 thru 0x718ad6 (0x9ad7 bytes) 000331[0] 1722482140.836130 write_OD 0x49b000 thru 0x49ffff (0x5000 bytes) 000332[1] 1722482140.851993 write_OD 0x164000 thru 0x170fff (0xd000 bytes) 000333[0] 1722482140.868432 mapwrite 0x8fa000 thru 0x8fb255 (0x1256 bytes) 000334[1] 1722482140.894073 read_OD 0x65f000 thru 0x661fff (0x3000 bytes) 000335[1] 1722482140.900888 read_OD 0x7d5000 thru 0x7dcfff (0x8000 bytes) 000337[0] 1722482140.904549 read_OD 0x209000 thru 0x212fff (0xa000 bytes) 000339[0] 1722482140.907192 mapread 0x4ef000 thru 0x4fa69c (0xb69d bytes) 000342[0] 1722482140.928493 trunc from 0x8fb256 to 0x1a153e (0x759d17 bytes) 000344[0] 1722482140.945013 read_OD 0x194000 thru 0x199fff (0x6000 bytes) 000345[1] 1722482140.949053 trunc from 0x1a153f to 0x551974 (0x3b0436 bytes) 000347[0] 1722482140.960565 write_OD 0x298000 thru 0x2a5fff (0xe000 bytes) 000349[1] 1722482140.977886 mapwrite 0x9ad000 thru 0x9bba5d (0xea5e bytes) 000350[1] 1722482141.011706 write_OD 0x6da000 thru 0x6dcfff (0x3000 bytes) 000351[0] 1722482141.031721 trunc from 0x9bba5e to 0x7c33c8 (0x1f8695 bytes) 000352[0] 1722482141.041680 trunc from 0x7c33c9 to 0x6e1705 (0xe1cc3 bytes) 000353[0] 1722482141.046010 mapread 0x17d000 thru 0x184d13 (0x7d14 bytes) 000354[0] 1722482141.072005 trunc from 0x6e1706 to 0x4b3a08 (0x22dcfd bytes) 000355[1] 1722482141.082801 mapread 0x11b000 thru 0x127bd1 (0xcbd2 bytes) 000357[1] 1722482141.108843 mapwrite 0x1be000 thru 0x1bf82e (0x182f bytes) 000358[0] 1722482141.134595 mapwrite 0x365000 thru 0x373c5b (0xec5c bytes) 000359[1] 1722482141.179819 write_OD 0x49b000 thru 0x49ffff (0x5000 bytes) 000361[0] 1722482141.195826 write_OD 0x10d000 thru 0x10dfff (0x1000 bytes) 000362[1] 1722482141.212534 write_OD 0x006000 thru 0x00afff (0x5000 bytes) 000363[1] 1722482141.229486 mapread 0x3da000 thru 0x3e28b1 (0x88b2 bytes) 000364[0] 1722482141.241269 mapread 0x170000 thru 0x1760e7 (0x60e8 bytes) 000366[0] 1722482141.248863 mapread 0x2cb000 thru 0x2d77fd (0xc7fe bytes) 000368[1] 1722482141.263400 trunc from 0x4b3a09 to 0x719a78 (0x266070 bytes) 000369[1] 1722482141.273534 write_OD 0x206000 thru 0x212fff (0xd000 bytes) 000370[0] 1722482141.292709 mapwrite 0x93e000 thru 0x93fa03 (0x1a04 bytes) 000372[0] 1722482141.332210 trunc from 0x93fa04 to 0x336813 (0x6091f0 bytes) 000373[0] 1722482141.341815 trunc from 0x336814 to 0x4453c9 (0x10ebb6 bytes) 000374[0] 1722482141.350170 mapread 0x367000 thru 0x372a46 (0xba47 bytes) 000375[1] 1722482141.365556 read_OD 0x3cb000 thru 0x3cbfff (0x1000 bytes) 000376[0] 1722482141.371183 trunc from 0x4453ca to 0x2f4750 (0x150c79 bytes) 000379[0] 1722482141.382287 mapread 0x1df000 thru 0x1e3f8c (0x4f8d bytes) 000380[0] 1722482141.392039 mapread 0x29b000 thru 0x2a7ace (0xcacf bytes) 000382[1] 1722482141.407242 mapwrite 0x43f000 thru 0x4427c8 (0x37c9 bytes) 000383[0] 1722482141.438294 mapwrite 0x923000 thru 0x92b2e2 (0x82e3 bytes) 000385[0] 1722482141.475709 mapread 0x499000 thru 0x4a2fcc (0x9fcd bytes) 000387[0] 1722482141.491066 mapread 0x8a0000 thru 0x8ab4f3 (0xb4f4 bytes) 000388[1] 1722482141.506854 trunc from 0x92b2e3 to 0x66e72c (0x2bcbb6 bytes) 000390[0] 1722482141.516983 write_OD 0x25b000 thru 0x263fff (0x9000 bytes) 000391[1] 1722482141.532714 read_OD 0x49b000 thru 0x49bfff (0x1000 bytes) 000394[1] 1722482141.535467 mapwrite 0x6d6000 thru 0x6e2701 (0xc702 bytes) 000395[0] 1722482141.571992 read_OD 0x444000 thru 0x444fff (0x1000 bytes) 000396[0] 1722482141.579402 mapread 0x077000 thru 0x0838ea (0xc8eb bytes) 000400[1] 1722482141.606757 read_OD 0x079000 thru 0x07bfff (0x3000 bytes) truncating to largest ever: 0x9fbcf9 000401[1] 1722482141.608137 trunc from 0x6e2702 to 0x9fbcf8 (0x3195f7 bytes) 000402[0] 1722482141.617853 read_OD 0x189000 thru 0x18dfff (0x5000 bytes) 000403[1] 1722482141.623461 write_OD 0x141000 thru 0x143fff (0x3000 bytes) 000404[1] 1722482141.638942 mapread 0x9d9000 thru 0x9da625 (0x1626 bytes) truncating to largest ever: 0x9fecf8 000405[0] 1722482141.667304 trunc from 0x9fbcf9 to 0x9fecf7 (0x2fff bytes) 000406[1] 1722482141.685045 mapread 0x0ca000 thru 0x0caa6b (0xa6c bytes) 000407[1] 1722482141.692326 trunc from 0x9fecf8 to 0x988107 (0x76bf0 bytes) 000408[0] 1722482141.702320 mapwrite 0x9b2000 thru 0x9b7ca4 (0x5ca5 bytes) 000409[0] 1722482141.748706 trunc from 0x9b7ca5 to 0x3ce019 (0x5e9c8b bytes) 000410[1] 1722482141.762468 trunc from 0x3ce01a to 0x86bf4b (0x49df32 bytes) 000412[1] 1722482141.774206 mapread 0x395000 thru 0x39ad16 (0x5d17 bytes) 000413[0] 1722482141.780642 read_OD 0x31d000 thru 0x32bfff (0xf000 bytes) 000414[1] 1722482141.785947 write_OD 0x015000 thru 0x01ffff (0xb000 bytes) 000416[1] 1722482141.802342 write_OD 0x299000 thru 0x2a6fff (0xe000 bytes) 000417[1] 1722482141.818368 mapread 0x2c1000 thru 0x2c4fe3 (0x3fe4 bytes) 000421[0] 1722482141.823660 write_OD 0x109000 thru 0x112fff (0xa000 bytes) 000427[1] 1722482141.838453 mapwrite 0x2df000 thru 0x2e030f (0x1310 bytes) 000429[0] 1722482141.861219 mapwrite 0x4f2000 thru 0x50077e (0xe77f bytes) 000435[0] 1722482141.919353 trunc from 0x86bf4c to 0x9eea1d (0x182ad2 bytes) 000440[1] 1722482141.934170 mapread 0x099000 thru 0x0a2ad1 (0x9ad2 bytes) 000442[0] 1722482141.953964 write_OD 0x86e000 thru 0x870fff (0x3000 bytes) 000443[0] 1722482141.968109 mapwrite 0x2aa000 thru 0x2b5bfe (0xbbff bytes) 000444[1] 1722482142.001471 trunc from 0x9eea1e to 0x3193ea (0x6d5633 bytes) 000446[1] 1722482142.015967 write_OD 0x4a5000 thru 0x4a7fff (0x3000 bytes) 000450[0] 1722482142.034418 mapread 0x3f0000 thru 0x3f1cf9 (0x1cfa bytes) 000453[0] 1722482142.037242 mapread 0x17d000 thru 0x17e1fc (0x11fd bytes) 000454[0] 1722482142.039146 write_OD 0x638000 thru 0x641fff (0xa000 bytes) 000455[0] 1722482142.053801 trunc from 0x642000 to 0x9d8e4b (0x396e4c bytes) 000456[0] 1722482142.063388 read_OD 0x043000 thru 0x051fff (0xf000 bytes) 000460[0] 1722482142.068365 write_OD 0x431000 thru 0x434fff (0x4000 bytes) 000461[0] 1722482142.081819 read_OD 0x274000 thru 0x276fff (0x3000 bytes) 000462[0] 1722482142.084258 mapread 0x6e2000 thru 0x6ec1f1 (0xa1f2 bytes) 000464[1] 1722482142.107135 mapread 0x446000 thru 0x44ca27 (0x6a28 bytes) 000467[1] 1722482142.114852 trunc from 0x9d8e4c to 0x87172d (0x16771e bytes) 000468[0] 1722482142.127685 read_OD 0x84a000 thru 0x856fff (0xd000 bytes) 000471[1] 1722482142.134897 trunc from 0x87172e to 0x4678b7 (0x409e76 bytes) 000472[1] 1722482142.140978 read_OD 0x2e5000 thru 0x2ecfff (0x8000 bytes) 000473[0] 1722482142.144663 write_OD 0x233000 thru 0x236fff (0x4000 bytes) 000478[1] 1722482142.160853 mapread 0x2e4000 thru 0x2ecc20 (0x8c21 bytes) 000482[1] 1722482142.170819 mapread 0x022000 thru 0x023891 (0x1892 bytes) 000483[0] 1722482142.173331 trunc from 0x4678b8 to 0x3bc00b (0xab8ac bytes) 000485[1] 1722482142.184720 mapread 0x20a000 thru 0x20dcf9 (0x3cfa bytes) 000487[0] 1722482142.194362 mapwrite 0x63d000 thru 0x64a2a8 (0xd2a9 bytes) 000489[1] 1722482142.237294 read_OD 0x2be000 thru 0x2c8fff (0xb000 bytes) 000491[1] 1722482142.245292 mapwrite 0x29e000 thru 0x2a8ece (0xaecf bytes) 000496[0] 1722482142.294603 trunc from 0x64a2a9 to 0x131edc (0x5183cc bytes) 000499[1] 1722482142.309884 mapread 0x094000 thru 0x0a113d (0xd13e bytes) 000500[1] 1722482142.327870 mapread 0x08f000 thru 0x095f02 (0x6f03 bytes) All operations completed A-OK! PASS 16a (11s) == sanityn test 16b: 500 iterations of dual-mount fsx at small size ========================================================== 23:15:43 (1722482143) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0929789 s, 22.6 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0663849 s, 31.6 MB/s Chance of close/open is 1 in 50 Seed set to 2143 fd 0: /mnt/lustre/f16b.sanityn fd 1: /mnt/lustre2/f16b.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x4be719 000004[1] 1722482144.170208 trunc from 00000000 to 0x4be718 (0x4be719 bytes) 000008[0] 1722482144.179563 mapwrite 0x3ac5ca thru 0x3ad760 (0x1197 bytes) 000009[0] 1722482144.209240 read 0x1e629b thru 0x1e812b (0x1e91 bytes) truncating to largest ever: 0x7d00c0 000010[1] 1722482144.213711 trunc from 0x4be719 to 0x7d00bf (0x3119a7 bytes) 000013[0] 1722482144.225441 trunc from 0x7d00c0 to 0x2ac622 (0x523a9d bytes) 000014[1] 1722482144.233950 read 0x01be9b thru 0x01dc73 (0x1dd9 bytes) 000016[0] 1722482144.242480 mapread 0x137417 thru 0x137a7e (0x668 bytes) 000020[1] 1722482144.247944 mapread 0x0bbbf5 thru 0x0bc77f (0xb8b bytes) 000021[0] 1722482144.255142 mapread 0x205d27 thru 0x20602c (0x306 bytes) 000022[0] 1722482144.259000 mapread 0x021492 thru 0x022472 (0xfe1 bytes) 000023[0] 1722482144.266672 write 0x29e313 thru 0x29f519 (0x1207 bytes) 000025[0] 1722482144.275591 mapwrite 0x102d4f thru 0x103205 (0x4b7 bytes) 000028[1] 1722482144.298230 read 0x1b74e3 thru 0x1b9395 (0x1eb3 bytes) 000031[1] 1722482144.310157 mapread 0x231d30 thru 0x232f44 (0x1215 bytes) 000032[0] 1722482144.322818 mapread 0x05bd22 thru 0x05bef9 (0x1d8 bytes) 000033[1] 1722482144.325490 trunc from 0x2ac623 to 0x0dd324 (0x1cf2fe bytes) 000036[1] 1722482144.344219 write 0x6d3cf5 thru 0x6d55fc (0x1908 bytes) 000039[1] 1722482144.354348 read 0x205e80 thru 0x206191 (0x312 bytes) 000041[1] 1722482144.373502 trunc from 0x6d55fd to 0x0528aa (0x682d52 bytes) 000042[1] 1722482144.382940 trunc from 0x0528ab to 0x6b391d (0x661073 bytes) 000044[0] 1722482144.393161 read 0x159d6e thru 0x15b3ff (0x1692 bytes) 000046[1] 1722482144.402574 write 0x45bc6c thru 0x45bcbe (0x53 bytes) 000047[0] 1722482144.407218 write 0x6cfcee thru 0x6d17ab (0x1abe bytes) 000048[1] 1722482144.410761 trunc from 0x6d17ac to 0x684362 (0x4d449 bytes) 000050[1] 1722482144.423828 mapread 0x0538f2 thru 0x053d8c (0x49b bytes) 000051[0] 1722482144.425169 mapwrite 0x440833 thru 0x4422e9 (0x1ab7 bytes) 000052[1] 1722482144.456970 write 0x98cce1 thru 0x98cfec (0x30c bytes) 000053[1] 1722482144.461072 mapread 0x1d5d7c thru 0x1d7303 (0x1588 bytes) 000054[1] 1722482144.469143 mapwrite 0x795c2d thru 0x7966c8 (0xa9c bytes) 000055[0] 1722482144.491186 mapread 0x2a6e1d thru 0x2a76ed (0x8d1 bytes) 000056[1] 1722482144.495785 write 0x90df1e thru 0x90f7dd (0x18c0 bytes) 000057[1] 1722482144.501058 write 0x4cf30c thru 0x4d023b (0xf30 bytes) 000066[1] 1722482144.528139 write 0x83542a thru 0x837262 (0x1e39 bytes) 000068[0] 1722482144.535546 mapwrite 0x04be99 thru 0x04c5f0 (0x758 bytes) 000069[0] 1722482144.561678 read 0x05bc24 thru 0x05da77 (0x1e54 bytes) 000074[0] 1722482144.583299 mapread 0x18c121 thru 0x18d7b6 (0x1696 bytes) 000077[0] 1722482144.623087 read 0x7a178c thru 0x7a18aa (0x11f bytes) 000079[0] 1722482144.629126 mapread 0x0b03ef thru 0x0b056f (0x181 bytes) 000080[1] 1722482144.629539 mapwrite 0x01cb1f thru 0x01cb4d (0x2f bytes) 000081[0] 1722482144.654081 write 0x0f57d2 thru 0x0f62c5 (0xaf4 bytes) 000082[0] 1722482144.661086 mapread 0x1d5bf2 thru 0x1d5eb7 (0x2c6 bytes) 000084[0] 1722482144.667752 write 0x095afa thru 0x09792a (0x1e31 bytes) 000085[1] 1722482144.670243 trunc from 0x98cfed to 0x0e975a (0x8a3892 bytes) 000086[0] 1722482144.684287 trunc from 0x0e975b to 0x612965 (0x52920b bytes) 000087[1] 1722482144.692254 write 0x0af9ed thru 0x0b051d (0xb31 bytes) 000088[0] 1722482144.699135 mapwrite 0x78bb42 thru 0x78c068 (0x527 bytes) 000089[1] 1722482144.723922 trunc from 0x78c069 to 0x218d61 (0x573307 bytes) 000090[1] 1722482144.733220 trunc from 0x218d62 to 0x27a58f (0x6182e bytes) 000092[1] 1722482144.741101 read 0x02d9ba thru 0x02f6ce (0x1d15 bytes) 000097[0] 1722482144.762753 trunc from 0x27a590 to 0x0d887f (0x1a1d10 bytes) 000098[1] 1722482144.775114 mapwrite 0x8af8da thru 0x8b14e6 (0x1c0d bytes) 000100[1] 1722482144.825664 mapread 0x1e79e7 thru 0x1e7f1c (0x536 bytes) truncating to largest ever: 0x92fcc5 000101[1] 1722482144.830223 trunc from 0x8b14e7 to 0x92fcc4 (0x7e7de bytes) 000102[0] 1722482144.837616 mapwrite 0x3e8289 thru 0x3e8f73 (0xceb bytes) 000105[0] 1722482144.867125 mapread 0x0b8d55 thru 0x0b9c2f (0xedb bytes) 000106[1] 1722482144.878068 mapread 0x462e40 thru 0x463170 (0x331 bytes) 000107[0] 1722482144.881756 mapwrite 0x4971ac thru 0x498a47 (0x189c bytes) 000108[0] 1722482144.898782 write 0x878998 thru 0x879db0 (0x1419 bytes) 000111[1] 1722482144.904466 read 0x6fcda0 thru 0x6fdd72 (0xfd3 bytes) 000114[1] 1722482144.912852 mapwrite 0x24acc9 thru 0x24bc6a (0xfa2 bytes) 000116[0] 1722482144.936932 read 0x5530c6 thru 0x554815 (0x1750 bytes) 000120[1] 1722482144.955568 trunc from 0x92fcc5 to 0x1708bd (0x7bf407 bytes) 000125[1] 1722482144.969181 write 0x958b13 thru 0x958bec (0xda bytes) 000130[0] 1722482144.980328 write 0x83acf5 thru 0x83cc37 (0x1f43 bytes) 000131[0] 1722482144.985375 trunc from 0x958bed to 0x2e32ac (0x675940 bytes) 000132[1] 1722482144.995693 mapwrite 0x2cc109 thru 0x2cd170 (0x1068 bytes) 000133[0] 1722482145.017994 read 0x1569da thru 0x1576b4 (0xcdb bytes) 000134[0] 1722482145.027002 read 0x14f0ac thru 0x1509bc (0x1911 bytes) 000135[1] 1722482145.032224 read 0x158938 thru 0x159d95 (0x145e bytes) 000140[1] 1722482145.050498 mapwrite 0x495579 thru 0x495eae (0x936 bytes) 000144[0] 1722482145.086597 mapread 0x2d5c77 thru 0x2d7739 (0x1ac3 bytes) 000145[0] 1722482145.101737 mapread 0x40b5d5 thru 0x40b978 (0x3a4 bytes) 000146[1] 1722482145.105034 trunc from 0x495eaf to 0x88d486 (0x3f75d8 bytes) 000149[1] 1722482145.119377 read 0x5bb03d thru 0x5bbdaf (0xd73 bytes) 000151[1] 1722482145.141318 read 0x75ed42 thru 0x75fc4c (0xf0b bytes) 000153[0] 1722482145.144901 write 0x80f1f2 thru 0x80ff3a (0xd49 bytes) 000154[0] 1722482145.152855 trunc from 0x88d487 to 0x63baa7 (0x2519df bytes) 000155[1] 1722482145.161329 read 0x45e091 thru 0x45fa58 (0x19c8 bytes) 000157[1] 1722482145.174709 write 0x181fca thru 0x1838bb (0x18f2 bytes) 000159[1] 1722482145.186837 write 0x629501 thru 0x629613 (0x113 bytes) 000160[0] 1722482145.191179 mapwrite 0x7df645 thru 0x7e0146 (0xb02 bytes) 000161[1] 1722482145.221223 write 0x41c75d thru 0x41d070 (0x914 bytes) 000162[1] 1722482145.236307 write 0x3dc2cc thru 0x3dd844 (0x1579 bytes) 000163[0] 1722482145.251234 mapread 0x60d47d thru 0x60e659 (0x11dd bytes) 000164[1] 1722482145.262497 write 0x04046d thru 0x040bd2 (0x766 bytes) truncating to largest ever: 0x969d04 000165[0] 1722482145.268328 trunc from 0x7e0147 to 0x969d03 (0x189bbd bytes) 000166[1] 1722482145.280174 trunc from 0x969d04 to 0x0f1921 (0x8783e2 bytes) 000167[1] 1722482145.287336 mapread 0x06008d thru 0x061d02 (0x1c76 bytes) 000169[1] 1722482145.289940 trunc from 0x0f1922 to 0x94da58 (0x85c137 bytes) 000172[0] 1722482145.304822 trunc from 0x94da59 to 0x23a449 (0x71360f bytes) 000173[0] 1722482145.313991 mapwrite 0x1c167d thru 0x1c32e3 (0x1c67 bytes) 000175[0] 1722482145.335604 mapwrite 0x06459c thru 0x064c81 (0x6e6 bytes) 000176[0] 1722482145.353147 read 0x028d1c thru 0x02950c (0x7f1 bytes) 000177[0] 1722482145.369745 mapread 0x205715 thru 0x205cc6 (0x5b2 bytes) 000178[0] 1722482145.373379 mapwrite 0x113b4b thru 0x113e00 (0x2b6 bytes) 000179[0] 1722482145.387489 read 0x18709b thru 0x18895d (0x18c3 bytes) 000182[1] 1722482145.388055 write 0x09f75f thru 0x09fde3 (0x685 bytes) 000184[1] 1722482145.398445 write 0x3276c6 thru 0x3285b7 (0xef2 bytes) 000185[1] 1722482145.402112 mapread 0x03136c thru 0x032596 (0x122b bytes) 000186[0] 1722482145.404451 write 0x985af3 thru 0x986ea8 (0x13b6 bytes) 000188[1] 1722482145.414599 read 0x476eea thru 0x478bc0 (0x1cd7 bytes) 000190[1] 1722482145.425976 read 0x58d04d thru 0x58d390 (0x344 bytes) 000192[0] 1722482145.451101 trunc from 0x986ea9 to 0x26d397 (0x719b11 bytes) 000194[1] 1722482145.470103 trunc from 0x26d398 to 0x0607e0 (0x20cbb7 bytes) 000196[0] 1722482145.483627 trunc from 0x0607e1 to 0x08c611 (0x2be31 bytes) 000197[0] 1722482145.495848 trunc from 0x08c612 to 0x3a0d36 (0x314725 bytes) 000198[1] 1722482145.504093 mapwrite 0x68e885 thru 0x68eadc (0x258 bytes) 000200[0] 1722482145.531359 trunc from 0x68eadd to 0x0ce668 (0x5c0474 bytes) 000202[0] 1722482145.545758 trunc from 0x0ce669 to 0x12c1d8 (0x5db70 bytes) 000203[0] 1722482145.553315 write 0x64e0f9 thru 0x64e400 (0x308 bytes) 000204[0] 1722482145.558074 mapwrite 0x272d88 thru 0x273746 (0x9bf bytes) 000205[0] 1722482145.579211 mapread 0x07036d thru 0x071bac (0x1840 bytes) 000206[1] 1722482145.586724 write 0x4c4cfe thru 0x4c5b2c (0xe2f bytes) 000208[0] 1722482145.599398 trunc from 0x64e401 to 0x38face (0x2be932 bytes) 000211[0] 1722482145.615624 trunc from 0x38facf to 0x8533e4 (0x4c3916 bytes) 000213[0] 1722482145.620922 mapread 0x5e1df4 thru 0x5e2308 (0x515 bytes) 000214[1] 1722482145.623362 write 0x790477 thru 0x792356 (0x1ee0 bytes) 000215[1] 1722482145.632122 mapwrite 0x3c706b thru 0x3c8d4b (0x1ce1 bytes) 000217[0] 1722482145.657063 mapread 0x66c850 thru 0x66daef (0x12a0 bytes) 000220[1] 1722482145.670226 mapwrite 0x4c340b thru 0x4c4019 (0xc0f bytes) 000221[0] 1722482145.691142 write 0x28b46a thru 0x28cf8c (0x1b23 bytes) 000222[0] 1722482145.698127 write 0x4eda65 thru 0x4ee13a (0x6d6 bytes) 000223[0] 1722482145.703103 write 0x5ca480 thru 0x5cbb2f (0x16b0 bytes) 000225[1] 1722482145.713657 mapread 0x0311be thru 0x032955 (0x1798 bytes) 000227[0] 1722482145.726279 mapwrite 0x32b576 thru 0x32d044 (0x1acf bytes) 000229[0] 1722482145.753191 mapwrite 0x2b25db thru 0x2b3018 (0xa3e bytes) 000230[0] 1722482145.777722 mapwrite 0x69a8d1 thru 0x69b44c (0xb7c bytes) 000231[0] 1722482145.795292 write 0x7de3e5 thru 0x7df2b0 (0xecc bytes) 000237[1] 1722482145.807661 write 0x874a69 thru 0x87504f (0x5e7 bytes) 000238[0] 1722482145.812994 write 0x3965b9 thru 0x3981b6 (0x1bfe bytes) 000241[1] 1722482145.826795 mapwrite 0x8cfd41 thru 0x8d180b (0x1acb bytes) 000242[1] 1722482145.855839 mapread 0x54df0d thru 0x54dfae (0xa2 bytes) 000243[1] 1722482145.861941 trunc from 0x8d180c to 0x2fdc31 (0x5d3bda bytes) 000244[1] 1722482145.866345 trunc from 0x2fdc32 to 0x95bc42 (0x65e011 bytes) 000245[1] 1722482145.873885 mapread 0x4b17f1 thru 0x4b2970 (0x1180 bytes) 000246[0] 1722482145.879833 write 0x1e1593 thru 0x1e17a5 (0x213 bytes) 000248[0] 1722482145.889994 mapread 0x0ec0be thru 0x0ec5d0 (0x513 bytes) 000249[0] 1722482145.898068 mapread 0x4e6934 thru 0x4e7834 (0xf01 bytes) 000252[1] 1722482145.906638 mapwrite 0x24ef6e thru 0x24fb08 (0xb9b bytes) 000253[1] 1722482145.931624 mapwrite 0x74de5d thru 0x74e0c3 (0x267 bytes) 000257[0] 1722482145.958313 write 0x5e2c41 thru 0x5e44ea (0x18aa bytes) 000259[0] 1722482145.969222 mapwrite 0x788867 thru 0x789d7f (0x1519 bytes) 000262[0] 1722482145.997867 mapwrite 0x35f3b1 thru 0x35fb16 (0x766 bytes) 000265[0] 1722482146.025903 trunc from 0x95bc43 to 0x77804c (0x1e3bf6 bytes) 000266[1] 1722482146.034920 mapwrite 0x731862 thru 0x7335e0 (0x1d7f bytes) 000268[0] 1722482146.063149 mapread 0x023477 thru 0x0252e6 (0x1e70 bytes) 000269[0] 1722482146.071480 read 0x2d5d87 thru 0x2d6d95 (0x100f bytes) 000270[1] 1722482146.079512 read 0x4d3d12 thru 0x4d42ac (0x59b bytes) 000273[0] 1722482146.101932 mapwrite 0x9f0f29 thru 0x9f1dc8 (0xea0 bytes) 000274[1] 1722482146.157989 mapread 0x4fe718 thru 0x5004de (0x1dc7 bytes) 000275[0] 1722482146.188887 write 0x3b8cf3 thru 0x3b9161 (0x46f bytes) 000277[0] 1722482146.200288 write 0x67da0f thru 0x67f644 (0x1c36 bytes) 000281[0] 1722482146.213409 mapread 0x8c24f8 thru 0x8c2c91 (0x79a bytes) 000283[0] 1722482146.218537 trunc from 0x9f1dc9 to 0x2134cf (0x7de8f9 bytes) 000284[1] 1722482146.226401 mapwrite 0x2b4a7f thru 0x2b5af4 (0x1076 bytes) 000285[0] 1722482146.251650 mapread 0x13f5e5 thru 0x13fba2 (0x5be bytes) 000286[1] 1722482146.258296 mapread 0x218985 thru 0x219b28 (0x11a4 bytes) 000287[1] 1722482146.260677 write 0x4992b0 thru 0x49b1b1 (0x1f02 bytes) 000291[1] 1722482146.265003 mapwrite 0x24a748 thru 0x24b725 (0xfde bytes) 000293[1] 1722482146.287266 mapwrite 0x1ac1b7 thru 0x1ad41a (0x1264 bytes) 000294[0] 1722482146.311180 mapread 0x1cc6b9 thru 0x1ccf65 (0x8ad bytes) 000295[0] 1722482146.316992 trunc from 0x49b1b2 to 0x5dcb11 (0x141960 bytes) 000297[0] 1722482146.328620 mapwrite 0x05b01b thru 0x05bda3 (0xd89 bytes) 000298[1] 1722482146.346607 read 0x3382f4 thru 0x33a075 (0x1d82 bytes) 000306[0] 1722482146.370560 trunc from 0x5dcb12 to 0x7189b1 (0x13bea0 bytes) 000307[0] 1722482146.377309 trunc from 0x7189b2 to 0x7fdac2 (0xe5111 bytes) 000310[0] 1722482146.387683 write 0x40ffb6 thru 0x4109d1 (0xa1c bytes) 000311[0] 1722482146.393050 trunc from 0x7fdac3 to 0x39b75c (0x462366 bytes) 000312[1] 1722482146.397659 mapread 0x2de68b thru 0x2e0125 (0x1a9b bytes) 000315[0] 1722482146.411341 trunc from 0x39b75d to 0x33d8c5 (0x5de97 bytes) 000317[1] 1722482146.422648 mapread 0x00a6f8 thru 0x00b64b (0xf54 bytes) 000318[0] 1722482146.430108 mapread 0x216cd8 thru 0x2170fc (0x425 bytes) 000319[1] 1722482146.432602 mapwrite 0x1ad6d8 thru 0x1af51e (0x1e47 bytes) 000320[0] 1722482146.455074 mapread 0x019046 thru 0x01ad87 (0x1d42 bytes) 000322[0] 1722482146.466682 mapread 0x1b5471 thru 0x1b694d (0x14dd bytes) 000323[0] 1722482146.472591 mapwrite 0x6399c7 thru 0x63a898 (0xed2 bytes) 000324[1] 1722482146.498212 write 0x6c0af7 thru 0x6c238b (0x1895 bytes) 000326[1] 1722482146.507311 mapread 0x21c303 thru 0x21df66 (0x1c64 bytes) 000330[1] 1722482146.530568 trunc from 0x6c238c to 0x2af059 (0x413332 bytes) 000332[1] 1722482146.540898 write 0x95189f thru 0x953461 (0x1bc3 bytes) 000334[1] 1722482146.542690 write 0x97cd33 thru 0x97d5c1 (0x88f bytes) 000335[1] 1722482146.543069 read 0x17a128 thru 0x17b57c (0x1455 bytes) 000337[0] 1722482146.568362 trunc from 0x97d5c2 to 0x82fa9a (0x14db27 bytes) 000338[1] 1722482146.584398 mapwrite 0x7b4ab4 thru 0x7b5251 (0x79e bytes) 000344[0] 1722482146.621453 read 0x4d2794 thru 0x4d35a4 (0xe11 bytes) 000348[0] 1722482146.637794 write 0x62e66e thru 0x630250 (0x1be3 bytes) 000350[0] 1722482146.646985 trunc from 0x82fa9b to 0x3f42ef (0x43b7ab bytes) 000353[0] 1722482146.661758 trunc from 0x3f42f0 to 0x372c36 (0x816b9 bytes) 000355[0] 1722482146.672237 mapread 0x0bb75d thru 0x0bd3bd (0x1c61 bytes) 000361[1] 1722482146.677683 read 0x0121cc thru 0x0127c9 (0x5fe bytes) 000363[1] 1722482146.694910 trunc from 0x372c37 to 0x1768b0 (0x1fc386 bytes) 000364[1] 1722482146.708768 read 0x0cd5f9 thru 0x0cea31 (0x1439 bytes) 000365[0] 1722482146.715099 read 0x101543 thru 0x101e69 (0x927 bytes) 000366[0] 1722482146.727102 trunc from 0x1768b1 to 0x4bab4c (0x34429c bytes) 000367[0] 1722482146.739586 trunc from 0x4bab4d to 0x803515 (0x3489c9 bytes) 000369[1] 1722482146.748481 mapread 0x1ff488 thru 0x1ffc5e (0x7d7 bytes) 000370[1] 1722482146.759063 trunc from 0x803516 to 0x0e81b8 (0x71b35d bytes) 000371[0] 1722482146.770967 trunc from 0x0e81b9 to 0x6fc793 (0x6145db bytes) 000372[0] 1722482146.782521 read 0x1a1bee thru 0x1a24e4 (0x8f7 bytes) 000373[1] 1722482146.805708 mapread 0x162aae thru 0x163aa1 (0xff4 bytes) truncating to largest ever: 0x9d9f79 000374[0] 1722482146.817744 trunc from 0x6fc794 to 0x9d9f78 (0x2dd7e5 bytes) 000375[0] 1722482146.827861 mapwrite 0x2d3b42 thru 0x2d3ca4 (0x163 bytes) 000378[1] 1722482146.849774 mapwrite 0x23da60 thru 0x23f7a7 (0x1d48 bytes) 000383[0] 1722482146.896706 mapwrite 0x5a9e6e thru 0x5ab31f (0x14b2 bytes) 000384[1] 1722482146.916308 write 0x980cbd thru 0x98215d (0x14a1 bytes) 000385[1] 1722482146.924360 write 0x9e9323 thru 0x9e95ef (0x2cd bytes) 000386[1] 1722482146.924776 write 0x3b4616 thru 0x3b4b56 (0x541 bytes) 000387[1] 1722482146.925975 trunc from 0x9e95f0 to 0x786f43 (0x2626ac bytes) 000389[1] 1722482146.936365 mapwrite 0x8c4d66 thru 0x8c52c9 (0x564 bytes) 000390[1] 1722482146.959070 write 0x8ae28d thru 0x8ae63e (0x3b2 bytes) 000392[1] 1722482146.964693 read 0x884bce thru 0x88502d (0x460 bytes) 000393[0] 1722482146.968484 trunc from 0x8c52ca to 0x66d6fb (0x257bce bytes) 000396[0] 1722482146.982838 mapread 0x1e2290 thru 0x1e3eba (0x1c2b bytes) 000398[0] 1722482146.988325 trunc from 0x66d6fc to 0x122be6 (0x54ab15 bytes) 000399[0] 1722482146.995425 mapread 0x0f7bdd thru 0x0f9192 (0x15b6 bytes) 000403[1] 1722482147.009908 write 0x025389 thru 0x02594a (0x5c2 bytes) 000404[0] 1722482147.016356 write 0x47d155 thru 0x47e92e (0x17da bytes) 000408[1] 1722482147.024655 read 0x3578cd thru 0x358f59 (0x168d bytes) 000409[1] 1722482147.033066 mapread 0x038016 thru 0x039c8c (0x1c77 bytes) 000410[0] 1722482147.047512 read 0x07dd0d thru 0x07eb1e (0xe12 bytes) 000411[0] 1722482147.063529 mapwrite 0x432a64 thru 0x43315c (0x6f9 bytes) 000412[1] 1722482147.094009 trunc from 0x47e92f to 0x62e169 (0x1af83b bytes) 000413[1] 1722482147.104754 write 0x454d1e thru 0x45514c (0x42f bytes) 000415[1] 1722482147.119385 trunc from 0x62e16a to 0x412b4f (0x21b61a bytes) 000416[1] 1722482147.128008 mapwrite 0x896dbd thru 0x8982dd (0x1521 bytes) 000422[0] 1722482147.164775 trunc from 0x8982de to 0x546f80 (0x35135d bytes) 000423[0] 1722482147.175199 trunc from 0x546f81 to 0x74a517 (0x203597 bytes) 000424[0] 1722482147.178528 write 0x1b5a14 thru 0x1b5f39 (0x526 bytes) 000427[0] 1722482147.187310 mapwrite 0x644b84 thru 0x6469c5 (0x1e42 bytes) 000428[0] 1722482147.204059 mapwrite 0x5daef6 thru 0x5db5b0 (0x6bb bytes) 000431[1] 1722482147.224511 read 0x1cd8d9 thru 0x1ce5bb (0xce3 bytes) 000432[1] 1722482147.230581 trunc from 0x74a518 to 0x53deb0 (0x20c667 bytes) 000433[0] 1722482147.238777 read 0x20363f thru 0x20495f (0x1321 bytes) 000434[0] 1722482147.252194 read 0x44269c thru 0x4434a6 (0xe0b bytes) 000437[0] 1722482147.270000 mapread 0x0a66d1 thru 0x0a7f33 (0x1863 bytes) 000438[0] 1722482147.279323 mapwrite 0x932b98 thru 0x932ce6 (0x14f bytes) 000439[1] 1722482147.327737 mapwrite 0x9a47cb thru 0x9a59b7 (0x11ed bytes) 000440[1] 1722482147.389794 mapread 0x0bc336 thru 0x0bda5d (0x1728 bytes) 000441[1] 1722482147.394086 trunc from 0x9a59b8 to 0x91fd04 (0x85cb3 bytes) 000442[1] 1722482147.404138 write 0x5f3f4e thru 0x5f55a7 (0x165a bytes) 000443[1] 1722482147.405905 read 0x729e34 thru 0x72a662 (0x82f bytes) 000444[1] 1722482147.409715 mapwrite 0x2f0064 thru 0x2f07d9 (0x776 bytes) 000446[1] 1722482147.427900 mapwrite 0x729337 thru 0x72a6ff (0x13c9 bytes) 000447[0] 1722482147.446839 trunc from 0x91fd05 to 0x9c664a (0xa6946 bytes) 000448[0] 1722482147.465002 read 0x5a9f8b thru 0x5aaca3 (0xd19 bytes) 000449[0] 1722482147.488735 write 0x5aac7c thru 0x5ac3aa (0x172f bytes) 000450[0] 1722482147.489245 mapwrite 0x52d9de thru 0x52dcbb (0x2de bytes) 000451[1] 1722482147.508957 read 0x354ee9 thru 0x355666 (0x77e bytes) 000452[1] 1722482147.524231 trunc from 0x9c664b to 0x533346 (0x493304 bytes) 000453[1] 1722482147.538654 read 0x10fc27 thru 0x10fdfb (0x1d5 bytes) 000455[1] 1722482147.561561 mapwrite 0x363357 thru 0x3640a9 (0xd53 bytes) 000457[0] 1722482147.580535 read 0x363965 thru 0x36512c (0x17c8 bytes) 000458[0] 1722482147.592749 trunc from 0x533347 to 0x58e176 (0x5ae30 bytes) 000462[1] 1722482147.616490 trunc from 0x58e177 to 0x556fe0 (0x37196 bytes) 000463[1] 1722482147.625546 read 0x02c855 thru 0x02e67d (0x1e29 bytes) 000467[1] 1722482147.660229 mapwrite 0x19c3d7 thru 0x19e299 (0x1ec3 bytes) 000469[0] 1722482147.675040 mapwrite 0x68284d thru 0x6847c5 (0x1f79 bytes) 000470[1] 1722482147.721629 write 0x9b8c46 thru 0x9b9c85 (0x1040 bytes) 000472[1] 1722482147.732517 trunc from 0x9b9c86 to 0x49881b (0x52146a bytes) 000473[0] 1722482147.739553 mapwrite 0x6b006b thru 0x6b01d2 (0x168 bytes) 000474[0] 1722482147.768612 write 0x16c5cc thru 0x16e465 (0x1e9a bytes) 000475[1] 1722482147.775552 trunc from 0x6b01d3 to 0x2cf4f1 (0x3e0ce1 bytes) 000476[1] 1722482147.784887 trunc from 0x2cf4f2 to 0x14dca5 (0x18184c bytes) 000478[1] 1722482147.788470 mapread 0x06a960 thru 0x06b905 (0xfa6 bytes) 000479[0] 1722482147.795223 read 0x00196c thru 0x002d2d (0x13c2 bytes) 000480[1] 1722482147.808906 write 0x6a949a thru 0x6aa25f (0xdc6 bytes) 000483[0] 1722482147.817832 trunc from 0x6aa260 to 0x022357 (0x687f08 bytes) 000484[1] 1722482147.827921 read 0x0154ed thru 0x015cc4 (0x7d8 bytes) 000485[0] 1722482147.837126 read 0x00913f thru 0x009bbe (0xa80 bytes) 000487[1] 1722482147.847583 read 0x007dc8 thru 0x0082e8 (0x521 bytes) 000488[0] 1722482147.853358 read 0x00bf6e thru 0x00c90a (0x99d bytes) 000489[0] 1722482147.856689 trunc from 0x022358 to 0x12f823 (0x10d4cc bytes) 000490[1] 1722482147.866166 trunc from 0x12f824 to 0x6a9779 (0x579f56 bytes) 000497[0] 1722482147.892378 mapread 0x244f91 thru 0x246bd4 (0x1c44 bytes) 000500[1] 1722482147.905536 mapread 0x5aa74d thru 0x5ac5a7 (0x1e5b bytes) All operations completed A-OK! PASS 16b (6s) == sanityn test 16c: verify data consistency on ldiskfs with cache disabled (b=17397) ========================================================== 23:15:49 (1722482149) SKIP: sanityn test_16c dio on ldiskfs only SKIP 16c (0s) == sanityn test 16d: Verify DIO and buffer IO with two clients ========================================================== 23:15:50 (1722482150) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0893074 s, 23.5 MB/s 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0586161 s, 35.8 MB/s ldlm.namespaces.MGC192.168.202.155@tcp.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b6ccc800.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff88012da53000.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8800b6ccc800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff88012da53000.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8800b6ccc800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff88012da53000.lru_size=clear 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 2.91472 s, 36.0 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.711064 s, 147 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.665783 s, 157 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.33637 s, 78.5 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.87447 s, 55.9 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.987837 s, 106 MB/s PASS 16d (11s) == sanityn test 16e: Verify size consistency for O_DIRECT write ========================================================== 23:16:01 (1722482161) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0570511 s, 184 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0297335 s, 35.3 MB/s PASS 16e (2s) == sanityn test 16f: rw sequential consistency vs drop_caches ========================================================== 23:16:03 (1722482163) TIMEOUT PASS 16f (21s) == sanityn test 16g: mmap rw sequential consistency vs drop_caches ========================================================== 23:16:24 (1722482184) TIMEOUT PASS 16g (22s) == sanityn test 16i: read after truncate file ============ 23:16:46 (1722482206) ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16i (1s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 23:16:47 (1722482207) fail_loc=0x8000030a PASS 17 (4s) == sanityn test 18: mmap sanity check =========================================================================================== 23:16:51 (1722482211) mmap test1: basic mmap operation (PASS, 0.014622s) mmap test2: MAP_PRIVATE not write back (PASS, 0.010213s) mmap test3: concurrent mmap ops on two nodes (PASS, 4.2563s) mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 2.0605s) mmap test5: read/write file to/from the buffer which mmapped to just this file (PASS, 0.021045s) mmap test6: check mmap write/read content on two nodes (PASS, 0.024744s) mmap test7: file i/o with an unmapped buffer (SKIPPED, 0s) mmap test8: SIGBUS for beyond file size (SKIPPED, 0s) mmap test9: SIGBUS for negative file offset (SKIPPED, 0s) mmap test10: mtime not change for readonly mmap access (PASS, 1.0118s) PASS 18 (10s) == sanityn test 19: test concurrent uncached read races ========================================================================= 23:17:01 (1722482221) oleg255-server: error: get_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory pdsh@oleg255-client: oleg255-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (1s) == sanityn test 20: test extra readahead page left in cache ============================================================== 23:17:02 (1722482222) PASS 20 (1s) == sanityn test 21: Try to remove mountpoint on another dir ============================================================== 23:17:03 (1722482223) rmdir: removing directory, '/mnt/lustre/d21.sanityn' rmdir: failed to remove '/mnt/lustre/d21.sanityn': Device or resource busy rmdir: removing directory, '/mnt/lustre2/d21.sanityn' Removed mounted directory from another mountpoint, needs to be fixed PASS 21 (2s) == sanityn test 23: others should see updated atime while another read============================================================== 23:17:05 (1722482225) now is 1722482225 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.6848 new atime is 1722482286 PASS 23 (62s) == sanityn test 24a: lfs df [-ih] [path] test =================================================================================== 23:18:07 (1722482287) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 7168 3762176 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 13312 7525376 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 7168 3762176 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 13312 7525376 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.6K 369 488.3K 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 115.2K 376 114.9K 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 115.3K 373 114.9K 1% /mnt/lustre[OST:1] filesystem_summary: 230.1K 369 229.8K 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.6K 369 488.3K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.2K 376 114.9K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 115.3K 373 114.9K 1% /mnt/lustre2[OST:1] filesystem_summary: 230.1K 369 229.8K 1% /mnt/lustre2 UUID bytes Used Available Use% Mounted on lustre-MDT0000_UUID 2.1G 3.2M 2.1G 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3.6G 7.0M 3.6G 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3.6G 6.0M 3.6G 1% /mnt/lustre[OST:1] filesystem_summary: 7.2G 13.0M 7.2G 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500339 369 499970 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118008 376 117632 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 118037 373 117664 1% /mnt/lustre2[OST:1] filesystem_summary: 235665 369 235296 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 7168 3762176 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 13312 7525376 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 488.6K 369 488.3K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.2K 376 114.9K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 115.3K 373 114.9K 1% /mnt/lustre2[OST:1] filesystem_summary: 230.1K 369 229.8K 1% /mnt/lustre2 No device found for name osc: Invalid argument UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500339 369 499970 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 118008 376 117632 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 118037 373 117664 1% /mnt/lustre[OST:1] filesystem_summary: 235665 369 235296 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 500339 369 499970 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118008 376 117632 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 118037 373 117664 1% /mnt/lustre2[OST:1] filesystem_summary: 235665 369 235296 1% /mnt/lustre2 No device found for name osc: Invalid argument UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 7168 3762176 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 13312 7525376 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 7168 3762176 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 13312 7525376 1% /mnt/lustre2 PASS 24a (2s) == sanityn test 24b: lfs df should show both filesystems ========================================================================= 23:18:09 (1722482289) PASS 24b (1s) == sanityn test 25a: change ACL on one mountpoint be seen on another ============================================================= 23:18:10 (1722482290) running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] PASS 25a (2s) == sanityn test 25b: change ACL under remote dir on one mountpoint be seen on another ========================================================== 23:18:12 (1722482292) SKIP: sanityn test_25b needs >= 2 MDTs SKIP 25b (0s) == sanityn test 26a: allow mtime to get older ============ 23:18:12 (1722482292) utime: good mknod times 1722482292 <= 1722482293 <= 1722482293 for /mnt/lustre/f26a utime: good mknod times 1722482292 <= 1722482293 <= 1722482293 for /mnt/lustre2/f26a utime: good utime mtimes 100000, atime 200000 utime: updated times for /mnt/lustre2/f26a PASS 26a (3s) == sanityn test 26b: sync mtime between ost and mds ====== 23:18:15 (1722482295) PASS 26b (3s) SKIP: sanityn test_27 skipping excluded test 27 SKIP: sanityn test_28 skipping ALWAYS excluded test 28 == sanityn test 30: recreate file race =================== 23:18:19 (1722482299) 0 PASS 30 (3s) == sanityn test 31a: voluntary cancel / blocking ast race======================================================================== 23:18:22 (1722482302) fail_loc=0x314 PASS 31a (2s) == sanityn test 31b: voluntary OST cancel / blocking ast race======================================================================== 23:18:24 (1722482304) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg255-server mds-ost sync done. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete fail_loc=0x314 fail_loc=0x316 fail_loc=0 fail_loc=0 Filesystem 1K-blocks Used Available Use% Mounted on 192.168.202.155@tcp:/lustre 7542784 14336 7524352 1% /mnt/lustre2 PASS 31b (21s) == sanityn test 31r: open-rename(replace) race =========== 23:18:45 (1722482325) -rw-r--r-- 1 root root 0 Jul 31 23:18 /mnt/lustre/f31r.sanityn.target fail_loc=0x1419 fail_val=3 mv: failed to access '/mnt/lustre2/f31r.sanityn.target': Input/output error PASS 31r (4s) SKIP: sanityn test_33a skipping SLOW test 33a == sanityn test 33b: COS: cross create/delete, 2 clients, benchmark under remote dir ========================================================== 23:18:50 (1722482330) SKIP: sanityn test_33b Need two or more clients, have 1 SKIP 33b (0s) == sanityn test 33c: Cancel cross-MDT lock should trigger Sync-Lock-Cancel ========================================================== 23:18:50 (1722482330) SKIP: sanityn test_33c needs >= 2 MDTs SKIP 33c (1s) == sanityn test 33d: DNE distributed operation should trigger COS ========================================================== 23:18:51 (1722482331) SKIP: sanityn test_33d needs >= 2 MDTs SKIP 33d (1s) == sanityn test 33e: DNE local operation shouldn't trigger COS ========================================================== 23:18:52 (1722482332) SKIP: sanityn test_33e Need two or more clients, have 1 SKIP 33e (0s) == sanityn test 34: no lock timeout under IO ============= 23:18:52 (1722482332) fail_loc=0x512 fail_loc=0x512 lock should not expire writing on client1 reading on client2 success fail_loc=0x511 fail_loc=0x511 lock should expire writing on client1 reading on client2 success oleg255-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800b6ccc800.ost_server_uuid,osc.lustre-OST0000-osc-ffff88012da53000.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff8800b6ccc800.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0000-osc-ffff88012da53000.ost_server_uuid in FULL state after 0 sec oleg255-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800b6ccc800.ost_server_uuid,osc.lustre-OST0001-osc-ffff88012da53000.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff8800b6ccc800.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0001-osc-ffff88012da53000.ost_server_uuid in FULL state after 0 sec oleg255-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800b6ccc800.ost_server_uuid,osc.lustre-OST0000-osc-ffff88012da53000.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff8800b6ccc800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0000-osc-ffff88012da53000.ost_server_uuid in IDLE state after 0 sec oleg255-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800b6ccc800.ost_server_uuid,osc.lustre-OST0001-osc-ffff88012da53000.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff8800b6ccc800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0001-osc-ffff88012da53000.ost_server_uuid in FULL state after 0 sec oleg255-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800b6ccc800.ost_server_uuid,osc.lustre-OST0000-osc-ffff88012da53000.ost_server_uuid 40 osc.lustre-OST0000-osc-ffff8800b6ccc800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0000-osc-ffff88012da53000.ost_server_uuid in IDLE state after 0 sec oleg255-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800b6ccc800.ost_server_uuid,osc.lustre-OST0001-osc-ffff88012da53000.ost_server_uuid 40 osc.lustre-OST0001-osc-ffff8800b6ccc800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0001-osc-ffff88012da53000.ost_server_uuid in FULL state after 0 sec PASS 34 (71s) == sanityn test 35: -EINTR cp_ast vs. bl_ast race does not evict client ========================================================== 23:20:03 (1722482403) fail_loc=0x80000317 Race attempt 0 Wait for 15608 15747 for 60 sec... total: 4000 open/close in 7.36 seconds: 543.75 ops/second fail_loc=0x0 Filesystem Size Used Avail Use% Mounted on 192.168.202.155@tcp:/lustre 7.2G 14M 7.2G 1% /mnt/lustre 192.168.202.155@tcp:/lustre 7.2G 14M 7.2G 1% /mnt/lustre2 PASS 35 (63s) == sanityn test 36: handle ESTALE/open-unlink correctly == 23:21:06 (1722482466) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg255-server mds-ost sync done. Waiting for MDT destroys to complete 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.307507 s, 170 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6848 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(0) *** before(7524352) after_dd(7473152) after(7524352) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.270431 s, 194 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6848 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(1) *** before(7524352) after_dd(7473152) after(7524352) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.285236 s, 184 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6848 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(2) *** before(7524352) after_dd(7473152) after(7524352) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.284126 s, 185 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6848 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(3) *** before(7524352) after_dd(7473152) after(7524352) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.27519 s, 191 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6848 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(4) *** before(7524352) after_dd(7473152) after(7524352) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.268683 s, 195 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6848 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(5) *** before(7524352) after_dd(7473152) after(7524352) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.308479 s, 170 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6848 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(6) *** before(7524352) after_dd(7473152) after(7524352) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.260335 s, 201 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6848 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(7) *** before(7524352) after_dd(7473152) after(7524352) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.341351 s, 154 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6848 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(8) *** before(7524352) after_dd(7473152) after(7524352) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.296479 s, 177 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6848 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(9) *** before(7524352) after_dd(7473152) after(7524352) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.268287 s, 195 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6848 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(10) *** before(7524352) after_dd(7473152) after(7524352) PASS 36 (229s) == sanityn test 37: check i_size is not updated for directory on close (bug 18695) ======================================================================== 23:24:55 (1722482695) multiop /mnt/lustre/d37.sanityn vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.6848 total: 10000 create in 9.11 seconds: 1097.86 ops/second PASS 37 (12s) == sanityn test 39a: test from 11063 ============================================================================================ 23:25:07 (1722482707) repeat after cancel_lru_locks PASS 39a (1s) == sanityn test 39b: 11063 problem 1 ============================================================================================ 23:25:08 (1722482708) repeat after cancel_lru_locks PASS 39b (3s) == sanityn test 39c: check truncate mtime update ================================================================================ 23:25:11 (1722482711) repeat after cancel_lru_locks PASS 39c (2s) == sanityn test 39d: sync write should update mtime ====== 23:25:13 (1722482713) fail_loc=0x411 fail_loc=0 PASS 39d (1s) == sanityn test 40a: pdirops: create vs others ======================================================================== 23:25:14 (1722482714) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40a (7s) == sanityn test 40b: pdirops: open|create and others ======================================================================== 23:25:21 (1722482721) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40b (8s) == sanityn test 40c: pdirops: link and others ======================================================================== 23:25:29 (1722482729) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40c (7s) == sanityn test 40d: pdirops: unlink and others ======================================================================== 23:25:36 (1722482736) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40d (7s) == sanityn test 40e: pdirops: rename and others ======================================================================== 23:25:43 (1722482743) No conflict No conflict No conflict No conflict No conflict No conflict PASS 40e (7s) == sanityn test 41a: pdirops: create vs mkdir ======================================================================== 23:25:50 (1722482750) mkdir: cannot create directory '/mnt/lustre2/f41a.sanityn': File exists Conflict PASS 41a (4s) == sanityn test 41b: pdirops: create vs create ======================================================================== 23:25:54 (1722482754) open: File exists Conflict PASS 41b (4s) == sanityn test 41c: pdirops: create vs link ======================================================================== 23:25:58 (1722482758) link: cannot create link '/mnt/lustre2/f41c.sanityn' to '/mnt/lustre2/f41c.sanityn-2': File exists Conflict PASS 41c (4s) == sanityn test 41d: pdirops: create vs unlink ======================================================================== 23:26:02 (1722482762) Conflict PASS 41d (5s) == sanityn test 41e: pdirops: create and rename (tgt) ======================================================================== 23:26:07 (1722482767) Conflict PASS 41e (4s) == sanityn test 41f: pdirops: create and rename (src) ======================================================================== 23:26:11 (1722482771) Conflict PASS 41f (4s) == sanityn test 41g: pdirops: create vs getattr ======================================================================== 23:26:15 (1722482775) Conflict PASS 41g (5s) == sanityn test 41h: pdirops: create vs readdir ======================================================================== 23:26:20 (1722482780) Conflict PASS 41h (4s) == sanityn test 41i: reint_open: create vs create ======== 23:26:24 (1722482784) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 41i (686s) == sanityn test 42a: pdirops: mkdir vs mkdir ======================================================================== 23:37:50 (1722483470) mkdir: cannot create directory '/mnt/lustre2/f42a.sanityn': File exists Conflict PASS 42a (5s) == sanityn test 42b: pdirops: mkdir vs create ======================================================================== 23:37:55 (1722483475) open: File exists Conflict PASS 42b (5s) == sanityn test 42c: pdirops: mkdir vs link ======================================================================== 23:38:00 (1722483480) link: cannot create link '/mnt/lustre2/f42c.sanityn' to '/mnt/lustre2/f42c.sanityn-2': File exists Conflict PASS 42c (6s) == sanityn test 42d: pdirops: mkdir vs unlink ======================================================================== 23:38:06 (1722483486) Conflict PASS 42d (6s) == sanityn test 42e: pdirops: mkdir and rename (tgt) ======================================================================== 23:38:12 (1722483492) mv: cannot overwrite directory '/mnt/lustre2/f42e.sanityn' with non-directory Conflict PASS 42e (5s) == sanityn test 42f: pdirops: mkdir and rename (src) ======================================================================== 23:38:17 (1722483497) Conflict PASS 42f (6s) == sanityn test 42g: pdirops: mkdir vs getattr ======================================================================== 23:38:23 (1722483503) Conflict PASS 42g (5s) == sanityn test 42h: pdirops: mkdir vs readdir ======================================================================== 23:38:28 (1722483508) Conflict PASS 42h (5s) == sanityn test 43a: rmdir,mkdir doesn't return -EEXIST ======================================================================== 23:38:34 (1722483514) PASS 43a (16s) == sanityn test 43b: pdirops: unlink vs create ======================================================================== 23:38:50 (1722483530) Conflict PASS 43b (5s) == sanityn test 43c: pdirops: unlink vs link ======================================================================== 23:38:55 (1722483535) Conflict PASS 43c (6s) == sanityn test 43d: pdirops: unlink vs unlink ======================================================================== 23:39:01 (1722483541) rm: cannot remove '/mnt/lustre2/f43d.sanityn': No such file or directory Conflict PASS 43d (5s) == sanityn test 43e: pdirops: unlink and rename (tgt) ======================================================================== 23:39:06 (1722483546) Conflict PASS 43e (5s) == sanityn test 43f: pdirops: unlink and rename (src) ======================================================================== 23:39:11 (1722483551) mv: cannot stat '/mnt/lustre2/f43f.sanityn': No such file or directory Conflict PASS 43f (5s) == sanityn test 43g: pdirops: unlink vs getattr ======================================================================== 23:39:16 (1722483556) stat: cannot stat '/mnt/lustre2/f43g.sanityn': No such file or directory Conflict PASS 43g (5s) == sanityn test 43h: pdirops: unlink vs readdir ======================================================================== 23:39:21 (1722483561) Conflict PASS 43h (5s) == sanityn test 43i: pdirops: unlink vs remote mkdir ===== 23:39:26 (1722483566) SKIP: sanityn test_43i needs >= 2 MDTs SKIP 43i (1s) == sanityn test 43j: racy mkdir return EEXIST ======================================================================== 23:39:27 (1722483567) mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists PASS 43j (45s) == sanityn test 43k: unlink vs create ==================== 23:40:12 (1722483612) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 43k (469s) == sanityn test 44a: pdirops: rename tgt vs mkdir ======================================================================== 23:48:01 (1722484081) mkdir: cannot create directory '/mnt/lustre2/f44a.sanityn': File exists Conflict Wed Jul 31 23:48:04 EDT 2024 PASS 44a (5s) == sanityn test 44b: pdirops: rename tgt vs create ======================================================================== 23:48:06 (1722484086) open: File exists Conflict PASS 44b (5s) == sanityn test 44c: pdirops: rename tgt vs link ======================================================================== 23:48:12 (1722484092) link: cannot create link '/mnt/lustre2/f44c.sanityn' to '/mnt/lustre2/f44c.sanityn-3': File exists Conflict PASS 44c (6s) == sanityn test 44d: pdirops: rename tgt vs unlink ======================================================================== 23:48:17 (1722484097) Conflict PASS 44d (6s) == sanityn test 44e: pdirops: rename tgt and rename (tgt) ======================================================================== 23:48:23 (1722484103) Conflict PASS 44e (5s) == sanityn test 44f: pdirops: rename tgt and rename (src) ======================================================================== 23:48:28 (1722484108) Conflict PASS 44f (6s) == sanityn test 44g: pdirops: rename tgt vs getattr ======================================================================== 23:48:34 (1722484114) Conflict PASS 44g (5s) == sanityn test 44h: pdirops: rename tgt vs readdir ======================================================================== 23:48:39 (1722484119) Conflict PASS 44h (6s) == sanityn test 44i: pdirops: rename tgt vs remote mkdir ========================================================== 23:48:45 (1722484125) SKIP: sanityn test_44i needs >= 2 MDTs SKIP 44i (1s) == sanityn test 45a: rename,mkdir doesn't return -EEXIST ======================================================================== 23:48:46 (1722484126) PASS 45a (32s) == sanityn test 45b: pdirops: rename src vs create ======================================================================== 23:49:18 (1722484158) Conflict PASS 45b (6s) == sanityn test 45c: pdirops: rename src vs link ======================================================================== 23:49:24 (1722484164) Conflict PASS 45c (5s) == sanityn test 45d: pdirops: rename src vs unlink ======================================================================== 23:49:29 (1722484169) rm: cannot remove '/mnt/lustre2/f45d.sanityn': No such file or directory Conflict PASS 45d (6s) == sanityn test 45e: pdirops: rename src and rename (tgt) ======================================================================== 23:49:35 (1722484175) Conflict PASS 45e (5s) == sanityn test 45f: pdirops: rename src and rename (src) ======================================================================== 23:49:40 (1722484180) mv: cannot stat '/mnt/lustre2/f45f.sanityn': No such file or directory Conflict PASS 45f (5s) == sanityn test 45g: pdirops: rename src vs getattr ======================================================================== 23:49:46 (1722484186) stat: cannot stat '/mnt/lustre2/f45g.sanityn': No such file or directory Conflict PASS 45g (6s) == sanityn test 45h: pdirops: unlink vs readdir ======================================================================== 23:49:51 (1722484191) Conflict PASS 45h (5s) == sanityn test 45i: pdirops: rename src vs remote mkdir ========================================================== 23:49:56 (1722484196) SKIP: sanityn test_45i needs >= 2 MDTs SKIP 45i (1s) == sanityn test 45j: read vs rename ====================== 23:49:57 (1722484197) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 45j (452s) == sanityn test 46a: pdirops: link vs mkdir ======================================================================== 23:57:29 (1722484649) mkdir: cannot create directory '/mnt/lustre2/f46a.sanityn': File exists Conflict PASS 46a (6s) == sanityn test 46b: pdirops: link vs create ======================================================================== 23:57:35 (1722484655) open: File exists Conflict PASS 46b (5s) == sanityn test 46c: pdirops: link vs link ======================================================================== 23:57:41 (1722484661) link: cannot create link '/mnt/lustre2/f46c.sanityn' to '/mnt/lustre2/f46c.sanityn': File exists Conflict PASS 46c (5s) == sanityn test 46d: pdirops: link vs unlink ======================================================================== 23:57:46 (1722484666) Conflict PASS 46d (5s) == sanityn test 46e: pdirops: link and rename (tgt) ======================================================================== 23:57:51 (1722484671) Conflict PASS 46e (6s) == sanityn test 46f: pdirops: link and rename (src) ======================================================================== 23:57:57 (1722484677) Conflict PASS 46f (5s) == sanityn test 46g: pdirops: link vs getattr ======================================================================== 23:58:02 (1722484682) Conflict PASS 46g (6s) == sanityn test 46h: pdirops: link vs readdir ======================================================================== 23:58:08 (1722484688) Conflict PASS 46h (5s) == sanityn test 46i: pdirops: link vs remote mkdir ======= 23:58:13 (1722484693) SKIP: sanityn test_46i needs >= 2 MDTs SKIP 46i (2s) == sanityn test 47a: pdirops: remote mkdir vs mkdir ====== 23:58:15 (1722484695) SKIP: sanityn test_47a needs >= 2 MDTs SKIP 47a (1s) == sanityn test 47b: pdirops: remote mkdir vs create ===== 23:58:16 (1722484696) SKIP: sanityn test_47b needs >= 2 MDTs SKIP 47b (1s) == sanityn test 47c: pdirops: remote mkdir vs link ======= 23:58:17 (1722484697) SKIP: sanityn test_47c needs >= 2 MDTs SKIP 47c (1s) == sanityn test 47d: pdirops: remote mkdir vs unlink ===== 23:58:18 (1722484698) SKIP: sanityn test_47d needs >= 2 MDTs SKIP 47d (1s) == sanityn test 47e: pdirops: remote mkdir and rename (tgt) ========================================================== 23:58:19 (1722484699) SKIP: sanityn test_47e needs >= 2 MDTs SKIP 47e (1s) == sanityn test 47f: pdirops: remote mkdir and rename (src) ========================================================== 23:58:21 (1722484701) SKIP: sanityn test_47f needs >= 2 MDTs SKIP 47f (1s) == sanityn test 47g: pdirops: remote mkdir vs getattr ==== 23:58:22 (1722484702) SKIP: sanityn test_47g needs >= 2 MDTs SKIP 47g (1s) == sanityn test 50: osc lvb attrs: enqueue vs. CP AST ======================================================================== 23:58:23 (1722484703) 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.00764864 s, 1.3 MB/s fail_loc=0x410 fail_loc=0x0 PASS 50 (7s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 23:58:30 (1722484710) 0+1 records in 0+1 records out 159 bytes (159 B) copied, 0.00659173 s, 24.1 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3175: kill: (24847) - No such process PASS 51a (4s) == sanityn test 51b: layout lock: glimpse should be able to restart if layout changed ========================================================== 23:58:34 (1722484714) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00430893 s, 238 kB/s fail_loc=0x1404 fail_val=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0219781 s, 47.7 MB/s 3145728 PASS 51b (15s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 23:58:49 (1722484729) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00689571 s, 148 kB/s PASS 51c (7s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 23:58:56 (1722484736) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.020815 s, 50.4 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (3s) == sanityn test 51e: lfs getstripe does not break leases, part 2 ========================================================== 23:58:59 (1722484739) /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2432 0x980 0 write lease(2) has applied. /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2432 0x980 0 read lease(1) has applied. PASS 51e (4s) == sanityn test 54: rename locking ======================= 23:59:03 (1722484743) llite.lustre-ffff8800b6ccc800.xattr_cache=1 llite.lustre-ffff88012da53000.xattr_cache=1 ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504963 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-07-31 23:59:04.000000000 -0400 Modify: 2024-07-31 23:59:04.000000000 -0400 Change: 2024-07-31 23:59:04.000000000 -0400 Birth: - ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000154 File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504966 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-07-31 23:59:10.000000000 -0400 Modify: 2024-07-31 23:59:10.000000000 -0400 Change: 2024-07-31 23:59:10.000000000 -0400 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 512 Blocks: 1 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504969 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-07-31 23:59:15.000000000 -0400 Modify: 2024-07-31 23:59:15.000000000 -0400 Change: 2024-07-31 23:59:15.000000000 -0400 Birth: - open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504968 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-07-31 23:59:15.000000000 -0400 Modify: 2024-07-31 23:59:15.000000000 -0400 Change: 2024-07-31 23:59:15.000000000 -0400 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000154 open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504971 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-07-31 23:59:21.000000000 -0400 Modify: 2024-07-31 23:59:21.000000000 -0400 Change: 2024-07-31 23:59:21.000000000 -0400 Birth: - File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272504972 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-07-31 23:59:21.000000000 -0400 Modify: 2024-07-31 23:59:21.000000000 -0400 Change: 2024-07-31 23:59:21.000000000 -0400 Birth: - PASS 54 (25s) == sanityn test 55a: rename vs unlink target dir ========= 23:59:28 (1722484768) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55a.sanityn/d1/d2' to '/mnt/lustre/d55a.sanityn/d3/d2': No such file or directory PASS 55a (8s) == sanityn test 55b: rename vs unlink source dir ========= 23:59:36 (1722484776) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55b.sanityn/d1/d2' to '/mnt/lustre/d55b.sanityn/d3/d2': No such file or directory PASS 55b (7s) == sanityn test 55c: rename vs unlink orphan target dir == 23:59:43 (1722484783) fail_loc=0x156 mv: cannot move '/mnt/lustre/d55c.sanityn/d1/d2' to '/mnt/lustre/d55c.sanityn/d3/d2': No such file or directory PASS 55c (13s) == sanityn test 55d: rename file vs link ================= 23:59:56 (1722484796) fail_loc=0x155 mv: cannot move '/mnt/lustre/d55d.sanityn/f1' to '/mnt/lustre/d55d.sanityn/d55d.sanityn': Is a directory PASS 55d (10s) == sanityn test 60: Verify data_version behaviour ======== 00:00:06 (1722484806) PASS 60 (2s) == sanityn test 70a: cd directory && rm directory ======== 00:00:08 (1722484808) PASS 70a (2s) == sanityn test 70b: remove files after calling rm_entry ========================================================== 00:00:10 (1722484810) PASS 70b (2s) == sanityn test 71a: correct file map just after write operation is finished ========================================================== 00:00:12 (1722484812) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00415108 s, 15.8 MB/s SKIP: sanityn test_71a ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71a (1s) == sanityn test 71b: check fiemap support for stripecount > 1 ========================================================== 00:00:13 (1722484813) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00613083 s, 10.7 MB/s SKIP: sanityn test_71b ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71b (1s) == sanityn test 71c: check FIEMAP_EXTENT_LAST flag with different extents number ========================================================== 00:00:14 (1722484814) SKIP: sanityn test_71c support only ldiskfs ost SKIP 71c (2s) == sanityn test 71d: fiemap corruption test with fm_extent_count=0 ========================================================== 00:00:16 (1722484816) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.0071585 s, 9.2 MB/s SKIP: sanityn test_71d ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71d (1s) == sanityn test 72: getxattr/setxattr cache should be consistent between nodes ========================================================== 00:00:17 (1722484817) llite.lustre-ffff8800b6ccc800.xattr_cache=1 llite.lustre-ffff88012da53000.xattr_cache=1 getfattr: Removing leading '/' from absolute path names user.attr1="value1" getfattr: Removing leading '/' from absolute path names user.attr1="value2" getfattr: Removing leading '/' from absolute path names getfattr: Removing leading '/' from absolute path names b362740ad371eae580e7f85452e8830b - 870e072da1ebfc20ea8c0cd3d6bdf3b6 - PASS 72 (2s) == sanityn test 73: getxattr should not cause xattr lock cancellation ========================================================== 00:00:19 (1722484819) llite.lustre-ffff8800b6ccc800.xattr_cache=1 llite.lustre-ffff88012da53000.xattr_cache=1 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" PASS 73 (2s) == sanityn test 74: flock deadlock: different mounts ======================================================================== 00:00:22 (1722484822) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00460739 s, 222 kB/s 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00374096 s, 274 kB/s 3500: get lock2 3501: get lock1 3500: done 3500: get lock1 3501: done 3501: get lock2 fcntl cmd 7 failed: Resource deadlock avoided 3501: cannot get lock2: Resource deadlock avoided 3501: exit rc=0 fcntl cmd 7 failed: Resource deadlock avoided 3500: cannot get lock1: Resource deadlock avoided 3500: done 3500: exit rc=0 PASS 74 (7s) == sanityn test 75: osc: upcall after unuse lock============================================================================= 00:00:28 (1722484828) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0211128 s, 99.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124025 s, 84.5 MB/s fail_loc=0x31d /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3743: 4135 Killed stat -c %s $DIR1/$tfile fail_loc=0 PASS 75 (7s) == sanityn test 76: Verify MDT open_files listing ======== 00:00:35 (1722484835) opening files: ........ closing files: ........ PASS 76 (20s) == sanityn test 77a: check FIFO NRS policy =============== 00:00:55 (1722484855) ost.OSS.ost.nrs_policies=fifo ost.OSS.ost_create.nrs_policies=fifo ost.OSS.ost_io.nrs_policies=fifo ost.OSS.ost_out.nrs_policies=fifo ost.OSS.ost_seq.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.113889 s, 147 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00763345 s, 137 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112109 s, 93.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138845 s, 75.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142984 s, 73.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101406 s, 103 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0263514 s, 39.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0275284 s, 38.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0220157 s, 47.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0171105 s, 61.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0183783 s, 57.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0225473 s, 46.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103657 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0169553 s, 61.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0257731 s, 40.7 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6ccc800.lock_unused_count=4 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6ccc800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0227097 s, 46.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0235 s, 44.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00698188 s, 150 MB/s 1048576 bytes (1.0 MB) copied, 0.00173737 s, 604 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00979001 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0082183 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115884 s, 90.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00970565 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00968172 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00963842 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109914 s, 95.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117674 s, 89.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110365 s, 95.0 MB/s 1048576 bytes (1.0 MB) copied, 0.011554 s, 90.8 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6ccc800.lock_unused_count=2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111996 s, 93.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106521 s, 98.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104328 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116121 s, 90.3 MB/s removed '/mnt/lustre/d77a.sanityn/nrs_w_oleg255-client.virtnet' removed '/mnt/lustre/d77a.sanityn/nrs_r_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77a.sanityn' PASS 77a (3s) == sanityn test 77b: check CRR-N NRS policy ============== 00:00:58 (1722484858) ost.OSS.ost.nrs_policies=crrn ost.OSS.ost_create.nrs_policies=crrn ost.OSS.ost_io.nrs_policies=crrn ost.OSS.ost_out.nrs_policies=crrn ost.OSS.ost_seq.nrs_policies=crrn ost.OSS.ost.nrs_crrn_quantum=1 ost.OSS.ost_create.nrs_crrn_quantum=1 ost.OSS.ost_io.nrs_crrn_quantum=1 ost.OSS.ost_out.nrs_crrn_quantum=1 ost.OSS.ost_seq.nrs_crrn_quantum=1 policy: crr-n, crrn_quantum 1 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.130937 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100443 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01557 s, 67.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00856204 s, 122 MB/s , 0.018111 s, 57.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00992751 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0368878 s, 28.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0164305 s, 63.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187126 s, 56.0 MB/s , 0.0341586 s, 30.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0236388 s, 44.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0359157 s, 29.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0307853 s, 34.1 MB/s , 0.00743422 s, 141 MB/s 1048576 bytes (1.0 MB) copied, 0.0290538 s, 36.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.040814 s, 25.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0308143 s, 34.0 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6ccc800.lock_unused_count=7 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6ccc800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00705481 s, 149 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00844362 s, 124 MB/s 1048576 bytes (1.0 MB) copied, 0.00683475 s, 153 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00614617 s, 171 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00890357 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00849674 s, 123 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00776522 s, 135 MB/s 1048576 bytes (1.0 MB) copied, 0.00752323 s, 139 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011773 s, 89.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117903 s, 88.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00939907 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00826502 s, 127 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00843212 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00882198 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108695 s, 96.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copiedldlm.namespaces.lustre-OST0001-osc-ffff8800b6ccc800.lock_unused_count=2 , 0.0084983 s, 123 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg255-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost.nrs_crrn_quantum=64 ost.OSS.ost_create.nrs_crrn_quantum=64 ost.OSS.ost_io.nrs_crrn_quantum=64 ost.OSS.ost_out.nrs_crrn_quantum=64 ost.OSS.ost_seq.nrs_crrn_quantum=64 policy: crr-n, crrn_quantum 64 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.141587 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01139 s, 92.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0153325 s, 68.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.021837 s, 48.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0304703 s, 34.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0443868 s, 23.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0414397 s, 25.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.03979 s, 26.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0418731 s, 25.0 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0479249 s, 21.9 MB/s 1048576 bytes (1.0 MB) copied, 0.047383 s, 22.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0434042 s, 24.2 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6ccc800.lock_unused_count=3 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0345578 s, 30.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0387658 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0350777 s, 29.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0424476 s, 24.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0505977 s, 20.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00969641 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00979916 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113363 s, 92.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00952259 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00132201 s, 793 MB/s 1048576 bytes (1.0 MB) copied, 0.00281958 s, 372 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00985583 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00323222 s, 324 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010526 s, 99.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103578 s, 101 MB/s , 0.0103772 s, 101 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6ccc800.lock_unused_count=6 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00285173 s, 368 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010792 s, 97.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113352 s, 92.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107621 s, 97.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109674 s, 95.6 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg255-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77b (4s) == sanityn test 77c: check ORR NRS policy ================ 00:01:02 (1722484862) ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_orr_quantum=1 ost.OSS.ost_io.nrs_orr_offset_type=physical ost.OSS.ost_io.nrs_orr_supported=reads policy: orr, orr_quantum 1, orr_offset_type physical, orr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.177862 s, 94.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112348 s, 93.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0227867 s, 46.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00905848 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.021956 s, 47.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0225072 s, 46.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121281 s, 86.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0324144 s, 32.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0293431 s, 35.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0370685 s, 28.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0363679 s, 28.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0375605 s, 27.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0354008 s, 29.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0246051 s, 42.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.029229 s, 35.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.032821 s, 31.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0202496 s, 51.8 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6ccc800.lock_unused_count=6 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6ccc800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00769069 s, 136 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00612104 s, 171 MB/s 1048576 bytes (1.0 MB) copied, 0.0093815 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00820193 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00902037 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110314 s, 95.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120208 s, 87.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143128 s, 73.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151654 s, 69.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0134176 s, 78.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151737 s, 69.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0172301 s, 60.9 MB/s , 0.0175676 s, 59.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0174928 s, 59.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0164426 s, 63.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.016112 s, 65.1 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6ccc800.lock_unused_count=2 removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg255-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=writes ost.OSS.ost_io.nrs_orr_quantum=64 policy: orr, orr_quantum 64, orr_offset_type physical, orr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.149657 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129081 s, 81.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0284081 s, 36.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0265044 s, 39.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0313073 s, 33.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.023827 s, 44.0 MB/s 1048576 bytes (1.0 MB) copied, 0.026683 s, 39.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0269337 s, 38.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0189109 s, 55.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0162612 s, 64.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0287675 s, 36.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00771786 s, 136 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6ccc800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0434613 s, 24.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0422356 s, 24.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0335448 s, 31.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0615635 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0399204 s, 26.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0130538 s, 80.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104402 s, 100 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133296 s, 78.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0138635 s, 75.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0170816 s, 61.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0173476 s, 60.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135303 s, 77.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0125805 s, 83.3 MB/s , 0.0140018 s, 74.9 MB/s , 0.0140602 s, 74.6 MB/s , 0.012902 s, 81.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0134297 s, 78.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152327 s, 68.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144079 s, 72.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155116 s, 67.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0157517 s, 66.6 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6ccc800.lock_unused_count=3 removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg255-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=reads_and_writes ost.OSS.ost_io.nrs_orr_offset_type=logical policy: orr, orr_quantum 64, orr_offset_type logical, orr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.146305 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206366 s, 50.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0216989 s, 48.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0305284 s, 34.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0263265 s, 39.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0305906 s, 34.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.037375 s, 28.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0272751 s, 38.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.041434 s, 25.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0345134 s, 30.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0274841 s, 38.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0211221 s, 49.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0259704 s, 40.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0309465 s, 33.9 MB/s , 0.0366629 s, 28.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0250049 s, 41.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0230786 s, 45.4 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6ccc800.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6ccc800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00765361 s, 137 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00185713 s, 565 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00710335 s, 148 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00960858 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105257 s, 99.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00891885 s, 118 MB/s , 0.00375277 s, 279 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113104 s, 92.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00960601 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00956875 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00246791 s, 425 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00763612 s, 137 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100323 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0011841 s, 886 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104562 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119747 s, 87.6 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6ccc800.lock_unused_count=1 removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg255-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77c (5s) == sanityn test 77d: check TRR nrs policy ================ 00:01:08 (1722484868) ost.OSS.ost_io.nrs_policies=trr ost.OSS.ost_io.nrs_trr_quantum=1 ost.OSS.ost_io.nrs_trr_offset_type=physical ost.OSS.ost_io.nrs_trr_supported=reads policy: trr, trr_quantum 1, trr_offset_type physical, trr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.216263 s, 77.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107756 s, 97.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0163203 s, 64.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0246135 s, 42.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0370234 s, 28.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0301061 s, 34.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0480358 s, 21.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0310128 s, 33.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0493071 s, 21.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0466525 s, 22.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0500353 s, 21.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0491925 s, 21.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0553901 s, 18.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.044876 s, 23.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.053537 s, 19.6 MB/s , 0.0594396 s, 17.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0521112 s, 20.1 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6ccc800.lock_unused_count=7 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6ccc800.lock_unused_count=7 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00741193 s, 141 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00681109 s, 154 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00908228 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00829491 s, 126 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00371222 s, 282 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00873478 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00948191 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00948092 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00270267 s, 388 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00130936 s, 801 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00973098 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00949892 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00966706 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00237206 s, 442 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110551 s, 94.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121622 s, 86.2 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6ccc800.lock_unused_count=1 removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg255-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=writes ost.OSS.ost_io.nrs_trr_quantum=64 policy: trr, trr_quantum 64, trr_offset_type physical, trr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.117089 s, 143 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00888764 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122487 s, 85.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012038 s, 87.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0246333 s, 42.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0272411 s, 38.5 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6ccc800.lock_unused_count=2 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0235025 s, 44.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0290404 s, 36.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0320551 s, 32.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0353069 s, 29.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0317415 s, 33.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0434752 s, 24.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0367227 s, 28.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0471769 s, 22.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.048685 s, 21.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0500502 s, 21.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0402129 s, 26.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00892556 s, 117 MB/s 1048576 bytes (1.0 MB) copied, 0.00627281 s, 167 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00547186 s, 192 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00569949 s, 184 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00649743 s, 161 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00679586 s, 154 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00674433 s, 155 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0047866 s, 219 MB/s , 0.00750698 s, 140 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00754932 s, 139 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00874815 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00796041 s, 132 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00726079 s, 144 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00831256 s, 126 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00865124 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00882999 s, 119 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg255-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=reads_and_writes ost.OSS.ost_io.nrs_trr_offset_type=logical policy: trr, trr_quantum 64, trr_offset_type logical, trr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.114149 s, 147 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00633424 s, 166 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00975987 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108975 s, 96.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0161808 s, 64.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125499 s, 83.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0220934 s, 47.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148455 s, 70.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0201985 s, 51.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0168983 s, 62.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0170316 s, 61.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0170379 s, 61.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0186172 s, 56.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00980276 s, 107 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00632308 s, 166 MB/s 1048576 bytes (1.0 MB) copied, 0.0230493 s, 45.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0202217 s, 51.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00586716 s, 179 MB/s 1048576 bytes (1.0 MB) copied, 0.00679578 s, 154 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00520982 s, 201 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00562567 s, 186 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00380694 s, 275 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00124376 s, 843 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00602667 s, 174 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0062833 s, 167 MB/s 1048576 bytes (1.0 MB) copied, 0.00649785 s, 161 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00700234 s, 150 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00737125 s, 142 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00780444 s, 134 MB/s , 0.0078473 s, 134 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00861135 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00928482 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00938962 s, 112 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg255-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77d (4s) == sanityn test 77e: check TBF NID nrs policy ============ 00:01:12 (1722484872) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_tbf_rule=start localhost nid={0@lo} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start clients nid={192.168.202.55@tcp} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start others nid={*.*.*.*@tcp} rate=50 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.209038 s, 80.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133092 s, 78.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0176815 s, 59.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0246411 s, 42.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115962 s, 90.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0348433 s, 30.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0320831 s, 32.7 MB/s 1048576 bytes (1.0 MB) copied, 0.038053 s, 27.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0295488 s, 35.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0351061 s, 29.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0258898 s, 40.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0199838 s, 52.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0209056 s, 50.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0342989 s, 30.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0243153 s, 43.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0301401 s, 34.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0215567 s, 48.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112087 s, 93.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0137412 s, 76.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0178158 s, 58.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114174 s, 91.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0122953 s, 85.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0128329 s, 81.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144038 s, 72.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0145644 s, 72.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0158392 s, 66.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0161169 s, 65.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0166831 s, 62.9 MB/s , 0.0168207 s, 62.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015774 s, 66.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.017126 s, 61.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0200869 s, 52.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0176559 s, 59.4 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg255-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change localhost rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change clients rate=101 ost.OSS.ost_io.nrs_tbf_rule=change others rate=51 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.129696 s, 129 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.013808 s, 75.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0166388 s, 63.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015067 s, 69.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.034168 s, 30.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0436343 s, 24.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0376318 s, 27.9 MB/s 1048576 bytes (1.0 MB) copied, 0.053485 s, 19.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.048732 s, 21.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0463808 s, 22.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0578508 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0445024 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0568615 s, 18.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0518671 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0499839 s, 21.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0630976 s, 16.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0474038 s, 22.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115356 s, 90.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116434 s, 90.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122755 s, 85.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152196 s, 68.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0139206 s, 75.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01833 s, 57.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.014296 s, 73.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138737 s, 75.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.016037 s, 65.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138014 s, 76.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00232732 s, 451 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0165637 s, 63.3 MB/s , 0.0163999 s, 63.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0165329 s, 63.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0176923 s, 59.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0194194 s, 54.0 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg255-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop localhost ost.OSS.ost_io.nrs_tbf_rule=stop clients ost.OSS.ost_io.nrs_tbf_rule=stop others 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.126235 s, 133 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131476 s, 79.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0132731 s, 79.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0199796 s, 52.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.020959 s, 50.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0252998 s, 41.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0242255 s, 43.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124653 s, 84.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0179645 s, 58.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0174302 s, 60.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0299241 s, 35.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0252007 s, 41.6 MB/s , 0.0224482 s, 46.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0235554 s, 44.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148434 s, 70.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155553 s, 67.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0207886 s, 50.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00748426 s, 140 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00666604 s, 157 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00530616 s, 198 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00482364 s, 217 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00949358 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00884164 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102653 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00646902 s, 162 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00944304 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00912083 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00776183 s, 135 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00109956 s, 954 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00768707 s, 136 MB/s , 0.00880657 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00916881 s, 114 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6ccc800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00901385 s, 116 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg255-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.124537 s, 135 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123378 s, 85.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0210198 s, 49.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0244147 s, 42.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.029471 s, 35.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0139364 s, 75.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0263453 s, 39.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0215 s, 48.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0389729 s, 26.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0339524 s, 30.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0254083 s, 41.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0398696 s, 26.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0382006 s, 27.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0341305 s, 30.7 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6ccc800.lock_unused_count=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0236373 s, 44.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0303701 s, 34.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0405178 s, 25.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00873881 s, 120 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00829413 s, 126 MB/s , 0.00338735 s, 310 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00946398 s, 111 MB/s 1048576 bytes (1.0 MB) copied, 0.0083681 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00127556 s, 822 MB/s 1048576 bytes (1.0 MB) copied, 0.00920992 s, 114 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00929992 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00420005 s, 250 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00147154 s, 713 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00128237 s, 818 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138485 s, 75.7 MB/s 1048576 bytes (1.0 MB) copied, 0.00225472 s, 465 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011558 s, 90.7 MB/s 1048576 bytes (1.0 MB) copied, 0.00542015 s, 193 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00122925 s, 853 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6ccc800.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6ccc800.lock_unused_count=2 removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg255-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' PASS 77e (9s) == sanityn test 77f: check TBF JobID nrs policy ========== 00:01:21 (1722484881) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start runas jobid={iozone.500 dd.500 tiotest.500} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start iozone_runas jobid={iozone.500} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg255-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.147759 s, 114 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00907577 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012396 s, 84.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.018808 s, 55.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155334 s, 67.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141058 s, 74.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0236398 s, 44.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120084 s, 87.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011133 s, 94.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00992274 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0177494 s, 59.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0375984 s, 27.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212227 s, 49.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0353451 s, 29.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0434699 s, 24.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0352174 s, 29.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0272957 s, 38.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128817 s, 81.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113866 s, 92.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119703 s, 87.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131022 s, 80.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0171007 s, 61.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0197474 s, 53.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0154281 s, 68.0 MB/s , 0.0169469 s, 61.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00361526 s, 290 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0176066 s, 59.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160159 s, 65.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0154974 s, 67.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0167886 s, 62.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0178738 s, 58.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0167647 s, 62.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0180101 s, 58.2 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg255-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change runas rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change iozone_runas rate=101 ost.OSS.ost_io.nrs_tbf_rule=change dd_runas rate=51 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg255-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.172408 s, 97.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0229657 s, 45.7 MB/s , 0.0105101 s, 99.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0269483 s, 38.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120963 s, 86.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206346 s, 50.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0264069 s, 39.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0163674 s, 64.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106086 s, 98.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0264334 s, 39.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0485948 s, 21.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0506623 s, 20.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0555476 s, 18.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0665256 s, 15.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0633369 s, 16.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.052891 s, 19.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0506365 s, 20.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116356 s, 90.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0140862 s, 74.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124691 s, 84.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00505014 s, 208 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125575 s, 83.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141081 s, 74.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0134322 s, 78.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187707 s, 55.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141125 s, 74.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01334 s, 78.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0139075 s, 75.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0172782 s, 60.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135142 s, 77.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138657 s, 75.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0149893 s, 70.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0167082 s, 62.8 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg255-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop runas ost.OSS.ost_io.nrs_tbf_rule=stop iozone_runas ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg255-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.170421 s, 98.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.03024 s, 34.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0345022 s, 30.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0227882 s, 46.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0424903 s, 24.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.031858 s, 32.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0295161 s, 35.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0227335 s, 46.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0295275 s, 35.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0496667 s, 21.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0423217 s, 24.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0494184 s, 21.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0427491 s, 24.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0403967 s, 26.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0366843 s, 28.6 MB/s 1048576 bytes (1.0 MB) copied, 0.022485 s, 46.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0324753 s, 32.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00532327 s, 197 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00626518 s, 167 MB/s , 0.0103339 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00143426 s, 731 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103527 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00154552 s, 678 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0089235 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0014295 s, 734 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100623 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00979406 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00119047 s, 881 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010412 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0097217 s, 108 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800b6ccc800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00140062 s, 749 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117584 s, 89.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00573529 s, 183 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg255-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_policies=fifo running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg255-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.14931 s, 112 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138404 s, 75.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0229467 s, 45.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0253895 s, 41.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010767 s, 97.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0250404 s, 41.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0315034 s, 33.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0194942 s, 53.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0166992 s, 62.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0264419 s, 39.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0328785 s, 31.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0230966 s, 45.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0262366 s, 40.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0344323 s, 30.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0395889 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0239644 s, 43.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.035729 s, 29.3 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6ccc800.lock_unused_count=1 ldlm.namespaces.lustre-OST0001-osc-ffff8800b6ccc800.lock_unused_count=1 running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.010046 s, 104 MB/s 1048576 bytes (1.0 MB) copied, 0.00721921 s, 145 MB/s , 0.00589143 s, 178 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105838 s, 99.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00657668 s, 159 MB/s 1048576 bytes (1.0 MB) copied, 0.00658788 s, 159 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00468672 s, 224 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00421316 s, 249 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126374 s, 83.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00992971 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00930096 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00874715 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00922232 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010116 s, 104 MB/s 1+0 records in 1+0 records out ldlm.namespaces.lustre-OST0001-osc-ffff8800b6ccc800.lock_unused_count=3 1048576 bytes (1.0 MB) copied, 0.0101678 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010042 s, 104 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg255-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' PASS 77f (7s) == sanityn test 77g: Change TBF type directly ============ 00:01:28 (1722484888) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 ost.OSS.ost_io.nrs_policies=fifo PASS 77g (4s) == sanityn test 77h: Wrong policy name should report error, not LBUG ========================================================== 00:01:32 (1722484892) oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=abc: No such file or directory pdsh@oleg255-client: oleg255-server: ssh exited with exit code 2 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc: Unknown error 524 pdsh@oleg255-client: oleg255-server: ssh exited with exit code 12 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf reg abc: Unknown error 524 pdsh@oleg255-client: oleg255-server: ssh exited with exit code 12 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc efg: Unknown error 524 pdsh@oleg255-client: oleg255-server: ssh exited with exit code 12 PASS 77h (4s) == sanityn test 77i: Change rank of TBF rule ============= 00:01:36 (1722484896) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start before jobid={jobid} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start after jobid={jobid} rate=1000 rank=default ost.OSS.ost_io.nrs_tbf_rule=start target jobid={jobid} rate=1000 rank=after Move before itself ost.OSS.ost_io.nrs_tbf_rule=change target rank=target Move to higher rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=before Move to lower rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=after Move before default ost.OSS.ost_io.nrs_tbf_rule=change target rank=default ost.OSS.ost_io.nrs_policies=fifo PASS 77i (8s) == sanityn test 77j: check TBF-OPCode NRS policy ========= 00:01:44 (1722484904) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf opcode ost.OSS.ost_io.nrs_tbf_rule=start ost_r opcode={ost_read} rate=5 ost.OSS.ost_io.nrs_tbf_rule=start ost_w opcode={ost_write} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.109851 s, 153 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010345 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126475 s, 82.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0338909 s, 30.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0353525 s, 29.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0404214 s, 25.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0445008 s, 23.6 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0446031 s, 23.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0400551 s, 26.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0387661 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0396024 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.03489 s, 30.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0467325 s, 22.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0387898 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0385833 s, 27.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0378757 s, 27.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0444955 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103276 s, 102 MB/s 1+0 records in 1+0 records out , 0.0101635 s, 103 MB/s 1048576 bytes (1.0 MB) copied, 0.0125359 s, 83.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.014807 s, 70.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0149113 s, 70.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0179053 s, 58.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144979 s, 72.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00644004 s, 163 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0149009 s, 70.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01359 s, 77.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0140223 s, 74.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015489 s, 67.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151237 s, 69.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143411 s, 73.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0139876 s, 75.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01973 s, 53.1 MB/s removed '/mnt/lustre/d77j.sanityn/nrs_w_oleg255-client.virtnet' removed '/mnt/lustre/d77j.sanityn/nrs_r_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77j.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 5 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.97586 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.4408 s, 5.4 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77j.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_r ost.OSS.ost_io.nrs_tbf_rule=stop ost_w ost.OSS.ost_io.nrs_policies=fifo PASS 77j (54s) == sanityn test 77ja: check TBF-UID/GID NRS policy ======= 00:02:38 (1722484958) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg255-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.667985 s, 25.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.146167 s, 7.2 MB/s , 0.148978 s, 7.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.17751 s, 5.9 MB/s , 0.16109 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.162747 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.172052 s, 6.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.190919 s, 5.5 MB/s , 0.165134 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.350636 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.362357 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.380587 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.361511 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.385395 s, 2.7 MB/s 1048576 bytes (1.0 MB) copied, 0.387706 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.399444 s, 2.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.398933 s, 2.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.133496 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.129807 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.132163 s, 7.9 MB/s 1048576 bytes (1.0 MB) copied, 0.128739 s, 8.1 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.130955 s, 8.0 MB/s 1048576 bytes (1.0 MB) copied, 0.130907 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.131734 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.132366 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.131176 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.131918 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.132226 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.134377 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.132585 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.134415 s, 7.8 MB/s , 0.133021 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.137428 s, 7.6 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg255-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.7265 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9327 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg255-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.666166 s, 25.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.148238 s, 7.1 MB/s , 0.150988 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.149844 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.149307 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.175375 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.160055 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.150906 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.167263 s, 6.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.350113 s, 3.0 MB/s , 0.347917 s, 3.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.374156 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.385646 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.38845 s, 2.7 MB/s , 0.381058 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.384333 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.409831 s, 2.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.133739 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.132093 s, 7.9 MB/s , 0.12772 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.132875 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.131198 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130886 s, 8.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.132193 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.131946 s, 7.9 MB/s 1048576 bytes (1.0 MB) copied, 0.133611 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.132433 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.133952 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.135308 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.135459 s, 7.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.138537 s, 7.6 MB/s , 0.137893 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.141817 s, 7.4 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg255-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.7119 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9303 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77ja (134s) == sanityn test 77k: check TBF policy with NID/JobID/OPCode expression ========================================================== 00:04:52 (1722485092) ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_tbf_rule=start ext_w jobid={dd.500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r jobid={dd.500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg255-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.220359 s, 76.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0197886 s, 53.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0214808 s, 48.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156856 s, 66.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107808 s, 97.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0303322 s, 34.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160008 s, 65.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0265608 s, 39.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0292454 s, 35.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0618582 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0888002 s, 11.8 MB/s , 0.0768174 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0941079 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0755863 s, 13.9 MB/s , 0.104268 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102593 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0904121 s, 11.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156917 s, 66.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112149 s, 93.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121396 s, 86.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0124196 s, 84.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160734 s, 65.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0154661 s, 67.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146725 s, 71.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0137336 s, 76.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0082911 s, 126 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012353 s, 84.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136783 s, 76.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.018828 s, 55.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0163736 s, 64.0 MB/s , 0.0158161 s, 66.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015215 s, 68.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0194034 s, 54.0 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg255-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.97445 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.74377 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext_w nid={0@lo 192.168.202.55@tcp}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r nid={0@lo 192.168.202.55@tcp}&opcode={ost_read} rate=10 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.173689 s, 96.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135246 s, 77.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0337362 s, 31.1 MB/s , 0.015983 s, 65.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0241501 s, 43.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0207645 s, 50.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.035747 s, 29.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0395767 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0373923 s, 28.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0269609 s, 38.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109576 s, 95.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.121999 s, 8.6 MB/s 1048576 bytes (1.0 MB) copied, 0.133472 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.2405 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.234961 s, 4.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.324737 s, 3.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.341465 s, 3.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128336 s, 81.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0175895 s, 59.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0137524 s, 76.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143219 s, 73.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0166534 s, 63.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0152526 s, 68.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015406 s, 68.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0154576 s, 67.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0173123 s, 60.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0184052 s, 57.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0177141 s, 59.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0180906 s, 58.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0177246 s, 59.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0190899 s, 54.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0185952 s, 56.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0207902 s, 50.4 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg255-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.96554 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.73669 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext nid={0@lo 192.168.202.55@tcp}&jobid={dd.500} rate=20 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg255-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.188112 s, 89.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0162929 s, 64.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0311674 s, 33.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0318728 s, 32.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0352884 s, 29.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0384798 s, 27.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0465101 s, 22.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0193522 s, 54.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0312094 s, 33.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0379184 s, 27.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0253268 s, 41.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0458915 s, 22.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0236917 s, 44.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.031961 s, 32.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0200314 s, 52.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0493271 s, 21.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0349171 s, 30.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133013 s, 78.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.016774 s, 62.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0140026 s, 74.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129068 s, 81.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0165531 s, 63.3 MB/s 1048576 bytes (1.0 MB) copied, 0.016493 s, 63.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00861841 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00775759 s, 135 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.016081 s, 65.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160525 s, 65.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0158769 s, 66.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0172132 s, 60.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.018256 s, 57.4 MB/s , 0.0156799 s, 66.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0193117 s, 54.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0191972 s, 54.6 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg255-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.97424 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.89198 s, 21.4 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext ost.OSS.ost_io.nrs_tbf_rule=start ext_a jobid={dd.500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b jobid={dd.500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg255-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.244556 s, 68.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00994024 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0308015 s, 34.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0219743 s, 47.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0340789 s, 30.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.025672 s, 40.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.024005 s, 43.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0286432 s, 36.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0334669 s, 31.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.165396 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.16347 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.191129 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.198067 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.19649 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.208425 s, 5.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.319623 s, 3.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.311193 s, 3.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0145184 s, 72.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.013156 s, 79.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0139319 s, 75.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128432 s, 81.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155854 s, 67.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0194095 s, 54.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00228171 s, 460 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160092 s, 65.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0175089 s, 59.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0158685 s, 66.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0171657 s, 61.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0195642 s, 53.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0192331 s, 54.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187117 s, 56.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0173816 s, 60.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0204636 s, 51.2 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg255-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.82769 s, 10.7 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.74625 s, 10.8 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.96889 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.74053 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_tbf_rule=start ext_ug uid={500}&gid={1000} rate=5 running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg255-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.477939 s, 35.1 MB/s running as uid/gid/euid/egid 500/1000/500/1000, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160685 s, 65.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0268166 s, 39.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0258775 s, 40.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100737 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0233392 s, 44.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0312472 s, 33.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148493 s, 70.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00971724 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.340372 s, 3.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.361445 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.379428 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.364936 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.378582 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.372794 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.377239 s, 2.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.376732 s, 2.8 MB/s running as uid/gid/euid/egid 500/1000/500/1000, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0111389 s, 94.1 MB/s , 0.015223 s, 68.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.014075 s, 74.5 MB/s , 0.0134894 s, 77.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142059 s, 73.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0194124 s, 54.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015104 s, 69.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.018118 s, 57.9 MB/s , 0.0183185 s, 57.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0184958 s, 56.7 MB/s , 0.0155003 s, 67.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0184115 s, 57.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0178491 s, 58.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0173297 s, 60.5 MB/s , 0.0177817 s, 59.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0222016 s, 47.2 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg255-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.7251 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/1000/500/1000, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.4409 s, 5.4 MB/s Read runtime is 20 s, speed is 5.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_ug ost.OSS.ost_io.nrs_tbf_rule=start ext_uw uid={500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_ur uid={500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg255-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.217711 s, 77.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.017972 s, 58.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0241009 s, 43.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0232835 s, 45.0 MB/s , 0.0176482 s, 59.4 MB/s , 0.0332051 s, 31.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0264534 s, 39.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0462036 s, 22.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0488445 s, 21.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0311878 s, 33.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0714124 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.087026 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0798257 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0861748 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0891944 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0742885 s, 14.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0952205 s, 11.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151461 s, 69.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109845 s, 95.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120045 s, 87.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0191847 s, 54.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0159058 s, 65.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0179283 s, 58.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0164065 s, 63.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0170269 s, 61.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0161886 s, 64.8 MB/s , 0.0173565 s, 60.4 MB/s , 0.0166733 s, 62.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156435 s, 67.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0171316 s, 61.2 MB/s , 0.0151044 s, 69.4 MB/s , 0.0169539 s, 61.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0210813 s, 49.7 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg255-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.97207 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.74181 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_uw ost.OSS.ost_io.nrs_tbf_rule=stop ext_ur ost.OSS.ost_io.nrs_tbf_rule=start ext_a uid={500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b uid={500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg255-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.242867 s, 69.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00771566 s, 136 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109057 s, 96.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0278934 s, 37.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0274356 s, 38.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0202246 s, 51.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0210672 s, 49.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0342497 s, 30.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0216291 s, 48.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.154955 s, 6.8 MB/s , 0.157061 s, 6.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.273769 s, 3.8 MB/s , 0.268927 s, 3.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.323102 s, 3.2 MB/s 1048576 bytes (1.0 MB) copied, 0.304016 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.362699 s, 2.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.365578 s, 2.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0093928 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103624 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106791 s, 98.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108763 s, 96.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0150629 s, 69.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0172932 s, 60.6 MB/s , 0.012153 s, 86.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0130756 s, 80.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0134266 s, 78.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.01534 s, 68.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0153374 s, 68.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015551 s, 67.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0167582 s, 62.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0177006 s, 59.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0159658 s, 65.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0204415 s, 51.3 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg255-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.83547 s, 10.7 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.72778 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.81683 s, 10.7 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.74012 s, 10.8 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_policies=fifo PASS 77k (362s) == sanityn test 77l: check the output of NRS policies for generic TBF ========================================================== 00:10:54 (1722485454) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_policies=fifo PASS 77l (3s) == sanityn test 77m: check NRS Delay slows write RPC processing ========================================================== 00:10:57 (1722485457) ost.OSS.ost_io.nrs_policies=delay ost.OSS.ost_io.nrs_delay_min=4 ost.OSS.ost_io.nrs_delay_max=4 ost.OSS.ost_io.nrs_delay_pct=100 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg255-client.virtnet] [bs=1M] [count=1] [oflag=direct] [conv=fdatasync] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 3.63299 s, 289 kB/s running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg255-client.virtnet] [bs=1M] [count=10] [oflag=direct] [conv=fdatasync] 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 40.0178 s, 262 kB/s ost.OSS.ost_io.nrs_policies=fifo PASS 77m (51s) == sanityn test 77n: check wildcard support for TBF JobID NRS policy ========================================================== 00:11:48 (1722485508) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={*.500} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.157122 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012254 s, 85.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0283836 s, 36.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.034403 s, 30.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0369963 s, 28.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0271583 s, 38.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0367848 s, 28.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0376302 s, 27.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0214332 s, 48.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0363715 s, 28.8 MB/s 1048576 bytes (1.0 MB) copied, 0.026637 s, 39.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0368541 s, 28.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.041392 s, 25.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0195064 s, 53.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0376924 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0263375 s, 39.8 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800b6ccc800.lock_unused_count=1 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0413615 s, 25.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00901287 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00748296 s, 140 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00659672 s, 159 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00700794 s, 150 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00841111 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110555 s, 94.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00832275 s, 126 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00255704 s, 410 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00859879 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00840622 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00111867 s, 937 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00924856 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00924635 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00931798 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00876618 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109675 s, 95.6 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg255-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77n.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.98405 s, 21.0 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77n.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.97294 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.*} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.216669 s, 77.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.018442 s, 56.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0236691 s, 44.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141067 s, 74.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0190513 s, 55.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0184544 s, 56.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0239519 s, 43.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00816668 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108912 s, 96.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0496704 s, 21.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0690404 s, 15.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0830011 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0885105 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.127513 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.132785 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.244725 s, 4.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.250111 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0118505 s, 88.5 MB/s , 0.0131726 s, 79.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133566 s, 78.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0132321 s, 79.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0191423 s, 54.8 MB/s , 0.0174089 s, 60.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0161662 s, 64.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0169328 s, 61.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015912 s, 65.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01568 s, 66.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0167171 s, 62.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0179011 s, 58.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0158952 s, 66.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0171737 s, 61.1 MB/s , 0.0175523 s, 59.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0210889 s, 49.7 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg255-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg255-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.96702 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.9734 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_policies=fifo PASS 77n (66s) == sanityn test 77o: Changing rank should not panic ====== 00:12:54 (1722485574) mds.MDS.mdt.nrs_policies=tbf nid mds.MDS.mdt.nrs_tbf_rule=start name nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=start name1 nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=change name1 rank=name mds.MDS.mdt.nrs_tbf_rule=stop name mds.MDS.mdt.nrs_policies=fifo PASS 77o (4s) == sanityn test 77q: Parallel TBF rule definitions should not panic ========================================================== 00:12:58 (1722485578) mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={500}&gid={500} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_policies=fifo PASS 77q (34s) == sanityn test 77p: Check validity of rule names for TBF policies ========================================================== 00:13:32 (1722485612) mds.MDS.mdt.nrs_policies=tbf oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_overflo uid={500} rate=500: File name too long pdsh@oleg255-client: oleg255-server: ssh exited with exit code 36 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_empty: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p@spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p.spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p~spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p#spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p/spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p^spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p%spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p*spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p;spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p,spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p?spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77pspec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p:spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p+spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p=spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p)spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p(spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p{spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p}spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p|spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p[spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p]spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p!spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p&spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p$spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p`spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p\spec uid={500} rate=500: Invalid argument pdsh@oleg255-client: oleg255-server: ssh exited with exit code 22 mds.MDS.mdt.nrs_policies=fifo PASS 77p (12s) == sanityn test 78: Enable policy and specify tunings right away ========================================================== 00:13:44 (1722485624) oleg255-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_orr_quantum=1: No such device pdsh@oleg255-client: oleg255-server: ssh exited with exit code 19 ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_policies=fifo PASS 78 (3s) == sanityn test 79: xattr: intent error ================== 00:13:47 (1722485627) File: '/mnt/lustre/d79.sanityn' Size: 512 Blocks: 1 IO Block: 131072 directory Device: 2c54f966h/743766374d Inode: 144115205272505431 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-08-01 00:13:48.000000000 -0400 Modify: 2024-08-01 00:13:48.000000000 -0400 Change: 2024-08-01 00:13:48.000000000 -0400 Birth: - fail_val=0 fail_loc=0x80000160 fail_val=0 fail_loc=0x80000131 # file: mnt/lustre/d79.sanityn trusted.name1="value1" PASS 79 (13s) == sanityn test 80a: migrate directory when some children is being opened ========================================================== 00:14:00 (1722485640) SKIP: sanityn test_80a needs >= 2 MDTs SKIP 80a (1s) == sanityn test 80b: Accessing directory during migration ========================================================== 00:14:01 (1722485641) SKIP: sanityn test_80b needs >= 2 MDTs SKIP 80b (1s) == sanityn test 81a: rename and stat under striped directory ========================================================== 00:14:02 (1722485642) SKIP: sanityn test_81a needs >= 2 MDTs SKIP 81a (2s) == sanityn test 81b: rename under striped directory doesn't deadlock ========================================================== 00:14:04 (1722485644) SKIP: sanityn test_81b We need at least 2 MDTs for this test SKIP 81b (1s) == sanityn test 81c: rename revoke LOOKUP lock for remote object ========================================================== 00:14:05 (1722485645) SKIP: sanityn test_81c needs >= 4 MDTs SKIP 81c (1s) == sanityn test 82: fsetxattr and fgetxattr on orphan files ========================================================== 00:14:06 (1722485646) multiop /mnt/lustre/f82.sanityn vO_ac TMPPIPE=/tmp/multiop_open_wait_pipe.6848 multiop /mnt/lustre2/f82.sanityn vo_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.6848 PASS 82 (2s) == sanityn test 83: access striped directory while it is being created/unlinked ========================================================== 00:14:08 (1722485648) SKIP: sanityn test_83 needs >= 2 MDTs SKIP 83 (1s) == sanityn test 84: 0-nlink race in lu_object_find() ===== 00:14:09 (1722485649) fail_loc=0x8000060b PASS 84 (8s) == sanityn test 90: open/create and unlink striped directory ========================================================== 00:14:17 (1722485657) SKIP: sanityn test_90 needs >= 2 MDTs SKIP 90 (1s) == sanityn test 91: chmod and unlink striped directory === 00:14:18 (1722485658) SKIP: sanityn test_91 needs >= 2 MDTs SKIP 91 (1s) == sanityn test 92: create remote directory under orphan directory ========================================================== 00:14:19 (1722485659) SKIP: sanityn test_92 needs >= 2 MDTs SKIP 92 (1s) == sanityn test 93: alloc_rr should not allocate on same ost ========================================================== 00:14:21 (1722485661) fail_loc=0x00000163 fail_loc=0x0 /mnt/lustre/f93.sanityn-1/file1 lmm_stripe_count: 2 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2627 0xa43 0 0 2646 0xa56 0 /mnt/lustre2/f93.sanityn-2/file2 lmm_stripe_count: 2 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2647 0xa57 0 1 2628 0xa44 0 rc1=0 and rc2=0 PASS 93 (10s) == sanityn test 94: signal vs CP callback race =========== 00:14:30 (1722485670) osc.lustre-OST0000-osc-ffff8800b6ccc800.idle_timeout=0 osc.lustre-OST0000-osc-ffff88012da53000.idle_timeout=0 osc.lustre-OST0001-osc-ffff8800b6ccc800.idle_timeout=0 osc.lustre-OST0001-osc-ffff88012da53000.idle_timeout=0 2+0 records in 2+0 records out 8192 bytes (8.2 kB) copied, 0.0651605 s, 126 kB/s fail_val=5 fail_loc=0x80000312 fail_val=6 fail_loc=0x80000329 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 3.0023 s, 1.4 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 5164: 4869 Alarm clock dd if=/dev/zero of=$DIR/$tfile conv=notrunc oflag=append bs=4k count=1 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0233932 s, 175 kB/s osc.lustre-OST0000-osc-ffff8800b6ccc800.idle_timeout=debug osc.lustre-OST0000-osc-ffff88012da53000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b6ccc800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012da53000.idle_timeout=debug PASS 94 (10s) == sanityn test 95b: Check readpage() on a page that is no longer uptodate ========================================================== 00:14:40 (1722485680) llite.lustre-ffff8800b6ccc800.fast_read=0 llite.lustre-ffff88012da53000.fast_read=0 1+0 records in 1+0 records out 12288 bytes (12 kB) copied, 0.00301995 s, 4.1 MB/s fail_loc=0x80001424 fail_val=5 fail_loc=0 llite.lustre-ffff8800b6ccc800.fast_read=1 llite.lustre-ffff88012da53000.fast_read=1 PASS 95b (8s) == sanityn test 100a: DoM: glimpse RPCs for stat without IO lock (DoM only file) ========================================================== 00:14:48 (1722485688) SKIP: sanityn test_100a Reserved for glimpse-ahead SKIP 100a (2s) == sanityn test 100b: DoM: no glimpse RPC for stat with IO lock (DoM only file) ========================================================== 00:14:50 (1722485690) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00302202 s, 1.4 MB/s /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK PASS 100b (2s) == sanityn test 100c: DoM: write vs stat without IO lock (combined file) ========================================================== 00:14:52 (1722485692) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0378759 s, 55.4 MB/s /mnt/lustre/d100c.sanityn/dom has type file OK /mnt/lustre/d100c.sanityn/dom has size 2097152 OK PASS 100c (2s) == sanityn test 100d: DoM: write+truncate vs stat without IO lock (combined file) ========================================================== 00:14:54 (1722485694) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0411678 s, 50.9 MB/s /mnt/lustre/d100d.sanityn/dom has type file OK /mnt/lustre/d100d.sanityn/dom has size 4096 OK PASS 100d (3s) == sanityn test 100e: DoM: read on open and file size ==== 00:14:57 (1722485697) 1+0 records in 1+0 records out 12000 bytes (12 kB) copied, 0.00254236 s, 4.7 MB/s PASS 100e (2s) == sanityn test 101a: Discard DoM data on unlink ========= 00:14:59 (1722485699) /mnt/lustre/f101a.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.000807534 s, 5.1 MB/s PASS 101a (2s) == sanityn test 101b: Discard DoM data on rename ========= 00:15:01 (1722485701) /mnt/lustre/f101b.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.000770007 s, 5.3 MB/s PASS 101b (3s) == sanityn test 101c: Discard DoM data on close-unlink === 00:15:04 (1722485704) /mnt/lustre/f101c.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.000864027 s, 4.7 MB/s PASS 101c (3s) SKIP: sanityn test_102 skipping ALWAYS excluded test 102 == sanityn test 103: Test size correctness with lockahead ========================================================== 00:15:07 (1722485707) fail_loc=0x415 fail_loc=0x415 fail_val=2 Incorrect size expected (no glimpse fix): Starting test test23 at 1722485708 lockahead_test: lockahead_test.c:1186: test23: assertion 'sb.st_size == sb2.st_size' failed: size on /mnt/lustre/d103.sanityn/f103.sanityn and /mnt/lustre2/d103.sanityn/f103.sanityn differs: 0 vs 1048576 fail_loc=0 fail_loc=0x214 fail_val=2 Starting test test23 at 1722485711 Finishing test test23 at 1722485711 PASS 103 (8s) == sanityn test 104: Verify that MDS stores atime/mtime/ctime during close ========================================================== 00:15:15 (1722485715) SKIP: sanityn test_104 ldiskfs only test SKIP 104 (1s) == sanityn test 105: Glimpse and lock cancel race ======== 00:15:16 (1722485716) fail_loc=0x416 PASS 105 (48s) == sanityn test 106a: Verify the btime via statx() ======= 00:16:04 (1722485764) SKIP: sanityn test_106a Test only for ldiskfs and statx() supported SKIP 106a (1s) == sanityn test 106b: Glimpse RPCs test for statx ======== 00:16:05 (1722485765) SKIP: sanityn test_106b statx() only test SKIP 106b (1s) == sanityn test 106c: Verify statx attributes mask ======= 00:16:06 (1722485766) SKIP: sanityn test_106c statx() only test SKIP 106c (1s) == sanityn test 107a: Basic grouplock conflict =========== 00:16:08 (1722485768) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0889711 s, 118 MB/s /mnt/lustre/f107a.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 2654 0xa5e 0 multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.6848 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.6848 First grouplock blocks second one PASS 107a (5s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 00:16:12 (1722485772) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0946298 s, 111 MB/s /mnt/lustre/f107b.sanityn lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2632 0xa48 0 multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.6848 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (8s) == sanityn test 108a: lseek: parallel updates ============ 00:16:20 (1722485780) 1+0 records in 1+0 records out 10000 bytes (10 kB) copied, 0.00288576 s, 3.5 MB/s fail_val=4 fail_loc=0x80000414 1+0 records in 1+0 records out 8388608 bytes (8.4 MB) copied, 4.25532 s, 2.0 MB/s PASS 108a (7s) == sanityn test 109: Race with several mount instances on 1 node ========================================================== 00:16:27 (1722485787) 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Starting race between client mount instances (50 iterations): Iteration 1 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions oleg255-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 2 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 3 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions oleg255-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 4 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 5 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 6 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions oleg255-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 7 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 8 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions oleg255-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 9 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions oleg255-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg255-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 10 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions oleg255-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 11 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 12 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions oleg255-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 13 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions oleg255-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 14 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions oleg255-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 15 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 16 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 17 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 18 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 19 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 20 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 21 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 22 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 23 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 24 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 25 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 26 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 27 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 28 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 29 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 30 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 31 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 32 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions oleg255-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 33 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 34 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 35 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_refcnt: could not read integer from '/sys/module/acpi_cpufreq/refcnt': 'No such device' libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 36 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions oleg255-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 37 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 38 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 39 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 40 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 41 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 42 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions oleg255-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 43 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions oleg255-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 44 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 45 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 46 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 47 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 48 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 49 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions Iteration 50 Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 192.168.202.155@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 192.168.202.155@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt 0 0 Stopping client oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre (opts:) LNET ready to unload Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg255-server' oleg255-server: oleg255-server.virtnet: executing load_modules_local oleg255-server: Loading modules from /home/green/git/lustre-release/lustre oleg255-server: detected 4 online CPUs by sysfs oleg255-server: Force libcfs to create 2 CPU partitions oleg255-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre Starting client: oleg255-client.virtnet: -o user_xattr,flock oleg255-server@tcp:/lustre /mnt/lustre2 PASS 109 (456s) == sanityn test 110: do not grant another lock on resend ========================================================== 00:24:03 (1722486243) fail_loc=0x525 fail_val=3 fail_loc=0x534 File: '/mnt/lustre/f110.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205306056707 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-08-01 00:24:03.000000000 -0400 Modify: 2024-08-01 00:24:03.000000000 -0400 Change: 2024-08-01 00:24:03.000000000 -0400 Birth: - fail_loc=0 fail_val=0 Connected clients: oleg255-client.virtnet oleg255-client.virtnet PASS 110 (49s) == sanityn test 111: A racy rename/link an open file should not cause fs corruption ========================================================== 00:24:52 (1722486292) SKIP: sanityn test_111 needs >= 2 MDTs SKIP 111 (1s) == sanityn test 112: update max-inherit in default LMV === 00:24:53 (1722486293) SKIP: sanityn test_112 We need at least 2 MDTs for this test SKIP 112 (1s) == sanityn test 113: check servers of specified fs ======= 00:24:54 (1722486294) lustre-OST0000-osc-ffff88012db33000 active. lustre-OST0001-osc-ffff88012db33000 active. lustre-OST0000-osc-ffff88012db33000 active. lustre-OST0001-osc-ffff88012db33000 active. MGC192.168.202.155@tcp active. PASS 113 (3s) cleanup: ====================================================== == sanityn test complete, duration 4368 sec ============== 00:24:57 (1722486297) Stopping clients: oleg255-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg255-client.virtnet /mnt/lustre2 opts: