-----============= acceptance-small: sanityn ============----- Thu May 1 17:15:28 EDT 2025 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 oleg305-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/sanityn.*ex: No such file or directory excepting tests: 27 28 102 skipping tests SLOW=no: 33a === sanityn: start setup 17:15:41 (1746134141) === Starting client oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 Started clients oleg305-client.virtnet: 192.168.203.105@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) oleg305-client.virtnet: executing check_config_client /mnt/lustre oleg305-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg305-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800aed5e800.idle_timeout=debug osc.lustre-OST0000-osc-ffff8800b61ae000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800aed5e800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b61ae000.idle_timeout=debug disable quota as required oleg305-server: oleg305-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanityn: finish setup 17:15:59 (1746134159) === 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0324273 s, 32.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f7018] == sanityn test 0: do_node_vp() and do_facet_vp() do the right thing ========================================================== 17:16:00 (1746134160) PASS 0 (4s) == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 17:16:04 (1746134164) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (4s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 17:16:08 (1746134168) -rw-r--r-- 1 root root 0 May 1 17:16 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (3s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 17:16:11 (1746134171) -rw-r--r-- 1 root root 0 May 1 17:16 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (4s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 17:16:15 (1746134175) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (3s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 17:16:18 (1746134178) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (3s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 17:16:22 (1746134182) total 1 -rwxrwxrwx 1 root root 0 May 1 17:16 f2a -rwxrwxrwx 1 root root 0 May 1 17:16 f2b total 1 -rwxrwxrwx 1 root root 0 May 1 17:16 f2a -rwxrwxrwx 1 root root 0 May 1 17:16 f2b running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes (512 B) copied, 0.0108149 s, 47.3 kB/s PASS 2e (3s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 17:16:25 (1746134185) SKIP: sanityn test_2f needs >= 2 MDTs SKIP 2f (2s) == sanityn test 2g: check blocks update on sync write ==== 17:16:27 (1746134187) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.215495 s, 9.7 MB/s /mnt/lustre/f2g.sanityn has 4103 blocks /mnt/lustre2/f2g.sanityn has 4103 blocks PASS 2g (3s) == sanityn test 3: symlink on one mtpt, readlink on another ===================================================================== 17:16:30 (1746134190) PASS 3 (3s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 17:16:33 (1746134193) PASS 4 (4s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 17:16:37 (1746134197) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (4s) == sanityn test 6: remove of open file on other node ============================================================================ 17:16:41 (1746134201) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (3s) == sanityn test 7: remove of open directory on other node ======================================================================= 17:16:44 (1746134204) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (3s) == sanityn test 8: remove of open special file on other node ==================================================================== 17:16:47 (1746134207) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (4s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 17:16:51 (1746134211) PASS 9a (3s) == sanityn test 9b: append to striped sparse file ======== 17:16:54 (1746134214) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0353031 s, 29.7 MB/s 3+0 records in 3+0 records out 3 bytes (3 B) copied, 0.0236952 s, 0.1 kB/s Data read (expecting 'foo'): foo PASS 9b (4s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 17:16:58 (1746134218) 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00251804 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00709208 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0104116 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00678781 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00928136 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00862335 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00574762 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00916808 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00584821 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.010235 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00583597 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00429566 s, 0.2 kB/s PASS 10a (4s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 17:17:02 (1746134222) 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.0114701 s, 268 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0147696 s, 277 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00032815 s, 9.4 MB/s PASS 10b (3s) == sanityn test 11: execution of file opened for write should return error ============================================================== 17:17:05 (1746134225) multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.7018 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 301: /mnt/lustre2/d11/f: Text file busy PASS 11 (4s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 17:17:09 (1746134229) warning: '-runtime' deprecated, use '-t runtime' instead - link 720 (time 1746134240.89 total 10.00 last 71.99) - link 1482 (time 1746134250.90 total 20.01 last 76.11) - link 2070 (time 1746134260.90 total 30.02 last 58.79) - link 2802 (time 1746134270.91 total 40.02 last 73.15) - link 3563 (time 1746134280.91 total 50.03 last 76.03) - link 4375 (time 1746134290.92 total 60.03 last 81.19) - link 5357 (time 1746134300.93 total 70.04 last 98.10) - link 6221 (time 1746134310.93 total 80.05 last 86.39) - link 7086 (time 1746134320.94 total 90.06 last 86.37) total: 7872 link in 100.00 seconds: 78.72 ops/second using seed 3106276518 running for 100 seconds - stat 10000 (time 1746134239 ; total 8 ; last 8) - stat 20000 (time 1746134247 ; total 16 ; last 8) - stat 30000 (time 1746134254 ; total 23 ; last 7) - stat 40000 (time 1746134262 ; total 31 ; last 8) - stat 50000 (time 1746134270 ; total 39 ; last 8) - stat 60000 (time 1746134277 ; total 46 ; last 7) - stat 67768 (time 1746134288 ; total 57 ; last 11) - stat 70000 (time 1746134294 ; total 63 ; last 6) - stat 73258 (time 1746134305 ; total 74 ; last 11) - stat 76375 (time 1746134316 ; total 85 ; last 11) - stat 79951 (time 1746134327 ; total 96 ; last 11) - stat 80000 (time 1746134327 ; total 96 ; last 0) total: 81111 stats in 100 seconds: 811.109985 stats/second - unlinked 0 (time 1746134281 ; total 0 ; last 0) unlink(/mnt/lustre2/lockdir/lockfile7872) error: No such file or directory total: 7871 unlinks in 89 seconds: 88.438202 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (22072) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (22074) - No such process PASS 12 (144s) == sanityn test 13: test directory page revocation ======= 17:19:33 (1746134373) f13 f13 PASS 13 (4s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 17:19:37 (1746134377) multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.7018 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 336: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4880: 23471 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (4s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 17:19:41 (1746134381) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4880: 24107 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (3s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 17:19:44 (1746134384) truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 351: 24741 Terminated $DIR1/$tdir/sleep 60 PASS 14b (3s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 17:19:47 (1746134387) cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 363: 25377 Terminated $DIR1/$tdir/sleep 60 PASS 14c (3s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 17:19:50 (1746134390) chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 374: 26013 Terminated $DIR1/$tdir/sleep 60 PASS 14d (4s) == sanityn test 15: test out-of-space with multiple writers ===================================================================== 17:19:54 (1746134394) PATH=/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/opt/iozone/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin: mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_CODE=117440512 CLIENT_OS_VERSION_ID=7 STRIPECOUNT=2 ORIGFREE=7524352 MAXFREE=800000 SKIP: oos2 test_15 oos2.sh: 7524352kB free gt MAXFREE 800000kB, increase 800000 (or reduce test fs size) to proceed sleep 5 for ZFS MDS Waiting for MDT destroys to complete SKIP 15 (20s) == sanityn test 16a: 500 iterations of dual-mount fsx ==== 17:20:14 (1746134414) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.371635 s, 22.6 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.318383 s, 26.3 MB/s Chance of close/open is 1 in 50 Seed set to 4416 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000004[0] 1746134416.965907 mapwrite 0x2f73ab thru 0x2fc96c (0x55c2 bytes) 000005[1] 1746134417.112922 write 0x5369b9 thru 0x543a92 (0xd0da bytes) truncating to largest ever: 0x5bdff 000007[0] 1746134417.154201 trunc from 0x543a93 to 0x05bdfe (0x4e7c94 bytes) 000009[1] 1746134417.213443 write 0x282b13 thru 0x28dc12 (0xb100 bytes) 000010[1] 1746134417.236312 write 0x28290e thru 0x28b474 (0x8b67 bytes) 000012[1] 1746134417.254620 read 0x1f6903 thru 0x1f7eee (0x15ec bytes) truncating to largest ever: 0x391b92 000013[1] 1746134417.270440 trunc from 0x28dc13 to 0x391b91 (0x103f7f bytes) 000016[1] 1746134417.329992 read 0x2707a4 thru 0x277e79 (0x76d6 bytes) truncating to largest ever: 0x67efc1 000019[1] 1746134417.397939 trunc from 0x391b92 to 0x67efc0 (0x2ed42f bytes) 000023[1] 1746134417.429455 read 0x522330 thru 0x5317fe (0xf4cf bytes) truncating to largest ever: 0x731c25 000024[0] 1746134417.449513 trunc from 0x67efc1 to 0x731c24 (0xb2c64 bytes) 000025[1] 1746134417.480875 read 0x0a9909 thru 0x0b3177 (0x986f bytes) 000026[0] 1746134417.492544 write 0x36dfa9 thru 0x37548f (0x74e7 bytes) 000028[0] 1746134417.538433 read 0x156e00 thru 0x166cae (0xfeaf bytes) 000031[0] 1746134417.553652 trunc from 0x731c25 to 0x1eb5e6 (0x54663e bytes) truncating to largest ever: 0x909e07 000033[0] 1746134417.572006 trunc from 0x1eb5e7 to 0x909e06 (0x71e820 bytes) 000035[1] 1746134417.605656 write 0x0ec0af thru 0x0f8307 (0xc259 bytes) 000036[0] 1746134417.629777 write 0x13dec3 thru 0x1400df (0x221d bytes) 000037[0] 1746134417.650827 write 0x932e51 thru 0x934cdc (0x1e8c bytes) 000039[1] 1746134417.651995 mapread 0x4e3c0b thru 0x4ef947 (0xbd3d bytes) 000041[1] 1746134417.695478 mapwrite 0x250ad9 thru 0x25cf3b (0xc463 bytes) 000042[0] 1746134417.783989 write 0x5e29bc thru 0x5f17a8 (0xeded bytes) 000044[0] 1746134417.833059 write 0x72ca78 thru 0x7349db (0x7f64 bytes) 000045[0] 1746134417.858968 trunc from 0x934cdd to 0x5bf4d3 (0x375809 bytes) truncating to largest ever: 0x96a507 000047[0] 1746134417.922092 trunc from 0x5bf4d4 to 0x96a506 (0x3ab033 bytes) 000048[1] 1746134417.948510 read 0x4ec604 thru 0x4ee3a9 (0x1da6 bytes) 000049[0] 1746134417.976437 read 0x51b038 thru 0x526a1c (0xb9e5 bytes) 000051[1] 1746134418.009568 mapread 0x05dae3 thru 0x067461 (0x997f bytes) 000053[1] 1746134418.047132 write 0x03a29e thru 0x048e6c (0xebcf bytes) 000054[0] 1746134418.073870 mapwrite 0x64085e thru 0x64dada (0xd27d bytes) 000055[0] 1746134418.191403 write 0x611dec thru 0x61d0a3 (0xb2b8 bytes) 000056[0] 1746134418.211528 mapwrite 0x59545c thru 0x596034 (0xbd9 bytes) 000057[1] 1746134418.271013 trunc from 0x96a507 to 0x923b62 (0x469a4 bytes) 000061[0] 1746134418.341287 write 0x8be92d thru 0x8c7b5b (0x922f bytes) 000062[0] 1746134418.382726 read 0x317cb3 thru 0x31ead1 (0x6e1f bytes) 000064[0] 1746134418.419460 read 0x09dab5 thru 0x0a6fa1 (0x94ed bytes) 000066[1] 1746134418.444620 mapread 0x0f1ace thru 0x0f9a3f (0x7f72 bytes) 000068[0] 1746134418.482605 read 0x68e8b4 thru 0x695560 (0x6cad bytes) 000074[1] 1746134418.497838 mapread 0x42ef68 thru 0x434647 (0x56e0 bytes) 000075[1] 1746134418.531165 write 0x816246 thru 0x817c6b (0x1a26 bytes) 000077[0] 1746134418.562566 mapread 0x5efebf thru 0x5fbb58 (0xbc9a bytes) 000079[1] 1746134418.597323 mapread 0x72abd9 thru 0x733e54 (0x927c bytes) 000081[1] 1746134418.608396 write 0x79f652 thru 0x7aa299 (0xac48 bytes) 000086[1] 1746134418.653187 mapread 0x26e6a4 thru 0x270721 (0x207e bytes) 000087[0] 1746134418.688412 write 0x77b149 thru 0x789b5e (0xea16 bytes) 000088[0] 1746134418.725274 trunc from 0x923b63 to 0x50b0b4 (0x418aae bytes) 000089[1] 1746134418.763638 write 0x2db008 thru 0x2e64d7 (0xb4d0 bytes) 000093[0] 1746134418.837277 trunc from 0x50b0b5 to 0x632e10 (0x127d5c bytes) 000096[0] 1746134418.910672 trunc from 0x632e11 to 0x7623f4 (0x12f5e4 bytes) 000098[1] 1746134418.950492 trunc from 0x7623f5 to 0x5bff1f (0x1a24d5 bytes) 000099[1] 1746134419.001263 read 0x37df00 thru 0x384d7a (0x6e7b bytes) 000102[1] 1746134419.009610 write 0x5781fd thru 0x57a112 (0x1f16 bytes) 000104[1] 1746134419.022337 write 0x42f082 thru 0x433d10 (0x4c8f bytes) 000106[0] 1746134419.048303 mapwrite 0x097f29 thru 0x09aab0 (0x2b88 bytes) 000109[0] 1746134419.199572 trunc from 0x5bff20 to 0x302e99 (0x2bd086 bytes) 000111[0] 1746134419.258000 read 0x222571 thru 0x2272f2 (0x4d82 bytes) 000112[0] 1746134419.327280 mapwrite 0x90a90d thru 0x9174a4 (0xcb98 bytes) 000115[0] 1746134419.507695 write 0x98a85e thru 0x98bb8a (0x132d bytes) 000116[1] 1746134419.528855 read 0x01cd5e thru 0x02c9a1 (0xfc44 bytes) 000117[0] 1746134419.559716 mapread 0x5ee3b0 thru 0x5f5b99 (0x77ea bytes) 000118[1] 1746134419.565820 mapwrite 0x0b5a73 thru 0x0b7d0a (0x2298 bytes) 000119[0] 1746134419.666986 trunc from 0x98bb8b to 0x506347 (0x485843 bytes) 000121[0] 1746134419.717595 mapread 0x033609 thru 0x0399b5 (0x63ad bytes) 000124[1] 1746134419.778539 read 0x2e7021 thru 0x2ee7bb (0x779b bytes) 000127[0] 1746134419.826537 mapwrite 0x5d62d1 thru 0x5e2da8 (0xcad8 bytes) 000128[0] 1746134419.946545 write 0x27440d thru 0x27709f (0x2c93 bytes) 000130[0] 1746134419.967081 mapwrite 0x5e9ccc thru 0x5f51f6 (0xb52b bytes) 000131[0] 1746134420.053875 mapwrite 0x61d61a thru 0x623047 (0x5a2e bytes) 000134[1] 1746134420.142004 mapread 0x358bcd thru 0x366fc5 (0xe3f9 bytes) 000135[0] 1746134420.180533 read 0x2577af thru 0x258cc1 (0x1513 bytes) 000137[1] 1746134420.198973 mapwrite 0x5f5311 thru 0x5fdef4 (0x8be4 bytes) 000138[1] 1746134420.259783 trunc from 0x623048 to 0x0b9921 (0x569726 bytes) 000139[1] 1746134420.289629 write 0x7de3da thru 0x7e63f4 (0x801b bytes) 000140[0] 1746134420.295728 mapread 0x632899 thru 0x6357d1 (0x2f39 bytes) 000144[0] 1746134420.351432 trunc from 0x7e63f5 to 0x8e3827 (0xfd433 bytes) 000146[1] 1746134420.378729 write 0x967873 thru 0x96cb6a (0x52f8 bytes) 000147[1] 1746134420.390447 write 0x59f8de thru 0x5a4f17 (0x563a bytes) 000148[1] 1746134420.406814 write 0x296c07 thru 0x2a2e0c (0xc206 bytes) 000149[0] 1746134420.421786 mapwrite 0x45d2aa thru 0x463440 (0x6197 bytes) 000150[0] 1746134420.481657 trunc from 0x96cb6b to 0x34d57e (0x61f5ec bytes) 000154[1] 1746134420.552860 trunc from 0x34d57f to 0x8ea4ad (0x59cf2f bytes) 000157[0] 1746134420.598582 mapwrite 0x1bcf3f thru 0x1cc001 (0xf0c3 bytes) 000160[1] 1746134420.719909 trunc from 0x8ea4ae to 0x141a1a (0x7a8a93 bytes) 000161[0] 1746134420.752520 write 0x6e7bf7 thru 0x6f5d80 (0xe18a bytes) 000163[1] 1746134420.782893 read 0x601ef4 thru 0x60e329 (0xc436 bytes) 000164[0] 1746134420.813136 mapread 0x011300 thru 0x01d48f (0xc190 bytes) 000171[0] 1746134420.841724 mapread 0x384271 thru 0x38d467 (0x91f7 bytes) 000172[1] 1746134420.873728 read 0x32cf0d thru 0x3394de (0xc5d2 bytes) 000174[1] 1746134420.933652 write 0x1a17e3 thru 0x1aa80f (0x902d bytes) 000179[0] 1746134420.966314 read 0x45e5be thru 0x467c74 (0x96b7 bytes) 000180[0] 1746134420.972975 write 0x0615af thru 0x06788e (0x62e0 bytes) 000181[0] 1746134421.028883 mapread 0x3c2ef3 thru 0x3c53b9 (0x24c7 bytes) 000182[0] 1746134421.047096 read 0x2f0aeb thru 0x2fe7cf (0xdce5 bytes) truncating to largest ever: 0x9ef435 000184[0] 1746134421.097682 trunc from 0x6f5d81 to 0x9ef434 (0x2f96b4 bytes) 000185[0] 1746134421.119986 mapread 0x7b48b0 thru 0x7b62ee (0x1a3f bytes) 000186[0] 1746134421.138754 mapwrite 0x2fc238 thru 0x305249 (0x9012 bytes) 000187[0] 1746134421.183032 mapwrite 0x3a0aca thru 0x3a9856 (0x8d8d bytes) 000188[0] 1746134421.231751 mapread 0x3146af thru 0x31bb67 (0x74b9 bytes) 000190[1] 1746134421.236422 mapwrite 0x943bf8 thru 0x946165 (0x256e bytes) 000193[0] 1746134421.325887 read 0x7a7683 thru 0x7a8f43 (0x18c1 bytes) 000195[1] 1746134421.353742 read 0x3012e6 thru 0x304964 (0x367f bytes) 000198[0] 1746134421.383035 mapwrite 0x5ae6c6 thru 0x5b979a (0xb0d5 bytes) 000201[1] 1746134421.513206 write 0x330fbe thru 0x3320f8 (0x113b bytes) 000202[0] 1746134421.533646 write 0x26515b thru 0x26a8e4 (0x578a bytes) 000203[0] 1746134421.556137 mapwrite 0x38b82b thru 0x390616 (0x4dec bytes) 000204[1] 1746134421.633037 write 0x143f03 thru 0x1469e0 (0x2ade bytes) 000208[0] 1746134421.695814 write 0x1f8023 thru 0x2007e8 (0x87c6 bytes) 000209[0] 1746134421.725948 mapwrite 0x642404 thru 0x6493e2 (0x6fdf bytes) 000210[1] 1746134421.785444 read 0x3384bb thru 0x33bb2b (0x3671 bytes) 000218[1] 1746134421.860009 read 0x23fe28 thru 0x24c138 (0xc311 bytes) 000219[1] 1746134421.873743 mapread 0x477350 thru 0x479df4 (0x2aa5 bytes) 000220[1] 1746134421.902593 read 0x4cd002 thru 0x4d4f9b (0x7f9a bytes) 000221[1] 1746134421.912263 mapwrite 0x6724d9 thru 0x681e6f (0xf997 bytes) 000222[1] 1746134422.011900 mapwrite 0x4034f7 thru 0x40f333 (0xbe3d bytes) 000223[0] 1746134422.082392 mapwrite 0x5aa3cf thru 0x5ad5a1 (0x31d3 bytes) 000225[0] 1746134422.121110 mapwrite 0x797c00 thru 0x798523 (0x924 bytes) 000227[1] 1746134422.185609 trunc from 0x9ef435 to 0x25632b (0x799109 bytes) 000230[0] 1746134422.249464 mapread 0x004e2e thru 0x005294 (0x467 bytes) 000233[0] 1746134422.286087 mapwrite 0x3cbdde thru 0x3d8536 (0xc759 bytes) 000234[1] 1746134422.370440 mapread 0x261c3b thru 0x26f19c (0xd562 bytes) 000236[0] 1746134422.407889 read 0x2d929a thru 0x2e3a77 (0xa7de bytes) 000237[0] 1746134422.467197 write 0x5ce341 thru 0x5d0380 (0x2040 bytes) 000241[0] 1746134422.491333 write 0x2ee59d thru 0x2f3d10 (0x5774 bytes) 000242[0] 1746134422.512112 trunc from 0x5d0381 to 0x7e5918 (0x215598 bytes) 000244[0] 1746134422.548241 mapwrite 0x8f0cd7 thru 0x8fc107 (0xb431 bytes) 000245[0] 1746134422.690939 mapread 0x3da2c5 thru 0x3e57f6 (0xb532 bytes) 000246[0] 1746134422.703502 trunc from 0x8fc108 to 0x053cf5 (0x8a8412 bytes) 000251[1] 1746134422.745892 mapread 0x017e2e thru 0x025fd0 (0xe1a3 bytes) 000256[0] 1746134422.786652 read 0x02584d thru 0x02b477 (0x5c2b bytes) 000257[1] 1746134422.794224 trunc from 0x053cf6 to 0x8f13b1 (0x89d6bc bytes) 000259[0] 1746134422.831735 write 0x43e637 thru 0x44c41b (0xdde5 bytes) 000260[1] 1746134422.875810 write 0x355859 thru 0x35c1cc (0x6974 bytes) 000262[0] 1746134422.910992 mapwrite 0x88787f thru 0x88c1c8 (0x494a bytes) 000267[0] 1746134423.195959 write 0x8fdd43 thru 0x9032a2 (0x5560 bytes) 000268[1] 1746134423.206768 trunc from 0x9032a3 to 0x52f942 (0x3d3960 bytes) 000270[1] 1746134423.295043 write 0x58ac6b thru 0x5989c7 (0xdd5d bytes) 000271[0] 1746134423.307599 mapwrite 0x5e01c1 thru 0x5e44cb (0x430b bytes) 000272[0] 1746134423.414672 mapread 0x41a148 thru 0x41d21b (0x30d4 bytes) 000274[1] 1746134423.453582 mapread 0x3de097 thru 0x3e5ca8 (0x7c12 bytes) 000276[0] 1746134423.499116 read 0x13915b thru 0x147b6b (0xea11 bytes) 000277[1] 1746134423.505695 mapread 0x1e9798 thru 0x1f6784 (0xcfed bytes) 000279[0] 1746134423.530249 mapread 0x2dbc39 thru 0x2dd58e (0x1956 bytes) 000280[0] 1746134423.551736 read 0x0d2d13 thru 0x0d5856 (0x2b44 bytes) 000285[1] 1746134423.585166 read 0x0358b9 thru 0x03b05a (0x57a2 bytes) 000287[1] 1746134423.623421 trunc from 0x5e44cc to 0x5c9a77 (0x1aa54 bytes) 000289[0] 1746134423.689294 mapread 0x37d094 thru 0x382103 (0x5070 bytes) 000290[0] 1746134423.717637 write 0x3f1404 thru 0x3fa44f (0x904c bytes) 000294[1] 1746134423.777558 mapread 0x4a8aca thru 0x4b4161 (0xb698 bytes) 000297[0] 1746134423.834639 read 0x37f1b2 thru 0x38a570 (0xb3bf bytes) 000298[0] 1746134423.849720 write 0x141213 thru 0x142037 (0xe25 bytes) 000299[0] 1746134423.870309 read 0x069970 thru 0x06a209 (0x89a bytes) 000301[1] 1746134423.887472 mapwrite 0x627e47 thru 0x6325c8 (0xa782 bytes) 000302[0] 1746134423.984844 mapwrite 0x1e33c7 thru 0x1ee15b (0xad95 bytes) 000303[1] 1746134424.124382 read 0x4a662c thru 0x4b51c5 (0xeb9a bytes) 000312[0] 1746134424.223717 mapwrite 0x37639b thru 0x386395 (0xfffb bytes) 000317[0] 1746134424.374545 read 0x20f708 thru 0x21a465 (0xad5e bytes) 000318[0] 1746134424.391522 write 0x067fd5 thru 0x07005c (0x8088 bytes) 000319[0] 1746134424.405424 mapread 0x4f44b9 thru 0x50168f (0xd1d7 bytes) 000324[1] 1746134424.478682 read 0x4884ae thru 0x48c0c0 (0x3c13 bytes) 000325[1] 1746134424.506378 mapwrite 0x12f9cc thru 0x13e7e4 (0xee19 bytes) 000329[0] 1746134424.677969 mapread 0x5cdd45 thru 0x5d618b (0x8447 bytes) 000330[0] 1746134424.722248 trunc from 0x6325c9 to 0x020982 (0x611c46 bytes) 000331[1] 1746134424.756741 mapwrite 0x46cb53 thru 0x46e166 (0x1614 bytes) 000335[1] 1746134424.925178 read 0x2bf645 thru 0x2cee0c (0xf7c8 bytes) 000336[0] 1746134424.944244 read 0x033cc3 thru 0x03fd2f (0xc06d bytes) 000341[0] 1746134424.965846 mapwrite 0x457254 thru 0x463cea (0xca97 bytes) 000343[0] 1746134425.103584 mapwrite 0x03cb00 thru 0x041fc2 (0x54c3 bytes) 000347[0] 1746134425.268851 mapread 0x16925a thru 0x17347f (0xa226 bytes) 000348[0] 1746134425.283851 mapread 0x0d5fce thru 0x0d7bab (0x1bde bytes) 000350[0] 1746134425.294414 read 0x3f7af0 thru 0x3f8ea9 (0x13ba bytes) 000351[1] 1746134425.325925 write 0x5f069c thru 0x5f6502 (0x5e67 bytes) 000354[1] 1746134425.365547 write 0x412adb thru 0x413f40 (0x1466 bytes) 000356[0] 1746134425.391754 mapwrite 0x98693a thru 0x991886 (0xaf4d bytes) 000358[0] 1746134425.535186 mapread 0x5d7ec3 thru 0x5e55ca (0xd708 bytes) 000361[0] 1746134425.621112 read 0x0847ea thru 0x08a2cd (0x5ae4 bytes) 000363[0] 1746134425.650465 write 0x809ab3 thru 0x8117b5 (0x7d03 bytes) 000364[1] 1746134425.655937 mapread 0x500c04 thru 0x50b67f (0xaa7c bytes) 000368[0] 1746134425.709788 write 0x1c0482 thru 0x1d03e3 (0xff62 bytes) 000370[0] 1746134425.726047 trunc from 0x991887 to 0x7e36fe (0x1ae188 bytes) 000373[1] 1746134425.778859 trunc from 0x7e36ff to 0x46eca9 (0x374a55 bytes) 000375[0] 1746134425.840849 read 0x2d936d thru 0x2e6fc2 (0xdc56 bytes) 000376[0] 1746134425.872785 write 0x228410 thru 0x2306a0 (0x8291 bytes) 000377[0] 1746134425.896233 mapwrite 0x8c348b thru 0x8c61c0 (0x2d36 bytes) 000379[1] 1746134426.000694 read 0x0b328b thru 0x0b6d84 (0x3afa bytes) 000380[1] 1746134426.025149 write 0x16e49a thru 0x1743be (0x5f25 bytes) 000383[1] 1746134426.073472 read 0x2c8acd thru 0x2c90b7 (0x5eb bytes) 000384[0] 1746134426.092995 read 0x04ddff thru 0x05ceab (0xf0ad bytes) 000386[1] 1746134426.134629 write 0x611204 thru 0x61bad8 (0xa8d5 bytes) 000388[0] 1746134426.178863 write 0x081991 thru 0x08a6a3 (0x8d13 bytes) 000389[0] 1746134426.225991 write 0x8ab893 thru 0x8b458f (0x8cfd bytes) 000393[0] 1746134426.287128 mapwrite 0x9bf69f thru 0x9c247b (0x2ddd bytes) 000394[1] 1746134426.386649 read 0x0ad9ba thru 0x0b9bbe (0xc205 bytes) 000398[0] 1746134426.422729 write 0x2f07b1 thru 0x2fcf16 (0xc766 bytes) 000400[0] 1746134426.459894 mapwrite 0x6618ee thru 0x66f8b9 (0xdfcc bytes) 000401[0] 1746134426.523435 trunc from 0x9c247c to 0x2db141 (0x6e733a bytes) 000402[0] 1746134426.546962 mapwrite 0x76cfb7 thru 0x7719f0 (0x4a3a bytes) 000403[1] 1746134426.617381 mapread 0x3f58bf thru 0x4003fa (0xab3c bytes) 000404[1] 1746134426.664915 mapread 0x6b203a thru 0x6bd052 (0xb019 bytes) 000405[0] 1746134426.681909 mapwrite 0x8ada8a thru 0x8b8f91 (0xb508 bytes) 000407[0] 1746134426.806692 mapwrite 0x253428 thru 0x25df06 (0xaadf bytes) 000414[1] 1746134426.897709 trunc from 0x8b8f92 to 0x10af94 (0x7adffd bytes) 000415[1] 1746134426.918739 trunc from 0x10af95 to 0x4cacc7 (0x3bfd33 bytes) 000416[0] 1746134426.933878 write 0x36af58 thru 0x3719d0 (0x6a79 bytes) 000417[1] 1746134426.948725 trunc from 0x4cacc8 to 0x4eac6b (0x1ffa4 bytes) 000419[0] 1746134426.983588 mapwrite 0x46de8a thru 0x474801 (0x6978 bytes) 000421[1] 1746134427.049664 mapread 0x325084 thru 0x327f40 (0x2ebd bytes) 000424[0] 1746134427.086823 trunc from 0x4eac6c to 0x26254d (0x28871e bytes) 000425[1] 1746134427.103990 trunc from 0x26254e to 0x245374 (0x1d1d9 bytes) 000426[1] 1746134427.122048 trunc from 0x245375 to 0x843d62 (0x5fe9ee bytes) 000428[1] 1746134427.146775 mapwrite 0x3837ed thru 0x38a2cc (0x6ae0 bytes) 000429[0] 1746134427.199374 write 0x019328 thru 0x01c5a6 (0x327f bytes) 000430[0] 1746134427.219271 read 0x008c64 thru 0x00d7ba (0x4b57 bytes) 000432[1] 1746134427.239114 mapwrite 0x639fe3 thru 0x63cf7a (0x2f98 bytes) 000433[1] 1746134427.295379 mapread 0x741216 thru 0x748494 (0x727f bytes) 000434[0] 1746134427.325686 read 0x66c248 thru 0x67ac5b (0xea14 bytes) 000436[1] 1746134427.350473 mapread 0x7b17b2 thru 0x7b8799 (0x6fe8 bytes) 000441[1] 1746134427.382071 mapwrite 0x1ae556 thru 0x1b7b3a (0x95e5 bytes) 000442[1] 1746134427.468670 read 0x5ffb29 thru 0x60aae7 (0xafbf bytes) 000444[1] 1746134427.483952 write 0x3a9148 thru 0x3b4f0c (0xbdc5 bytes) 000449[1] 1746134427.508708 mapwrite 0x7acd69 thru 0x7b1691 (0x4929 bytes) 000451[1] 1746134427.571759 read 0x3b984d thru 0x3c70b3 (0xd867 bytes) 000452[1] 1746134427.611452 write 0x1aace2 thru 0x1ab48f (0x7ae bytes) 000457[0] 1746134427.665060 write 0x2fa18b thru 0x3005df (0x6455 bytes) 000460[0] 1746134427.737705 write 0x5ad6d0 thru 0x5b4f88 (0x78b9 bytes) 000461[0] 1746134427.753080 trunc from 0x843d63 to 0x6223e1 (0x221981 bytes) 000464[0] 1746134427.823621 mapread 0x0e9f5b thru 0x0f0cce (0x6d74 bytes) 000465[1] 1746134427.852456 write 0x3b84aa thru 0x3bfb9e (0x76f5 bytes) 000468[1] 1746134427.933659 mapread 0x17abfd thru 0x188eed (0xe2f1 bytes) 000470[0] 1746134428.007698 mapwrite 0x56627f thru 0x5742e4 (0xe066 bytes) 000472[1] 1746134428.119151 write 0x584666 thru 0x584749 (0xe4 bytes) 000474[1] 1746134428.157014 read 0x01fbe7 thru 0x02167e (0x1a98 bytes) 000476[1] 1746134428.180854 write 0x6197c8 thru 0x622fe4 (0x981d bytes) 000477[0] 1746134428.193577 trunc from 0x622fe5 to 0x48de5b (0x195189 bytes) 000479[0] 1746134428.250525 write 0x3296e4 thru 0x338db6 (0xf6d3 bytes) 000480[0] 1746134428.259091 mapwrite 0x6673c8 thru 0x67035d (0x8f96 bytes) 000481[0] 1746134428.345568 write 0x2c2127 thru 0x2c58b4 (0x378e bytes) 000488[0] 1746134428.382498 mapread 0x13e78b thru 0x1496fc (0xaf72 bytes) 000489[0] 1746134428.405592 read 0x096fd6 thru 0x09d237 (0x6262 bytes) 000492[1] 1746134428.452019 write 0x0d63e1 thru 0x0dca71 (0x6691 bytes) 000493[0] 1746134428.477094 mapwrite 0x300baa thru 0x306f35 (0x638c bytes) 000496[1] 1746134428.565297 write 0x7929ef thru 0x7944f0 (0x1b02 bytes) 000498[1] 1746134428.593968 mapwrite 0x33380b thru 0x33a6fe (0x6ef4 bytes) 000499[1] 1746134428.674067 mapwrite 0x5c9088 thru 0x5cd432 (0x43ab bytes) All operations completed A-OK! Chance of close/open is 1 in 50 Seed set to 4428 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read truncating to largest ever: 0x953e08 000005[0] 1746134429.223973 trunc from 00000000 to 0x953e07 (0x953e08 bytes) 000008[1] 1746134429.280160 mapwrite 0x2db000 thru 0x2e3abe (0x8abf bytes) 000009[1] 1746134429.382155 mapwrite 0x5c3000 thru 0x5c4b15 (0x1b16 bytes) 000012[1] 1746134429.453200 mapread 0x6a0000 thru 0x6a2f98 (0x2f99 bytes) 000013[0] 1746134429.465774 mapread 0x5b3000 thru 0x5c0a30 (0xda31 bytes) 000014[0] 1746134429.492878 mapread 0x51c000 thru 0x528daa (0xcdab bytes) 000015[1] 1746134429.503727 mapwrite 0x88d000 thru 0x89bb8c (0xeb8d bytes) 000016[0] 1746134429.585909 mapwrite 0x894000 thru 0x8970bc (0x30bd bytes) 000018[0] 1746134429.636698 write 0x796000 thru 0x79a84a (0x484b bytes) 000019[1] 1746134429.644938 mapread 0x21d000 thru 0x223a5f (0x6a60 bytes) 000025[1] 1746134429.670185 trunc from 0x953e08 to 0x81ad83 (0x139084 bytes) 000026[0] 1746134429.697633 read 0x790000 thru 0x79819c (0x819d bytes) 000027[0] 1746134429.708172 write 0x829000 thru 0x830c53 (0x7c54 bytes) 000028[1] 1746134429.722671 read_OD 0x68f000 thru 0x697fff (0x9000 bytes) 000029[1] 1746134429.742067 mapwrite 0x1c9000 thru 0x1d6a61 (0xda62 bytes) 000033[0] 1746134429.844467 mapwrite 0x7cb000 thru 0x7d9659 (0xe65a bytes) 000035[1] 1746134429.931989 mapread 0x75f000 thru 0x76817f (0x9180 bytes) 000037[0] 1746134429.960958 mapwrite 0x385000 thru 0x38b6d6 (0x66d7 bytes) 000042[0] 1746134430.037945 mapwrite 0x2a3000 thru 0x2a8058 (0x5059 bytes) 000043[0] 1746134430.076935 mapwrite 0x938000 thru 0x9388b2 (0x8b3 bytes) 000044[0] 1746134430.126847 mapread 0x4e7000 thru 0x4ecce5 (0x5ce6 bytes) 000045[1] 1746134430.143217 mapwrite 0x7b4000 thru 0x7b53bb (0x13bc bytes) 000048[0] 1746134430.202279 mapread 0x316000 thru 0x31f70f (0x9710 bytes) 000053[1] 1746134430.223441 read_OD 0x6b8000 thru 0x6c1fff (0xa000 bytes) 000054[0] 1746134430.227181 mapwrite 0x9bf000 thru 0x9c51ac (0x61ad bytes) 000056[1] 1746134430.277962 read_OD 0x8a9000 thru 0x8abfff (0x3000 bytes) 000058[1] 1746134430.291262 trunc from 0x9c51ad to 0x632054 (0x393158 bytes) 000059[0] 1746134430.308561 trunc from 0x632055 to 0x1fe0d1 (0x433f83 bytes) 000061[0] 1746134430.337318 trunc from 0x1fe0d2 to 0x6472d8 (0x449207 bytes) 000062[1] 1746134430.352791 read_OD 0x256000 thru 0x262fff (0xd000 bytes) 000065[0] 1746134430.374426 mapread 0x4de000 thru 0x4eb218 (0xd219 bytes) 000066[1] 1746134430.389542 write_OD 0x6f4000 thru 0x6f4fff (0x1000 bytes) 000069[1] 1746134430.426601 mapwrite 0x6a5000 thru 0x6b33ec (0xe3ed bytes) 000073[1] 1746134430.578563 mapwrite 0x69d000 thru 0x6a0627 (0x3628 bytes) 000075[1] 1746134430.616595 write_OD 0x635000 thru 0x63ffff (0xb000 bytes) 000077[1] 1746134430.680413 read_OD 0x1fb000 thru 0x205fff (0xb000 bytes) 000078[0] 1746134430.688068 mapread 0x1d5000 thru 0x1e1881 (0xc882 bytes) 000081[0] 1746134430.706882 read 0x266000 thru 0x27399a (0xd99b bytes) 000082[0] 1746134430.713425 read 0x181000 thru 0x181f7e (0xf7f bytes) 000084[0] 1746134430.715542 mapread 0x02b000 thru 0x038291 (0xd292 bytes) 000086[0] 1746134430.724847 mapwrite 0x5b0000 thru 0x5b3380 (0x3381 bytes) 000088[0] 1746134430.772141 trunc from 0x6f5000 to 0x634c32 (0xc03cd bytes) 000090[1] 1746134430.806499 trunc from 0x634c33 to 0x44a00f (0x1eac23 bytes) 000092[0] 1746134430.826875 mapread 0x20a000 thru 0x21006e (0x606f bytes) 000093[0] 1746134430.841852 write 0x63d000 thru 0x644206 (0x7207 bytes) 000094[0] 1746134430.854204 mapread 0x407000 thru 0x40a9dd (0x39de bytes) 000095[0] 1746134430.864207 write 0x343000 thru 0x34a584 (0x7585 bytes) 000098[1] 1746134430.883812 mapread 0x06e000 thru 0x079d0a (0xbd0b bytes) 000099[1] 1746134430.922184 mapread 0x006000 thru 0x011bd7 (0xbbd8 bytes) 000100[0] 1746134430.932523 mapwrite 0x0f2000 thru 0x0fe024 (0xc025 bytes) 000101[1] 1746134431.025194 mapwrite 0x966000 thru 0x96c410 (0x6411 bytes) 000103[0] 1746134431.123101 read 0x5c5000 thru 0x5c7a82 (0x2a83 bytes) 000106[1] 1746134431.139816 write_OD 0x980000 thru 0x985fff (0x6000 bytes) 000109[0] 1746134431.186526 write 0x3c3000 thru 0x3cec27 (0xbc28 bytes) 000110[1] 1746134431.221699 trunc from 0x986000 to 0x5fdc3f (0x3883c0 bytes) 000111[1] 1746134431.268077 mapread 0x3c8000 thru 0x3d4d33 (0xcd34 bytes) 000115[1] 1746134431.334507 trunc from 0x5fdc40 to 0x7ed4e6 (0x1ef8a7 bytes) 000117[1] 1746134431.347396 mapwrite 0x447000 thru 0x455f57 (0xef58 bytes) 000118[0] 1746134431.428319 mapread 0x539000 thru 0x5393c6 (0x3c7 bytes) 000119[1] 1746134431.443070 trunc from 0x7ed4e7 to 0x08f6da (0x75de0c bytes) 000121[0] 1746134431.471792 mapread 0x00f000 thru 0x0117c7 (0x27c8 bytes) 000122[0] 1746134431.488553 write 0x0b2000 thru 0x0c1060 (0xf061 bytes) 000126[0] 1746134431.534990 trunc from 0x0c1061 to 0x1cf90d (0x10e8ad bytes) 000128[1] 1746134431.562232 trunc from 0x1cf90e to 0x3b5fb6 (0x1e66a9 bytes) 000131[0] 1746134431.611000 mapwrite 0x58f000 thru 0x59ab38 (0xbb39 bytes) 000135[1] 1746134431.760435 mapwrite 0x155000 thru 0x15a692 (0x5693 bytes) 000139[0] 1746134431.872886 read 0x1f6000 thru 0x1f8af2 (0x2af3 bytes) 000143[1] 1746134431.890711 write_OD 0x724000 thru 0x727fff (0x4000 bytes) 000144[0] 1746134431.934821 trunc from 0x728000 to 0x531a5a (0x1f65a5 bytes) 000145[0] 1746134431.955551 trunc from 0x531a5b to 0x56bc59 (0x3a1ff bytes) 000146[1] 1746134431.988150 trunc from 0x56bc5a to 0x7d28d9 (0x266c80 bytes) 000148[0] 1746134432.020644 read 0x0f5000 thru 0x0f868e (0x368f bytes) 000152[0] 1746134432.038373 trunc from 0x7d28da to 0x33c95d (0x495f7c bytes) 000154[1] 1746134432.073764 read_OD 0x2af000 thru 0x2bdfff (0xf000 bytes) 000155[1] 1746134432.093460 mapwrite 0x89b000 thru 0x8aa1e3 (0xf1e4 bytes) 000157[0] 1746134432.272517 mapread 0x84d000 thru 0x853095 (0x6096 bytes) 000160[1] 1746134432.303113 mapwrite 0x603000 thru 0x6105d4 (0xd5d5 bytes) 000161[1] 1746134432.404804 trunc from 0x8aa1e4 to 0x2cfb93 (0x5da650 bytes) 000164[1] 1746134432.444979 mapread 0x136000 thru 0x13a28d (0x428e bytes) 000166[1] 1746134432.460004 mapwrite 0x37f000 thru 0x386560 (0x7561 bytes) 000167[1] 1746134432.557834 mapwrite 0x921000 thru 0x928a66 (0x7a67 bytes) 000169[1] 1746134432.645682 read_OD 0x67e000 thru 0x686fff (0x9000 bytes) 000170[0] 1746134432.657724 trunc from 0x928a67 to 0x407673 (0x5213f3 bytes) 000171[0] 1746134432.671046 mapread 0x03e000 thru 0x0454ba (0x74bb bytes) 000172[0] 1746134432.689077 write 0x2a3000 thru 0x2ace1e (0x9e1f bytes) 000173[0] 1746134432.708523 mapwrite 0x16b000 thru 0x174ac1 (0x9ac2 bytes) 000174[0] 1746134432.777865 mapwrite 0x1c1000 thru 0x1cce0c (0xbe0d bytes) 000176[1] 1746134432.833827 mapwrite 0x97d000 thru 0x987089 (0xa08a bytes) 000179[1] 1746134432.918758 write_OD 0x213000 thru 0x220fff (0xe000 bytes) 000184[1] 1746134432.982792 mapread 0x23c000 thru 0x24a7b6 (0xe7b7 bytes) 000189[0] 1746134433.003478 mapwrite 0x342000 thru 0x34fa65 (0xda66 bytes) 000191[0] 1746134433.115102 read 0x8ea000 thru 0x8eec6f (0x4c70 bytes) 000194[1] 1746134433.138414 mapwrite 0x137000 thru 0x145cd3 (0xecd4 bytes) 000195[1] 1746134433.232020 mapread 0x7bf000 thru 0x7cef65 (0xff66 bytes) 000204[0] 1746134433.354708 read 0x2f8000 thru 0x2f9406 (0x1407 bytes) 000205[0] 1746134433.366691 mapread 0x80e000 thru 0x80f3e4 (0x13e5 bytes) 000206[0] 1746134433.384585 read 0x70d000 thru 0x71ca34 (0xfa35 bytes) 000207[0] 1746134433.408166 mapread 0x2ec000 thru 0x2f1ab3 (0x5ab4 bytes) 000212[1] 1746134433.425168 read_OD 0x6d0000 thru 0x6dcfff (0xd000 bytes) 000213[1] 1746134433.434463 mapwrite 0x931000 thru 0x93a4a9 (0x94aa bytes) 000214[0] 1746134433.517980 write 0x0d4000 thru 0x0dbc39 (0x7c3a bytes) 000218[1] 1746134433.552892 mapread 0x8a1000 thru 0x8a935a (0x835b bytes) 000221[1] 1746134433.591711 write_OD 0x8a9000 thru 0x8b3fff (0xb000 bytes) 000223[1] 1746134433.654254 read_OD 0x178000 thru 0x17bfff (0x4000 bytes) 000225[0] 1746134433.657669 mapread 0x0f6000 thru 0x0f917c (0x317d bytes) 000227[0] 1746134433.669979 mapwrite 0x17e000 thru 0x18d9d8 (0xf9d9 bytes) 000228[0] 1746134433.742800 write 0x84e000 thru 0x85cd79 (0xed7a bytes) 000230[0] 1746134433.750166 write 0x633000 thru 0x63c42d (0x942e bytes) 000231[0] 1746134433.769804 read 0x322000 thru 0x32a23c (0x823d bytes) 000232[1] 1746134433.775683 read_OD 0x6c8000 thru 0x6d2fff (0xb000 bytes) 000234[1] 1746134433.799114 write_OD 0x0d7000 thru 0x0e1fff (0xb000 bytes) 000236[0] 1746134433.865530 write 0x316000 thru 0x31ee02 (0x8e03 bytes) truncating to largest ever: 0x99db74 000239[1] 1746134433.917325 trunc from 0x98708a to 0x99db73 (0x16aea bytes) 000240[1] 1746134433.953570 trunc from 0x99db74 to 0x60e4ba (0x38f6b9 bytes) 000241[0] 1746134433.969780 write 0x975000 thru 0x982cad (0xdcae bytes) 000242[0] 1746134433.979152 mapwrite 0x7cf000 thru 0x7d8d39 (0x9d3a bytes) 000246[0] 1746134434.062404 trunc from 0x982cae to 0x976974 (0xc339 bytes) 000247[1] 1746134434.080757 read_OD 0x01f000 thru 0x01ffff (0x1000 bytes) 000248[1] 1746134434.095293 write_OD 0x187000 thru 0x18afff (0x4000 bytes) 000251[1] 1746134434.124133 trunc from 0x976975 to 0x87ba17 (0xfaf5d bytes) 000253[1] 1746134434.141495 mapread 0x5f2000 thru 0x5fc5f5 (0xa5f6 bytes) 000255[0] 1746134434.178764 mapread 0x299000 thru 0x2a0636 (0x7637 bytes) 000256[0] 1746134434.202234 mapread 0x594000 thru 0x599ba1 (0x5ba2 bytes) 000257[0] 1746134434.217666 mapread 0x772000 thru 0x781384 (0xf385 bytes) 000259[0] 1746134434.233250 mapread 0x045000 thru 0x04b0ef (0x60f0 bytes) 000260[1] 1746134434.244492 mapread 0x80e000 thru 0x81baba (0xdabb bytes) 000262[1] 1746134434.258380 write_OD 0x54c000 thru 0x54efff (0x3000 bytes) 000263[0] 1746134434.295484 read 0x1e7000 thru 0x1f05f1 (0x95f2 bytes) 000264[1] 1746134434.300967 mapwrite 0x660000 thru 0x669734 (0x9735 bytes) 000265[0] 1746134434.358403 read 0x62a000 thru 0x636283 (0xc284 bytes) 000268[0] 1746134434.377526 trunc from 0x87ba18 to 0x88321a (0x7803 bytes) 000269[1] 1746134434.412104 write_OD 0x3e4000 thru 0x3e5fff (0x2000 bytes) 000270[0] 1746134434.454463 read 0x36d000 thru 0x379f05 (0xcf06 bytes) 000274[0] 1746134434.468796 read 0x6df000 thru 0x6e4bb9 (0x5bba bytes) 000277[1] 1746134434.476286 mapwrite 0x0e4000 thru 0x0e73f6 (0x33f7 bytes) 000279[1] 1746134434.539456 write_OD 0x587000 thru 0x593fff (0xd000 bytes) 000285[1] 1746134434.585845 mapread 0x582000 thru 0x58a988 (0x8989 bytes) 000286[1] 1746134434.594843 write_OD 0x0a3000 thru 0x0acfff (0xa000 bytes) 000288[0] 1746134434.627388 mapwrite 0x491000 thru 0x49dadc (0xcadd bytes) 000289[0] 1746134434.691978 read 0x6cf000 thru 0x6dda2d (0xea2e bytes) 000290[0] 1746134434.704387 write 0x538000 thru 0x53abf5 (0x2bf6 bytes) 000293[1] 1746134434.724941 read_OD 0x59a000 thru 0x5a7fff (0xe000 bytes) 000294[1] 1746134434.743620 read_OD 0x136000 thru 0x138fff (0x3000 bytes) 000296[1] 1746134434.748578 write_OD 0x2df000 thru 0x2e0fff (0x2000 bytes) 000298[0] 1746134434.780636 trunc from 0x88321b to 0x65c1f3 (0x227027 bytes) 000299[0] 1746134434.803383 read 0x032000 thru 0x037af5 (0x5af6 bytes) 000301[1] 1746134434.837844 mapwrite 0x5e2000 thru 0x5f0d4b (0xed4c bytes) 000302[1] 1746134434.910121 read_OD 0x4c2000 thru 0x4cdfff (0xc000 bytes) 000306[1] 1746134434.925179 mapwrite 0x948000 thru 0x9503fe (0x83ff bytes) 000313[0] 1746134435.088837 write 0x51c000 thru 0x5212fc (0x52fd bytes) 000317[1] 1746134435.112536 mapwrite 0x5b4000 thru 0x5bc961 (0x8962 bytes) 000319[0] 1746134435.167111 mapwrite 0x80b000 thru 0x8195be (0xe5bf bytes) 000320[0] 1746134435.244159 trunc from 0x9503ff to 0x29e8e0 (0x6b1b1e bytes) 000324[0] 1746134435.270617 trunc from 0x29e8e1 to 0x2d6aa9 (0x381c9 bytes) 000325[0] 1746134435.280405 write 0x509000 thru 0x50ca03 (0x3a04 bytes) truncating to largest ever: 0x9b3c70 000327[0] 1746134435.295474 trunc from 0x50ca04 to 0x9b3c6f (0x4a726c bytes) 000328[1] 1746134435.303881 trunc from 0x9b3c70 to 0x8eb6b0 (0xc85bf bytes) 000329[1] 1746134435.335596 mapwrite 0x341000 thru 0x344176 (0x3177 bytes) 000330[1] 1746134435.374853 mapwrite 0x0fc000 thru 0x109be0 (0xdbe1 bytes) 000335[0] 1746134435.446655 mapread 0x2c4000 thru 0x2cc5a8 (0x85a9 bytes) 000336[0] 1746134435.466735 read 0x8a0000 thru 0x8a9249 (0x924a bytes) 000337[0] 1746134435.472182 write 0x609000 thru 0x61208c (0x908d bytes) 000338[0] 1746134435.482305 trunc from 0x8eb6b1 to 0x537569 (0x3b4147 bytes) 000340[1] 1746134435.501633 mapread 0x3c7000 thru 0x3cc50f (0x5510 bytes) 000341[0] 1746134435.517538 mapwrite 0x54c000 thru 0x54cb77 (0xb78 bytes) 000342[0] 1746134435.580512 trunc from 0x54cb78 to 0x8321c3 (0x2e564c bytes) 000344[0] 1746134435.607438 trunc from 0x8321c4 to 0x70569b (0x12cb28 bytes) 000346[1] 1746134435.625148 read_OD 0x25c000 thru 0x264fff (0x9000 bytes) 000347[1] 1746134435.647282 mapwrite 0x799000 thru 0x7a3962 (0xa963 bytes) 000348[0] 1746134435.758821 trunc from 0x7a3963 to 0x5d6e95 (0x1ccacd bytes) 000350[0] 1746134435.776223 mapwrite 0x4f0000 thru 0x4f0971 (0x972 bytes) 000352[0] 1746134435.833440 mapread 0x38e000 thru 0x39d3c8 (0xf3c9 bytes) 000354[1] 1746134435.870818 trunc from 0x5d6e96 to 0x49a515 (0x13c980 bytes) 000355[0] 1746134435.904515 read 0x0b1000 thru 0x0b1194 (0x195 bytes) 000357[0] 1746134435.919747 read 0x009000 thru 0x016abe (0xdabf bytes) 000358[1] 1746134435.925822 trunc from 0x49a516 to 0x364cff (0x135816 bytes) 000359[0] 1746134435.948281 mapread 0x04c000 thru 0x052764 (0x6765 bytes) 000363[1] 1746134435.986009 trunc from 0x364d00 to 0x21156e (0x153791 bytes) 000365[0] 1746134436.011822 write 0x4df000 thru 0x4e861e (0x961f bytes) 000369[0] 1746134436.056234 write 0x246000 thru 0x2542ad (0xe2ae bytes) 000373[0] 1746134436.103448 read 0x200000 thru 0x20356f (0x3570 bytes) 000374[1] 1746134436.107590 trunc from 0x4e861f to 0x43e3fb (0xaa223 bytes) 000375[0] 1746134436.142810 mapwrite 0x6e6000 thru 0x6e9616 (0x3617 bytes) 000376[0] 1746134436.252825 mapread 0x664000 thru 0x66fad5 (0xbad6 bytes) 000379[1] 1746134436.277210 write_OD 0x446000 thru 0x44afff (0x5000 bytes) 000380[1] 1746134436.316963 write_OD 0x3e1000 thru 0x3e2fff (0x2000 bytes) 000381[0] 1746134436.372371 read 0x37d000 thru 0x380d3b (0x3d3c bytes) 000383[0] 1746134436.383903 mapwrite 0x830000 thru 0x835a69 (0x5a6a bytes) 000384[1] 1746134436.495816 mapwrite 0x311000 thru 0x3190c5 (0x80c6 bytes) 000386[0] 1746134436.620973 mapwrite 0x6c4000 thru 0x6d17b1 (0xd7b2 bytes) 000388[1] 1746134436.721118 write_OD 0x33d000 thru 0x34bfff (0xf000 bytes) 000389[1] 1746134436.773319 mapread 0x584000 thru 0x584407 (0x408 bytes) 000390[1] 1746134436.779985 mapread 0x13f000 thru 0x14bb19 (0xcb1a bytes) 000392[1] 1746134436.795406 write_OD 0x827000 thru 0x830fff (0xa000 bytes) 000396[1] 1746134436.870887 mapread 0x18d000 thru 0x19c837 (0xf838 bytes) 000402[0] 1746134436.885329 read 0x5b2000 thru 0x5b4333 (0x2334 bytes) 000405[0] 1746134436.893172 read 0x384000 thru 0x385a00 (0x1a01 bytes) 000409[0] 1746134436.897194 mapread 0x2b3000 thru 0x2b880d (0x580e bytes) 000411[1] 1746134436.909585 write_OD 0x5c4000 thru 0x5ccfff (0x9000 bytes) 000412[0] 1746134436.952125 mapread 0x4dd000 thru 0x4e9a84 (0xca85 bytes) 000413[0] 1746134436.982305 mapread 0x77c000 thru 0x78a8c7 (0xe8c8 bytes) 000415[1] 1746134437.031316 trunc from 0x835a6a to 0x85accb (0x25262 bytes) 000416[0] 1746134437.079534 mapread 0x55f000 thru 0x562811 (0x3812 bytes) 000417[0] 1746134437.111824 write 0x97a000 thru 0x983307 (0x9308 bytes) 000419[0] 1746134437.122434 read 0x66c000 thru 0x66e88e (0x288f bytes) 000421[1] 1746134437.155468 trunc from 0x983308 to 0x88e796 (0xf4b71 bytes) 000422[1] 1746134437.210105 read_OD 0x6a2000 thru 0x6abfff (0xa000 bytes) 000423[1] 1746134437.221879 trunc from 0x88e797 to 0x37ccd7 (0x511abf bytes) 000424[0] 1746134437.239211 mapread 0x22c000 thru 0x2315d8 (0x55d9 bytes) 000425[0] 1746134437.267303 trunc from 0x37ccd8 to 0x0420a7 (0x33ac30 bytes) 000426[0] 1746134437.286888 write 0x56a000 thru 0x56e0cf (0x40d0 bytes) 000427[1] 1746134437.288896 mapread 0x505000 thru 0x50708d (0x208e bytes) 000430[1] 1746134437.325176 mapread 0x4cb000 thru 0x4d711f (0xc120 bytes) 000434[0] 1746134437.348032 mapwrite 0x54d000 thru 0x54d6ff (0x700 bytes) 000435[0] 1746134437.429017 read 0x2d5000 thru 0x2d77dd (0x27de bytes) 000436[1] 1746134437.443656 read_OD 0x009000 thru 0x017fff (0xf000 bytes) 000437[1] 1746134437.464303 mapwrite 0x1a2000 thru 0x1b183a (0xf83b bytes) 000440[1] 1746134437.596481 trunc from 0x56e0d0 to 0x862aee (0x2f4a1f bytes) 000443[1] 1746134437.610199 mapread 0x85c000 thru 0x860cdc (0x4cdd bytes) 000444[1] 1746134437.636823 write_OD 0x482000 thru 0x48dfff (0xc000 bytes) 000445[1] 1746134437.690202 write_OD 0x976000 thru 0x976fff (0x1000 bytes) 000448[0] 1746134437.730632 mapread 0x75f000 thru 0x764d34 (0x5d35 bytes) 000450[1] 1746134437.743616 read_OD 0x09d000 thru 0x0a6fff (0xa000 bytes) 000451[1] 1746134437.749794 write_OD 0x07f000 thru 0x08bfff (0xd000 bytes) 000452[1] 1746134437.798867 mapread 0x796000 thru 0x7a5e83 (0xfe84 bytes) 000454[0] 1746134437.832445 read 0x53f000 thru 0x546ce8 (0x7ce9 bytes) 000456[1] 1746134437.854132 trunc from 0x977000 to 0x89970c (0xdd8f3 bytes) 000457[0] 1746134437.895066 write 0x149000 thru 0x14e464 (0x5465 bytes) 000458[1] 1746134437.915898 read_OD 0x148000 thru 0x151fff (0xa000 bytes) 000459[0] 1746134437.938672 write 0x6ae000 thru 0x6b2a15 (0x4a16 bytes) 000465[0] 1746134437.968814 write 0x8fd000 thru 0x90a88b (0xd88c bytes) 000466[0] 1746134437.970299 mapwrite 0x1ac000 thru 0x1b1910 (0x5911 bytes) 000473[1] 1746134438.058242 trunc from 0x90a88c to 0x7c4307 (0x146584 bytes) 000475[0] 1746134438.076848 read 0x28d000 thru 0x297b5f (0xab60 bytes) 000477[1] 1746134438.102793 write_OD 0x5a5000 thru 0x5b1fff (0xd000 bytes) 000479[1] 1746134438.144841 trunc from 0x7c4308 to 0x0f4310 (0x6cfff7 bytes) 000480[0] 1746134438.163431 mapread 0x0b4000 thru 0x0b9ad4 (0x5ad5 bytes) 000488[1] 1746134438.196941 mapwrite 0x9be000 thru 0x9bfb85 (0x1b86 bytes) 000491[0] 1746134438.277160 read 0x348000 thru 0x34d9d8 (0x59d9 bytes) 000492[0] 1746134438.292573 read 0x476000 thru 0x47bb22 (0x5b23 bytes) 000495[0] 1746134438.296734 trunc from 0x9bfb86 to 0x440347 (0x57f83e bytes) 000496[1] 1746134438.325922 mapread 0x02b000 thru 0x03a896 (0xf897 bytes) 000498[1] 1746134438.366011 write_OD 0x665000 thru 0x673fff (0xf000 bytes) 000500[0] 1746134438.427706 mapwrite 0x3b3000 thru 0x3bcaaf (0x9ab0 bytes) All operations completed A-OK! PASS 16a (26s) == sanityn test 16b: 500 iterations of dual-mount fsx at small size ========================================================== 17:20:41 (1746134441) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.304005 s, 27.6 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.265927 s, 31.5 MB/s Chance of close/open is 1 in 50 Seed set to 4442 fd 0: /mnt/lustre/f16b.sanityn fd 1: /mnt/lustre2/f16b.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000001[1] 1746134443.041834 write 0x6b2a8b thru 0x6b37c4 (0xd3a bytes) truncating to largest ever: 0x446b08 000002[0] 1746134443.064323 trunc from 0x6b37c5 to 0x446b07 (0x26ccbd bytes) 000003[0] 1746134443.088321 read 0x0ce5b4 thru 0x0cf5fd (0x104a bytes) 000004[0] 1746134443.095812 mapread 0x257af3 thru 0x257ded (0x2fb bytes) 000005[1] 1746134443.113751 read 0x32dbc4 thru 0x32e446 (0x883 bytes) 000006[1] 1746134443.132258 read 0x0ee04a thru 0x0eea07 (0x9be bytes) 000009[0] 1746134443.145796 write 0x3a94c3 thru 0x3a9f72 (0xab0 bytes) 000011[0] 1746134443.178192 mapwrite 0x964599 thru 0x965a9d (0x1505 bytes) 000012[1] 1746134443.323420 mapwrite 0x5f25da thru 0x5f36ad (0x10d4 bytes) 000013[1] 1746134443.459063 mapread 0x194692 thru 0x195233 (0xba2 bytes) 000016[0] 1746134443.519905 read 0x229eea thru 0x22b102 (0x1219 bytes) 000018[1] 1746134443.536762 write 0x22bc98 thru 0x22c419 (0x782 bytes) 000020[1] 1746134443.572230 mapwrite 0x4990db thru 0x49b028 (0x1f4e bytes) 000022[1] 1746134443.651150 mapread 0x2638da thru 0x264e91 (0x15b8 bytes) 000024[0] 1746134443.675440 mapwrite 0x2ed260 thru 0x2edb47 (0x8e8 bytes) 000028[0] 1746134443.791442 read 0x3ff234 thru 0x3ffb26 (0x8f3 bytes) 000029[1] 1746134443.804594 read 0x415614 thru 0x416502 (0xeef bytes) 000030[1] 1746134443.819248 mapwrite 0x0819d0 thru 0x08217f (0x7b0 bytes) 000031[1] 1746134443.903719 read 0x255677 thru 0x256ff6 (0x1980 bytes) 000032[1] 1746134443.924045 read 0x62cec2 thru 0x62d5c7 (0x706 bytes) 000035[0] 1746134443.955892 mapread 0x0898f5 thru 0x08a0d6 (0x7e2 bytes) 000036[1] 1746134443.987676 write 0x75e8a5 thru 0x7604fe (0x1c5a bytes) 000039[1] 1746134444.007958 read 0x39318f thru 0x394462 (0x12d4 bytes) 000046[0] 1746134444.032588 read 0x691a17 thru 0x692703 (0xced bytes) 000047[0] 1746134444.051779 write 0x39a492 thru 0x39ad6a (0x8d9 bytes) 000048[0] 1746134444.077769 mapread 0x155a48 thru 0x156b71 (0x112a bytes) 000052[1] 1746134444.099296 read 0x334b60 thru 0x334c82 (0x123 bytes) 000055[1] 1746134444.118317 mapread 0x7d2601 thru 0x7d4543 (0x1f43 bytes) 000056[0] 1746134444.134777 mapwrite 0x2bd36e thru 0x2be425 (0x10b8 bytes) 000058[0] 1746134444.234470 mapread 0x160940 thru 0x162129 (0x17ea bytes) truncating to largest ever: 0x735b1b 000059[0] 1746134444.258548 trunc from 0x965a9e to 0x735b1a (0x22ff83 bytes) 000060[0] 1746134444.309024 mapwrite 0x6fdef0 thru 0x6ff085 (0x1196 bytes) 000061[1] 1746134444.411572 trunc from 0x735b1b to 0x24fbaa (0x4e5f70 bytes) 000063[1] 1746134444.460184 write 0x850a36 thru 0x852807 (0x1dd2 bytes) 000065[1] 1746134444.486540 read 0x395ece thru 0x396445 (0x578 bytes) 000069[0] 1746134444.537108 mapwrite 0x7736b1 thru 0x7752f6 (0x1c46 bytes) 000070[0] 1746134444.640424 read 0x7be3ce thru 0x7bfd84 (0x19b7 bytes) 000072[1] 1746134444.673036 read 0x66f5eb thru 0x670e8b (0x18a1 bytes) 000073[0] 1746134444.683898 write 0x4057b5 thru 0x40674e (0xf9a bytes) 000076[0] 1746134444.759737 mapwrite 0x23d28d thru 0x23d448 (0x1bc bytes) 000078[1] 1746134444.822047 write 0x2d0f6e thru 0x2d1757 (0x7ea bytes) 000080[1] 1746134444.852976 write 0x87ccc2 thru 0x87d27c (0x5bb bytes) 000084[1] 1746134444.896979 read 0x34ddb3 thru 0x34f0ea (0x1338 bytes) 000087[0] 1746134444.932379 read 0x3cef3b thru 0x3d0771 (0x1837 bytes) 000088[0] 1746134444.946490 trunc from 0x87d27d to 0x540f8f (0x33c2ed bytes) 000093[1] 1746134444.987525 mapwrite 0x0c6276 thru 0x0c7bd2 (0x195d bytes) 000094[1] 1746134445.066100 read 0x0a6d51 thru 0x0a8992 (0x1c42 bytes) 000095[0] 1746134445.074228 trunc from 0x540f90 to 0x243d8c (0x2fd203 bytes) 000100[1] 1746134445.117280 mapread 0x1aabef thru 0x1abe88 (0x129a bytes) 000101[1] 1746134445.141493 mapread 0x10ee3b thru 0x10f4fb (0x6c1 bytes) 000102[0] 1746134445.154700 mapread 0x03eee2 thru 0x03f296 (0x3b5 bytes) 000104[1] 1746134445.172672 read 0x092217 thru 0x0937a1 (0x158b bytes) truncating to largest ever: 0x9917f3 000105[1] 1746134445.201740 trunc from 0x243d8d to 0x9917f2 (0x74da66 bytes) 000106[1] 1746134445.247737 mapread 0x90010c thru 0x901b53 (0x1a48 bytes) 000107[0] 1746134445.334666 write 0x4b86c7 thru 0x4b92ea (0xc24 bytes) 000111[1] 1746134445.406513 mapwrite 0x71fc8d thru 0x720dfb (0x116f bytes) 000115[0] 1746134445.495080 read 0x4a1b94 thru 0x4a1f3a (0x3a7 bytes) 000119[0] 1746134445.515982 read 0x37a047 thru 0x37bff1 (0x1fab bytes) 000121[0] 1746134445.533470 write 0x2483e8 thru 0x24844d (0x66 bytes) 000125[0] 1746134445.553522 write 0x4f7478 thru 0x4f7d21 (0x8aa bytes) 000126[0] 1746134445.582161 mapwrite 0x4b08ec thru 0x4b1af4 (0x1209 bytes) 000127[1] 1746134445.652743 read 0x89afd8 thru 0x89c7e4 (0x180d bytes) 000128[1] 1746134445.678258 trunc from 0x9917f3 to 0x2d4fc5 (0x6bc82d bytes) 000129[1] 1746134445.719043 trunc from 0x2d4fc6 to 0x619e4d (0x344e88 bytes) 000130[0] 1746134445.754908 mapread 0x41d23e thru 0x41d786 (0x549 bytes) 000132[0] 1746134445.801257 mapwrite 0x7a76fd thru 0x7a8e62 (0x1766 bytes) 000133[0] 1746134445.878236 write 0x8976fb thru 0x897a75 (0x37b bytes) 000134[0] 1746134445.898409 mapread 0x2284da thru 0x229a7e (0x15a5 bytes) 000135[0] 1746134445.906898 mapwrite 0x373770 thru 0x3738fb (0x18c bytes) 000136[1] 1746134445.959933 write 0x57351f thru 0x573d8b (0x86d bytes) 000140[0] 1746134446.020486 read 0x44ac91 thru 0x44cbff (0x1f6f bytes) 000141[1] 1746134446.039110 mapread 0x0b0c82 thru 0x0b1512 (0x891 bytes) 000142[1] 1746134446.066757 mapwrite 0x812123 thru 0x8136c5 (0x15a3 bytes) 000145[0] 1746134446.138546 trunc from 0x897a76 to 0x5489dc (0x34f099 bytes) 000146[0] 1746134446.164881 mapread 0x52ae5e thru 0x52c7ac (0x194f bytes) 000147[0] 1746134446.188915 write 0x5ad7c0 thru 0x5af62c (0x1e6d bytes) 000149[0] 1746134446.200641 mapwrite 0x042341 thru 0x044073 (0x1d33 bytes) 000150[1] 1746134446.263559 mapwrite 0x9c1570 thru 0x9c2886 (0x1317 bytes) 000152[0] 1746134446.389660 read 0x3717d1 thru 0x372bc0 (0x13f0 bytes) 000154[0] 1746134446.446725 write 0x9cf021 thru 0x9d0b42 (0x1b22 bytes) 000155[1] 1746134446.477560 mapwrite 0x14c292 thru 0x14ced9 (0xc48 bytes) 000156[1] 1746134446.569175 read 0x44451c thru 0x445481 (0xf66 bytes) 000157[1] 1746134446.582332 read 0x29d492 thru 0x29d6f1 (0x260 bytes) 000162[0] 1746134446.587256 write 0x43a41d thru 0x43a470 (0x54 bytes) 000167[1] 1746134446.648860 read 0x8c5305 thru 0x8c562e (0x32a bytes) 000168[1] 1746134446.665881 mapread 0x92b9fd thru 0x92d1c3 (0x17c7 bytes) 000170[0] 1746134446.704471 read 0x1af6a3 thru 0x1b04d7 (0xe35 bytes) 000171[0] 1746134446.728968 read 0x0ce88f thru 0x0d05b4 (0x1d26 bytes) 000172[1] 1746134446.750278 mapread 0x20e38d thru 0x20e5f1 (0x265 bytes) 000177[0] 1746134446.775800 mapread 0x984c90 thru 0x9867f3 (0x1b64 bytes) 000180[1] 1746134446.788175 read 0x09fc0e thru 0x0a184b (0x1c3e bytes) 000182[0] 1746134446.812821 trunc from 0x9d0b43 to 0x20d4d5 (0x7c366d bytes) 000183[0] 1746134446.835312 read 0x1eccff thru 0x1ed91f (0xc21 bytes) 000184[1] 1746134446.870030 mapwrite 0x705ddc thru 0x7077b2 (0x19d7 bytes) 000185[1] 1746134446.988484 read 0x29f4de thru 0x2a022f (0xd52 bytes) 000186[0] 1746134447.012896 mapwrite 0x00fdf2 thru 0x00feae (0xbd bytes) 000187[0] 1746134447.142498 mapwrite 0x0a8219 thru 0x0a943b (0x1223 bytes) 000188[0] 1746134447.245729 read 0x0a8ccf thru 0x0a966d (0x99f bytes) 000194[0] 1746134447.345584 trunc from 0x7077b3 to 0x5969fe (0x170db4 bytes) 000196[0] 1746134447.404504 read 0x382214 thru 0x382521 (0x30e bytes) 000197[1] 1746134447.418092 read 0x25170e thru 0x252f2a (0x181d bytes) 000198[0] 1746134447.456901 mapwrite 0x35f2ac thru 0x360b54 (0x18a9 bytes) 000199[1] 1746134447.538517 mapread 0x48f14b thru 0x48f8ad (0x763 bytes) 000200[1] 1746134447.563314 read 0x385e0d thru 0x386e41 (0x1035 bytes) 000202[0] 1746134447.583442 mapwrite 0x0bbd85 thru 0x0bdb26 (0x1da2 bytes) 000203[1] 1746134447.654138 trunc from 0x5969ff to 0x1dfc07 (0x3b6df7 bytes) 000205[1] 1746134447.694048 mapread 0x100be1 thru 0x100db6 (0x1d6 bytes) 000206[0] 1746134447.715930 mapread 0x18e4e8 thru 0x18f892 (0x13ab bytes) 000209[1] 1746134447.755007 write 0x6986db thru 0x69a5b8 (0x1ede bytes) 000210[0] 1746134447.757215 write 0x623569 thru 0x6250bc (0x1b54 bytes) 000214[1] 1746134447.808507 write 0x3b7beb thru 0x3b7c25 (0x3b bytes) 000215[1] 1746134447.837489 trunc from 0x69a5b9 to 0x14d0ac (0x54d50c bytes) 000216[0] 1746134447.878126 mapwrite 0x0442c2 thru 0x044300 (0x3f bytes) 000217[1] 1746134447.969712 mapwrite 0x94a4bc thru 0x94b71f (0x1264 bytes) 000223[0] 1746134448.070766 mapread 0x28e8b1 thru 0x28fdd7 (0x1527 bytes) 000227[0] 1746134448.113791 mapread 0x8670ad thru 0x867295 (0x1e9 bytes) 000228[0] 1746134448.122282 mapread 0x3dee7f thru 0x3e081c (0x199e bytes) 000230[0] 1746134448.141220 read 0x86c509 thru 0x86e461 (0x1f59 bytes) 000232[1] 1746134448.145500 mapread 0x1c3046 thru 0x1c4fba (0x1f75 bytes) 000234[1] 1746134448.153734 mapread 0x57388a thru 0x5746b4 (0xe2b bytes) 000237[1] 1746134448.172236 read 0x6c20c4 thru 0x6c3ebd (0x1dfa bytes) 000240[0] 1746134448.177547 read 0x2c81f3 thru 0x2ca145 (0x1f53 bytes) 000243[0] 1746134448.233109 trunc from 0x94b720 to 0x76fe6b (0x1db8b4 bytes) 000245[1] 1746134448.279581 read 0x4600b1 thru 0x460fd6 (0xf26 bytes) 000246[1] 1746134448.292905 read 0x4527ba thru 0x453d4d (0x1594 bytes) 000247[0] 1746134448.296803 trunc from 0x76fe6c to 0x58d9f4 (0x1e2477 bytes) 000248[1] 1746134448.319976 trunc from 0x58d9f5 to 0x1cf8b6 (0x3be13e bytes) 000255[0] 1746134448.435626 trunc from 0x1cf8b7 to 0x835d87 (0x6664d1 bytes) 000256[1] 1746134448.460819 trunc from 0x835d88 to 0x3d222c (0x463b5b bytes) 000258[0] 1746134448.500771 read 0x04367c thru 0x04492e (0x12b3 bytes) 000260[0] 1746134448.547598 mapread 0x0a7cf3 thru 0x0a989e (0x1bac bytes) 000261[0] 1746134448.564083 read 0x3824e4 thru 0x382be4 (0x701 bytes) 000263[0] 1746134448.565168 mapwrite 0x909ab8 thru 0x90a361 (0x8aa bytes) 000265[1] 1746134448.713960 trunc from 0x90a362 to 0x450d83 (0x4b95de bytes) 000268[0] 1746134448.778798 trunc from 0x450d84 to 0x547505 (0xf6782 bytes) 000269[1] 1746134448.833235 trunc from 0x547506 to 0x84539a (0x2fde95 bytes) 000270[1] 1746134448.852729 write 0x6adcb8 thru 0x6ae6fb (0xa44 bytes) 000271[0] 1746134448.857684 read 0x2b72b0 thru 0x2b86eb (0x143c bytes) 000272[1] 1746134448.875899 read 0x5603bc thru 0x56196d (0x15b2 bytes) 000273[0] 1746134448.889327 read 0x000e58 thru 0x00119c (0x345 bytes) 000274[0] 1746134448.902106 read 0x4422ef thru 0x442aee (0x800 bytes) 000275[0] 1746134448.917516 write 0x8675b2 thru 0x86856f (0xfbe bytes) 000278[0] 1746134448.945546 write 0x8c55dd thru 0x8c5bc3 (0x5e7 bytes) 000282[0] 1746134448.969202 mapwrite 0x87a224 thru 0x87b678 (0x1455 bytes) 000284[1] 1746134449.021133 mapread 0x75cdcf thru 0x75dce6 (0xf18 bytes) 000285[0] 1746134449.038997 trunc from 0x8c5bc4 to 0x926033 (0x60470 bytes) 000286[1] 1746134449.059710 trunc from 0x926034 to 0x20bc54 (0x71a3df bytes) 000289[1] 1746134449.111306 mapread 0x07ad03 thru 0x07bcd5 (0xfd3 bytes) 000291[0] 1746134449.129198 mapread 0x1def31 thru 0x1dfd98 (0xe68 bytes) 000293[0] 1746134449.153096 trunc from 0x20bc55 to 0x4e0ac3 (0x2d4e6f bytes) 000299[0] 1746134449.232523 read 0x237bf3 thru 0x238155 (0x563 bytes) 000300[1] 1746134449.239437 mapread 0x25e561 thru 0x25fe05 (0x18a5 bytes) 000301[1] 1746134449.272203 mapread 0x166c37 thru 0x16869f (0x1a69 bytes) 000305[0] 1746134449.308558 trunc from 0x4e0ac4 to 0x90f4c8 (0x42ea05 bytes) 000307[0] 1746134449.362426 mapread 0x5b659c thru 0x5b7f8d (0x19f2 bytes) 000309[0] 1746134449.406429 mapread 0x1b7751 thru 0x1b8b0a (0x13ba bytes) 000310[1] 1746134449.436177 write 0x06a73e thru 0x06bf2b (0x17ee bytes) 000313[1] 1746134449.482907 read 0x4786de thru 0x479c7e (0x15a1 bytes) 000315[1] 1746134449.499796 read 0x5666f7 thru 0x567744 (0x104e bytes) 000316[0] 1746134449.511423 mapwrite 0x106fa8 thru 0x10881f (0x1878 bytes) 000319[0] 1746134449.652051 read 0x7e592f thru 0x7e66e9 (0xdbb bytes) 000321[1] 1746134449.667288 trunc from 0x90f4c9 to 0x13ab39 (0x7d498f bytes) 000322[0] 1746134449.700823 mapwrite 0x5abed7 thru 0x5acacb (0xbf5 bytes) 000324[0] 1746134449.838441 trunc from 0x5acacc to 0x1c111c (0x3eb9af bytes) 000328[1] 1746134449.883882 trunc from 0x1c111d to 0x95ccab (0x79bb8f bytes) 000329[1] 1746134449.916898 read 0x25755c thru 0x257c3d (0x6e2 bytes) 000330[1] 1746134449.935469 read 0x1a9101 thru 0x1a9108 (0x8 bytes) truncating to largest ever: 0x9c7f63 000331[0] 1746134449.958851 trunc from 0x95ccac to 0x9c7f62 (0x6b2b7 bytes) 000333[0] 1746134449.995720 mapwrite 0x4ff222 thru 0x4ffd61 (0xb40 bytes) 000336[0] 1746134450.137746 write 0x1e4944 thru 0x1e5819 (0xed6 bytes) 000340[0] 1746134450.190313 mapread 0x79c1f8 thru 0x79cb8a (0x993 bytes) 000341[1] 1746134450.208017 mapread 0x701070 thru 0x702aef (0x1a80 bytes) 000343[0] 1746134450.265659 mapwrite 0x3b5f0a thru 0x3b7e4e (0x1f45 bytes) 000344[1] 1746134450.336048 read 0x0b9ea8 thru 0x0ba2d5 (0x42e bytes) 000345[0] 1746134450.348713 trunc from 0x9c7f63 to 0x2b4419 (0x713b49 bytes) 000346[1] 1746134450.391772 trunc from 0x2b441a to 0x1fb7d6 (0xb8c43 bytes) 000348[0] 1746134450.430196 mapread 0x0fb963 thru 0x0fc69f (0xd3d bytes) 000349[1] 1746134450.458129 read 0x1c2a36 thru 0x1c2b86 (0x151 bytes) 000350[0] 1746134450.485481 trunc from 0x1fb7d7 to 0x6be9b0 (0x4c31da bytes) 000351[0] 1746134450.524330 mapwrite 0x943f9e thru 0x9455d9 (0x163c bytes) 000352[1] 1746134450.611120 mapwrite 0x6fe943 thru 0x70075e (0x1e1c bytes) 000353[1] 1746134450.703782 mapwrite 0x8bfba8 thru 0x8c1035 (0x148e bytes) 000354[1] 1746134450.866592 mapread 0x09fb63 thru 0x0a0c19 (0x10b7 bytes) 000355[0] 1746134450.883173 mapread 0x291217 thru 0x291417 (0x201 bytes) 000356[0] 1746134450.913878 trunc from 0x9455da to 0x7f722c (0x14e3ad bytes) 000357[0] 1746134450.943487 mapread 0x6b51a8 thru 0x6b6a01 (0x185a bytes) 000358[0] 1746134450.965670 read 0x20dcb3 thru 0x20ef38 (0x1286 bytes) 000360[1] 1746134450.996213 mapread 0x6b692f thru 0x6b6a04 (0xd6 bytes) 000363[1] 1746134451.015795 mapread 0x303ab2 thru 0x304aca (0x1019 bytes) 000368[0] 1746134451.042410 read 0x57ea52 thru 0x57f5ef (0xb9e bytes) 000370[1] 1746134451.046480 trunc from 0x7f722d to 0x9152c6 (0x11e09a bytes) 000371[0] 1746134451.082933 read 0x8134e2 thru 0x814c92 (0x17b1 bytes) 000373[1] 1746134451.099588 mapwrite 0x9ff6bd thru 0x9ffc52 (0x596 bytes) 000374[0] 1746134451.180640 mapwrite 0x40f165 thru 0x40ff9c (0xe38 bytes) 000375[0] 1746134451.245299 mapwrite 0x6dd58f thru 0x6df48f (0x1f01 bytes) 000377[1] 1746134451.361503 write 0x8f4884 thru 0x8f5539 (0xcb6 bytes) 000380[1] 1746134451.403533 mapread 0x14d955 thru 0x14efa9 (0x1655 bytes) 000382[1] 1746134451.437892 read 0x456fb1 thru 0x457611 (0x661 bytes) 000384[0] 1746134451.480669 mapread 0x59d95b thru 0x59dbc5 (0x26b bytes) 000385[1] 1746134451.520819 mapwrite 0x1bd4e8 thru 0x1be8a2 (0x13bb bytes) 000389[1] 1746134451.631010 read 0x75313f thru 0x75316c (0x2e bytes) 000390[1] 1746134451.637061 read 0x22b6d1 thru 0x22c5d4 (0xf04 bytes) 000392[0] 1746134451.652969 trunc from 0x9ffc53 to 0x228da6 (0x7d6eac bytes) 000393[1] 1746134451.728875 write 0x5002d6 thru 0x5004cb (0x1f6 bytes) 000394[0] 1746134451.750789 read 0x37e245 thru 0x37f473 (0x122f bytes) 000401[1] 1746134451.880426 read 0x22ba30 thru 0x22bdeb (0x3bc bytes) 000402[0] 1746134451.893581 read 0x147fdc thru 0x148512 (0x537 bytes) 000403[0] 1746134451.922211 mapwrite 0x6c473d thru 0x6c5549 (0xe0d bytes) 000404[0] 1746134452.045398 mapwrite 0x17af02 thru 0x17b48c (0x58b bytes) 000405[1] 1746134452.111599 read 0x24516d thru 0x24520b (0x9f bytes) 000411[1] 1746134452.166707 mapwrite 0x44512b thru 0x446e78 (0x1d4e bytes) 000412[0] 1746134452.251572 write 0x678fa5 thru 0x67a5f2 (0x164e bytes) 000413[1] 1746134452.270984 trunc from 0x6c554a to 0x59ae11 (0x12a738 bytes) 000414[0] 1746134452.314782 write 0x2d0188 thru 0x2d0265 (0xde bytes) 000419[1] 1746134452.365718 mapwrite 0x7cd0b5 thru 0x7ce06b (0xfb7 bytes) skipping zero size write 000422[1] 1746134452.482496 mapread 0x7ab48c thru 0x7acc14 (0x1789 bytes) 000424[0] 1746134452.512051 trunc from 0x7ce06c to 0x47e45d (0x34fc0e bytes) 000425[1] 1746134452.540525 mapwrite 0x0cdcbd thru 0x0cf5f2 (0x1936 bytes) 000427[0] 1746134452.640469 read 0x15d6da thru 0x15f021 (0x1948 bytes) 000429[1] 1746134452.656974 write 0x7d9b54 thru 0x7db5a0 (0x1a4d bytes) 000430[0] 1746134452.672781 read 0x78f9a7 thru 0x790743 (0xd9d bytes) 000431[0] 1746134452.704682 mapread 0x7a5a9b thru 0x7a7809 (0x1d6f bytes) 000433[1] 1746134452.726926 read 0x34888b thru 0x349a7f (0x11f5 bytes) 000437[0] 1746134452.730798 mapwrite 0x96b1ee thru 0x96ce63 (0x1c76 bytes) 000438[1] 1746134452.872917 mapread 0x233572 thru 0x2353f5 (0x1e84 bytes) 000439[1] 1746134452.922060 mapread 0x098f68 thru 0x099321 (0x3ba bytes) 000440[0] 1746134452.933061 mapwrite 0x1c7c09 thru 0x1c99ac (0x1da4 bytes) 000441[1] 1746134453.027194 write 0x0bacf9 thru 0x0bad50 (0x58 bytes) 000443[1] 1746134453.061318 mapwrite 0x647398 thru 0x648650 (0x12b9 bytes) 000444[1] 1746134453.164787 write 0x46e872 thru 0x470870 (0x1fff bytes) 000447[0] 1746134453.187255 write 0x05b4b1 thru 0x05cb0e (0x165e bytes) 000448[0] 1746134453.218193 mapread 0x931463 thru 0x932888 (0x1426 bytes) 000449[1] 1746134453.252708 mapread 0x206200 thru 0x206ff2 (0xdf3 bytes) 000452[0] 1746134453.305547 write 0x68ceda thru 0x68ddeb (0xf12 bytes) 000454[1] 1746134453.366584 trunc from 0x96ce64 to 0x3e0c69 (0x58c1fa bytes) 000455[1] 1746134453.417941 mapread 0x13548b thru 0x13736f (0x1ee5 bytes) 000458[0] 1746134453.460751 mapwrite 0x0d96c4 thru 0x0db088 (0x19c5 bytes) 000460[0] 1746134453.548807 trunc from 0x3e0c6a to 0x551470 (0x170807 bytes) 000461[0] 1746134453.566540 mapread 0x353c69 thru 0x353d7e (0x116 bytes) 000462[0] 1746134453.571126 read 0x3ab0da thru 0x3aca19 (0x1940 bytes) 000464[1] 1746134453.597543 mapwrite 0x807c60 thru 0x808a21 (0xdc2 bytes) 000468[1] 1746134453.732872 trunc from 0x808a22 to 0x301c5b (0x506dc6 bytes) 000471[0] 1746134453.781233 read 0x20ca84 thru 0x20d451 (0x9ce bytes) 000472[1] 1746134453.845566 mapwrite 0x87a73b thru 0x87bd86 (0x164c bytes) 000474[1] 1746134453.959411 read 0x78e93b thru 0x78f18f (0x855 bytes) 000476[0] 1746134453.975435 read 0x5b03d3 thru 0x5b2381 (0x1faf bytes) 000477[1] 1746134453.993764 trunc from 0x87bd87 to 0x30a7bc (0x5715ca bytes) 000478[1] 1746134454.022477 mapread 0x2e2c21 thru 0x2e2c4b (0x2b bytes) 000479[1] 1746134454.040126 trunc from 0x30a7bd to 0x2c802e (0x4278e bytes) 000480[1] 1746134454.064673 trunc from 0x2c802f to 0x67b918 (0x3b38ea bytes) 000481[1] 1746134454.081982 mapwrite 0x639c68 thru 0x63b6cc (0x1a65 bytes) 000483[0] 1746134454.163225 read 0x10cfe5 thru 0x10e130 (0x114c bytes) 000485[1] 1746134454.204495 write 0x939762 thru 0x93a18e (0xa2d bytes) 000487[1] 1746134454.237079 mapread 0x0d6b9b thru 0x0d76d7 (0xb3d bytes) 000488[0] 1746134454.244205 trunc from 0x93a18f to 0x059f2b (0x8e0263 bytes) 000490[1] 1746134454.309300 read 0x001667 thru 0x003636 (0x1fd0 bytes) 000491[0] 1746134454.344063 read 0x003736 thru 0x004f24 (0x17ef bytes) 000492[0] 1746134454.357206 trunc from 0x059f2c to 0x35a822 (0x3008f7 bytes) 000497[1] 1746134454.425226 read 0x0e5ac2 thru 0x0e5e0e (0x34d bytes) 000498[0] 1746134454.488030 mapwrite 0x39ce11 thru 0x39df00 (0x10f0 bytes) 000499[0] 1746134454.672398 write 0x899f09 thru 0x89bb7f (0x1c77 bytes) All operations completed A-OK! PASS 16b (16s) == sanityn test 16c: verify data consistency on ldiskfs with cache disabled (b=17397) ========================================================== 17:20:56 (1746134456) SKIP: sanityn test_16c dio on ldiskfs only SKIP 16c (3s) == sanityn test 16d: Verify DIO and buffer IO with two clients ========================================================== 17:20:59 (1746134459) 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.323595 s, 25.9 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.274829 s, 30.5 MB/s ldlm.namespaces.MGC192.168.203.105@tcp.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8800aed5e800.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8800b61ae000.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8800aed5e800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8800b61ae000.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8800aed5e800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8800b61ae000.lru_size=clear 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 7.60595 s, 13.8 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.6801 s, 62.4 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.08213 s, 96.9 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 2.92571 s, 35.8 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.83068 s, 18.0 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.37186 s, 76.4 MB/s PASS 16d (26s) == sanityn test 16e: Verify size consistency for O_DIRECT write ========================================================== 17:21:26 (1746134486) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.116033 s, 90.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0760774 s, 13.8 MB/s PASS 16e (3s) == sanityn test 16f: rw sequential consistency vs drop_caches ========================================================== 17:21:29 (1746134489) TIMEOUT PASS 16f (23s) == sanityn test 16g: mmap rw sequential consistency vs drop_caches ========================================================== 17:21:53 (1746134513) TIMEOUT PASS 16g (24s) == sanityn test 16h: mmap read after truncate file ======= 17:22:17 (1746134537) ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16h (4s) == sanityn test 16i: read after truncate file ============ 17:22:21 (1746134541) ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16i (5s) == sanityn test 16j: race dio with buffered i/o ========== 17:22:26 (1746134546) 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 0.652798 s, 40.2 MB/s bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 1.02723 s, 25.5 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 2.38768 s, 11.0 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.378433 s, 69.3 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 1.84446 s, 14.2 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 dd: error reading '/mnt/lustre/f16j.sanityn.1': Invalid argument 0+0 records in 0+0 records out 0 bytes (0 B) copied, 0.18824 s, 0.0 kB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.414714 s, 63.2 MB/s sanityn test_16j: @@@@@@ FAIL: dio copy 1 w/bsize 1049600 failed: 1 Trace dump: = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7249:error() = /home/green/git/lustre-release/lustre/tests/sanityn.sh:760:test_16j() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7622:run_one() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7685:run_one_logged() = /home/green/git/lustre-release/lustre/tests/test-framework.sh:7503:run_test() = /home/green/git/lustre-release/lustre/tests/sanityn.sh:830:main() Dumping lctl log to /tmp/testlogs//sanityn.test_16j.*.1746134557.log rsync: chown "/tmp/testlogs/.sanityn.test_16j.debug_log.oleg305-server.1746134557.log.BmpAap" failed: Operation not permitted (1) rsync: chown "/tmp/testlogs/.sanityn.test_16j.dmesg.oleg305-server.1746134557.log.d6bZV5" failed: Operation not permitted (1) rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1651) [generator=3.1.2] FAIL 16j (14s) == sanityn test 16k: Parallel FSX and drop caches should not panic ========================================================== 17:22:43 (1746134563) + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.1 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.2 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.3 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.4 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.5 -l 67108864 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x1a7062c fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x1a7062c truncating to largest ever: 0x1a7062c truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x3c569db truncating to largest ever: 0x32cce75 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab All operations completed A-OK! All operations completed A-OK! All operations completed A-OK! All operations completed A-OK! + fsx 1 done: rc=0 All operations completed A-OK! Thu May 1 17:23:08 EDT 2025 + fsx 2 done: rc=0 Thu May 1 17:23:08 EDT 2025 + fsx 3 done: rc=0 Thu May 1 17:23:08 EDT 2025 + fsx 4 done: rc=0 Thu May 1 17:23:08 EDT 2025 + fsx 5 done: rc=0 Thu May 1 17:23:08 EDT 2025 PASS 16k (29s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 17:23:12 (1746134592) fail_loc=0x8000030a PASS 17 (5s) == sanityn test 18: mmap sanity check =========================================================================================== 17:23:17 (1746134597) mmap test1: basic mmap operation (PASS, 0.05949s) mmap test2: MAP_PRIVATE not write back (PASS, 0.032916s) mmap test3: concurrent mmap ops on two nodes (PASS, 18.114s) mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 4.2574s) mmap test5: read/write file to/from the buffer which mmapped to just this file (PASS, 0.12451s) mmap test6: check mmap write/read content on two nodes (PASS, 0.12264s) mmap test7: file i/o with an unmapped buffer (SKIPPED, 0s) mmap test8: SIGBUS for beyond file size (SKIPPED, 0s) mmap test9: SIGBUS for negative file offset (SKIPPED, 0s) mmap test10: multi-thread mmap access (PASS, 0.50724s) mmap test11: multi-thread shared mmap (PASS, 0.57566s) mmap test10: mtime not change for readonly mmap access (PASS, 1.0542s) PASS 18 (29s) == sanityn test 19: test concurrent uncached read races ========================================================================= 17:23:46 (1746134626) oleg305-server: error: get_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory pdsh@oleg305-client: oleg305-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (2s) == sanityn test 20: test extra readahead page left in cache ============================================================== 17:23:48 (1746134628) PASS 20 (3s) == sanityn test 21: Try to remove mountpoint on another dir ============================================================== 17:23:51 (1746134631) rmdir: removing directory, '/mnt/lustre/d21.sanityn' rmdir: failed to remove '/mnt/lustre/d21.sanityn': Device or resource busy rmdir: removing directory, '/mnt/lustre2/d21.sanityn' Removed mounted directory from another mountpoint, needs to be fixed PASS 21 (3s) == sanityn test 23: others should see updated atime while another read============================================================== 17:23:54 (1746134634) now is 1746134635 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.7018 new atime is 1746134697 PASS 23 (65s) == sanityn test 24a: lfs df [-ih] [path] test =================================================================================== 17:24:59 (1746134699) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 19456 3749888 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 45056 3724288 2% /mnt/lustre[OST:1] filesystem_summary: 7542784 64512 7474176 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 19456 3749888 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 45056 3724288 2% /mnt/lustre2[OST:1] filesystem_summary: 7542784 64512 7474176 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.6K 388 490.2K 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 114.9K 404 114.5K 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 114.1K 405 113.7K 1% /mnt/lustre[OST:1] filesystem_summary: 228.6K 388 228.2K 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.6K 388 490.2K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 114.9K 404 114.5K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 114.1K 405 113.7K 1% /mnt/lustre2[OST:1] filesystem_summary: 228.6K 388 228.2K 1% /mnt/lustre2 UUID bytes Used Available Use% Mounted on lustre-MDT0000_UUID 2.1G 3.2M 2.1G 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3.6G 19.0M 3.6G 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3.6G 44.0M 3.6G 2% /mnt/lustre[OST:1] filesystem_summary: 7.2G 63.0M 7.1G 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502379 388 501991 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 117652 404 117248 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 116853 405 116448 1% /mnt/lustre2[OST:1] filesystem_summary: 234084 388 233696 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 19456 3749888 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 45056 3724288 2% /mnt/lustre[OST:1] filesystem_summary: 7542784 64512 7474176 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.6K 388 490.2K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 114.9K 404 114.5K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 114.1K 405 113.7K 1% /mnt/lustre2[OST:1] filesystem_summary: 228.6K 388 228.2K 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502379 388 501991 1% /mnt/lustre[MDT:0] filesystem_summary: 502379 388 501991 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502379 388 501991 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 117652 404 117248 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 116853 405 116448 1% /mnt/lustre2[OST:1] filesystem_summary: 234084 388 233696 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 19456 3749888 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 45056 3724288 2% /mnt/lustre[OST:1] filesystem_summary: 7542784 64512 7474176 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 19456 3749888 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 45056 3724288 2% /mnt/lustre2[OST:1] filesystem_summary: 7542784 64512 7474176 1% /mnt/lustre2 PASS 24a (3s) == sanityn test 24b: lfs df should show both filesystems ========================================================================= 17:25:02 (1746134702) PASS 24b (3s) == sanityn test 25a: change ACL on one mountpoint be seen on another ============================================================= 17:25:05 (1746134705) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] PASS 25a (3s) == sanityn test 25b: change ACL under remote dir on one mountpoint be seen on another ========================================================== 17:25:08 (1746134708) SKIP: sanityn test_25b needs >= 2 MDTs SKIP 25b (1s) == sanityn test 26a: allow mtime to get older ============ 17:25:09 (1746134709) utime: good mknod times 1746134709 <= 1746134710 <= 1746134710 for /mnt/lustre/f26a utime: good mknod times 1746134709 <= 1746134710 <= 1746134710 for /mnt/lustre2/f26a utime: good utime mtimes 100000, atime 200000 utime: updated times for /mnt/lustre2/f26a PASS 26a (4s) == sanityn test 26b: sync mtime between ost and mds ====== 17:25:13 (1746134713) PASS 26b (4s) == sanityn test 26c: set-in-past on open file is not lost on close ========================================================== 17:25:18 (1746134718) multiop /mnt/lustre/f26c.sanityn vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.7018 File: '/mnt/lustre/f26c.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205272502391 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2025-05-01 17:25:18.000000000 -0400 Birth: - File: '/mnt/lustre2/f26c.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205272502391 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2025-05-01 17:25:18.000000000 -0400 Birth: - PASS 26c (4s) SKIP: sanityn test_27 skipping excluded test 27 SKIP: sanityn test_28 skipping ALWAYS excluded test 28 == sanityn test 30: recreate file race =================== 17:25:22 (1746134722) 0 PASS 30 (5s) == sanityn test 31a: voluntary cancel / blocking ast race======================================================================== 17:25:27 (1746134727) fail_loc=0x314 PASS 31a (3s) == sanityn test 31b: voluntary OST cancel / blocking ast race======================================================================== 17:25:30 (1746134730) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg305-server mds-ost sync done. sleep 5 for ZFS MDS Waiting for MDT destroys to complete fail_loc=0x314 fail_loc=0x316 fail_loc=0 fail_loc=0 Filesystem 1K-blocks Used Available Use% Mounted on 192.168.203.105@tcp:/lustre 7542784 64512 7472128 1% /mnt/lustre2 PASS 31b (14s) == sanityn test 31r: open-rename(replace) race =========== 17:25:44 (1746134744) -rw-r--r-- 1 root root 0 May 1 17:25 /mnt/lustre/f31r.sanityn.target fail_loc=0x1419 fail_val=3 PASS 31r (5s) == sanityn test 31s: open should not revalidate invalid dentry ========================================================== 17:25:49 (1746134749) /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 1213: 13603 Terminated tail -f $tfile PASS 31s (3s) == sanityn test 31t: getattr should not revalidate invalid dentry ========================================================== 17:25:52 (1746134752) PASS 31t (4s) SKIP: sanityn test_33a skipping SLOW test 33a == sanityn test 33b: COS: cross create/delete, 2 clients, benchmark under remote dir ========================================================== 17:25:56 (1746134756) SKIP: sanityn test_33b Need two or more clients, have 1 SKIP 33b (1s) == sanityn test 33c: Cancel cross-MDT lock should trigger Sync-on-Lock-Cancel ========================================================== 17:25:57 (1746134757) SKIP: sanityn test_33c needs >= 2 MDTs SKIP 33c (1s) == sanityn test 33d: dependent transactions should trigger COS ========================================================== 17:25:58 (1746134758) SKIP: sanityn test_33d needs >= 2 MDTs SKIP 33d (2s) == sanityn test 33e: independent transactions shouldn't trigger COS ========================================================== 17:26:00 (1746134760) SKIP: sanityn test_33e needs >= 2 MDTs SKIP 33e (1s) == sanityn test 34: no lock timeout under IO ============= 17:26:01 (1746134761) fail_loc=0x512 fail_loc=0x512 lock should not expire writing on client1 reading on client2 success fail_loc=0x511 fail_loc=0x511 lock should expire writing on client1 reading on client2 success oleg305-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800aed5e800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800aed5e800.ost_server_uuid in FULL state after 0 sec oleg305-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800aed5e800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800aed5e800.ost_server_uuid in IDLE state after 0 sec oleg305-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800aed5e800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800aed5e800.ost_server_uuid in FULL state after 0 sec oleg305-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800aed5e800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800aed5e800.ost_server_uuid in IDLE state after 0 sec oleg305-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800aed5e800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800aed5e800.ost_server_uuid in FULL state after 0 sec oleg305-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800aed5e800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800aed5e800.ost_server_uuid in IDLE state after 0 sec PASS 34 (93s) == sanityn test 35: -EINTR cp_ast vs. bl_ast race does not evict client ========================================================== 17:27:34 (1746134854) fail_loc=0x80000317 Race attempt 0 Wait for 20237 20391 for 60 sec... ls: reading directory /mnt/lustre/d35.sanityn: Interrupted system call - open/close 1377 (time 1746134867.15 total 10.01 last 137.63) - open/close 3250 (time 1746134877.15 total 20.01 last 187.30) total: 4000 open/close in 23.25 seconds: 172.02 ops/second fail_loc=0x0 Filesystem Size Used Avail Use% Mounted on 192.168.203.105@tcp:/lustre 7.2G 64M 7.2G 1% /mnt/lustre 192.168.203.105@tcp:/lustre 7.2G 64M 7.2G 1% /mnt/lustre2 PASS 35 (66s) == sanityn test 36: handle ESTALE/open-unlink correctly == 17:28:40 (1746134920) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg305-server mds-ost sync done. Waiting for MDT destroys to complete 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.456059 s, 115 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7018 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(0) *** before(7473152) after_dd(7414784) after(7465984) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.402689 s, 130 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7018 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(1) *** before(7465984) after_dd(7415808) after(7467008) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.38877 s, 135 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7018 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(2) *** before(7467008) after_dd(7414784) after(7465984) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.433934 s, 121 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7018 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(3) *** before(7465984) after_dd(7417856) after(7469056) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.400905 s, 131 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7018 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(4) *** before(7469056) after_dd(7417856) after(7469056) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.382491 s, 137 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7018 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(5) *** before(7469056) after_dd(7415808) after(7467008) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.504586 s, 104 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7018 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(6) *** before(7467008) after_dd(7415808) after(7467008) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.418852 s, 125 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7018 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(7) *** before(7467008) after_dd(7414784) after(7465984) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.418996 s, 125 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7018 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(8) *** before(7465984) after_dd(7417856) after(7469056) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.413603 s, 127 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7018 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(9) *** before(7469056) after_dd(7414784) after(7465984) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.464388 s, 113 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7018 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(10) *** before(7465984) after_dd(7417856) after(7469056) PASS 36 (231s) == sanityn test 37: check i_size is not updated for directory on close (bug 18695) ======================================================================== 17:32:31 (1746135151) multiop /mnt/lustre/d37.sanityn vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.7018 - create 3113 (time 1746135163.33 total 10.00 last 311.30) - create 5653 (time 1746135173.33 total 20.00 last 254.00) - create 8507 (time 1746135183.33 total 30.00 last 285.39) total: 10000 create in 35.33 seconds: 283.07 ops/second PASS 37 (40s) == sanityn test 39a: file mtime does not change after rename ========================================================== 17:33:11 (1746135191) repeat after cancel_lru_locks PASS 39a (4s) == sanityn test 39b: file mtime the same on clients with/out lock ========================================================== 17:33:15 (1746135195) repeat after cancel_lru_locks PASS 39b (4s) == sanityn test 39c: check truncate mtime update ================================================================================ 17:33:19 (1746135199) repeat after cancel_lru_locks PASS 39c (4s) == sanityn test 39d: sync write should update mtime ====== 17:33:23 (1746135203) fail_loc=0x411 fail_loc=0 PASS 39d (3s) == sanityn test 40a: pdirops: create vs others ======================================================================== 17:33:26 (1746135206) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40a (10s) == sanityn test 40b: pdirops: open|create and others ======================================================================== 17:33:36 (1746135216) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40b (9s) == sanityn test 40c: pdirops: link and others ======================================================================== 17:33:45 (1746135225) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40c (10s) == sanityn test 40d: pdirops: unlink and others ======================================================================== 17:33:56 (1746135236) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40d (11s) == sanityn test 40e: pdirops: rename and others ======================================================================== 17:34:06 (1746135246) No conflict No conflict No conflict No conflict No conflict No conflict PASS 40e (9s) == sanityn test 41a: pdirops: create vs mkdir ======================================================================== 17:34:15 (1746135255) mkdir: cannot create directory '/mnt/lustre2/f41a.sanityn': File exists Conflict PASS 41a (6s) == sanityn test 41b: pdirops: create vs create ======================================================================== 17:34:21 (1746135261) open: File exists Conflict PASS 41b (7s) == sanityn test 41c: pdirops: create vs link ======================================================================== 17:34:28 (1746135268) link: cannot create link '/mnt/lustre2/f41c.sanityn' to '/mnt/lustre2/f41c.sanityn-2': File exists Conflict PASS 41c (7s) == sanityn test 41d: pdirops: create vs unlink ======================================================================== 17:34:35 (1746135275) Conflict PASS 41d (7s) == sanityn test 41e: pdirops: create and rename (tgt) ======================================================================== 17:34:42 (1746135282) Conflict PASS 41e (7s) == sanityn test 41f: pdirops: create and rename (src) ======================================================================== 17:34:49 (1746135289) Conflict PASS 41f (8s) == sanityn test 41g: pdirops: create vs getattr ======================================================================== 17:34:57 (1746135297) Conflict PASS 41g (7s) == sanityn test 41h: pdirops: create vs readdir ======================================================================== 17:35:04 (1746135304) Conflict PASS 41h (7s) == sanityn test 41i: reint_open: create vs create ======== 17:35:11 (1746135311) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 41i (774s) == sanityn test 42a: pdirops: mkdir vs mkdir ======================================================================== 17:48:05 (1746136085) mkdir: cannot create directory '/mnt/lustre2/f42a.sanityn': File exists Conflict PASS 42a (7s) == sanityn test 42b: pdirops: mkdir vs create ======================================================================== 17:48:12 (1746136092) open: File exists Conflict PASS 42b (8s) == sanityn test 42c: pdirops: mkdir vs link ======================================================================== 17:48:20 (1746136100) link: cannot create link '/mnt/lustre2/f42c.sanityn' to '/mnt/lustre2/f42c.sanityn-2': File exists Conflict PASS 42c (7s) == sanityn test 42d: pdirops: mkdir vs unlink ======================================================================== 17:48:27 (1746136107) Conflict PASS 42d (8s) == sanityn test 42e: pdirops: mkdir and rename (tgt) ======================================================================== 17:48:35 (1746136115) mv: cannot overwrite directory '/mnt/lustre2/f42e.sanityn' with non-directory Conflict PASS 42e (6s) == sanityn test 42f: pdirops: mkdir and rename (src) ======================================================================== 17:48:42 (1746136122) Conflict PASS 42f (7s) == sanityn test 42g: pdirops: mkdir vs getattr ======================================================================== 17:48:49 (1746136129) Conflict PASS 42g (7s) == sanityn test 42h: pdirops: mkdir vs readdir ======================================================================== 17:48:56 (1746136136) Conflict PASS 42h (8s) == sanityn test 43a: rmdir,mkdir doesn't return -EEXIST ======================================================================== 17:49:04 (1746136144) PASS 43a (35s) == sanityn test 43b: pdirops: unlink vs create ======================================================================== 17:49:39 (1746136179) Conflict PASS 43b (7s) == sanityn test 43c: pdirops: unlink vs link ======================================================================== 17:49:46 (1746136186) Conflict PASS 43c (7s) == sanityn test 43d: pdirops: unlink vs unlink ======================================================================== 17:49:53 (1746136193) rm: cannot remove '/mnt/lustre2/f43d.sanityn': No such file or directory Conflict PASS 43d (6s) == sanityn test 43e: pdirops: unlink and rename (tgt) ======================================================================== 17:49:59 (1746136199) Conflict PASS 43e (7s) == sanityn test 43f: pdirops: unlink and rename (src) ======================================================================== 17:50:06 (1746136206) mv: cannot stat '/mnt/lustre2/f43f.sanityn': No such file or directory Conflict PASS 43f (8s) == sanityn test 43g: pdirops: unlink vs getattr ======================================================================== 17:50:14 (1746136214) stat: cannot stat '/mnt/lustre2/f43g.sanityn': No such file or directory Conflict PASS 43g (6s) == sanityn test 43h: pdirops: unlink vs readdir ======================================================================== 17:50:20 (1746136220) Conflict PASS 43h (5s) == sanityn test 43i: pdirops: unlink vs remote mkdir ===== 17:50:25 (1746136225) SKIP: sanityn test_43i needs >= 2 MDTs SKIP 43i (2s) == sanityn test 43j: racy mkdir return EEXIST ======================================================================== 17:50:27 (1746136227) mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists PASS 43j (62s) == sanityn test 43k: unlink vs create ==================== 17:51:29 (1746136289) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 43k (605s) == sanityn test 44a: pdirops: rename tgt vs mkdir ======================================================================== 18:01:34 (1746136894) mkdir: cannot create directory '/mnt/lustre2/f44a.sanityn': File exists Conflict Thu May 1 18:01:39 EDT 2025 PASS 44a (7s) == sanityn test 44b: pdirops: rename tgt vs create ======================================================================== 18:01:41 (1746136901) open: File exists Conflict PASS 44b (7s) == sanityn test 44c: pdirops: rename tgt vs link ======================================================================== 18:01:48 (1746136908) link: cannot create link '/mnt/lustre2/f44c.sanityn' to '/mnt/lustre2/f44c.sanityn-3': File exists Conflict PASS 44c (8s) == sanityn test 44d: pdirops: rename tgt vs unlink ======================================================================== 18:01:56 (1746136916) Conflict PASS 44d (8s) == sanityn test 44e: pdirops: rename tgt and rename (tgt) ======================================================================== 18:02:04 (1746136924) Conflict PASS 44e (7s) == sanityn test 44f: pdirops: rename tgt and rename (src) ======================================================================== 18:02:11 (1746136931) Conflict PASS 44f (8s) == sanityn test 44g: pdirops: rename tgt vs getattr ======================================================================== 18:02:19 (1746136939) Conflict PASS 44g (8s) == sanityn test 44h: pdirops: rename tgt vs readdir ======================================================================== 18:02:27 (1746136947) Conflict PASS 44h (8s) == sanityn test 44i: pdirops: rename tgt vs remote mkdir ========================================================== 18:02:35 (1746136955) SKIP: sanityn test_44i needs >= 2 MDTs SKIP 44i (1s) == sanityn test 45a: rename,mkdir doesn't return -EEXIST ======================================================================== 18:02:36 (1746136956) PASS 45a (71s) == sanityn test 45b: pdirops: rename src vs create ======================================================================== 18:03:47 (1746137027) Conflict PASS 45b (8s) == sanityn test 45c: pdirops: rename src vs link ======================================================================== 18:03:55 (1746137035) Conflict PASS 45c (8s) == sanityn test 45d: pdirops: rename src vs unlink ======================================================================== 18:04:03 (1746137043) rm: cannot remove '/mnt/lustre2/f45d.sanityn': No such file or directory Conflict PASS 45d (7s) == sanityn test 45e: pdirops: rename src and rename (tgt) ======================================================================== 18:04:10 (1746137050) Conflict PASS 45e (7s) == sanityn test 45f: pdirops: rename src and rename (src) ======================================================================== 18:04:18 (1746137058) mv: cannot stat '/mnt/lustre2/f45f.sanityn': No such file or directory Conflict PASS 45f (8s) == sanityn test 45g: pdirops: rename src vs getattr ======================================================================== 18:04:25 (1746137065) stat: cannot stat '/mnt/lustre2/f45g.sanityn': No such file or directory Conflict PASS 45g (7s) == sanityn test 45h: pdirops: unlink vs readdir ======================================================================== 18:04:32 (1746137072) Conflict PASS 45h (7s) == sanityn test 45i: pdirops: rename src vs remote mkdir ========================================================== 18:04:40 (1746137080) SKIP: sanityn test_45i needs >= 2 MDTs SKIP 45i (1s) == sanityn test 45j: read vs rename ====================== 18:04:41 (1746137081) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 45j (645s) == sanityn test 46a: pdirops: link vs mkdir ======================================================================== 18:15:26 (1746137726) mkdir: cannot create directory '/mnt/lustre2/f46a.sanityn': File exists Conflict PASS 46a (7s) == sanityn test 46b: pdirops: link vs create ======================================================================== 18:15:33 (1746137733) open: File exists Conflict PASS 46b (6s) == sanityn test 46c: pdirops: link vs link ======================================================================== 18:15:39 (1746137739) link: cannot create link '/mnt/lustre2/f46c.sanityn' to '/mnt/lustre2/f46c.sanityn': File exists Conflict PASS 46c (7s) == sanityn test 46d: pdirops: link vs unlink ======================================================================== 18:15:46 (1746137746) Conflict PASS 46d (6s) == sanityn test 46e: pdirops: link and rename (tgt) ======================================================================== 18:15:52 (1746137752) Conflict PASS 46e (6s) == sanityn test 46f: pdirops: link and rename (src) ======================================================================== 18:15:58 (1746137758) Conflict PASS 46f (7s) == sanityn test 46g: pdirops: link vs getattr ======================================================================== 18:16:05 (1746137765) Conflict PASS 46g (6s) == sanityn test 46h: pdirops: link vs readdir ======================================================================== 18:16:11 (1746137771) Conflict PASS 46h (5s) == sanityn test 46i: pdirops: link vs remote mkdir ======= 18:16:16 (1746137776) SKIP: sanityn test_46i needs >= 2 MDTs SKIP 46i (1s) == sanityn test 47a: pdirops: remote mkdir vs mkdir ====== 18:16:18 (1746137778) SKIP: sanityn test_47a needs >= 2 MDTs SKIP 47a (2s) == sanityn test 47b: pdirops: remote mkdir vs create ===== 18:16:19 (1746137779) SKIP: sanityn test_47b needs >= 2 MDTs SKIP 47b (1s) == sanityn test 47c: pdirops: remote mkdir vs link ======= 18:16:20 (1746137780) SKIP: sanityn test_47c needs >= 2 MDTs SKIP 47c (1s) == sanityn test 47d: pdirops: remote mkdir vs unlink ===== 18:16:21 (1746137781) SKIP: sanityn test_47d needs >= 2 MDTs SKIP 47d (1s) == sanityn test 47e: pdirops: remote mkdir and rename (tgt) ========================================================== 18:16:22 (1746137782) SKIP: sanityn test_47e needs >= 2 MDTs SKIP 47e (1s) == sanityn test 47f: pdirops: remote mkdir and rename (src) ========================================================== 18:16:24 (1746137784) SKIP: sanityn test_47f needs >= 2 MDTs SKIP 47f (1s) == sanityn test 47g: pdirops: remote mkdir vs getattr ==== 18:16:25 (1746137785) SKIP: sanityn test_47g needs >= 2 MDTs SKIP 47g (1s) == sanityn test 50: osc lvb attrs: enqueue vs. CP AST ======================================================================== 18:16:26 (1746137786) 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.0133736 s, 766 kB/s fail_loc=0x410 fail_loc=0x0 PASS 50 (8s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 18:16:34 (1746137794) 0+1 records in 0+1 records out 159 bytes (159 B) copied, 0.0140564 s, 11.3 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3519: kill: (11269) - No such process PASS 51a (4s) == sanityn test 51b: layout lock: glimpse should be able to restart if layout changed ========================================================== 18:16:38 (1746137798) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00579893 s, 177 kB/s fail_loc=0x1404 fail_val=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0340813 s, 30.8 MB/s 3145728 PASS 51b (15s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 18:16:53 (1746137813) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.0177689 s, 57.6 kB/s PASS 51c (7s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 18:17:00 (1746137820) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0196955 s, 53.2 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (3s) == sanityn test 51e: lfs getstripe does not break leases, part 2 ========================================================== 18:17:03 (1746137823) /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2447 0x98f 0x280000400 write lease(2) has applied. /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2447 0x98f 0x280000400 read lease(1) has applied. PASS 51e (5s) == sanityn test 54: rename locking ======================= 18:17:08 (1746137828) llite.lustre-ffff8800aed5e800.xattr_cache=1 llite.lustre-ffff8800b61ae000.xattr_cache=1 ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505005 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 18:17:09.000000000 -0400 Modify: 2025-05-01 18:17:09.000000000 -0400 Change: 2025-05-01 18:17:09.000000000 -0400 Birth: - ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000154 File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505008 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 18:17:15.000000000 -0400 Modify: 2025-05-01 18:17:15.000000000 -0400 Change: 2025-05-01 18:17:15.000000000 -0400 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 512 Blocks: 1 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505011 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 18:17:20.000000000 -0400 Modify: 2025-05-01 18:17:20.000000000 -0400 Change: 2025-05-01 18:17:20.000000000 -0400 Birth: - open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505010 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 18:17:20.000000000 -0400 Modify: 2025-05-01 18:17:21.000000000 -0400 Change: 2025-05-01 18:17:21.000000000 -0400 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000154 open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505014 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 18:17:26.000000000 -0400 Modify: 2025-05-01 18:17:26.000000000 -0400 Change: 2025-05-01 18:17:26.000000000 -0400 Birth: - File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505013 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 18:17:26.000000000 -0400 Modify: 2025-05-01 18:17:26.000000000 -0400 Change: 2025-05-01 18:17:26.000000000 -0400 Birth: - PASS 54 (26s) == sanityn test 55a: rename vs unlink target dir ========= 18:17:34 (1746137854) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55a.sanityn/d1/d2' to '/mnt/lustre/d55a.sanityn/d3/d2': No such file or directory PASS 55a (8s) == sanityn test 55b: rename vs unlink source dir ========= 18:17:42 (1746137862) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55b.sanityn/d1/d2' to '/mnt/lustre/d55b.sanityn/d3/d2': No such file or directory PASS 55b (8s) == sanityn test 55c: rename vs unlink orphan target dir == 18:17:50 (1746137870) fail_loc=0x156 mv: cannot move '/mnt/lustre/d55c.sanityn/d1/d2' to '/mnt/lustre/d55c.sanityn/d3/d2': No such file or directory PASS 55c (13s) == sanityn test 55d: rename file vs link ================= 18:18:03 (1746137883) fail_loc=0x155 mv: cannot move '/mnt/lustre/d55d.sanityn/f1' to '/mnt/lustre/d55d.sanityn/d55d.sanityn': Is a directory PASS 55d (10s) == sanityn test 56a: test llverdev with single large stripe ========================================================== 18:18:13 (1746137893) run_llverdev /mnt/lustre/f56a.sanityn -p -s 16000000 -c 4k llverdev: /mnt/lustre/f56a.sanityn is 16777216000000 bytes (15625 GB) in size timestamp: 1746137894 chunksize: 4096 size: 16777216000000 write offset: 16384000000kB 1.22078 MB/s read offset: 16384000000kB inf MB/s llverdev: data verified successfully PASS 56a (53s) == sanityn test 56b: test llverdev and partial verify of wide stripe file ========================================================== 18:19:07 (1746137947) run_llverdev /mnt/lustre/f56b.sanityn -p -s 32000000 -c 4k llverdev: read /mnt/lustre/f56b.sanityn@33554431995904+4096 no data: Success llverdev: read /mnt/lustre/f56b.sanityn@33554431995904+4096 no data: Success llverdev: /mnt/lustre/f56b.sanityn is 33554432000000 bytes (31250 GB) in size timestamp: 1746137948 chunksize: 4096 size: 33554432000000 write offset: 32768000000kB 2.59732 MB/s read offset: 32768000000kB -nan MB/s llverdev: data verified successfully PASS 56b (53s) == sanityn test 60: Verify data_version behaviour ======== 18:19:59 (1746137999) PASS 60 (3s) == sanityn test 70a: cd directory && rm directory ======== 18:20:02 (1746138002) PASS 70a (3s) == sanityn test 70b: remove files after calling rm_entry ========================================================== 18:20:06 (1746138006) PASS 70b (4s) == sanityn test 71a: correct file map just after write operation is finished ========================================================== 18:20:09 (1746138009) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00899711 s, 7.3 MB/s SKIP: sanityn test_71a ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71a (2s) == sanityn test 71b: check fiemap support for stripecount > 1 ========================================================== 18:20:11 (1746138011) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00545706 s, 12.0 MB/s SKIP: sanityn test_71b ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71b (1s) == sanityn test 71c: check FIEMAP_EXTENT_LAST flag with different extents number ========================================================== 18:20:12 (1746138012) SKIP: sanityn test_71c support only ldiskfs ost SKIP 71c (2s) == sanityn test 71d: fiemap corruption test with fm_extent_count=0 ========================================================== 18:20:14 (1746138014) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00553513 s, 11.8 MB/s SKIP: sanityn test_71d ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71d (1s) == sanityn test 72: getxattr/setxattr cache should be consistent between nodes ========================================================== 18:20:15 (1746138015) llite.lustre-ffff8800aed5e800.xattr_cache=1 llite.lustre-ffff8800b61ae000.xattr_cache=1 getfattr: Removing leading '/' from absolute path names user.attr1="value1" getfattr: Removing leading '/' from absolute path names user.attr1="value2" getfattr: Removing leading '/' from absolute path names getfattr: Removing leading '/' from absolute path names b362740ad371eae580e7f85452e8830b - 870e072da1ebfc20ea8c0cd3d6bdf3b6 - PASS 72 (3s) == sanityn test 73: getxattr should not cause xattr lock cancellation ========================================================== 18:20:18 (1746138018) llite.lustre-ffff8800aed5e800.xattr_cache=1 llite.lustre-ffff8800b61ae000.xattr_cache=1 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" PASS 73 (3s) == sanityn test 74: flock deadlock: different mounts ======================================================================== 18:20:21 (1746138021) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.0117609 s, 87.1 kB/s 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.0147691 s, 69.3 kB/s 23755: get lock2 23756: get lock1 23756: done 23756: get lock2 23755: done 23755: get lock1 fcntl cmd 7 failed: Resource deadlock avoided 23756: cannot get lock2: Resource deadlock avoided 23756: exit rc=0 fcntl cmd 7 failed: Resource deadlock avoided 23755: cannot get lock1: Resource deadlock avoided 23755: done 23755: exit rc=0 PASS 74 (7s) == sanityn test 75: osc: upcall after unuse lock============================================================================= 18:20:28 (1746138028) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0189334 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0226072 s, 46.4 MB/s fail_loc=0x31d /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 4108: 24399 Killed stat -c %s $DIR1/$tfile fail_loc=0 PASS 75 (7s) == sanityn test 76: Verify MDT open_files listing ======== 18:20:35 (1746138035) opening files: ........ closing files: ........ PASS 76 (21s) == sanityn test 77a: check FIFO NRS policy =============== 18:20:56 (1746138056) ost.OSS.ost.nrs_policies=fifo ost.OSS.ost_create.nrs_policies=fifo ost.OSS.ost_io.nrs_policies=fifo ost.OSS.ost_out.nrs_policies=fifo ost.OSS.ost_seq.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.1216 s, 138 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119949 s, 87.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0162852 s, 64.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0355559 s, 29.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0451245 s, 23.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0443291 s, 23.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0398877 s, 26.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0485714 s, 21.6 MB/s , 0.0443818 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0411704 s, 25.5 MB/s , 0.0523302 s, 20.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0581372 s, 18.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0409629 s, 25.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0458023 s, 22.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0605158 s, 17.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0642333 s, 16.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.077344 s, 13.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0194048 s, 54.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0231851 s, 45.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0236565 s, 44.3 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0236835 s, 44.3 MB/s , 0.0281597 s, 37.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0239003 s, 43.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.030803 s, 34.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0250633 s, 41.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0254815 s, 41.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0247835 s, 42.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0264612 s, 39.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0287817 s, 36.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0283194 s, 37.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0260232 s, 40.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0293824 s, 35.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0316942 s, 33.1 MB/s removed '/mnt/lustre/d77a.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77a.sanityn/nrs_r_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77a.sanityn' PASS 77a (4s) == sanityn test 77b: check CRR-N NRS policy ============== 18:21:00 (1746138060) ost.OSS.ost.nrs_policies=crrn ost.OSS.ost_create.nrs_policies=crrn ost.OSS.ost_io.nrs_policies=crrn ost.OSS.ost_out.nrs_policies=crrn ost.OSS.ost_seq.nrs_policies=crrn ost.OSS.ost.nrs_crrn_quantum=1 ost.OSS.ost_create.nrs_crrn_quantum=1 ost.OSS.ost_io.nrs_crrn_quantum=1 ost.OSS.ost_out.nrs_crrn_quantum=1 ost.OSS.ost_seq.nrs_crrn_quantum=1 policy: crr-n, crrn_quantum 1 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.116972 s, 143 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0111838 s, 93.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0114137 s, 91.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0268331 s, 39.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0251169 s, 41.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0401021 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0427251 s, 24.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0427486 s, 24.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0443453 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0464877 s, 22.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0447294 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0501259 s, 20.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0446789 s, 23.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0530328 s, 19.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0532942 s, 19.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0525761 s, 19.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0505561 s, 20.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0162845 s, 64.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105137 s, 99.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00439107 s, 239 MB/s , 0.0172179 s, 60.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00945476 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00255402 s, 411 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0246828 s, 42.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0214599 s, 48.9 MB/s , 0.0190472 s, 55.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0257063 s, 40.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0200282 s, 52.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0168314 s, 62.3 MB/s , 0.019512 s, 53.7 MB/s , 0.0210856 s, 49.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0223374 s, 46.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0228345 s, 45.9 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost.nrs_crrn_quantum=64 ost.OSS.ost_create.nrs_crrn_quantum=64 ost.OSS.ost_io.nrs_crrn_quantum=64 ost.OSS.ost_out.nrs_crrn_quantum=64 ost.OSS.ost_seq.nrs_crrn_quantum=64 policy: crr-n, crrn_quantum 64 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.107323 s, 156 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124119 s, 84.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00705659 s, 149 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0181404 s, 57.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0465372 s, 22.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.050511 s, 20.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0502483 s, 20.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0551059 s, 19.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0563578 s, 18.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0557837 s, 18.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0553973 s, 18.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0585748 s, 17.9 MB/s , 0.0576373 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0599166 s, 17.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0599601 s, 17.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0634115 s, 16.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0652914 s, 16.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124966 s, 83.9 MB/s 1+0 records in 1+0 records out , 0.0123178 s, 85.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0140683 s, 74.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00972754 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138709 s, 75.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0118098 s, 88.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0144888 s, 72.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0118484 s, 88.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151385 s, 69.3 MB/s , 0.0152887 s, 68.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0154607 s, 67.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0173475 s, 60.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0160892 s, 65.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0175143 s, 59.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0184684 s, 56.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0205613 s, 51.0 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg305-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77b (4s) == sanityn test 77c: check ORR NRS policy ================ 18:21:04 (1746138064) ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_orr_quantum=1 ost.OSS.ost_io.nrs_orr_offset_type=physical ost.OSS.ost_io.nrs_orr_supported=reads policy: orr, orr_quantum 1, orr_offset_type physical, orr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.140926 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155576 s, 67.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0261726 s, 40.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0470874 s, 22.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0429097 s, 24.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0316247 s, 33.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0489731 s, 21.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0436628 s, 24.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0619564 s, 16.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.062319 s, 16.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0584063 s, 18.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0456695 s, 23.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0589286 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0541435 s, 19.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0635153 s, 16.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0646213 s, 16.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0713543 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00823713 s, 127 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00170152 s, 616 MB/s 1048576 bytes (1.0 MB) copied, 0.0187236 s, 56.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0469348 s, 22.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0284343 s, 36.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126474 s, 82.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120646 s, 86.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.04275 s, 24.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0164509 s, 63.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00353695 s, 296 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0385272 s, 27.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117335 s, 89.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206296 s, 50.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00334735 s, 313 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105255 s, 99.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00807219 s, 130 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=writes ost.OSS.ost_io.nrs_orr_quantum=64 policy: orr, orr_quantum 64, orr_offset_type physical, orr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.13149 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0200211 s, 52.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0237356 s, 44.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187521 s, 55.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187223 s, 56.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0737769 s, 14.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0837737 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.098897 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0833416 s, 12.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.100377 s, 10.4 MB/s , 0.102702 s, 10.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.083118 s, 12.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0860342 s, 12.2 MB/s 1048576 bytes (1.0 MB) copied, 0.102551 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0831375 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.108853 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.119497 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0317269 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0150802 s, 69.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142759 s, 73.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0152748 s, 68.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0171363 s, 61.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.035895 s, 29.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0167323 s, 62.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0363187 s, 28.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0358409 s, 29.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0386056 s, 27.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0198078 s, 52.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0259274 s, 40.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0268175 s, 39.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0277917 s, 37.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.028186 s, 37.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0317249 s, 33.1 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg305-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=reads_and_writes ost.OSS.ost_io.nrs_orr_offset_type=logical policy: orr, orr_quantum 64, orr_offset_type logical, orr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.163943 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0118445 s, 88.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187198 s, 56.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0366364 s, 28.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0373429 s, 28.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0399591 s, 26.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0370048 s, 28.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0528481 s, 19.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0462287 s, 22.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0544051 s, 19.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0595496 s, 17.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.074765 s, 14.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0686168 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.075612 s, 13.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.073855 s, 14.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0787053 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0844502 s, 12.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0105997 s, 98.9 MB/s , 0.0197993 s, 53.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116375 s, 90.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0140438 s, 74.7 MB/s , 0.0211542 s, 49.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.019393 s, 54.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0078707 s, 133 MB/s , 0.0114195 s, 91.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00995471 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108312 s, 96.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113581 s, 92.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113711 s, 92.2 MB/s 1048576 bytes (1.0 MB) copied, 0.01222 s, 85.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120616 s, 86.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0127149 s, 82.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0145448 s, 72.1 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77c (5s) == sanityn test 77d: check TRR nrs policy ================ 18:21:10 (1746138070) ost.OSS.ost_io.nrs_policies=trr ost.OSS.ost_io.nrs_trr_quantum=1 ost.OSS.ost_io.nrs_trr_offset_type=physical ost.OSS.ost_io.nrs_trr_supported=reads policy: trr, trr_quantum 1, trr_offset_type physical, trr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.191754 s, 87.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0204555 s, 51.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0306348 s, 34.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0622433 s, 16.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0899692 s, 11.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0879345 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0880806 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0947811 s, 11.1 MB/s , 0.0862273 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0958891 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.101124 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.105245 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0963957 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.103727 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.107773 s, 9.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102955 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.116734 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107003 s, 98.0 MB/s , 0.0149355 s, 70.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00166472 s, 630 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00984287 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0217904 s, 48.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0207542 s, 50.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0183755 s, 57.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123788 s, 84.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00155631 s, 674 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0015905 s, 659 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00172259 s, 609 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00336198 s, 312 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0279515 s, 37.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0370696 s, 28.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0166524 s, 63.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0049006 s, 214 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg305-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=writes ost.OSS.ost_io.nrs_trr_quantum=64 policy: trr, trr_quantum 64, trr_offset_type physical, trr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.179907 s, 93.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0139351 s, 75.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0175551 s, 59.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0671435 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0671176 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0792852 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0809352 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0820486 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0836711 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0832994 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0897112 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.093919 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0964357 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0906123 s, 11.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0993968 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0989268 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.110325 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015324 s, 68.4 MB/s , 0.00166595 s, 629 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0336011 s, 31.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0286552 s, 36.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206311 s, 50.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0272127 s, 38.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0440748 s, 23.8 MB/s , 0.0389199 s, 26.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0282351 s, 37.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00404742 s, 259 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0272427 s, 38.5 MB/s , 0.0212253 s, 49.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0326544 s, 32.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0382268 s, 27.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0387557 s, 27.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.014352 s, 73.1 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=reads_and_writes ost.OSS.ost_io.nrs_trr_offset_type=logical policy: trr, trr_quantum 64, trr_offset_type logical, trr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.150155 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0190067 s, 55.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0237057 s, 44.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0604145 s, 17.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0659351 s, 15.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0605994 s, 17.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0708193 s, 14.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0800748 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.08557 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0719843 s, 14.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0828344 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0913157 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0840228 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0925123 s, 11.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0907092 s, 11.6 MB/s 1048576 bytes (1.0 MB) copied, 0.110698 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.120483 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0368556 s, 28.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0384904 s, 27.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.039967 s, 26.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0331705 s, 31.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0366403 s, 28.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0384773 s, 27.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0374277 s, 28.0 MB/s , 0.0396189 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0423636 s, 24.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0426189 s, 24.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0444063 s, 23.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0475776 s, 22.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0466057 s, 22.5 MB/s 1048576 bytes (1.0 MB) copied, 0.047842 s, 21.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.04556 s, 23.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0552514 s, 19.0 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg305-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77d (7s) == sanityn test 77e: check TBF NID nrs policy ============ 18:21:16 (1746138076) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_tbf_rule=start localhost nid={0@lo} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start clients nid={192.168.203.5@tcp} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start others nid={*.*.*.*@tcp} rate=50 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.194057 s, 86.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.025868 s, 40.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.023337 s, 44.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0158045 s, 66.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0911765 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0867196 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.110474 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0883103 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0982977 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.101767 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.134616 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.144184 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.145226 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.142101 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.139778 s, 7.5 MB/s , 0.134571 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.149321 s, 7.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0273891 s, 38.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.030242 s, 34.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0209957 s, 49.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0349916 s, 30.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0372517 s, 28.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151509 s, 69.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187677 s, 55.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187475 s, 55.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0202073 s, 51.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203395 s, 51.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0233819 s, 44.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0235793 s, 44.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.024725 s, 42.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0254439 s, 41.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0262393 s, 40.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0291977 s, 35.9 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg305-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change localhost rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change clients rate=101 ost.OSS.ost_io.nrs_tbf_rule=change others rate=51 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.208005 s, 80.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0241381 s, 43.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0269404 s, 38.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0912399 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0973701 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0972305 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0717078 s, 14.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0947133 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.091999 s, 11.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0853652 s, 12.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.115323 s, 9.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.107885 s, 9.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0971785 s, 10.8 MB/s 1048576 bytes (1.0 MB) copied, 0.10285 s, 10.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.100459 s, 10.4 MB/s 1048576 bytes (1.0 MB) copied, 0.111712 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.147175 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0278178 s, 37.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0223831 s, 46.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0336189 s, 31.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0246494 s, 42.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0257753 s, 40.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0297535 s, 35.2 MB/s , 0.0294956 s, 35.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0303336 s, 34.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0359971 s, 29.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0338198 s, 31.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0390738 s, 26.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.035844 s, 29.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0417142 s, 25.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0371547 s, 28.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0390709 s, 26.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0391388 s, 26.8 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg305-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop localhost ost.OSS.ost_io.nrs_tbf_rule=stop clients ost.OSS.ost_io.nrs_tbf_rule=stop others 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.128431 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0241922 s, 43.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0329071 s, 31.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0433691 s, 24.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.062289 s, 16.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0635101 s, 16.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0879529 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0846334 s, 12.4 MB/s , 0.0877334 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0806891 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0944383 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.090805 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0856177 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.097593 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0870622 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0856432 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.10555 s, 9.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.029158 s, 36.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.030322 s, 34.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0201314 s, 52.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109766 s, 95.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0285911 s, 36.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146209 s, 71.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0154729 s, 67.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0188978 s, 55.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.019427 s, 54.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203843 s, 51.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0205003 s, 51.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0235557 s, 44.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0235617 s, 44.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0250061 s, 41.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0260104 s, 40.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.031459 s, 33.3 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg305-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.164055 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0173291 s, 60.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0221334 s, 47.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0294025 s, 35.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0222016 s, 47.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0642262 s, 16.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0922145 s, 11.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0980527 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0802145 s, 13.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0806963 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0986472 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.119064 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0987386 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.119716 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.103298 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.106111 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.133259 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00237805 s, 441 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0299491 s, 35.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00536095 s, 196 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00306746 s, 342 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00167276 s, 627 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.034564 s, 30.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0408444 s, 25.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00163422 s, 642 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0037716 s, 278 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00354997 s, 295 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0393177 s, 26.7 MB/s , 0.0259254 s, 40.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.02839 s, 36.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0286042 s, 36.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0236048 s, 44.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0265366 s, 39.5 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg305-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' PASS 77e (11s) == sanityn test 77f: check TBF JobID nrs policy ========== 18:21:27 (1746138087) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start runas jobid={iozone.500 dd.500 tiotest.500} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start iozone_runas jobid={iozone.500} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.293316 s, 57.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0289785 s, 36.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0235511 s, 44.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.115929 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.122463 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.140009 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.141983 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.138656 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.136855 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.143528 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.154261 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.168345 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.171561 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.167131 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.166342 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.175261 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.174907 s, 6.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0485591 s, 21.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0488675 s, 21.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0463008 s, 22.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0483995 s, 21.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0506505 s, 20.7 MB/s , 0.0474609 s, 22.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0496446 s, 21.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0587485 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0579835 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0610767 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.061279 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0593632 s, 17.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0652318 s, 16.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0489448 s, 21.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0689377 s, 15.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0757334 s, 13.8 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change runas rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change iozone_runas rate=101 ost.OSS.ost_io.nrs_tbf_rule=change dd_runas rate=51 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.119061 s, 141 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0164475 s, 63.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0201449 s, 52.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0471404 s, 22.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0596479 s, 17.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0524976 s, 20.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0540888 s, 19.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0750711 s, 14.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0657962 s, 15.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0622015 s, 16.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0702795 s, 14.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0748943 s, 14.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0921469 s, 11.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0975492 s, 10.7 MB/s 1048576 bytes (1.0 MB) copied, 0.097625 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.103125 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0930822 s, 11.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0193714 s, 54.1 MB/s , 0.0193295 s, 54.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142882 s, 73.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0172471 s, 60.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.017274 s, 60.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0186584 s, 56.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0190407 s, 55.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0209919 s, 50.0 MB/s , 0.0213271 s, 49.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0235644 s, 44.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0231546 s, 45.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.024739 s, 42.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0227682 s, 46.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0233583 s, 44.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0238991 s, 43.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0294286 s, 35.6 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop runas ost.OSS.ost_io.nrs_tbf_rule=stop iozone_runas ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.134874 s, 124 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141299 s, 74.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0210541 s, 49.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0477598 s, 22.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0500409 s, 21.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0540789 s, 19.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0609668 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0687137 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.078229 s, 13.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0646956 s, 16.2 MB/s , 0.0746217 s, 14.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0679653 s, 15.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0842257 s, 12.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.08357 s, 12.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0698603 s, 15.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0796638 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0887625 s, 11.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0284744 s, 36.8 MB/s , 0.0356221 s, 29.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107436 s, 97.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0140785 s, 74.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0145771 s, 71.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0149503 s, 70.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152262 s, 68.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160035 s, 65.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0160595 s, 65.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0428497 s, 24.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0175957 s, 59.6 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0191951 s, 54.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0189672 s, 55.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0223999 s, 46.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.037738 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0262569 s, 39.9 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg305-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_policies=fifo running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.191619 s, 87.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107271 s, 97.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00795222 s, 132 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0269615 s, 38.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0218665 s, 48.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101765 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00747919 s, 140 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0360217 s, 29.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0432379 s, 24.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0236112 s, 44.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112331 s, 93.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0200572 s, 52.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.141413 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.153542 s, 6.8 MB/s 1048576 bytes (1.0 MB) copied, 0.151803 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.172476 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.192101 s, 5.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010969 s, 95.6 MB/s , 0.0248018 s, 42.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0132921 s, 78.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0298592 s, 35.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0184342 s, 56.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160476 s, 65.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0164819 s, 63.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203404 s, 51.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0218709 s, 47.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.023109 s, 45.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0233022 s, 45.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0239397 s, 43.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0303064 s, 34.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0277458 s, 37.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0273472 s, 38.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0280469 s, 37.4 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' PASS 77f (11s) == sanityn test 77g: Change TBF type directly ============ 18:21:38 (1746138098) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 ost.OSS.ost_io.nrs_policies=fifo PASS 77g (4s) == sanityn test 77h: Wrong policy name should report error, not LBUG ========================================================== 18:21:42 (1746138102) oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=abc: No such file or directory oleg305-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='abc': No such file or directory pdsh@oleg305-client: oleg305-server: ssh exited with exit code 2 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc: Unknown error 524 oleg305-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf abc': Unknown error 524 pdsh@oleg305-client: oleg305-server: ssh exited with exit code 12 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf reg abc: Unknown error 524 oleg305-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf reg abc': Unknown error 524 pdsh@oleg305-client: oleg305-server: ssh exited with exit code 12 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc efg: Unknown error 524 oleg305-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf abc efg': Unknown error 524 pdsh@oleg305-client: oleg305-server: ssh exited with exit code 12 PASS 77h (4s) == sanityn test 77i: Change rank of TBF rule ============= 18:21:46 (1746138106) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start before jobid={jobid} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start after jobid={jobid} rate=1000 rank=default ost.OSS.ost_io.nrs_tbf_rule=start target jobid={jobid} rate=1000 rank=after Move before itself ost.OSS.ost_io.nrs_tbf_rule=change target rank=target Move to higher rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=before Move to lower rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=after Move before default ost.OSS.ost_io.nrs_tbf_rule=change target rank=default ost.OSS.ost_io.nrs_policies=fifo PASS 77i (9s) == sanityn test 77j: check TBF-OPCode NRS policy ========= 18:21:55 (1746138115) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf opcode ost.OSS.ost_io.nrs_tbf_rule=start ost_r opcode={ost_read} rate=5 ost.OSS.ost_io.nrs_tbf_rule=start ost_w opcode={ost_write} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.116565 s, 144 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00715494 s, 147 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0147731 s, 71.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126705 s, 82.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0218171 s, 48.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.053513 s, 19.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0536716 s, 19.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0537334 s, 19.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0559258 s, 18.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0527957 s, 19.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0791745 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0926446 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0863499 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.089459 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.111633 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.110754 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.112261 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152127 s, 68.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00202782 s, 517 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00150715 s, 696 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142597 s, 73.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0346264 s, 30.3 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out , 0.0257136 s, 40.8 MB/s 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0320299 s, 32.7 MB/s , 0.0273852 s, 38.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0367459 s, 28.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0271991 s, 38.6 MB/s , 0.0245963 s, 42.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0194553 s, 53.9 MB/s , 0.0270398 s, 38.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00522455 s, 201 MB/s , 0.00523962 s, 200 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00408614 s, 257 MB/s removed '/mnt/lustre/d77j.sanityn/nrs_r_oleg305-client.virtnet' removed '/mnt/lustre/d77j.sanityn/nrs_w_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77j.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 5 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.47586 s, 19.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.5026 s, 5.4 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77j.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_r ost.OSS.ost_io.nrs_tbf_rule=stop ost_w ost.OSS.ost_io.nrs_policies=fifo PASS 77j (52s) == sanityn test 77ja: check TBF-UID/GID NRS policy ======= 18:22:47 (1746138167) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg305-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg305-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [777] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg305-client.virtnet] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg305-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.22898 s, 13.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123934 s, 84.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0171629 s, 61.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0317642 s, 33.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0325388 s, 32.2 MB/s , 0.0319224 s, 32.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0307921 s, 34.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0567587 s, 18.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0752843 s, 13.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.161577 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.175059 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.178889 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.184247 s, 5.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.1913 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.18921 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.183681 s, 5.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.195415 s, 5.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0141325 s, 74.2 MB/s 1+0 records in 1+0 records out , 0.0156414 s, 67.0 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0161787 s, 64.8 MB/s , 0.0151409 s, 69.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.016996 s, 61.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0186826 s, 56.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0202924 s, 51.7 MB/s , 0.019792 s, 53.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0186466 s, 56.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0192924 s, 54.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0194764 s, 53.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206491 s, 50.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0200882 s, 52.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.020406 s, 51.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0227309 s, 46.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0249958 s, 42.0 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.8668 s, 5.3 MB/s Write runtime is 20 s, speed is 5.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9487 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg305-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg305-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [777] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg305-client.virtnet] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg305-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.465784 s, 36.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0257088 s, 40.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0294691 s, 35.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0351851 s, 29.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0325275 s, 32.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.025343 s, 41.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0604432 s, 17.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.062611 s, 16.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0627303 s, 16.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.11956 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.112707 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.143434 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.123172 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.148428 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.148263 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.164482 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.19759 s, 5.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187901 s, 55.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0197106 s, 53.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0191654 s, 54.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0264451 s, 39.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0214976 s, 48.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0252511 s, 41.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0290826 s, 36.1 MB/s , 0.0232824 s, 45.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0244374 s, 42.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0310254 s, 33.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0251332 s, 41.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0285876 s, 36.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0302255 s, 34.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0284836 s, 36.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0289933 s, 36.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0331615 s, 31.6 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.7667 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9649 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77ja (132s) == sanityn test 77jb: check TBF-UID/GID NRS policy on files that don't belong to us ========================================================== 18:24:59 (1746138299) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 0/500/0/500, groups: 500 [touch] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg305-client.virtnet] running as uid/gid/euid/egid 0/500/0/500, groups: 500 [touch] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg305-client.virtnet] running as uid/gid/euid/egid 0/500/0/500, groups: 500 [chmod] [777] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg305-client.virtnet] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg305-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.22875 s, 13.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0330245 s, 31.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0405537 s, 25.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0465184 s, 22.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0492521 s, 21.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0655449 s, 16.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0569999 s, 18.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0448625 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0610927 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.162546 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.16259 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.172052 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.165845 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.180867 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.187731 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.203112 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.210532 s, 5.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0216839 s, 48.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0211866 s, 49.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0208778 s, 50.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0219753 s, 47.7 MB/s , 0.0210313 s, 49.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0216471 s, 48.4 MB/s 1048576 bytes (1.0 MB) copied, 0.022494 s, 46.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.02168 s, 48.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0262684 s, 39.9 MB/s , 0.0242949 s, 43.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0226043 s, 46.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0256552 s, 40.9 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0257581 s, 40.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0241251 s, 43.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0252862 s, 41.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0297552 s, 35.2 MB/s removed '/mnt/lustre/d77jb.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77jb.sanityn/nrs_r_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77jb.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 0/500/0/500, groups: 500 [touch] [/mnt/lustre/d77jb.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.8957 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77jb.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9508 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77jb.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/0/500/0, groups: 0 [touch] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg305-client.virtnet] running as uid/gid/euid/egid 500/0/500/0, groups: 0 [touch] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg305-client.virtnet] running as uid/gid/euid/egid 500/0/500/0, groups: 0 [chmod] [777] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg305-client.virtnet] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg305-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.2563 s, 13.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0323666 s, 32.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0370438 s, 28.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0600717 s, 17.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0680862 s, 15.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0662116 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.032446 s, 32.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0912947 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.108074 s, 9.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.148694 s, 7.1 MB/s , 0.1409 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.172027 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.171438 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.198157 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.196651 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.197385 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.21764 s, 4.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.022751 s, 46.1 MB/s , 0.0249584 s, 42.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0230724 s, 45.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0242832 s, 43.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0337173 s, 31.1 MB/s , 0.0261389 s, 40.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0285846 s, 36.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0293273 s, 35.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.03028 s, 34.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0305324 s, 34.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0369925 s, 28.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0374371 s, 28.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0344675 s, 30.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.040422 s, 25.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0366454 s, 28.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0414386 s, 25.3 MB/s removed '/mnt/lustre/d77jb.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77jb.sanityn/nrs_r_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77jb.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/0/500/0, groups: 0 [touch] [/mnt/lustre/d77jb.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.7643 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77jb.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9405 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77jb.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77jb (135s) == sanityn test 77k: check TBF policy with UID/GID/JobID/OPCode expression ========================================================== 18:27:14 (1746138434) ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_tbf_rule=start ext_w jobid={dd.500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r jobid={dd.500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.353682 s, 47.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.019683 s, 53.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120319 s, 87.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0223505 s, 46.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0508967 s, 20.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0788071 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0821624 s, 12.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0847088 s, 12.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0880185 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0956015 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0887581 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.085859 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.111888 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.121298 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.118272 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.123987 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.112126 s, 9.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0201529 s, 52.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0284929 s, 36.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0229323 s, 45.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0297211 s, 35.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203179 s, 51.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206431 s, 50.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.028987 s, 36.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0243879 s, 43.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0268362 s, 39.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0268736 s, 39.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0272104 s, 38.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0296135 s, 35.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0312228 s, 33.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0306215 s, 34.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.032261 s, 32.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.041125 s, 25.5 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.11189 s, 20.5 MB/s Write runtime is 7 s, speed is 14.285714 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.8044 s, 10.7 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext_w nid={0@lo 192.168.203.5@tcp}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r nid={0@lo 192.168.203.5@tcp}&opcode={ost_read} rate=10 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.281814 s, 59.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0255165 s, 41.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0359913 s, 29.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0680449 s, 15.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0756308 s, 13.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0782214 s, 13.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0880997 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.09012 s, 11.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.117123 s, 9.0 MB/s 1048576 bytes (1.0 MB) copied, 0.11019 s, 9.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.117236 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.118659 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.114538 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.125699 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.120064 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.132121 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.133246 s, 7.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0292166 s, 35.9 MB/s , 0.0259759 s, 40.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0247566 s, 42.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0208446 s, 50.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0416096 s, 25.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0163745 s, 64.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0240466 s, 43.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0463341 s, 22.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.019609 s, 53.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0269132 s, 39.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0226042 s, 46.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0231931 s, 45.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0246558 s, 42.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0281284 s, 37.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0264192 s, 39.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0291103 s, 36.0 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.41836 s, 19.4 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.82757 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext nid={0@lo 192.168.203.5@tcp}&jobid={dd.500} rate=20 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.206549 s, 81.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0202093 s, 51.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0208939 s, 50.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0531407 s, 19.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0549029 s, 19.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0685603 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0685333 s, 15.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.070819 s, 14.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0749021 s, 14.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0829014 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0806988 s, 13.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0900084 s, 11.6 MB/s , 0.0925933 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.132886 s, 7.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.13681 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.135049 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.155567 s, 6.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.031363 s, 33.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0314103 s, 33.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0320911 s, 32.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0326636 s, 32.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.03177 s, 33.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.033236 s, 31.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0333084 s, 31.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0360272 s, 29.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.024743 s, 42.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0359416 s, 29.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0380308 s, 27.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0280276 s, 37.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0296824 s, 35.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0312779 s, 33.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0313047 s, 33.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0341876 s, 30.7 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.39825 s, 19.4 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.96494 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext ost.OSS.ost_io.nrs_tbf_rule=start ext_a jobid={dd.500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b jobid={dd.500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.194635 s, 86.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0154761 s, 67.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.014843 s, 70.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0192629 s, 54.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0196492 s, 53.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0426092 s, 24.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0546019 s, 19.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0443149 s, 23.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0790134 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0933438 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0739271 s, 14.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0978205 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102518 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.103512 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0980137 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.139458 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.141701 s, 7.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0166314 s, 63.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0271633 s, 38.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00238158 s, 440 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0180063 s, 58.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.013163 s, 79.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00228053 s, 460 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0588866 s, 17.8 MB/s , 0.0493594 s, 21.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0362072 s, 29.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0252215 s, 41.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187189 s, 56.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0027942 s, 375 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0145236 s, 72.2 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0117239 s, 89.4 MB/s 1048576 bytes (1.0 MB) copied, 0.00893341 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00671234 s, 156 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.82047 s, 10.7 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.75521 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.01424 s, 20.9 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.76842 s, 10.7 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_tbf_rule=start ext_ug uid={500}&gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.207618 s, 80.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0176393 s, 59.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0244857 s, 42.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0713002 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0726199 s, 14.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0736954 s, 14.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0771456 s, 13.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0668598 s, 15.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0600904 s, 17.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0736447 s, 14.2 MB/s , 0.0821957 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0828932 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0883872 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.106658 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0828439 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.11203 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.105705 s, 9.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142352 s, 73.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0220904 s, 47.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00417681 s, 251 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0017951 s, 584 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0016368 s, 641 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0194829 s, 53.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0243299 s, 43.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160986 s, 65.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0224178 s, 46.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0015513 s, 676 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0166117 s, 63.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0324107 s, 32.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00825624 s, 127 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00863777 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113322 s, 92.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00667523 s, 157 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.6721 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.5125 s, 5.4 MB/s Read runtime is 20 s, speed is 5.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_ug ost.OSS.ost_io.nrs_tbf_rule=start ext_uw uid={500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_ur uid={500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.204107 s, 82.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156834 s, 66.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105287 s, 99.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212222 s, 49.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0461334 s, 22.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.056145 s, 18.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0587551 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0637719 s, 16.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0692187 s, 15.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0687813 s, 15.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0715537 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0743618 s, 14.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0814163 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.111065 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.108417 s, 9.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.118558 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.123904 s, 8.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00632043 s, 166 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out , 0.0328629 s, 31.9 MB/s 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0194558 s, 53.9 MB/s , 0.0219489 s, 47.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0211794 s, 49.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0315365 s, 33.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0334134 s, 31.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0276592 s, 37.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0387915 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0301237 s, 34.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0431285 s, 24.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010309 s, 102 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00361402 s, 290 MB/s 1048576 bytes (1.0 MB) copied, 0.00378177 s, 277 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0383402 s, 27.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0326019 s, 32.2 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.38262 s, 19.5 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.84341 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_uw ost.OSS.ost_io.nrs_tbf_rule=stop ext_ur ost.OSS.ost_io.nrs_tbf_rule=start ext_a uid={500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b uid={500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.249231 s, 67.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0216956 s, 48.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0272464 s, 38.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0672291 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0700675 s, 15.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0799296 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.07697 s, 13.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0844316 s, 12.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0804737 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0913679 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0893564 s, 11.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0964429 s, 10.9 MB/s 1048576 bytes (1.0 MB) copied, 0.090951 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130239 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.13483 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.167934 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.183207 s, 5.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0285877 s, 36.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.029383 s, 35.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0297854 s, 35.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0276455 s, 37.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0278324 s, 37.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0420101 s, 25.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0300829 s, 34.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0309447 s, 33.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0358661 s, 29.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0450701 s, 23.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.034122 s, 30.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0353203 s, 29.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0323933 s, 32.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0332263 s, 31.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0371073 s, 28.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.040207 s, 26.1 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg305-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 10.1829 s, 10.3 MB/s Write runtime is 12 s, speed is 8.333333 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.86817 s, 10.6 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.91811 s, 10.6 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.83829 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_policies=fifo PASS 77k (352s) == sanityn test 77l: check the output of NRS policies for generic TBF ========================================================== 18:33:06 (1746138786) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_policies=fifo PASS 77l (4s) == sanityn test 77m: check NRS Delay slows write RPC processing ========================================================== 18:33:11 (1746138791) ost.OSS.ost_io.nrs_policies=delay ost.OSS.ost_io.nrs_delay_min=4 ost.OSS.ost_io.nrs_delay_max=4 ost.OSS.ost_io.nrs_delay_pct=100 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg305-client.virtnet] [bs=1M] [count=1] [oflag=direct] [conv=fdatasync] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 3.42813 s, 306 kB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg305-client.virtnet] [bs=1M] [count=10] [oflag=direct] [conv=fdatasync] 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 40.0241 s, 262 kB/s ost.OSS.ost_io.nrs_policies=fifo PASS 77m (52s) == sanityn test 77n: check wildcard support for TBF JobID NRS policy ========================================================== 18:34:02 (1746138842) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={*.500} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.145464 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0185538 s, 56.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.022317 s, 47.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0623857 s, 16.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0616638 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0719705 s, 14.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0672008 s, 15.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0761648 s, 13.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0775035 s, 13.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0756282 s, 13.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.077618 s, 13.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.088846 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0821758 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0866912 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0857679 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0885964 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0945305 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0267154 s, 39.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0015669 s, 669 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0296446 s, 35.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0044667 s, 235 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.024063 s, 43.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0239613 s, 43.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0088734 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00166523 s, 630 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00650602 s, 161 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0415695 s, 25.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0021267 s, 493 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0344741 s, 30.4 MB/s , 0.0231608 s, 45.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0337584 s, 31.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0297017 s, 35.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0037546 s, 279 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77n.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.57374 s, 18.8 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77n.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.94272 s, 21.2 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.*} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.424053 s, 39.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0294298 s, 35.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.032945 s, 31.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0825825 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0867332 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.103365 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0995463 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.108095 s, 9.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.126758 s, 8.3 MB/s 1048576 bytes (1.0 MB) copied, 0.117123 s, 9.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130304 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.129794 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.128864 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.163019 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.162678 s, 6.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.235843 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.234789 s, 4.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143793 s, 72.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0481622 s, 21.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00849794 s, 123 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0495621 s, 21.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0648221 s, 16.2 MB/s , 0.0599504 s, 17.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0369004 s, 28.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0568591 s, 18.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0222998 s, 47.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0790968 s, 13.3 MB/s , 0.036645 s, 28.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00522657 s, 201 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0396817 s, 26.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0205622 s, 51.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0177971 s, 58.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120724 s, 86.9 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg305-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg305-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.35832 s, 19.6 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.94877 s, 21.2 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_policies=fifo PASS 77n (68s) == sanityn test 77o: Changing rank should not panic ====== 18:35:10 (1746138910) mds.MDS.mdt.nrs_policies=tbf nid mds.MDS.mdt.nrs_tbf_rule=start name nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=start name1 nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=change name1 rank=name mds.MDS.mdt.nrs_tbf_rule=stop name mds.MDS.mdt.nrs_policies=fifo PASS 77o (5s) == sanityn test 77q: Parallel TBF rule definitions should not panic ========================================================== 18:35:15 (1746138915) mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_policies=fifo PASS 77q (50s) == sanityn test 77p: Check validity of rule names for TBF policies ========================================================== 18:36:05 (1746138965) mds.MDS.mdt.nrs_policies=tbf oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_overflo uid={500} rate=500: File name too long oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test_77p_overflo uid={500} rate=500': File name too long pdsh@oleg305-client: oleg305-server: ssh exited with exit code 36 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_empty: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test_77p_empty': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p@spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p@spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p.spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p.spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p~spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p~spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p#spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p#spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p/spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p/spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p^spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p^spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p%spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p%spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p*spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p*spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p;spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p;spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p,spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p,spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p?spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p?spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77pspec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p>spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p:spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p:spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p+spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p+spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p=spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p=spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p)spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p)spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p(spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p(spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p{spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p{spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p}spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p}spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p|spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p|spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p[spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p[spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p]spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p]spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p!spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p!spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p&spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p&spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p$spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p$spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p`spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p`spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 oleg305-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p\spec uid={500} rate=500: Invalid argument oleg305-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p\spec uid={500} rate=500': Invalid argument pdsh@oleg305-client: oleg305-server: ssh exited with exit code 22 mds.MDS.mdt.nrs_policies=fifo PASS 77p (17s) == sanityn test 77r: Change type of tbf policy at run time ========================================================== 18:36:22 (1746138982) mds.MDS.mdt.nrs_policies=tbf uid mds.MDS.mdt.nrs_tbf_rule=start md_rule uid={500} rate=1 mds.MDS.mdt.nrs_policies=tbf gid mds.MDS.mdt.nrs_tbf_rule=start md_rule gid={500} rate=1 mds.MDS.mdt.nrs_policies=tbf jobid mds.MDS.mdt.nrs_tbf_rule=start md_rule jobid={*.500} rate=1 mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start md_rule uid={500} rate=1 mds.MDS.mdt.nrs_policies=fifo check the number of requests in queue: fifo: 0 crrn: 0 tbf: 0 delay: 0 fifo: 0 crrn: 0 tbf: 0 delay: 0 cleanup 77r 20976 kill md_thread xargs PASS 77r (43s) == sanityn test 78: Enable policy and specify tunings right away ========================================================== 18:37:05 (1746139025) ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_orr_quantum=1 ost.OSS.ost_io.nrs_policies=fifo PASS 78 (5s) == sanityn test 79: xattr: intent error ================== 18:37:10 (1746139030) File: '/mnt/lustre/d79.sanityn' Size: 512 Blocks: 1 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505823 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 18:37:10.000000000 -0400 Modify: 2025-05-01 18:37:10.000000000 -0400 Change: 2025-05-01 18:37:11.000000000 -0400 Birth: - fail_val=0 fail_loc=0x80000160 fail_val=0 fail_loc=0x80000131 # file: mnt/lustre/d79.sanityn trusted.name1="value1" PASS 79 (14s) == sanityn test 80a: migrate directory when some children is being opened ========================================================== 18:37:24 (1746139044) SKIP: sanityn test_80a needs >= 2 MDTs SKIP 80a (2s) == sanityn test 80b: Accessing directory during migration ========================================================== 18:37:26 (1746139046) SKIP: sanityn test_80b needs >= 2 MDTs SKIP 80b (2s) == sanityn test 81a: rename and stat under striped directory ========================================================== 18:37:28 (1746139048) SKIP: sanityn test_81a needs >= 2 MDTs SKIP 81a (1s) == sanityn test 81b: rename under striped directory doesn't deadlock ========================================================== 18:37:29 (1746139049) SKIP: sanityn test_81b We need at least 2 MDTs for this test SKIP 81b (2s) == sanityn test 81c: rename revoke LOOKUP lock for remote object ========================================================== 18:37:31 (1746139051) SKIP: sanityn test_81c needs >= 4 MDTs SKIP 81c (1s) == sanityn test 81d: parallel rename file cross-dir on same MDT ========================================================== 18:37:32 (1746139052) - open/close 1259 (time 1746139065.53 total 10.00 last 125.84) - open/close 2418 (time 1746139075.53 total 20.00 last 115.90) total: 2500 open/close in 20.71 seconds: 120.72 ops/second snapshot_time 1746139121.856444539 secs.nsecs start_time 1746139054.566834028 secs.nsecs elapsed_time 67.289610511 secs.nsecs open 2505 samples [usecs] 108 7213 1805197 1995369529 close 2504 samples [usecs] 106 3916 696715 385898191 mknod 2501 samples [usecs] 281 7120 1602023 1584565657 unlink 2500 samples [usecs] 444 51591 3104749 19375039549 mkdir 2 samples [usecs] 585 3366 3951 11672181 rmdir 2 samples [usecs] 4352 12056 16408 164287040 rename 2500 samples [usecs] 320 33669 8419848 53409258314 getattr 3764 samples [usecs] 4 3413 104605 53224691 parallel_rename_file 2500 samples [usecs] 320 33669 8419848 53409258314 crossdir_rename 2500 samples [usecs] 320 33669 8419848 53409258314 PASS 81d (72s) == sanityn test 82: fsetxattr and fgetxattr on orphan files ========================================================== 18:38:44 (1746139124) multiop /mnt/lustre/f82.sanityn vO_ac TMPPIPE=/tmp/multiop_open_wait_pipe.7018 multiop /mnt/lustre2/f82.sanityn vo_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.7018 PASS 82 (3s) == sanityn test 83: access striped directory while it is being created/unlinked ========================================================== 18:38:47 (1746139127) SKIP: sanityn test_83 needs >= 2 MDTs SKIP 83 (1s) == sanityn test 84: 0-nlink race in lu_object_find() ===== 18:38:49 (1746139129) fail_loc=0x8000060b PASS 84 (8s) == sanityn test 85: Lustre API root cache race =========== 18:38:57 (1746139137) Starting: llapi_root_test /mnt/lustre/f85.sanityn /mnt/lustre2/f85.sanityn Starting test test1 at 1746139138 Finishing test test1 at 1746139140 PASS 85 (6s) == sanityn test 90: open/create and unlink striped directory ========================================================== 18:39:03 (1746139143) SKIP: sanityn test_90 needs >= 2 MDTs SKIP 90 (2s) == sanityn test 91: chmod and unlink striped directory === 18:39:05 (1746139145) SKIP: sanityn test_91 needs >= 2 MDTs SKIP 91 (1s) == sanityn test 92: create remote directory under orphan directory ========================================================== 18:39:06 (1746139146) SKIP: sanityn test_92 needs >= 2 MDTs SKIP 92 (2s) == sanityn test 93: alloc_rr should not allocate on same ost ========================================================== 18:39:08 (1746139148) fail_loc=0x00000163 fail_loc=0x0 /mnt/lustre/f93.sanityn-1/file1 lmm_stripe_count: 2 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 5193 0x1449 0x240000400 1 5180 0x143c 0x280000400 /mnt/lustre2/f93.sanityn-2/file2 lmm_stripe_count: 2 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 5194 0x144a 0x240000400 1 5181 0x143d 0x280000400 rc1=0 and rc2=0 PASS 93 (10s) == sanityn test 94: signal vs CP callback race =========== 18:39:18 (1746139158) osc.lustre-OST0000-osc-ffff8800aed5e800.idle_timeout=0 osc.lustre-OST0000-osc-ffff8800b61ae000.idle_timeout=0 osc.lustre-OST0001-osc-ffff8800aed5e800.idle_timeout=0 osc.lustre-OST0001-osc-ffff8800b61ae000.idle_timeout=0 2+0 records in 2+0 records out 8192 bytes (8.2 kB) copied, 0.114301 s, 71.7 kB/s fail_val=5 fail_loc=0x80000312 fail_val=6 fail_loc=0x80000329 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 3.024 s, 1.4 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 5764: 4252 Alarm clock dd if=/dev/zero of=$DIR/$tfile conv=notrunc oflag=append bs=4k count=1 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.062451 s, 65.6 kB/s osc.lustre-OST0000-osc-ffff8800aed5e800.idle_timeout=debug osc.lustre-OST0000-osc-ffff8800b61ae000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800aed5e800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800b61ae000.idle_timeout=debug PASS 94 (11s) == sanityn test 95a: Check readpage() on a page that was removed from page cache ========================================================== 18:39:29 (1746139169) llite.lustre-ffff8800aed5e800.fast_read=0 llite.lustre-ffff8800b61ae000.fast_read=0 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0211735 s, 99.0 MB/s fail_loc=0x80001421 fail_val=7 fail_loc=0x80001422 fail_val=10 llite.lustre-ffff8800aed5e800.fast_read=1 llite.lustre-ffff8800b61ae000.fast_read=1 PASS 95a (21s) == sanityn test 95b: Check readpage() on a page that is no longer uptodate ========================================================== 18:39:50 (1746139190) llite.lustre-ffff8800aed5e800.fast_read=0 llite.lustre-ffff8800b61ae000.fast_read=0 1+0 records in 1+0 records out 12288 bytes (12 kB) copied, 0.00900932 s, 1.4 MB/s fail_loc=0x80001424 fail_val=5 fail_loc=0 llite.lustre-ffff8800aed5e800.fast_read=1 llite.lustre-ffff8800b61ae000.fast_read=1 PASS 95b (10s) == sanityn test 100a: DoM: glimpse RPCs for stat without IO lock (DoM only file) ========================================================== 18:40:00 (1746139200) SKIP: sanityn test_100a Reserved for glimpse-ahead SKIP 100a (1s) == sanityn test 100b: DoM: no glimpse RPC for stat with IO lock (DoM only file) ========================================================== 18:40:01 (1746139201) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00338831 s, 1.2 MB/s /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK PASS 100b (4s) == sanityn test 100c: DoM: write vs stat without IO lock (combined file) ========================================================== 18:40:05 (1746139205) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0663101 s, 31.6 MB/s /mnt/lustre/d100c.sanityn/dom has type file OK /mnt/lustre/d100c.sanityn/dom has size 2097152 OK PASS 100c (4s) == sanityn test 100d: DoM: write+truncate vs stat without IO lock (combined file) ========================================================== 18:40:09 (1746139209) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0491708 s, 42.7 MB/s /mnt/lustre/d100d.sanityn/dom has type file OK /mnt/lustre/d100d.sanityn/dom has size 4096 OK PASS 100d (3s) == sanityn test 100e: DoM: read on open and file size ==== 18:40:12 (1746139212) 1+0 records in 1+0 records out 12000 bytes (12 kB) copied, 0.00265294 s, 4.5 MB/s PASS 100e (4s) == sanityn test 101a: Discard DoM data on unlink ========= 18:40:16 (1746139216) /mnt/lustre/f101a.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00159851 s, 2.6 MB/s PASS 101a (3s) == sanityn test 101b: Discard DoM data on rename ========= 18:40:19 (1746139219) /mnt/lustre/f101b.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00111834 s, 3.7 MB/s PASS 101b (4s) == sanityn test 101c: Discard DoM data on close-unlink === 18:40:23 (1746139223) /mnt/lustre/f101c.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00188505 s, 2.2 MB/s PASS 101c (5s) SKIP: sanityn test_102 skipping ALWAYS excluded test 102 == sanityn test 103: Test size correctness with lockahead ========================================================== 18:40:29 (1746139229) fail_loc=0x415 fail_loc=0x415 fail_val=2 Incorrect size expected (no glimpse fix): Starting test test23 at 1746139230 lockahead_test: lockahead_test.c:1191: test23: assertion 'sb.st_size == sb2.st_size' failed: size on /mnt/lustre/d103.sanityn/f103.sanityn and /mnt/lustre2/d103.sanityn/f103.sanityn differs: 0 vs 1048576 fail_loc=0 fail_loc=0x214 fail_val=2 Starting test test23 at 1746139233 Finishing test test23 at 1746139233 PASS 103 (8s) == sanityn test 104: Verify that MDS stores atime/mtime/ctime during close ========================================================== 18:40:38 (1746139238) SKIP: sanityn test_104 ldiskfs only test SKIP 104 (2s) == sanityn test 105: Glimpse and lock cancel race ======== 18:40:39 (1746139239) fail_loc=0x416 PASS 105 (23s) == sanityn test 106a: Verify the btime via statx() ======= 18:41:02 (1746139262) SKIP: sanityn test_106a Test only for ldiskfs and statx() supported SKIP 106a (1s) == sanityn test 106b: Glimpse RPCs test for statx ======== 18:41:03 (1746139263) SKIP: sanityn test_106b statx() only test SKIP 106b (2s) == sanityn test 106c: Verify statx attributes mask ======= 18:41:05 (1746139265) SKIP: sanityn test_106c statx() only test SKIP 106c (2s) == sanityn test 107a: Basic grouplock conflict =========== 18:41:07 (1746139267) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.128333 s, 81.7 MB/s /mnt/lustre/f107a.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 5186 0x1442 0x280000400 multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.7018 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.7018 First grouplock blocks second one PASS 107a (6s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 18:41:13 (1746139273) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.124325 s, 84.3 MB/s /mnt/lustre/f107b.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 5202 0x1452 0x240000400 multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.7018 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (10s) == sanityn test 108a: lseek: parallel updates ============ 18:41:23 (1746139283) 1+0 records in 1+0 records out 10000 bytes (10 kB) copied, 0.00422324 s, 2.4 MB/s fail_val=4 fail_loc=0x80000414 1+0 records in 1+0 records out 8388608 bytes (8.4 MB) copied, 4.37272 s, 1.9 MB/s PASS 108a (7s) == sanityn test 109: Race with several mount instances on 1 node ========================================================== 18:41:30 (1746139290) 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Starting race between client mount instances (50 iterations): Iteration 1 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 2 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions oleg305-server: libkmod: kmod_module_get_refcnt: could not read integer from '/sys/module/acpi_cpufreq/refcnt': 'No such device' Iteration 3 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 4 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 5 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 6 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 7 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 8 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 9 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 10 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 11 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 12 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 13 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 14 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 15 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 16 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 17 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 18 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 19 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 20 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 21 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 22 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 23 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 24 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 25 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 26 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 27 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 28 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 29 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 30 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 31 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 32 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 33 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 34 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 35 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 36 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 37 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 38 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 39 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 40 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 41 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 42 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 43 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 44 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 45 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 46 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 47 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Iteration 48 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 49 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions oleg305-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 50 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre 192.168.203.105@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.203.105@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg305-server' oleg305-server: oleg305-server.virtnet: executing load_modules_local oleg305-server: Loading modules from /home/green/git/lustre-release/lustre oleg305-server: detected 4 online CPUs by sysfs oleg305-server: MODOPTS_LIBCFS= oleg305-server: Force libcfs to create 2 CPU partitions Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre Starting client: oleg305-client.virtnet: -o user_xattr,flock 192.168.203.105@tcp:/lustre /mnt/lustre2 PASS 109 (580s) == sanityn test 110: do not grant another lock on resend ========================================================== 18:51:10 (1746139870) fail_loc=0x525 fail_val=3 fail_loc=0x534 File: '/mnt/lustre/f110.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205306056707 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-05-01 18:51:11.000000000 -0400 Modify: 2025-05-01 18:51:11.000000000 -0400 Change: 2025-05-01 18:51:11.000000000 -0400 Birth: - fail_loc=0 fail_val=0 Connected clients: oleg305-client.virtnet oleg305-client.virtnet PASS 110 (65s) == sanityn test 111: A racy rename/link an open file should not cause fs corruption ========================================================== 18:52:15 (1746139935) SKIP: sanityn test_111 needs >= 2 MDTs SKIP 111 (2s) == sanityn test 112: update max-inherit in default LMV === 18:52:17 (1746139937) SKIP: sanityn test_112 We need at least 2 MDTs for this test SKIP 112 (1s) == sanityn test 113: check servers of specified fs ======= 18:52:19 (1746139939) lustre-OST0000-osc-ffff8800ac191800 active. lustre-OST0001-osc-ffff8800ac191800 active. lustre-OST0000-osc-ffff8800ac191800 active. lustre-OST0001-osc-ffff8800ac191800 active. MGC192.168.203.105@tcp active. PASS 113 (4s) == sanityn test 114: implicit default LMV inherit ======== 18:52:22 (1746139942) SKIP: sanityn test_114 We need at least 2 MDTs for this test SKIP 114 (1s) == sanityn test 115: ldiskfs doesn't check direntry for uniqueness ========================================================== 18:52:23 (1746139943) SKIP: sanityn test_115 ldiskfs only test SKIP 115 (2s) == sanityn test 116: DNE: Set default LMV layout from a remote client ========================================================== 18:52:25 (1746139945) SKIP: sanityn test_116 needs >= 2 MDTs SKIP 116 (2s) == sanityn test 200: service remains healthy while able to process request ========================================================== 18:52:27 (1746139947) at_max=10 at_unhealthy_factor=3 ost.OSS.ost_io.threads_max=19 fail_loc=0x1e1 fail_val=20 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.105 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1282 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1799 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.107 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1115 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1402 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1521 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1708 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.1834 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.1113 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.203 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.285 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.2364 s, 0.1 kB/s , 40.2782 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.2694 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.2497 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.2441 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.2694 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.2346 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.2232 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.2714 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.3834 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.327 s, 0.1 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.3685 s, 0.1 kB/s 4096 bytes (4.1 kB) copied, 60.3263 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.3097 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.3288 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.2379 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.2768 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.3061 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.3253 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.3984 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.3902 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.3454 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.4008 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.4229 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 100.376 s, 0.0 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 100.37 s, 0.0 kB/s at_max=600 at_unhealthy_factor=3 ost.OSS.ost_io.threads_max=116 oleg305-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800ac191800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800ac191800.ost_server_uuid in FULL state after 0 sec PASS 200 (110s) cleanup: ====================================================== == sanityn test complete, duration 5928 sec ============== 18:54:18 (1746140058) sanityn: FAIL: test_16j dio copy 1 w/bsize 1049600 failed: 1 === sanityn: start cleanup 18:54:20 (1746140060) === Stopping clients: oleg305-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg305-client.virtnet /mnt/lustre2 opts: === sanityn: finish cleanup 18:56:43 (1746140203) ===