-----============= acceptance-small: sanityn ============----- Fri Apr 25 18:23:27 EDT 2025 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 oleg134-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/sanityn.*ex: No such file or directory excepting tests: 27 28 40a 102 skipping tests SLOW=no: 33a === sanityn: start setup 18:23:36 (1745619816) === Starting client oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Started clients oleg134-client.virtnet: 192.168.201.134@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose) oleg134-client.virtnet: executing check_config_client /mnt/lustre oleg134-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg134-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff88012a619800.idle_timeout=debug osc.lustre-OST0000-osc-ffff88012ab18800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a619800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012ab18800.idle_timeout=debug disable quota as required oleg134-server: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanityn: finish setup 18:23:50 (1745619830) === 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.017289 s, 60.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f7075] == sanityn test 0: do_node_vp() and do_facet_vp() do the right thing ========================================================== 18:23:52 (1745619832) PASS 0 (5s) == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 18:23:57 (1745619837) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (4s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 18:24:01 (1745619841) -rw-r--r-- 1 root root 0 Apr 25 18:24 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (4s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 18:24:06 (1745619846) -rw-r--r-- 1 root root 0 Apr 25 18:24 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (4s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 18:24:10 (1745619850) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (4s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 18:24:14 (1745619854) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (3s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 18:24:18 (1745619858) total 1 -rwxrwxrwx 1 root root 0 Apr 25 18:24 f2a -rwxrwxrwx 1 root root 0 Apr 25 18:24 f2b total 1 -rwxrwxrwx 1 root root 0 Apr 25 18:24 f2a -rwxrwxrwx 1 root root 0 Apr 25 18:24 f2b running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes (512 B) copied, 0.0160486 s, 31.9 kB/s PASS 2e (3s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 18:24:21 (1745619861) SKIP: sanityn test_2f needs >= 2 MDTs SKIP 2f (2s) == sanityn test 2g: check blocks update on sync write ==== 18:24:23 (1745619863) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.343463 s, 6.1 MB/s /mnt/lustre/f2g.sanityn has 4103 blocks /mnt/lustre2/f2g.sanityn has 4103 blocks PASS 2g (5s) == sanityn test 3: symlink on one mtpt, readlink on another ===================================================================== 18:24:28 (1745619868) PASS 3 (4s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 18:24:32 (1745619872) PASS 4 (5s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 18:24:37 (1745619877) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (4s) == sanityn test 6: remove of open file on other node ============================================================================ 18:24:41 (1745619881) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (4s) == sanityn test 7: remove of open directory on other node ======================================================================= 18:24:45 (1745619885) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (4s) == sanityn test 8: remove of open special file on other node ==================================================================== 18:24:49 (1745619889) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (3s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 18:24:52 (1745619892) PASS 9a (5s) == sanityn test 9b: append to striped sparse file ======== 18:24:57 (1745619897) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0755022 s, 13.9 MB/s 3+0 records in 3+0 records out 3 bytes (3 B) copied, 0.0462027 s, 0.1 kB/s Data read (expecting 'foo'): foo PASS 9b (4s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 18:25:01 (1745619901) 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00921596 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0117855 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00954731 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0152295 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0154987 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0109277 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0342618 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.018291 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0288634 s, 0.0 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0119072 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0160147 s, 0.1 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.013252 s, 0.1 kB/s PASS 10a (6s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 18:25:07 (1745619907) 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.0109202 s, 281 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0341986 s, 120 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00046627 s, 6.6 MB/s PASS 10b (4s) == sanityn test 11: execution of file opened for write should return error ============================================================== 18:25:11 (1745619911) multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.7075 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 301: /mnt/lustre2/d11/f: Text file busy PASS 11 (5s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 18:25:16 (1745619916) warning: '-runtime' deprecated, use '-t runtime' instead - link 496 (time 1745619927.53 total 10.01 last 49.56) - link 978 (time 1745619937.53 total 20.01 last 48.18) - link 1469 (time 1745619947.53 total 30.02 last 49.08) - link 1979 (time 1745619957.54 total 40.02 last 50.98) - link 2548 (time 1745619967.55 total 50.03 last 56.85) - link 3168 (time 1745619977.55 total 60.03 last 61.98) - link 3732 (time 1745619987.55 total 70.03 last 56.39) - link 4342 (time 1745619997.56 total 80.04 last 60.96) - link 5100 (time 1745620007.56 total 90.05 last 75.75) total: 5763 link in 100.01 seconds: 57.63 ops/second using seed 3834203882 running for 100 seconds - stat 9809 (time 1745619929 ; total 11 ; last 11) - stat 10000 (time 1745619929 ; total 11 ; last 0) - stat 20000 (time 1745619939 ; total 21 ; last 10) - stat 29947 (time 1745619950 ; total 32 ; last 11) - stat 30000 (time 1745619950 ; total 32 ; last 0) - stat 40000 (time 1745619959 ; total 41 ; last 9) - stat 49489 (time 1745619970 ; total 52 ; last 11) - stat 50000 (time 1745619972 ; total 54 ; last 2) - stat 53045 (time 1745619983 ; total 65 ; last 11) - stat 55959 (time 1745619994 ; total 76 ; last 11) - stat 59693 (time 1745620005 ; total 87 ; last 11) - stat 60000 (time 1745620006 ; total 88 ; last 1) - stat 62853 (time 1745620017 ; total 99 ; last 11) total: 63436 stats in 100 seconds: 634.359985 stats/second - unlinked 0 (time 1745619968 ; total 0 ; last 0) unlink(/mnt/lustre2/lockdir/lockfile5763) error: No such file or directory total: 5762 unlinks in 90 seconds: 64.022224 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (22137) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (22140) - No such process PASS 12 (145s) == sanityn test 13: test directory page revocation ======= 18:27:41 (1745620061) f13 f13 PASS 13 (5s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 18:27:46 (1745620066) multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.7075 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 336: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4892: 23536 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (4s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 18:27:50 (1745620070) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4892: 24172 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (4s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 18:27:54 (1745620074) truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 351: 24806 Terminated $DIR1/$tdir/sleep 60 PASS 14b (3s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 18:27:57 (1745620077) cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 363: 25443 Terminated $DIR1/$tdir/sleep 60 PASS 14c (4s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 18:28:01 (1745620081) chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 374: 26079 Terminated $DIR1/$tdir/sleep 60 PASS 14d (4s) == sanityn test 15: test out-of-space with multiple writers ===================================================================== 18:28:05 (1745620085) PATH=/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/opt/iozone/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin: mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_CODE=117440512 CLIENT_OS_VERSION_ID=7 STRIPECOUNT=2 ORIGFREE=7522304 MAXFREE=2097152000 lustre-OST0000 avl=63488 grnt=44864 diff=18624 limit=45713 FULL lustre-OST0001 avl=61440 grnt=57920 diff=3520 limit=45713 FULL LOG LOG2 file dd: error writing '/mnt/lustre/oosfile': No space left on device 3742781+0 records in 3742780+0 records out 3832606720 bytes (3.8 GB) copied, 430.593 s, 8.9 MB/s dd: error writing '/mnt/lustre2/oosfile2': No space left on device 3658117+0 records in 3658116+0 records out 3745910784 bytes (3.7 GB) copied, 353.24 s, 10.6 MB/s Success! sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete PASS 15 (470s) == sanityn test 16a: 500 iterations of dual-mount fsx ==== 18:35:55 (1745620555) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.830714 s, 10.1 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.467369 s, 17.9 MB/s Chance of close/open is 1 in 50 Seed set to 560 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000004[1] 1745620561.747602 mapwrite 0x4dae10 thru 0x4e5c8d (0xae7e bytes) 000007[1] 1745620562.217023 write 0x9a1896 thru 0x9a4788 (0x2ef3 bytes) truncating to largest ever: 0x40f6f4 000009[0] 1745620562.227508 trunc from 0x9a4789 to 0x40f6f3 (0x595095 bytes) 000010[0] 1745620562.422733 trunc from 0x40f6f4 to 0x11351f (0x2fc1d4 bytes) 000014[1] 1745620562.614572 mapwrite 0x781602 thru 0x7869bc (0x53bb bytes) 000015[0] 1745620562.925282 write 0x5308cc thru 0x537bbf (0x72f4 bytes) 000018[1] 1745620562.997960 mapread 0x011997 thru 0x019a2d (0x8097 bytes) 000019[0] 1745620563.079388 write 0x018560 thru 0x0242e8 (0xbd89 bytes) 000021[0] 1745620563.137770 mapwrite 0x9039fc thru 0x90589f (0x1ea4 bytes) 000022[1] 1745620563.416489 read 0x88bafe thru 0x8995b2 (0xdab5 bytes) 000024[0] 1745620563.470312 mapread 0x250f14 thru 0x25eab2 (0xdb9f bytes) 000025[1] 1745620563.529353 trunc from 0x9058a0 to 0x36f26b (0x596634 bytes) 000026[0] 1745620563.716184 read 0x2e3caa thru 0x2efc5b (0xbfb2 bytes) 000027[1] 1745620563.783478 read 0x0f585d thru 0x1015d3 (0xbd77 bytes) 000028[0] 1745620563.970302 trunc from 0x36f26c to 0x187381 (0x1e7eea bytes) 000030[1] 1745620564.063364 read 0x12977f thru 0x1318f0 (0x8172 bytes) 000031[1] 1745620564.184894 mapread 0x16ce57 thru 0x1742b8 (0x7462 bytes) truncating to largest ever: 0x82cacb 000035[0] 1745620564.261983 trunc from 0x187382 to 0x82caca (0x6a5749 bytes) 000036[1] 1745620564.354451 trunc from 0x82cacb to 0x55a88e (0x2d223c bytes) 000037[1] 1745620564.457416 trunc from 0x55a88f to 0x7cd824 (0x272f96 bytes) 000039[1] 1745620564.581268 read 0x16b8bd thru 0x173b8b (0x82cf bytes) 000041[0] 1745620564.610579 mapwrite 0x79550d thru 0x79ddb7 (0x88ab bytes) 000042[0] 1745620564.790944 read 0x1fccbe thru 0x202fc1 (0x6304 bytes) 000043[1] 1745620564.821154 write 0x66775c thru 0x669e82 (0x2727 bytes) 000044[1] 1745620564.871320 write 0x2168cc thru 0x222d78 (0xc4ad bytes) 000045[1] 1745620564.915176 write 0x1d228c thru 0x1d741a (0x518f bytes) 000046[1] 1745620564.928651 write 0x2aa45b thru 0x2acbb2 (0x2758 bytes) 000047[0] 1745620564.951378 read 0x76a30b thru 0x76baa9 (0x179f bytes) 000048[0] 1745620564.984051 write 0x81fdc3 thru 0x823c2f (0x3e6d bytes) 000049[1] 1745620565.025616 trunc from 0x823c30 to 0x7c12b3 (0x6297c bytes) 000050[1] 1745620565.123495 write 0x1d1794 thru 0x1d17c7 (0x34 bytes) 000051[0] 1745620565.135046 write 0x06e8f1 thru 0x07518a (0x689a bytes) 000052[1] 1745620565.188093 read 0x62c763 thru 0x637074 (0xa912 bytes) 000054[1] 1745620565.255850 read 0x097340 thru 0x09750b (0x1cc bytes) 000055[1] 1745620565.302147 write 0x77ad35 thru 0x780a9a (0x5d66 bytes) 000058[0] 1745620565.343501 mapread 0x124abf thru 0x12b301 (0x6843 bytes) 000060[0] 1745620565.481897 write 0x915835 thru 0x916bae (0x137a bytes) 000061[1] 1745620565.559745 write 0x512178 thru 0x513680 (0x1509 bytes) 000062[0] 1745620565.634410 read 0x1df798 thru 0x1e7fea (0x8853 bytes) 000063[1] 1745620565.718296 mapwrite 0x63ccdd thru 0x645f65 (0x9289 bytes) truncating to largest ever: 0x872e14 000066[1] 1745620566.036346 trunc from 0x916baf to 0x872e13 (0xa3d9b bytes) 000067[1] 1745620566.117804 write 0x49131e thru 0x493a8a (0x276d bytes) 000068[0] 1745620566.198550 write 0x597ce1 thru 0x59927f (0x159f bytes) 000071[0] 1745620566.323426 write 0x30e01f thru 0x317051 (0x9033 bytes) 000072[1] 1745620566.405864 trunc from 0x872e14 to 0x557467 (0x31b9ac bytes) 000074[1] 1745620566.555823 trunc from 0x557468 to 0x1cb0d1 (0x38c396 bytes) 000076[1] 1745620566.600274 read 0x0482bb thru 0x04af5c (0x2ca2 bytes) 000077[1] 1745620566.735529 mapwrite 0x82b0e3 thru 0x837102 (0xc020 bytes) 000079[1] 1745620567.296666 mapread 0x1899c7 thru 0x18b366 (0x19a0 bytes) 000080[0] 1745620567.316662 read 0x2fa553 thru 0x2fce52 (0x2900 bytes) 000081[1] 1745620567.355182 write 0x854c28 thru 0x85a513 (0x58ec bytes) 000086[1] 1745620567.381620 read 0x09ee9a thru 0x0ac50e (0xd675 bytes) 000087[0] 1745620567.453332 read 0x0ad7b4 thru 0x0b2667 (0x4eb4 bytes) 000088[0] 1745620567.519982 trunc from 0x85a514 to 0x72f157 (0x12b3bc bytes) 000089[0] 1745620567.597137 write 0x5db279 thru 0x5dd3a1 (0x2129 bytes) 000090[1] 1745620567.655376 mapwrite 0x9e43a3 thru 0x9e84c5 (0x4123 bytes) 000092[1] 1745620567.987036 write 0x8b4e43 thru 0x8ba84e (0x5a0c bytes) 000098[1] 1745620568.129439 trunc from 0x9e84c6 to 0x5e7454 (0x401071 bytes) 000100[0] 1745620568.240443 mapread 0x32ec86 thru 0x33e9ed (0xfd68 bytes) 000103[0] 1745620568.453606 trunc from 0x5e7455 to 0x6c5bb3 (0xde75f bytes) 000105[0] 1745620568.547740 read 0x081b33 thru 0x08901d (0x74eb bytes) 000106[1] 1745620568.627299 mapread 0x1e6932 thru 0x1f39fe (0xd0cd bytes) 000107[0] 1745620568.784812 read 0x649643 thru 0x6521da (0x8b98 bytes) 000108[0] 1745620568.800791 read 0x269df1 thru 0x275ea3 (0xc0b3 bytes) 000109[1] 1745620568.843419 trunc from 0x6c5bb4 to 0x6c6b85 (0xfd2 bytes) 000112[0] 1745620569.080290 write 0x8de515 thru 0x8dfce8 (0x17d4 bytes) 000113[1] 1745620569.139505 read 0x0414f2 thru 0x04d115 (0xbc24 bytes) 000114[0] 1745620569.236395 write 0x29aca1 thru 0x2a14c7 (0x6827 bytes) 000119[0] 1745620569.482852 trunc from 0x8dfce9 to 0x5422ef (0x39d9f9 bytes) 000120[0] 1745620569.535260 mapwrite 0x2e84da thru 0x2f816a (0xfc91 bytes) 000121[0] 1745620569.762772 trunc from 0x5422f0 to 0x59ffc2 (0x5dcd3 bytes) 000124[0] 1745620569.825630 write 0x1ccae2 thru 0x1d1824 (0x4d43 bytes) 000125[0] 1745620569.848330 mapread 0x42cc27 thru 0x43715a (0xa534 bytes) 000128[0] 1745620570.028506 trunc from 0x59ffc3 to 0x141bbf (0x45e403 bytes) 000129[1] 1745620570.151312 mapread 0x025e29 thru 0x031cd2 (0xbeaa bytes) 000132[1] 1745620570.370533 mapread 0x079b40 thru 0x07f8f7 (0x5db8 bytes) 000135[1] 1745620570.464168 mapwrite 0x980113 thru 0x981bba (0x1aa8 bytes) 000141[1] 1745620570.967679 read 0x709366 thru 0x7151c4 (0xbe5f bytes) 000142[0] 1745620571.007057 mapwrite 0x2bdc8d thru 0x2cdbf3 (0xff67 bytes) 000143[1] 1745620571.319370 write 0x4e6c70 thru 0x4f1c8c (0xb01d bytes) 000150[1] 1745620571.608697 read 0x7c4e13 thru 0x7cf9c3 (0xabb1 bytes) 000153[1] 1745620571.774546 write 0x33b54e thru 0x33d7c8 (0x227b bytes) 000154[1] 1745620571.851168 write 0x7cf7ad thru 0x7d504e (0x58a2 bytes) 000156[1] 1745620571.878263 read 0x1d6d47 thru 0x1e1fbf (0xb279 bytes) 000158[0] 1745620571.998592 read 0x94719f thru 0x9508fb (0x975d bytes) 000160[1] 1745620572.076360 mapread 0x030b85 thru 0x032018 (0x1494 bytes) 000161[1] 1745620572.116945 mapread 0x52b187 thru 0x537501 (0xc37b bytes) 000162[0] 1745620572.195525 mapread 0x0c0a87 thru 0x0d0838 (0xfdb2 bytes) 000163[0] 1745620572.247730 read 0x951718 thru 0x95ca32 (0xb31b bytes) 000165[0] 1745620572.346825 mapread 0x50258c thru 0x50677e (0x41f3 bytes) 000166[1] 1745620572.459282 mapread 0x2ea524 thru 0x2f77d7 (0xd2b4 bytes) 000167[0] 1745620572.539336 mapwrite 0x824a88 thru 0x82de05 (0x937e bytes) 000168[1] 1745620572.820960 mapread 0x7ff0b5 thru 0x802fa3 (0x3eef bytes) 000170[1] 1745620572.929022 mapwrite 0x7baa5d thru 0x7c359f (0x8b43 bytes) 000171[1] 1745620573.140180 write 0x10b509 thru 0x10ce15 (0x190d bytes) 000173[1] 1745620573.233482 trunc from 0x981bbb to 0x15b5da (0x8265e0 bytes) 000174[0] 1745620573.296293 read 0x0268eb thru 0x02eb18 (0x822e bytes) 000175[1] 1745620573.482336 mapread 0x0cf365 thru 0x0d1a5e (0x26fa bytes) 000176[1] 1745620573.570360 read 0x099c6f thru 0x0a8926 (0xecb8 bytes) 000177[0] 1745620573.683394 write 0x01c820 thru 0x0222c2 (0x5aa3 bytes) 000178[1] 1745620573.735930 mapwrite 0x96fde4 thru 0x97ee43 (0xf060 bytes) 000179[0] 1745620574.160515 mapwrite 0x0fc757 thru 0x1064eb (0x9d95 bytes) 000181[0] 1745620574.419416 read 0x161f2d thru 0x170c48 (0xed1c bytes) 000182[0] 1745620574.439425 mapread 0x041377 thru 0x04aad2 (0x975c bytes) truncating to largest ever: 0x92d3d4 000183[1] 1745620574.496724 trunc from 0x97ee44 to 0x92d3d3 (0x51a70 bytes) 000185[0] 1745620574.583536 read 0x901c44 thru 0x9025a9 (0x966 bytes) 000186[0] 1745620574.601897 mapwrite 0x772dfa thru 0x77303a (0x241 bytes) 000188[0] 1745620574.764641 mapwrite 0x61a672 thru 0x62997c (0xf30b bytes) 000191[1] 1745620574.923499 trunc from 0x92d3d4 to 0x07d7ad (0x8afc26 bytes) 000195[1] 1745620575.063164 read 0x04d850 thru 0x05249c (0x4c4d bytes) 000197[0] 1745620575.123146 read 0x05b3f2 thru 0x06ac6e (0xf87d bytes) 000199[0] 1745620575.197946 write 0x4ed7cf thru 0x4fc795 (0xefc7 bytes) 000202[1] 1745620575.269354 trunc from 0x4fc796 to 0x2f477e (0x208017 bytes) 000205[1] 1745620575.443614 mapread 0x203f4a thru 0x20c5b0 (0x8667 bytes) 000206[1] 1745620575.551363 write 0x0158a5 thru 0x023e38 (0xe594 bytes) 000211[0] 1745620575.583482 mapwrite 0x833228 thru 0x8348c7 (0x16a0 bytes) 000215[0] 1745620576.020458 trunc from 0x8348c8 to 0x84309c (0xe7d5 bytes) 000219[0] 1745620576.172309 write 0x11ddb5 thru 0x12cd47 (0xef93 bytes) 000224[1] 1745620576.243240 write 0x4e752d thru 0x4ea716 (0x31ea bytes) 000226[0] 1745620576.314379 read 0x6f11cc thru 0x6ff68c (0xe4c1 bytes) 000228[0] 1745620576.342249 read 0x408621 thru 0x4161b2 (0xdb92 bytes) 000229[1] 1745620576.364772 write 0x8e7d72 thru 0x8ec494 (0x4723 bytes) 000230[0] 1745620576.426265 read 0x10ed56 thru 0x11a8cd (0xbb78 bytes) 000231[0] 1745620576.463124 write 0x400555 thru 0x409881 (0x932d bytes) 000238[0] 1745620576.564326 read 0x2bc3b0 thru 0x2c46ed (0x833e bytes) 000239[0] 1745620576.581455 mapread 0x3d5300 thru 0x3dc5ab (0x72ac bytes) 000240[1] 1745620576.605897 read 0x6afb9e thru 0x6b34e1 (0x3944 bytes) 000245[0] 1745620576.664980 trunc from 0x8ec495 to 0x5669e6 (0x385aae bytes) 000248[1] 1745620576.731948 read 0x08bb2b thru 0x09b9df (0xfeb5 bytes) 000250[0] 1745620576.775252 read 0x418ec4 thru 0x419d69 (0xea6 bytes) 000255[0] 1745620576.843575 read 0x2ba971 thru 0x2c681d (0xbead bytes) 000258[1] 1745620576.883427 trunc from 0x5669e7 to 0x116342 (0x4506a4 bytes) 000260[0] 1745620576.998519 mapread 0x02b265 thru 0x02e779 (0x3515 bytes) 000261[0] 1745620577.065482 mapread 0x102df0 thru 0x110f05 (0xe116 bytes) 000262[1] 1745620577.091515 trunc from 0x116343 to 0x7ecff6 (0x6d6cb4 bytes) 000264[1] 1745620577.158783 mapread 0x7aaabb thru 0x7b015d (0x56a3 bytes) 000265[1] 1745620577.197105 mapread 0x7eb4f4 thru 0x7ecff6 (0x1b03 bytes) 000267[0] 1745620577.209486 read 0x127557 thru 0x13287e (0xb328 bytes) 000268[1] 1745620577.235338 mapwrite 0x2e77e1 thru 0x2f31fb (0xba1b bytes) 000269[1] 1745620577.448439 write 0x31bfbe thru 0x3266d4 (0xa717 bytes) 000270[0] 1745620577.500572 mapwrite 0x1a8b27 thru 0x1a8cbe (0x198 bytes) 000275[1] 1745620577.767409 mapwrite 0x90a7d1 thru 0x90ae1f (0x64f bytes) 000277[0] 1745620577.970895 read 0x1ea2f7 thru 0x1eb6b5 (0x13bf bytes) 000278[0] 1745620578.016676 trunc from 0x90ae20 to 0x4be9bd (0x44c462 bytes) 000279[0] 1745620578.085883 trunc from 0x4be9be to 0x6aec71 (0x1f02b4 bytes) 000280[0] 1745620578.112746 read 0x6197d6 thru 0x6238a7 (0xa0d2 bytes) 000281[0] 1745620578.124497 write 0x8040cb thru 0x80b488 (0x73be bytes) 000283[1] 1745620578.202727 mapread 0x2b9272 thru 0x2c8e01 (0xfb90 bytes) 000287[1] 1745620578.428721 mapwrite 0x41eefc thru 0x420ec8 (0x1fcd bytes) 000289[1] 1745620578.620589 read 0x6bec3b thru 0x6cbd86 (0xd14c bytes) 000291[0] 1745620578.785027 mapread 0x5f66e6 thru 0x5fd599 (0x6eb4 bytes) 000292[0] 1745620578.882597 read 0x6bb1c1 thru 0x6c7b1a (0xc95a bytes) 000293[1] 1745620579.000546 read 0x2130bb thru 0x2158ce (0x2814 bytes) 000295[1] 1745620579.014010 mapread 0x05dbb4 thru 0x06d3b1 (0xf7fe bytes) 000296[0] 1745620579.082386 trunc from 0x80b489 to 0x256a2d (0x5b4a5b bytes) 000297[0] 1745620579.176485 mapread 0x22acc7 thru 0x23977a (0xeab4 bytes) 000303[1] 1745620579.268457 write 0x1bca3b thru 0x1c07dd (0x3da3 bytes) 000304[0] 1745620579.317121 trunc from 0x256a2e to 0x1158f8 (0x141135 bytes) 000308[1] 1745620579.401347 mapwrite 0x337584 thru 0x339345 (0x1dc2 bytes) 000310[0] 1745620579.572299 mapread 0x046ed2 thru 0x054518 (0xd647 bytes) 000312[1] 1745620579.651056 read 0x29cbef thru 0x29d0a6 (0x4b8 bytes) 000313[1] 1745620579.754146 mapwrite 0x49da4e thru 0x49e191 (0x744 bytes) 000314[0] 1745620579.942912 mapread 0x0907fe thru 0x095c3e (0x5441 bytes) 000315[0] 1745620580.006224 mapread 0x296a93 thru 0x2a2495 (0xba03 bytes) 000317[1] 1745620580.050418 read 0x3486af thru 0x3511d0 (0x8b22 bytes) 000320[0] 1745620580.078366 read 0x412651 thru 0x41955f (0x6f0f bytes) truncating to largest ever: 0x9422f7 000321[0] 1745620580.126486 trunc from 0x49e192 to 0x9422f6 (0x4a4165 bytes) 000322[0] 1745620580.179290 write 0x8f087c thru 0x8fcdcf (0xc554 bytes) 000328[1] 1745620580.218584 read 0x6bbef1 thru 0x6c165c (0x576c bytes) 000331[1] 1745620580.279637 mapread 0x25fe71 thru 0x26f58f (0xf71f bytes) 000332[0] 1745620580.350438 read 0x433dca thru 0x43b6d1 (0x7908 bytes) 000337[0] 1745620580.360390 write 0x92301b thru 0x92b07a (0x8060 bytes) 000341[1] 1745620580.444967 read 0x6f88e9 thru 0x6ff90f (0x7027 bytes) 000342[0] 1745620580.456768 mapread 0x13af63 thru 0x148eb3 (0xdf51 bytes) 000343[1] 1745620580.535908 mapwrite 0x350e4c thru 0x35ae06 (0x9fbb bytes) 000344[0] 1745620580.783875 mapwrite 0x75ca1d thru 0x75d95e (0xf42 bytes) 000345[1] 1745620580.982491 mapread 0x0ab352 thru 0x0ae8d7 (0x3586 bytes) 000347[0] 1745620581.075950 trunc from 0x9422f7 to 0x6ea84b (0x257aab bytes) 000348[1] 1745620581.157683 mapread 0x15c6e8 thru 0x169789 (0xd0a2 bytes) 000352[0] 1745620581.243813 mapread 0x296bc8 thru 0x29dd9f (0x71d8 bytes) 000353[1] 1745620581.293011 trunc from 0x6ea84c to 0x0f1997 (0x5f8eb4 bytes) 000354[1] 1745620581.378282 read 0x07cdbd thru 0x086a00 (0x9c44 bytes) 000357[1] 1745620581.437369 trunc from 0x0f1998 to 0x69e779 (0x5acde2 bytes) 000359[1] 1745620581.468406 write 0x1de5c7 thru 0x1df8f0 (0x132a bytes) 000360[1] 1745620581.531230 read 0x1ff00e thru 0x20604e (0x7041 bytes) 000365[0] 1745620581.588643 read 0x002bc4 thru 0x0075fc (0x4a39 bytes) 000366[0] 1745620581.673231 trunc from 0x69e77a to 0x62ed4b (0x6fa2e bytes) 000367[0] 1745620581.728633 mapread 0x2fd021 thru 0x30063a (0x361a bytes) 000369[1] 1745620581.801547 trunc from 0x62ed4c to 0x3c3dc2 (0x26af89 bytes) 000372[1] 1745620581.924984 write 0x3a3b8e thru 0x3b08fb (0xcd6e bytes) 000375[0] 1745620582.024361 write 0x53874b thru 0x5467d6 (0xe08c bytes) 000381[0] 1745620582.171165 read 0x1485f8 thru 0x152df3 (0xa7fc bytes) 000382[1] 1745620582.234440 write 0x83c159 thru 0x840440 (0x42e8 bytes) 000387[0] 1745620582.367960 write 0x2f670f thru 0x2fbe79 (0x576b bytes) 000389[0] 1745620582.412122 trunc from 0x840441 to 0x8f8a48 (0xb8608 bytes) 000390[1] 1745620582.477493 read 0x753a32 thru 0x75bd93 (0x8362 bytes) 000391[0] 1745620582.507672 mapwrite 0x32419a thru 0x326cfb (0x2b62 bytes) 000392[0] 1745620582.697378 mapread 0x227f3b thru 0x2308f0 (0x89b6 bytes) 000393[1] 1745620582.721278 mapread 0x1c5463 thru 0x1c9c50 (0x47ee bytes) 000395[0] 1745620582.783167 mapread 0x1bd51e thru 0x1c09ff (0x34e2 bytes) 000397[1] 1745620582.830971 read 0x10be6b thru 0x10d52a (0x16c0 bytes) 000398[0] 1745620582.840831 mapwrite 0x70f165 thru 0x7113f0 (0x228c bytes) 000399[1] 1745620582.989243 mapwrite 0x3e77cd thru 0x3e78a1 (0xd5 bytes) 000400[0] 1745620583.142139 mapwrite 0x03a669 thru 0x044179 (0x9b11 bytes) 000403[1] 1745620583.277028 read 0x63e5da thru 0x63ec10 (0x637 bytes) 000404[1] 1745620583.321575 mapread 0x4c8234 thru 0x4ccf81 (0x4d4e bytes) 000405[1] 1745620583.393700 write 0x27a577 thru 0x27bf66 (0x19f0 bytes) 000407[0] 1745620583.419332 read 0x4751ee thru 0x483b29 (0xe93c bytes) 000408[1] 1745620583.443570 mapread 0x65b8e8 thru 0x661f9f (0x66b8 bytes) 000410[0] 1745620583.522824 write 0x29d7fd thru 0x2a28c8 (0x50cc bytes) 000412[1] 1745620583.577326 mapread 0x72cf2c thru 0x735d75 (0x8e4a bytes) 000414[0] 1745620583.636242 trunc from 0x8f8a49 to 0x5e9ab8 (0x30ef90 bytes) 000415[1] 1745620583.697837 mapwrite 0x71b57c thru 0x726090 (0xab15 bytes) 000417[0] 1745620583.922310 write 0x93a8f8 thru 0x93b351 (0xa5a bytes) 000419[0] 1745620583.972901 read 0x7a8bcf thru 0x7ad938 (0x4d6a bytes) 000421[1] 1745620584.054424 read 0x325b44 thru 0x333261 (0xd71e bytes) 000422[1] 1745620584.086245 write 0x83126e thru 0x83e820 (0xd5b3 bytes) 000424[0] 1745620584.156627 read 0x6826c8 thru 0x685d5d (0x3696 bytes) 000427[1] 1745620584.199479 write 0x7dbc72 thru 0x7e5b8e (0x9f1d bytes) 000428[1] 1745620584.231280 trunc from 0x93b352 to 0x5cd760 (0x36dbf1 bytes) 000429[0] 1745620584.254223 write 0x0fb381 thru 0x0fd79a (0x241a bytes) 000431[0] 1745620584.317606 read 0x3ea90c thru 0x3f2eb8 (0x85ad bytes) 000432[1] 1745620584.358238 mapread 0x067a1c thru 0x07289a (0xae7f bytes) 000433[0] 1745620584.419393 write 0x9f88bb thru 0x9fb496 (0x2bdc bytes) 000434[0] 1745620584.453589 trunc from 0x9fb497 to 0x52ff4d (0x4cb549 bytes) 000435[0] 1745620584.493348 read 0x3ec76c thru 0x3f9c02 (0xd497 bytes) 000436[0] 1745620584.520040 write 0x2e1f5f thru 0x2ec658 (0xa6fa bytes) 000437[0] 1745620584.544343 write 0x4e7450 thru 0x4f55d9 (0xe18a bytes) 000438[1] 1745620584.593877 trunc from 0x52ff4e to 0x028960 (0x5075ed bytes) 000443[0] 1745620584.756432 mapwrite 0x46488e thru 0x46fbdf (0xb352 bytes) 000444[1] 1745620584.910452 write 0x7a7ea8 thru 0x7b5442 (0xd59b bytes) 000445[0] 1745620584.942350 mapwrite 0x9bfc37 thru 0x9ca950 (0xad1a bytes) 000447[1] 1745620585.090266 write 0x0963aa thru 0x0a638b (0xffe2 bytes) 000448[1] 1745620585.130156 mapread 0x268e27 thru 0x276314 (0xd4ee bytes) 000450[1] 1745620585.185249 read 0x4d2927 thru 0x4db3b6 (0x8a90 bytes) 000455[0] 1745620585.231000 write 0x43bdfd thru 0x44bd2f (0xff33 bytes) 000457[0] 1745620585.313340 trunc from 0x9ca951 to 0x6a8334 (0x32261c bytes) 000460[1] 1745620585.415111 trunc from 0x6a8335 to 0x80d58a (0x165256 bytes) 000461[1] 1745620585.480099 mapwrite 0x0a1335 thru 0x0b0f80 (0xfc4c bytes) 000462[1] 1745620585.632617 mapread 0x241bed thru 0x244705 (0x2b19 bytes) 000463[1] 1745620585.660521 mapread 0x4092a7 thru 0x40fcca (0x6a24 bytes) 000464[0] 1745620585.712040 mapwrite 0x0b2dec thru 0x0b6149 (0x335e bytes) 000469[0] 1745620585.915626 trunc from 0x80d58b to 0x25966b (0x5b3f1f bytes) truncating to largest ever: 0x981309 000471[0] 1745620585.979530 trunc from 0x25966c to 0x981308 (0x727c9d bytes) 000473[1] 1745620586.005573 mapwrite 0x21e929 thru 0x22bfb5 (0xd68d bytes) 000474[1] 1745620586.156530 write 0x90c1cc thru 0x914d11 (0x8b46 bytes) 000475[1] 1745620586.185376 mapwrite 0x6f1d18 thru 0x6f99bb (0x7ca4 bytes) 000476[1] 1745620586.311677 read 0x51ecf1 thru 0x51ed1f (0x2f bytes) 000477[0] 1745620586.322947 read 0x5a1c2a thru 0x5acd79 (0xb150 bytes) 000478[0] 1745620586.381126 mapread 0x49dcaa thru 0x4a495d (0x6cb4 bytes) 000482[1] 1745620586.496709 write 0x71aa4f thru 0x71ad59 (0x30b bytes) 000484[0] 1745620586.530921 write 0x9951f6 thru 0x996a8d (0x1898 bytes) 000485[1] 1745620586.580945 write 0x0fc85b thru 0x1073b4 (0xab5a bytes) 000489[0] 1745620586.699529 mapwrite 0x5d90ed thru 0x5e8a20 (0xf934 bytes) 000493[1] 1745620586.916590 mapwrite 0x06cc44 thru 0x078803 (0xbbc0 bytes) 000494[0] 1745620587.055589 trunc from 0x996a8e to 0x205dcf (0x790cbe bytes) 000497[0] 1745620587.153684 read 0x0f99f4 thru 0x1039e1 (0x9fee bytes) All operations completed A-OK! Chance of close/open is 1 in 50 Seed set to 587 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read skipping zero size read 000008[0] 1745620588.144523 write_OD 0x71b000 thru 0x725fff (0xb000 bytes) 000010[1] 1745620588.221026 read 0x589000 thru 0x5931a7 (0xa1a8 bytes) 000012[1] 1745620588.232313 mapread 0x2ae000 thru 0x2af74c (0x174d bytes) 000015[1] 1745620588.249380 read 0x28a000 thru 0x293c96 (0x9c97 bytes) 000017[0] 1745620588.270003 read_OD 0x24e000 thru 0x256fff (0x9000 bytes) 000019[1] 1745620588.282570 write 0x0c1000 thru 0x0c1cbf (0xcc0 bytes) truncating to largest ever: 0x10db62 000020[0] 1745620588.310488 trunc from 0x726000 to 0x10db61 (0x61849e bytes) truncating to largest ever: 0x9013e7 000023[1] 1745620588.382731 trunc from 0x10db62 to 0x9013e6 (0x7f3885 bytes) 000025[1] 1745620588.423634 mapwrite 0x814000 thru 0x8221cc (0xe1cd bytes) 000026[0] 1745620588.630452 trunc from 0x9013e7 to 0x25edbe (0x6a2628 bytes) 000027[1] 1745620588.680687 mapread 0x088000 thru 0x08f118 (0x7119 bytes) 000028[1] 1745620588.725389 mapread 0x155000 thru 0x157249 (0x224a bytes) truncating to largest ever: 0x9a72b4 000029[0] 1745620588.740895 trunc from 0x25edbf to 0x9a72b3 (0x7484f5 bytes) 000030[0] 1745620588.783742 write_OD 0x52c000 thru 0x52ffff (0x4000 bytes) 000031[0] 1745620588.883261 trunc from 0x9a72b4 to 0x70aa5b (0x29c858 bytes) 000032[0] 1745620588.946066 mapwrite 0x930000 thru 0x93bb13 (0xbb14 bytes) 000033[0] 1745620589.100268 mapwrite 0x610000 thru 0x61cef9 (0xcefa bytes) 000034[1] 1745620589.231513 read 0x7cf000 thru 0x7d305a (0x405b bytes) 000035[1] 1745620589.279554 read 0x179000 thru 0x1809e5 (0x79e6 bytes) 000036[1] 1745620589.302598 mapwrite 0x607000 thru 0x61344b (0xc44c bytes) 000037[0] 1745620589.453511 write_OD 0x3da000 thru 0x3e2fff (0x9000 bytes) 000038[0] 1745620589.538213 read_OD 0x045000 thru 0x052fff (0xe000 bytes) 000041[0] 1745620589.551372 mapwrite 0x0bc000 thru 0x0c0ab6 (0x4ab7 bytes) 000043[1] 1745620589.699036 trunc from 0x93bb14 to 0x376153 (0x5c59c0 bytes) 000046[1] 1745620589.771125 mapwrite 0x39b000 thru 0x39b265 (0x266 bytes) 000047[1] 1745620589.899336 trunc from 0x39b266 to 0x6b8ea8 (0x31dc43 bytes) 000050[0] 1745620589.943565 read_OD 0x2b1000 thru 0x2b5fff (0x5000 bytes) 000051[1] 1745620589.975539 trunc from 0x6b8ea9 to 0x18aa0f (0x52e499 bytes) 000052[0] 1745620590.053969 mapwrite 0x781000 thru 0x78fbc6 (0xebc7 bytes) 000053[1] 1745620590.189362 trunc from 0x78fbc7 to 0x86fdc1 (0xe01fb bytes) 000055[0] 1745620590.248316 read_OD 0x015000 thru 0x01bfff (0x7000 bytes) 000056[1] 1745620590.288633 mapread 0x5ec000 thru 0x5f6496 (0xa497 bytes) 000059[0] 1745620590.340055 read_OD 0x43d000 thru 0x449fff (0xd000 bytes) 000063[1] 1745620590.349579 mapread 0x2a3000 thru 0x2aa328 (0x7329 bytes) 000064[0] 1745620590.366067 mapwrite 0x492000 thru 0x49a700 (0x8701 bytes) 000065[1] 1745620590.471345 read 0x0c0000 thru 0x0cc24e (0xc24f bytes) 000068[1] 1745620590.500880 mapread 0x4e7000 thru 0x4eef65 (0x7f66 bytes) 000075[1] 1745620590.548593 trunc from 0x86fdc2 to 0x19239f (0x6dda22 bytes) 000078[1] 1745620590.618788 read 0x115000 thru 0x11a4a1 (0x54a2 bytes) 000079[0] 1745620590.687641 mapread 0x0b2000 thru 0x0bd629 (0xb62a bytes) 000080[0] 1745620590.766397 write_OD 0x9a7000 thru 0x9affff (0x9000 bytes) 000081[0] 1745620590.877400 read_OD 0x39d000 thru 0x3a4fff (0x8000 bytes) 000083[1] 1745620590.898796 mapread 0x984000 thru 0x9913fc (0xd3fd bytes) 000084[1] 1745620591.080660 mapwrite 0x565000 thru 0x567a6e (0x2a6f bytes) 000087[0] 1745620591.289045 write_OD 0x475000 thru 0x477fff (0x3000 bytes) 000089[1] 1745620591.359876 mapread 0x379000 thru 0x3888cc (0xf8cd bytes) 000090[1] 1745620591.492146 mapread 0x2ad000 thru 0x2ba29b (0xd29c bytes) 000091[1] 1745620591.577672 trunc from 0x9b0000 to 0x77c01a (0x233fe5 bytes) 000092[0] 1745620591.624798 write_OD 0x6de000 thru 0x6e7fff (0xa000 bytes) 000098[0] 1745620591.710523 mapread 0x01f000 thru 0x024de2 (0x5de3 bytes) 000099[0] 1745620591.725934 write_OD 0x55c000 thru 0x562fff (0x7000 bytes) 000100[1] 1745620591.805030 mapread 0x2a7000 thru 0x2a9b88 (0x2b89 bytes) 000101[0] 1745620591.829532 mapread 0x2d9000 thru 0x2e1db4 (0x8db5 bytes) 000102[1] 1745620591.846440 read 0x2ea000 thru 0x2ec373 (0x2374 bytes) 000104[1] 1745620591.851291 mapwrite 0x1d7000 thru 0x1e1c80 (0xac81 bytes) 000106[1] 1745620591.967857 trunc from 0x77c01b to 0x59f5ad (0x1dca6d bytes) 000107[1] 1745620591.983683 mapwrite 0x92b000 thru 0x93164f (0x6650 bytes) 000108[1] 1745620592.110033 read 0x052000 thru 0x053f0a (0x1f0b bytes) 000110[0] 1745620592.170366 trunc from 0x931650 to 0x0c785a (0x869df5 bytes) 000112[0] 1745620592.192205 write_OD 0x180000 thru 0x18bfff (0xc000 bytes) 000117[0] 1745620592.296635 read_OD 0x179000 thru 0x17bfff (0x3000 bytes) 000119[1] 1745620592.305890 trunc from 0x18c000 to 0x791650 (0x605651 bytes) 000121[0] 1745620592.347616 mapwrite 0x9f5000 thru 0x9ffe4a (0xae4b bytes) 000122[0] 1745620592.610573 mapwrite 0x60d000 thru 0x61aea5 (0xdea6 bytes) 000125[1] 1745620592.707911 read 0x553000 thru 0x560c1c (0xdc1d bytes) 000128[0] 1745620592.792655 mapwrite 0x32a000 thru 0x339f33 (0xff34 bytes) 000135[1] 1745620593.091370 trunc from 0x9ffe4b to 0x835fdd (0x1c9e6d bytes) 000137[0] 1745620593.141911 mapread 0x23a000 thru 0x245e9c (0xbe9d bytes) 000138[0] 1745620593.230810 mapread 0x6ad000 thru 0x6b8cf4 (0xbcf5 bytes) 000141[0] 1745620593.290999 trunc from 0x835fde to 0x1be4ce (0x677b0f bytes) 000144[1] 1745620593.373156 read 0x100000 thru 0x10610b (0x610c bytes) 000146[1] 1745620593.424746 write 0x4b8000 thru 0x4c36d1 (0xb6d2 bytes) 000147[0] 1745620593.448830 read_OD 0x14f000 thru 0x152fff (0x4000 bytes) 000150[0] 1745620593.487737 mapwrite 0x97b000 thru 0x97b298 (0x299 bytes) 000151[0] 1745620593.703469 trunc from 0x97b299 to 0x346487 (0x634e11 bytes) 000152[0] 1745620593.720490 mapread 0x238000 thru 0x24443c (0xc43d bytes) 000153[0] 1745620593.743614 write_OD 0x8f7000 thru 0x8fffff (0x9000 bytes) 000156[1] 1745620593.832876 mapread 0x4d4000 thru 0x4ddfc9 (0x9fca bytes) 000157[1] 1745620593.912824 mapread 0x0a0000 thru 0x0a8338 (0x8339 bytes) 000162[0] 1745620593.966595 trunc from 0x900000 to 0x7363a3 (0x1c9c5c bytes) 000163[0] 1745620594.017216 trunc from 0x7363a4 to 0x91c187 (0x1e5de4 bytes) 000164[0] 1745620594.026779 trunc from 0x91c188 to 0x7cb29b (0x150eec bytes) 000166[1] 1745620594.078485 mapwrite 0x259000 thru 0x265819 (0xc81a bytes) 000169[0] 1745620594.339527 write_OD 0x585000 thru 0x58cfff (0x8000 bytes) 000172[0] 1745620594.431472 write_OD 0x2cf000 thru 0x2d9fff (0xb000 bytes) 000174[1] 1745620594.570510 read 0x468000 thru 0x46a2b1 (0x22b2 bytes) 000177[1] 1745620594.583392 write 0x6ed000 thru 0x6f34ec (0x64ed bytes) 000179[0] 1745620594.612445 write_OD 0x5db000 thru 0x5dcfff (0x2000 bytes) 000180[1] 1745620594.716215 mapread 0x0b7000 thru 0x0c17df (0xa7e0 bytes) 000184[1] 1745620594.744206 write 0x5c8000 thru 0x5ce8f3 (0x68f4 bytes) 000185[0] 1745620594.773444 write_OD 0x026000 thru 0x033fff (0xe000 bytes) 000186[1] 1745620594.864037 mapwrite 0x7e2000 thru 0x7e573f (0x3740 bytes) 000187[0] 1745620594.993619 mapwrite 0x51a000 thru 0x51c4a5 (0x24a6 bytes) 000195[1] 1745620595.245105 read 0x0e3000 thru 0x0e7e22 (0x4e23 bytes) 000198[1] 1745620595.264455 read 0x5de000 thru 0x5e8aa1 (0xaaa2 bytes) 000200[1] 1745620595.273164 mapread 0x1e4000 thru 0x1e7974 (0x3975 bytes) 000201[0] 1745620595.294177 trunc from 0x7e5740 to 0x8bb5e8 (0xd5ea9 bytes) 000202[1] 1745620595.358420 mapwrite 0x928000 thru 0x92b042 (0x3043 bytes) 000204[1] 1745620595.525971 read 0x780000 thru 0x78aa72 (0xaa73 bytes) 000205[1] 1745620595.548945 mapread 0x25d000 thru 0x25e9e9 (0x19ea bytes) 000208[1] 1745620595.608551 write 0x636000 thru 0x63bdf0 (0x5df1 bytes) 000209[0] 1745620595.615684 read_OD 0x3f4000 thru 0x3f4fff (0x1000 bytes) 000212[1] 1745620595.647703 mapread 0x80b000 thru 0x818076 (0xd077 bytes) 000218[1] 1745620595.680618 mapwrite 0x3f7000 thru 0x40385b (0xc85c bytes) 000219[0] 1745620595.835205 read_OD 0x1c9000 thru 0x1cafff (0x2000 bytes) 000220[0] 1745620595.856452 trunc from 0x92b043 to 0x3eb106 (0x53ff3c bytes) 000224[1] 1745620595.928891 trunc from 0x3eb107 to 0x762c12 (0x377b0c bytes) 000225[0] 1745620595.965594 mapread 0x1bb000 thru 0x1c4bca (0x9bcb bytes) 000227[0] 1745620596.013198 write_OD 0x182000 thru 0x189fff (0x8000 bytes) 000229[0] 1745620596.105583 write_OD 0x52a000 thru 0x52cfff (0x3000 bytes) 000230[1] 1745620596.178570 write 0x1eb000 thru 0x1f1514 (0x6515 bytes) 000231[1] 1745620596.214907 read 0x4a3000 thru 0x4a85aa (0x55ab bytes) 000233[1] 1745620596.249486 mapread 0x66d000 thru 0x6786fb (0xb6fc bytes) 000234[1] 1745620596.288410 mapwrite 0x990000 thru 0x99b480 (0xb481 bytes) 000240[1] 1745620596.518068 mapwrite 0x995000 thru 0x997c04 (0x2c05 bytes) 000243[1] 1745620596.612970 trunc from 0x99b481 to 0x145e30 (0x855650 bytes) 000246[1] 1745620596.668593 mapread 0x10f000 thru 0x118c80 (0x9c81 bytes) 000251[0] 1745620596.723495 mapread 0x0ea000 thru 0x0f163e (0x763f bytes) 000252[0] 1745620596.755451 mapread 0x124000 thru 0x125935 (0x1936 bytes) 000253[1] 1745620596.763597 read 0x08d000 thru 0x092473 (0x5474 bytes) 000256[1] 1745620596.793986 mapwrite 0x3c0000 thru 0x3cd321 (0xd322 bytes) 000257[1] 1745620596.974375 write 0x785000 thru 0x7926fb (0xd6fc bytes) 000258[1] 1745620596.981845 mapwrite 0x152000 thru 0x1595c8 (0x75c9 bytes) 000262[0] 1745620597.104630 mapread 0x30f000 thru 0x313dd4 (0x4dd5 bytes) 000263[0] 1745620597.171618 mapread 0x2f6000 thru 0x2fc2eb (0x62ec bytes) 000265[0] 1745620597.172486 mapread 0x0b7000 thru 0x0c21ba (0xb1bb bytes) 000266[0] 1745620597.187277 read_OD 0x012000 thru 0x020fff (0xf000 bytes) 000268[1] 1745620597.198050 mapwrite 0x7ec000 thru 0x7f7d24 (0xbd25 bytes) 000269[0] 1745620597.399548 read_OD 0x5e3000 thru 0x5e3fff (0x1000 bytes) 000270[1] 1745620597.433525 write 0x657000 thru 0x65cb9b (0x5b9c bytes) 000272[1] 1745620597.472711 trunc from 0x7f7d25 to 0x17c83a (0x67b4ea bytes) 000275[0] 1745620597.532243 mapread 0x0c1000 thru 0x0c5107 (0x4108 bytes) 000276[1] 1745620597.583780 trunc from 0x17c83b to 0x359893 (0x1dd059 bytes) 000277[1] 1745620597.610874 mapread 0x0e7000 thru 0x0f329e (0xc29f bytes) 000280[1] 1745620597.700778 mapwrite 0x7de000 thru 0x7dfbc6 (0x1bc7 bytes) 000281[0] 1745620597.847381 write_OD 0x6d0000 thru 0x6d8fff (0x9000 bytes) 000285[0] 1745620597.925750 trunc from 0x7dfbc7 to 0x13e23a (0x6a198c bytes) 000286[0] 1745620597.963404 read_OD 0x12b000 thru 0x130fff (0x6000 bytes) 000291[1] 1745620597.978284 mapread 0x111000 thru 0x12094b (0xf94c bytes) 000294[1] 1745620598.054367 mapwrite 0x033000 thru 0x04255b (0xf55c bytes) 000295[1] 1745620598.212869 trunc from 0x13e23b to 0x2f127e (0x1b3044 bytes) 000297[1] 1745620598.268733 mapread 0x249000 thru 0x249ab6 (0xab7 bytes) 000304[1] 1745620598.368900 mapwrite 0x449000 thru 0x44c283 (0x3284 bytes) 000305[1] 1745620598.476588 mapread 0x434000 thru 0x43e8a9 (0xa8aa bytes) 000307[1] 1745620598.590465 trunc from 0x44c284 to 0x00ca0b (0x43f878 bytes) 000309[1] 1745620598.642205 mapwrite 0x81e000 thru 0x81fda8 (0x1da9 bytes) 000311[1] 1745620598.776599 mapread 0x60e000 thru 0x610b30 (0x2b31 bytes) 000312[1] 1745620598.793194 mapwrite 0x617000 thru 0x61f645 (0x8646 bytes) 000316[1] 1745620598.932884 read 0x10c000 thru 0x1199b7 (0xd9b8 bytes) 000318[0] 1745620598.972168 mapwrite 0x0cd000 thru 0x0d47ce (0x77cf bytes) 000322[1] 1745620599.248900 mapread 0x798000 thru 0x7983f8 (0x3f9 bytes) 000324[0] 1745620599.295520 read_OD 0x6ac000 thru 0x6adfff (0x2000 bytes) 000326[0] 1745620599.305866 trunc from 0x81fda9 to 0x60f88e (0x21051a bytes) 000327[1] 1745620599.342992 mapwrite 0x555000 thru 0x561e4a (0xce4b bytes) 000328[0] 1745620599.476533 write_OD 0x1fc000 thru 0x20afff (0xf000 bytes) 000329[1] 1745620599.572092 mapread 0x1e3000 thru 0x1f11fb (0xe1fc bytes) 000333[1] 1745620599.600000 write 0x4ef000 thru 0x4f7222 (0x8223 bytes) 000337[0] 1745620599.634344 trunc from 0x60f88f to 0x783f67 (0x1746d9 bytes) 000341[0] 1745620599.694890 mapread 0x3ca000 thru 0x3d43ea (0xa3eb bytes) 000342[1] 1745620599.767064 trunc from 0x783f68 to 0x8e77e0 (0x163879 bytes) 000343[0] 1745620599.836981 read_OD 0x6ec000 thru 0x6fafff (0xf000 bytes) 000344[0] 1745620599.900212 mapread 0x60c000 thru 0x616675 (0xa676 bytes) 000345[1] 1745620599.949219 read 0x275000 thru 0x27d0ea (0x80eb bytes) 000347[1] 1745620599.956955 read 0x075000 thru 0x0844f4 (0xf4f5 bytes) 000348[1] 1745620599.966694 write 0x06d000 thru 0x07015b (0x315c bytes) 000350[1] 1745620599.984336 trunc from 0x8e77e1 to 0x99979a (0xb1fba bytes) 000352[1] 1745620600.026322 trunc from 0x99979b to 0x4eef98 (0x4aa802 bytes) 000354[0] 1745620600.108914 mapread 0x35b000 thru 0x363b85 (0x8b86 bytes) 000355[1] 1745620600.172820 mapread 0x48a000 thru 0x4999fc (0xf9fd bytes) 000357[1] 1745620600.223185 mapwrite 0x2c3000 thru 0x2d23ae (0xf3af bytes) 000358[1] 1745620600.379360 read 0x0ad000 thru 0x0b1906 (0x4907 bytes) 000359[1] 1745620600.390024 write 0x7c5000 thru 0x7cbe15 (0x6e16 bytes) 000360[0] 1745620600.394006 read_OD 0x7c8000 thru 0x7cafff (0x3000 bytes) 000364[1] 1745620600.429977 read 0x3c0000 thru 0x3cda00 (0xda01 bytes) 000368[1] 1745620600.446543 mapread 0x333000 thru 0x333a3c (0xa3d bytes) 000371[1] 1745620600.457990 read 0x689000 thru 0x69267b (0x967c bytes) 000372[1] 1745620600.468096 write 0x083000 thru 0x08d70f (0xa710 bytes) 000374[0] 1745620600.500711 write_OD 0x7bd000 thru 0x7cbfff (0xf000 bytes) 000378[1] 1745620600.599117 mapwrite 0x79c000 thru 0x7a01fd (0x41fe bytes) 000381[0] 1745620600.776527 mapread 0x0bf000 thru 0x0c29cd (0x39ce bytes) 000384[1] 1745620600.821179 write 0x785000 thru 0x785de3 (0xde4 bytes) 000386[0] 1745620600.869338 mapwrite 0x3ca000 thru 0x3d4efd (0xaefe bytes) 000388[0] 1745620601.005469 read_OD 0x659000 thru 0x663fff (0xb000 bytes) 000392[0] 1745620601.032625 write_OD 0x4be000 thru 0x4bffff (0x2000 bytes) 000393[1] 1745620601.091391 read 0x113000 thru 0x11dffc (0xaffd bytes) 000395[1] 1745620601.104296 read 0x54c000 thru 0x5573fe (0xb3ff bytes) 000396[0] 1745620601.109661 trunc from 0x7cc000 to 0x5733bf (0x258c40 bytes) 000398[1] 1745620601.168964 read 0x310000 thru 0x31326d (0x326e bytes) 000400[0] 1745620601.206723 read_OD 0x09a000 thru 0x09efff (0x5000 bytes) 000403[0] 1745620601.221005 write_OD 0x97c000 thru 0x989fff (0xe000 bytes) 000404[0] 1745620601.323911 mapwrite 0x8f4000 thru 0x9011f6 (0xd1f7 bytes) 000405[0] 1745620601.459017 read_OD 0x382000 thru 0x38ffff (0xe000 bytes) 000406[1] 1745620601.480745 write 0x31a000 thru 0x31c32c (0x232d bytes) 000408[1] 1745620601.515414 trunc from 0x98a000 to 0x5b8693 (0x3d196c bytes) 000409[1] 1745620601.550550 mapread 0x596000 thru 0x59a272 (0x4273 bytes) 000412[1] 1745620601.571376 trunc from 0x5b8694 to 0x03841b (0x580278 bytes) 000416[0] 1745620601.665541 mapread 0x00f000 thru 0x00f953 (0x954 bytes) 000417[0] 1745620601.695286 mapread 0x01a000 thru 0x02564f (0xb650 bytes) 000419[1] 1745620601.729875 read 0x029000 thru 0x0350f4 (0xc0f5 bytes) 000421[0] 1745620601.741634 read_OD 0x00b000 thru 0x015fff (0xb000 bytes) 000423[0] 1745620601.749261 mapread 0x037000 thru 0x037fcf (0xfd0 bytes) 000426[0] 1745620601.760708 mapwrite 0x347000 thru 0x348fae (0x1faf bytes) 000427[0] 1745620601.925474 mapread 0x293000 thru 0x2973cb (0x43cc bytes) 000429[0] 1745620601.932646 mapread 0x008000 thru 0x00f664 (0x7665 bytes) 000430[1] 1745620601.970011 read 0x191000 thru 0x19df51 (0xcf52 bytes) 000432[1] 1745620602.055577 write 0x780000 thru 0x78e310 (0xe311 bytes) 000436[1] 1745620602.126032 trunc from 0x78e311 to 0x019990 (0x774980 bytes) 000439[0] 1745620602.166930 trunc from 0x019991 to 0x0076be (0x122d2 bytes) 000441[0] 1745620602.228374 trunc from 0x0076bf to 0x30bcc9 (0x30460b bytes) 000443[1] 1745620602.264364 read 0x090000 thru 0x091e7c (0x1e7d bytes) 000444[0] 1745620602.375033 trunc from 0x30bcca to 0x2e04b2 (0x2b817 bytes) 000445[0] 1745620602.438573 trunc from 0x2e04b3 to 0x3eb7d3 (0x10b321 bytes) 000450[0] 1745620602.510449 mapread 0x0ad000 thru 0x0aeffc (0x1ffd bytes) 000452[1] 1745620602.558638 write 0x857000 thru 0x863944 (0xc945 bytes) 000453[1] 1745620602.594135 write 0x0bc000 thru 0x0c8831 (0xc832 bytes) 000454[0] 1745620602.615572 write_OD 0x211000 thru 0x21dfff (0xd000 bytes) 000455[1] 1745620602.721050 trunc from 0x863945 to 0x21cc64 (0x646ce0 bytes) 000456[1] 1745620602.748709 write 0x56e000 thru 0x57d1c1 (0xf1c2 bytes) truncating to largest ever: 0x9fc3eb 000458[1] 1745620602.773200 trunc from 0x57d1c2 to 0x9fc3ea (0x47f229 bytes) 000459[0] 1745620602.794589 mapwrite 0x23e000 thru 0x24078f (0x2790 bytes) 000462[0] 1745620602.918951 trunc from 0x9fc3eb to 0x963215 (0x991d5 bytes) 000465[0] 1745620603.010459 write_OD 0x518000 thru 0x51ffff (0x8000 bytes) 000466[0] 1745620603.081570 mapwrite 0x7dd000 thru 0x7e5307 (0x8308 bytes) 000467[0] 1745620603.262406 mapwrite 0x40d000 thru 0x4141ea (0x71eb bytes) 000470[0] 1745620603.339263 read_OD 0x716000 thru 0x718fff (0x3000 bytes) 000471[1] 1745620603.370983 mapread 0x0b1000 thru 0x0bbed2 (0xaed3 bytes) 000473[1] 1745620603.448626 mapread 0x139000 thru 0x13f87d (0x687e bytes) 000474[1] 1745620603.480006 write 0x302000 thru 0x30a136 (0x8137 bytes) 000476[1] 1745620603.538216 write 0x9c8000 thru 0x9d72f6 (0xf2f7 bytes) 000479[0] 1745620603.569795 mapwrite 0x0f3000 thru 0x0fb43a (0x843b bytes) 000480[1] 1745620603.768263 write 0x4de000 thru 0x4e7f1c (0x9f1d bytes) 000483[1] 1745620603.820974 mapread 0x5d2000 thru 0x5d675b (0x475c bytes) 000484[0] 1745620603.907369 mapwrite 0x93e000 thru 0x947c0c (0x9c0d bytes) 000488[1] 1745620604.029788 trunc from 0x9d72f7 to 0x999cb9 (0x3d63d bytes) 000493[0] 1745620604.096517 write_OD 0x75c000 thru 0x768fff (0xd000 bytes) 000495[1] 1745620604.166128 mapread 0x48c000 thru 0x491e75 (0x5e76 bytes) 000499[1] 1745620604.196743 mapread 0x03e000 thru 0x04c387 (0xe388 bytes) All operations completed A-OK! PASS 16a (52s) == sanityn test 16b: 500 iterations of dual-mount fsx at small size ========================================================== 18:36:47 (1745620607) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.516997 s, 16.2 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.38869 s, 21.6 MB/s Chance of close/open is 1 in 50 Seed set to 609 fd 0: /mnt/lustre/f16b.sanityn fd 1: /mnt/lustre2/f16b.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x23a157 000003[0] 1745620610.472184 trunc from 00000000 to 0x23a156 (0x23a157 bytes) 000006[1] 1745620610.546583 read 0x231e00 thru 0x233b0a (0x1d0b bytes) 000007[1] 1745620610.575033 write 0x9686c2 thru 0x969c5d (0x159c bytes) 000010[0] 1745620610.677752 mapread 0x2a5d24 thru 0x2a692c (0xc09 bytes) truncating to largest ever: 0x3a10e3 000011[1] 1745620610.722598 trunc from 0x969c5e to 0x3a10e2 (0x5c8b7b bytes) 000012[0] 1745620610.791218 mapread 0x062889 thru 0x064712 (0x1e8a bytes) 000015[1] 1745620610.877030 write 0x0c96c3 thru 0x0cb6b6 (0x1ff4 bytes) 000016[1] 1745620610.903594 mapread 0x022e9b thru 0x024a84 (0x1bea bytes) 000017[0] 1745620610.936254 mapwrite 0x18379b thru 0x18521f (0x1a85 bytes) 000019[1] 1745620611.165177 mapwrite 0x9dd044 thru 0x9ded89 (0x1d46 bytes) 000020[0] 1745620611.292583 read 0x160ba4 thru 0x161322 (0x77f bytes) 000023[0] 1745620611.312783 write 0x9efdd6 thru 0x9efff2 (0x21d bytes) 000026[0] 1745620611.365260 write 0x9a6ca1 thru 0x9a80e8 (0x1448 bytes) 000027[0] 1745620611.387711 write 0x09de44 thru 0x09f8e3 (0x1aa0 bytes) 000032[0] 1745620611.454328 mapwrite 0x0a8e24 thru 0x0aa27a (0x1457 bytes) 000033[0] 1745620611.553385 read 0x5e3b27 thru 0x5e44e0 (0x9ba bytes) 000038[1] 1745620611.597345 read 0x43e2bf thru 0x43ecc8 (0xa0a bytes) 000039[1] 1745620611.614354 mapread 0x2ba730 thru 0x2bbfbd (0x188e bytes) 000040[0] 1745620611.638924 mapread 0x94dc72 thru 0x94f88a (0x1c19 bytes) 000042[0] 1745620611.657289 trunc from 0x9efff3 to 0x32cf93 (0x6c305f bytes) 000043[0] 1745620611.703008 mapwrite 0x16244a thru 0x1632a5 (0xe5c bytes) 000044[0] 1745620611.805561 mapread 0x08eb3e thru 0x09070c (0x1bcf bytes) 000045[1] 1745620611.815641 write 0x7f808e thru 0x7f9e6b (0x1dde bytes) 000046[1] 1745620611.839800 mapread 0x42b087 thru 0x42cd13 (0x1c8d bytes) truncating to largest ever: 0x541163 000048[0] 1745620611.885914 trunc from 0x7f9e6c to 0x541162 (0x2b8d09 bytes) 000051[1] 1745620611.956330 mapread 0x053cb4 thru 0x05442f (0x77c bytes) 000052[0] 1745620611.994173 mapread 0x21a3c5 thru 0x21b843 (0x147f bytes) 000055[1] 1745620612.002392 mapread 0x4a7d61 thru 0x4a8b29 (0xdc9 bytes) 000056[0] 1745620612.029409 write 0x8a62b6 thru 0x8a67c7 (0x512 bytes) truncating to largest ever: 0x7e1fbc 000057[1] 1745620612.053307 trunc from 0x8a67c8 to 0x7e1fbb (0xc480c bytes) 000066[1] 1745620612.207350 read 0x37fb2e thru 0x3801ac (0x67f bytes) 000068[0] 1745620612.259406 mapread 0x0bc0d2 thru 0x0bda2c (0x195b bytes) 000071[0] 1745620612.324495 mapwrite 0x5ac60d thru 0x5aca36 (0x42a bytes) 000074[1] 1745620612.470420 mapread 0x4dd4f0 thru 0x4df198 (0x1ca9 bytes) 000076[0] 1745620612.519016 mapwrite 0x57f915 thru 0x581550 (0x1c3c bytes) 000077[0] 1745620612.686421 read 0x091de4 thru 0x093662 (0x187f bytes) 000078[1] 1745620612.690267 mapwrite 0x40653b thru 0x407d70 (0x1836 bytes) 000079[1] 1745620612.817189 mapwrite 0x6083a1 thru 0x6097d4 (0x1434 bytes) 000080[0] 1745620612.905715 mapread 0x119edb thru 0x11a917 (0xa3d bytes) 000082[0] 1745620612.943322 mapread 0x0314fa thru 0x033402 (0x1f09 bytes) 000085[0] 1745620612.982337 read 0x030e29 thru 0x0329a8 (0x1b80 bytes) 000087[1] 1745620612.995976 mapwrite 0x8ef447 thru 0x8f04cf (0x1089 bytes) 000092[1] 1745620613.157218 write 0x7a1850 thru 0x7a3525 (0x1cd6 bytes) 000093[1] 1745620613.182471 mapwrite 0x4a46ea thru 0x4a553f (0xe56 bytes) 000094[1] 1745620613.278749 mapread 0x5266c0 thru 0x527c21 (0x1562 bytes) 000099[1] 1745620613.309415 trunc from 0x8f04d0 to 0x613712 (0x2dcdbd bytes) 000100[0] 1745620613.340853 read 0x0b02a0 thru 0x0b1fb3 (0x1d14 bytes) 000104[0] 1745620613.448531 read 0x383f30 thru 0x3847c3 (0x894 bytes) 000105[1] 1745620613.474425 write 0x0805cf thru 0x082169 (0x1b9b bytes) 000113[0] 1745620613.591598 write 0x96aad3 thru 0x96c9a6 (0x1ed4 bytes) 000114[0] 1745620613.622131 read 0x772d9f thru 0x773ea5 (0x1107 bytes) 000116[0] 1745620613.659406 read 0x69ad67 thru 0x69b6b1 (0x94b bytes) 000122[0] 1745620613.721333 read 0x8ef432 thru 0x8ef7a3 (0x372 bytes) 000123[1] 1745620613.725827 mapwrite 0x63619d thru 0x637ea3 (0x1d07 bytes) 000124[1] 1745620613.892018 read 0x514f21 thru 0x516d08 (0x1de8 bytes) 000126[1] 1745620613.923133 read 0x16a7a6 thru 0x16c007 (0x1862 bytes) 000129[0] 1745620613.989996 mapread 0x6cf2de thru 0x6d122f (0x1f52 bytes) 000131[1] 1745620614.026566 mapwrite 0x9adc00 thru 0x9ae0c3 (0x4c4 bytes) 000132[1] 1745620614.181591 mapread 0x269586 thru 0x26b340 (0x1dbb bytes) 000134[1] 1745620614.238374 write 0x342cfa thru 0x342d8f (0x96 bytes) 000136[0] 1745620614.268708 mapread 0x92def5 thru 0x92e1ec (0x2f8 bytes) 000137[1] 1745620614.304621 read 0x39de84 thru 0x39e8f2 (0xa6f bytes) 000139[0] 1745620614.309993 mapwrite 0x46d6cd thru 0x46f333 (0x1c67 bytes) 000142[1] 1745620614.451761 mapwrite 0x1301e8 thru 0x131655 (0x146e bytes) 000147[0] 1745620614.641371 mapread 0x4a6d4a thru 0x4a784d (0xb04 bytes) 000148[1] 1745620614.670508 mapread 0x753e43 thru 0x754fd8 (0x1196 bytes) 000152[0] 1745620614.691772 mapread 0x545555 thru 0x545b09 (0x5b5 bytes) 000153[1] 1745620614.712990 write 0x7a286a thru 0x7a3f27 (0x16be bytes) 000155[1] 1745620614.733193 read 0x35a167 thru 0x35aa7a (0x914 bytes) 000157[1] 1745620614.775984 write 0x824763 thru 0x825090 (0x92e bytes) 000158[1] 1745620614.788920 read 0x027be5 thru 0x02944f (0x186b bytes) truncating to largest ever: 0x7f307b 000161[1] 1745620614.816388 trunc from 0x9ae0c4 to 0x7f307a (0x1bb049 bytes) 000162[1] 1745620614.836260 mapread 0x28c517 thru 0x28e374 (0x1e5e bytes) 000163[0] 1745620614.863182 write 0x214d4d thru 0x2168c5 (0x1b79 bytes) 000166[0] 1745620614.949187 mapread 0x67b975 thru 0x67d769 (0x1df5 bytes) 000168[0] 1745620615.000429 mapread 0x2849eb thru 0x284b5c (0x172 bytes) 000170[1] 1745620615.014886 mapwrite 0x711840 thru 0x7121b9 (0x97a bytes) 000173[0] 1745620615.163537 write 0x350221 thru 0x351913 (0x16f3 bytes) 000175[1] 1745620615.217913 trunc from 0x7f307b to 0x62e7d7 (0x1c48a3 bytes) 000180[1] 1745620615.313509 mapwrite 0x820696 thru 0x821a07 (0x1372 bytes) 000181[0] 1745620615.393480 mapread 0x21eb40 thru 0x21ebc5 (0x86 bytes) 000183[0] 1745620615.422640 mapwrite 0x6553d6 thru 0x655aad (0x6d8 bytes) 000184[1] 1745620615.516918 mapread 0x2338cc thru 0x23514a (0x187f bytes) truncating to largest ever: 0x971f89 000185[1] 1745620615.552188 trunc from 0x821a08 to 0x971f88 (0x150581 bytes) 000187[1] 1745620615.595947 mapread 0x8f176e thru 0x8f2d6c (0x15ff bytes) 000188[0] 1745620615.607924 mapread 0x1ba28e thru 0x1ba67b (0x3ee bytes) 000190[1] 1745620615.639397 trunc from 0x971f89 to 0x72fa3b (0x24254d bytes) 000191[0] 1745620615.683638 mapread 0x46bfe2 thru 0x46dd40 (0x1d5f bytes) 000193[0] 1745620615.790398 read 0x53b090 thru 0x53b3cc (0x33d bytes) 000195[1] 1745620615.835711 trunc from 0x72fa3c to 0x6ec413 (0x43628 bytes) 000196[0] 1745620615.931950 write 0x1539b4 thru 0x153a14 (0x61 bytes) 000198[0] 1745620616.018174 mapread 0x1a07c6 thru 0x1a081e (0x59 bytes) 000201[1] 1745620616.144114 read 0x654e28 thru 0x655062 (0x23b bytes) 000203[1] 1745620616.199390 mapwrite 0x031d9f thru 0x033310 (0x1572 bytes) 000204[1] 1745620616.383776 mapwrite 0x700374 thru 0x700f86 (0xc13 bytes) 000205[0] 1745620616.565526 mapwrite 0x7f83fb thru 0x7f92d2 (0xed8 bytes) 000207[1] 1745620616.759825 write 0x0f8527 thru 0x0f941f (0xef9 bytes) 000211[1] 1745620616.911749 trunc from 0x7f92d3 to 0x80c12c (0x12e5a bytes) 000212[0] 1745620616.947720 trunc from 0x80c12d to 0x953d2d (0x147c01 bytes) 000213[1] 1745620616.994224 mapwrite 0x36e324 thru 0x370034 (0x1d11 bytes) 000219[1] 1745620617.213325 write 0x42c1c5 thru 0x42e042 (0x1e7e bytes) 000220[1] 1745620617.236915 trunc from 0x953d2e to 0x8ed96b (0x663c2 bytes) 000222[0] 1745620617.263368 mapwrite 0x16bd35 thru 0x16d280 (0x154c bytes) 000223[1] 1745620617.382716 mapread 0x5d2ae6 thru 0x5d3ce9 (0x1204 bytes) 000224[1] 1745620617.433531 write 0x63528b thru 0x6352ab (0x21 bytes) 000225[1] 1745620617.472525 mapread 0x03bcbe thru 0x03d2b3 (0x15f6 bytes) 000227[1] 1745620617.571958 mapread 0x855c8b thru 0x85748d (0x1803 bytes) 000229[1] 1745620617.614412 trunc from 0x8ed96c to 0x69c140 (0x25182b bytes) 000231[1] 1745620617.681390 mapwrite 0x8d9a4e thru 0x8daa79 (0x102c bytes) 000233[1] 1745620617.846333 mapwrite 0x461392 thru 0x4617b1 (0x420 bytes) 000235[0] 1745620617.965772 trunc from 0x8daa7a to 0x72f3d5 (0x1ab6a4 bytes) 000236[0] 1745620618.019250 trunc from 0x72f3d6 to 0x0b6596 (0x678e3f bytes) 000237[0] 1745620618.038616 write 0x2285b1 thru 0x229e7d (0x18cd bytes) 000238[0] 1745620618.082797 mapwrite 0x3889f3 thru 0x389c20 (0x122e bytes) 000240[0] 1745620618.205126 mapwrite 0x49023a thru 0x491425 (0x11ec bytes) 000241[0] 1745620618.302136 mapread 0x21dadc thru 0x21de5f (0x384 bytes) 000242[0] 1745620618.308440 read 0x0b3c7c thru 0x0b3e99 (0x21e bytes) 000243[0] 1745620618.314101 read 0x2a0089 thru 0x2a09de (0x956 bytes) 000247[1] 1745620618.410127 mapread 0x3058c3 thru 0x307359 (0x1a97 bytes) 000248[1] 1745620618.453425 trunc from 0x491426 to 0x0d6de3 (0x3ba642 bytes) 000250[0] 1745620618.490972 read 0x08818a thru 0x088f84 (0xdfb bytes) 000251[1] 1745620618.509449 mapwrite 0x0a1ae4 thru 0x0a34b4 (0x19d1 bytes) 000252[1] 1745620618.667707 write 0x8724b7 thru 0x872658 (0x1a2 bytes) 000253[0] 1745620618.690478 write 0x1c5934 thru 0x1c5e8d (0x55a bytes) 000254[0] 1745620618.730258 mapread 0x80e028 thru 0x80f64d (0x1626 bytes) 000255[0] 1745620618.769233 mapread 0x027c35 thru 0x029079 (0x1445 bytes) 000257[0] 1745620618.816539 mapwrite 0x67758e thru 0x678c46 (0x16b9 bytes) 000259[1] 1745620618.934420 mapread 0x453d10 thru 0x45533d (0x162e bytes) 000261[0] 1745620618.983952 write 0x09168e thru 0x091865 (0x1d8 bytes) 000263[1] 1745620619.016920 write 0x329b39 thru 0x32b6c6 (0x1b8e bytes) 000265[1] 1745620619.064709 mapread 0x3215b0 thru 0x32195f (0x3b0 bytes) 000266[0] 1745620619.087473 trunc from 0x872659 to 0x5a6152 (0x2cc506 bytes) 000270[1] 1745620619.177839 write 0x6fcac3 thru 0x6fe0e1 (0x161f bytes) 000272[0] 1745620619.219823 read 0x4602e4 thru 0x460a3d (0x75a bytes) 000273[0] 1745620619.244904 write 0x0cead5 thru 0x0ceb1f (0x4b bytes) 000276[1] 1745620619.251454 read 0x031e4d thru 0x03228c (0x440 bytes) 000279[0] 1745620619.285420 read 0x254503 thru 0x2550f3 (0xbf1 bytes) 000282[0] 1745620619.294610 trunc from 0x6fe0e2 to 0x24a8f9 (0x4b37e8 bytes) 000283[1] 1745620619.402543 write 0x149dd1 thru 0x14a690 (0x8c0 bytes) 000285[0] 1745620619.462029 mapread 0x080b01 thru 0x082684 (0x1b84 bytes) 000286[1] 1745620619.499735 mapread 0x082f0b thru 0x082f28 (0x1e bytes) 000287[1] 1745620619.516639 mapwrite 0x208402 thru 0x2086ba (0x2b9 bytes) 000289[1] 1745620619.624651 mapread 0x0e4bb7 thru 0x0e6922 (0x1d6c bytes) 000290[0] 1745620619.667723 mapwrite 0x49f431 thru 0x49fd28 (0x8f8 bytes) 000292[0] 1745620619.798580 mapwrite 0x59e872 thru 0x59f9a4 (0x1133 bytes) 000293[1] 1745620619.947912 mapread 0x07ae72 thru 0x07c1f3 (0x1382 bytes) 000296[1] 1745620620.031568 read 0x3cebae thru 0x3cecaf (0x102 bytes) 000297[1] 1745620620.036019 write 0x9aef2e thru 0x9afe84 (0xf57 bytes) 000299[0] 1745620620.088109 mapread 0x407ed2 thru 0x408930 (0xa5f bytes) 000301[0] 1745620620.130036 read 0x3a1850 thru 0x3a31b4 (0x1965 bytes) 000302[1] 1745620620.154792 write 0x4ebf77 thru 0x4ed8d2 (0x195c bytes) 000303[0] 1745620620.189986 read 0x64ec27 thru 0x64ef4f (0x329 bytes) 000304[1] 1745620620.218162 mapwrite 0x78ec41 thru 0x78ff8a (0x134a bytes) 000305[0] 1745620620.308252 mapread 0x110c27 thru 0x112973 (0x1d4d bytes) 000306[1] 1745620620.345201 trunc from 0x9afe85 to 0x8a8c12 (0x107272 bytes) 000307[1] 1745620620.379434 mapwrite 0x8ebef8 thru 0x8ed46b (0x1574 bytes) 000308[1] 1745620620.546580 trunc from 0x8ed46c to 0x3d8de0 (0x51468b bytes) 000309[0] 1745620620.594639 mapread 0x0edaab thru 0x0ee444 (0x99a bytes) 000310[1] 1745620620.674754 trunc from 0x3d8de1 to 0x082357 (0x356a89 bytes) 000311[0] 1745620620.709708 mapread 0x04b4e4 thru 0x04b78b (0x2a8 bytes) 000312[0] 1745620620.758668 mapwrite 0x595d3a thru 0x5975e4 (0x18ab bytes) 000319[1] 1745620620.905282 mapwrite 0x704283 thru 0x705a08 (0x1786 bytes) 000320[1] 1745620621.077848 mapread 0x3dc5ed thru 0x3dcc24 (0x638 bytes) 000321[0] 1745620621.090301 read 0x6f2283 thru 0x6f3d8a (0x1b08 bytes) 000325[0] 1745620621.128668 mapwrite 0x64c772 thru 0x64d2f7 (0xb86 bytes) 000328[0] 1745620621.274146 trunc from 0x705a09 to 0x0d564d (0x6303bb bytes) 000329[0] 1745620621.314634 trunc from 0x0d564e to 0x61fbf2 (0x54a5a5 bytes) 000330[0] 1745620621.340030 mapread 0x057f9c thru 0x059dc0 (0x1e25 bytes) 000331[1] 1745620621.399718 write 0x917c5c thru 0x919363 (0x1708 bytes) 000332[0] 1745620621.433925 mapread 0x531af9 thru 0x53249b (0x9a3 bytes) 000333[1] 1745620621.492344 trunc from 0x919364 to 0x45cf95 (0x4bc3ce bytes) 000335[0] 1745620621.537187 mapread 0x33bf93 thru 0x33db4e (0x1bbc bytes) 000336[1] 1745620621.565581 trunc from 0x45cf96 to 0x016c2f (0x446366 bytes) 000338[0] 1745620621.624862 mapread 0x001f8c thru 0x0025ae (0x623 bytes) 000344[1] 1745620621.708913 trunc from 0x016c30 to 0x662ad6 (0x64bea7 bytes) 000346[0] 1745620621.768409 trunc from 0x662ad7 to 0x767348 (0x104872 bytes) 000349[0] 1745620621.856041 write 0x308a39 thru 0x30933e (0x906 bytes) 000351[0] 1745620621.900575 mapwrite 0x33908d thru 0x33aa05 (0x1979 bytes) 000352[0] 1745620621.997514 mapread 0x157e07 thru 0x15965b (0x1855 bytes) 000358[1] 1745620622.080732 mapread 0x732e3c thru 0x733543 (0x708 bytes) 000367[0] 1745620622.166925 read 0x0208f6 thru 0x021cb0 (0x13bb bytes) 000368[0] 1745620622.172850 mapread 0x5c8209 thru 0x5c940f (0x1207 bytes) 000369[0] 1745620622.205927 mapwrite 0x4345b6 thru 0x434c48 (0x693 bytes) 000370[0] 1745620622.322340 trunc from 0x767349 to 0x3775e3 (0x3efd65 bytes) 000371[0] 1745620622.353924 trunc from 0x3775e4 to 0x930ad1 (0x5b94ee bytes) 000373[0] 1745620622.402463 trunc from 0x930ad2 to 0x1c20fb (0x76e9d6 bytes) 000376[1] 1745620622.425603 trunc from 0x1c20fc to 0x0a7df3 (0x11a308 bytes) 000382[0] 1745620622.530438 mapwrite 0x4d7bb4 thru 0x4d9629 (0x1a76 bytes) 000383[1] 1745620622.725974 read 0x36d9e7 thru 0x36e435 (0xa4f bytes) 000384[0] 1745620622.844813 mapread 0x406698 thru 0x4085c5 (0x1f2e bytes) 000389[0] 1745620622.897055 read 0x1e0532 thru 0x1e21e3 (0x1cb2 bytes) 000390[0] 1745620622.917997 write 0x772f9f thru 0x77488a (0x18ec bytes) 000392[0] 1745620622.935972 mapwrite 0x7b10f2 thru 0x7b1e40 (0xd4f bytes) 000393[0] 1745620623.064450 write 0x381829 thru 0x383079 (0x1851 bytes) 000394[1] 1745620623.093056 mapwrite 0x2142ae thru 0x214f89 (0xcdc bytes) 000396[0] 1745620623.236464 write 0x3705a6 thru 0x3721b5 (0x1c10 bytes) 000398[0] 1745620623.278178 mapwrite 0x544bb6 thru 0x545a03 (0xe4e bytes) 000400[0] 1745620623.407042 trunc from 0x7b1e41 to 0x3c96a1 (0x3e879f bytes) 000403[1] 1745620623.423964 mapwrite 0x34f7c5 thru 0x34f9b4 (0x1f0 bytes) 000404[0] 1745620623.531518 read 0x1c5a2a thru 0x1c60bc (0x693 bytes) 000406[1] 1745620623.641289 read 0x24061c thru 0x2424bf (0x1ea4 bytes) 000412[1] 1745620623.732025 write 0x393a11 thru 0x39517b (0x176b bytes) 000413[0] 1745620623.773187 mapwrite 0x494532 thru 0x494a9e (0x56d bytes) 000415[0] 1745620623.917936 trunc from 0x494a9f to 0x028770 (0x46c32e bytes) 000416[0] 1745620623.945566 mapread 0x026df8 thru 0x027529 (0x732 bytes) 000417[1] 1745620623.980789 mapwrite 0x12c6e1 thru 0x12cf2d (0x84d bytes) 000418[1] 1745620624.123439 trunc from 0x12cf2e to 0x6405f9 (0x5136cc bytes) 000419[0] 1745620624.143375 trunc from 0x6405fa to 0x27176a (0x3cee8f bytes) 000422[1] 1745620624.223902 write 0x76a2aa thru 0x76b273 (0xfca bytes) 000423[1] 1745620624.244990 mapwrite 0x7e90ac thru 0x7e9af3 (0xa48 bytes) 000424[0] 1745620624.402573 mapread 0x1eded3 thru 0x1ee956 (0xa84 bytes) 000425[0] 1745620624.445752 trunc from 0x7e9af4 to 0x219ecf (0x5cfc24 bytes) 000426[0] 1745620624.505512 write 0x0e0840 thru 0x0e1bcd (0x138e bytes) 000427[1] 1745620624.534304 mapwrite 0x4076a8 thru 0x408da0 (0x16f9 bytes) 000431[0] 1745620624.694398 mapread 0x36dc78 thru 0x36f6c2 (0x1a4b bytes) 000432[1] 1745620624.744450 mapread 0x358cd4 thru 0x35ac5b (0x1f88 bytes) 000433[0] 1745620624.777995 write 0x5efa48 thru 0x5f0efd (0x14b6 bytes) 000434[0] 1745620624.794713 mapwrite 0x7cab64 thru 0x7cc235 (0x16d2 bytes) 000441[1] 1745620625.047465 mapwrite 0x3f09bc thru 0x3f26a0 (0x1ce5 bytes) 000443[0] 1745620625.210802 trunc from 0x7cc236 to 0x3f626f (0x3d5fc6 bytes) 000445[1] 1745620625.268220 mapread 0x09a1c1 thru 0x09bd7f (0x1bbf bytes) 000446[1] 1745620625.326807 mapwrite 0x6fe75c thru 0x7006c3 (0x1f68 bytes) 000447[1] 1745620625.475919 read 0x0301b9 thru 0x031e95 (0x1cdd bytes) 000448[0] 1745620625.481551 read 0x1adbb3 thru 0x1ae6d6 (0xb24 bytes) 000450[1] 1745620625.582748 mapwrite 0x287929 thru 0x288fca (0x16a2 bytes) 000452[1] 1745620625.677196 read 0x64aed9 thru 0x64bbed (0xd15 bytes) 000454[1] 1745620625.678132 mapread 0x602e38 thru 0x603d10 (0xed9 bytes) 000455[0] 1745620625.679826 read 0x4aac27 thru 0x4abd46 (0x1120 bytes) 000460[1] 1745620625.757302 read 0x526bca thru 0x5289d1 (0x1e08 bytes) 000464[1] 1745620625.792287 read 0x4118f7 thru 0x4123fd (0xb07 bytes) 000465[1] 1745620625.820715 write 0x013349 thru 0x013710 (0x3c8 bytes) 000466[1] 1745620625.827683 mapwrite 0x497ca3 thru 0x499973 (0x1cd1 bytes) 000470[1] 1745620625.939867 read 0x34cf5a thru 0x34dadd (0xb84 bytes) 000471[0] 1745620625.943680 mapwrite 0x9fc2c2 thru 0x9fd113 (0xe52 bytes) 000473[1] 1745620626.084436 trunc from 0x9fd114 to 0x82ae71 (0x1d22a2 bytes) 000474[1] 1745620626.123699 mapwrite 0x95d0dd thru 0x95ede4 (0x1d08 bytes) 000475[0] 1745620626.206975 trunc from 0x95ede5 to 0x230abd (0x72e327 bytes) 000478[1] 1745620626.259632 mapread 0x127c68 thru 0x128d6b (0x1104 bytes) 000479[1] 1745620626.301851 trunc from 0x230abe to 0x3d6403 (0x1a5946 bytes) 000480[0] 1745620626.355293 mapread 0x175caa thru 0x176921 (0xc78 bytes) 000481[1] 1745620626.398314 read 0x0be54f thru 0x0c00fe (0x1bb0 bytes) 000482[0] 1745620626.491684 read 0x21092c thru 0x211217 (0x8ec bytes) 000485[1] 1745620626.585030 mapwrite 0x1921fd thru 0x192cca (0xace bytes) 000488[1] 1745620626.681748 read 0x32682a thru 0x3285f3 (0x1dca bytes) 000489[0] 1745620626.760626 trunc from 0x3d6404 to 0x882ccc (0x4ac8c9 bytes) 000490[1] 1745620626.888122 write 0x6db094 thru 0x6db1b3 (0x120 bytes) 000491[0] 1745620626.930151 read 0x25401b thru 0x255aca (0x1ab0 bytes) 000492[0] 1745620626.950436 trunc from 0x882ccd to 0x55681a (0x32c4b2 bytes) 000493[1] 1745620626.986286 read 0x36f5d8 thru 0x3712b3 (0x1cdc bytes) 000498[1] 1745620627.038849 read 0x2b8a63 thru 0x2b93b3 (0x951 bytes) 000500[0] 1745620627.060101 trunc from 0x55681b to 0x482e86 (0xd3994 bytes) All operations completed A-OK! PASS 16b (23s) == sanityn test 16c: verify data consistency on ldiskfs with cache disabled (b=17397) ========================================================== 18:37:11 (1745620631) SKIP: sanityn test_16c dio on ldiskfs only SKIP 16c (3s) == sanityn test 16d: Verify DIO and buffer IO with two clients ========================================================== 18:37:14 (1745620634) 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.48721 s, 17.2 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.593696 s, 14.1 MB/s ldlm.namespaces.MGC192.168.201.134@tcp.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff88012a619800.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff88012ab18800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff88012a619800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff88012ab18800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff88012a619800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff88012ab18800.lru_size=clear 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 12.1436 s, 8.6 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 2.34577 s, 44.7 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.51626 s, 69.2 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.2183 s, 24.9 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 8.59977 s, 12.2 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 2.12968 s, 49.2 MB/s PASS 16d (41s) == sanityn test 16e: Verify size consistency for O_DIRECT write ========================================================== 18:37:55 (1745620675) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.188715 s, 55.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.107145 s, 9.8 MB/s PASS 16e (6s) == sanityn test 16f: rw sequential consistency vs drop_caches ========================================================== 18:38:01 (1745620681) TIMEOUT PASS 16f (24s) == sanityn test 16g: mmap rw sequential consistency vs drop_caches ========================================================== 18:38:25 (1745620705) TIMEOUT PASS 16g (25s) == sanityn test 16h: mmap read after truncate file ======= 18:38:50 (1745620730) ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16h (4s) == sanityn test 16i: read after truncate file ============ 18:38:55 (1745620735) ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16i (4s) == sanityn test 16j: race dio with buffered i/o ========== 18:38:59 (1745620739) 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 0.735824 s, 35.6 MB/s bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.783024 s, 33.5 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 2.70573 s, 9.7 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.46904 s, 55.9 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 1.96407 s, 13.3 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.367077 s, 71.4 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 2.06181 s, 12.7 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.516669 s, 50.7 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.882336 s, 29.7 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 2.34627 s, 11.2 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 2.49893 s, 10.5 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.668024 s, 39.2 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.945467 s, 27.7 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 2.381 s, 11.0 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 2.52387 s, 10.4 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.842497 s, 31.1 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 1.20073 s, 21.8 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 3.42304 s, 7.7 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 3.45942 s, 7.6 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK PASS 16j (29s) == sanityn test 16k: Parallel FSX and drop caches should not panic ========================================================== 18:39:29 (1745620769) + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.1 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.2 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.3 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.4 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.5 -l 67108864 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab All operations completed A-OK! All operations completed A-OK! All operations completed A-OK! All operations completed A-OK! All operations completed A-OK! + fsx 1 done: rc=0 Fri Apr 25 18:40:11 EDT 2025 + fsx 2 done: rc=0 Fri Apr 25 18:40:11 EDT 2025 + fsx 3 done: rc=0 Fri Apr 25 18:40:11 EDT 2025 + fsx 4 done: rc=0 Fri Apr 25 18:40:11 EDT 2025 + fsx 5 done: rc=0 Fri Apr 25 18:40:11 EDT 2025 PASS 16k (49s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 18:40:17 (1745620817) fail_loc=0x8000030a PASS 17 (8s) == sanityn test 18: mmap sanity check =========================================================================================== 18:40:25 (1745620825) mmap test1: basic mmap operation (PASS, 0.10072s) mmap test2: MAP_PRIVATE not write back (PASS, 0.059838s) mmap test3: concurrent mmap ops on two nodes (PASS, 16.943s) mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 4.5325s) mmap test5: read/write file to/from the buffer which mmapped to just this file (PASS, 0.14841s) mmap test6: check mmap write/read content on two nodes (PASS, 0.30789s) mmap test7: file i/o with an unmapped buffer (SKIPPED, 0s) mmap test8: SIGBUS for beyond file size (SKIPPED, 0s) mmap test9: SIGBUS for negative file offset (SKIPPED, 0s) mmap test10: multi-thread mmap access (PASS, 0.76444s) mmap test11: multi-thread shared mmap (PASS, 0.80161s) mmap test10: mtime not change for readonly mmap access (PASS, 1.0825s) PASS 18 (31s) == sanityn test 19: test concurrent uncached read races ========================================================================= 18:40:56 (1745620856) oleg134-server: error: get_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory pdsh@oleg134-client: oleg134-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (3s) == sanityn test 20: test extra readahead page left in cache ============================================================== 18:40:59 (1745620859) PASS 20 (6s) == sanityn test 21: Try to remove mountpoint on another dir ============================================================== 18:41:05 (1745620865) rmdir: removing directory, '/mnt/lustre/d21.sanityn' rmdir: failed to remove '/mnt/lustre/d21.sanityn': Device or resource busy rmdir: removing directory, '/mnt/lustre2/d21.sanityn' Removed mounted directory from another mountpoint, needs to be fixed PASS 21 (5s) == sanityn test 23: others should see updated atime while another read============================================================== 18:41:10 (1745620870) now is 1745620872 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.7075 new atime is 1745620933 PASS 23 (66s) == sanityn test 24a: lfs df [-ih] [path] test =================================================================================== 18:42:16 (1745620936) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 33792 3735552 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 39936 7498752 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 33792 3735552 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 39936 7498752 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.5K 386 490.1K 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 114.5K 430 114.1K 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 115.3K 428 114.9K 1% /mnt/lustre[OST:1] filesystem_summary: 229.3K 386 229.0K 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.5K 386 490.1K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 114.5K 430 114.1K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 115.3K 428 114.9K 1% /mnt/lustre2[OST:1] filesystem_summary: 229.3K 386 229.0K 1% /mnt/lustre2 UUID bytes Used Available Use% Mounted on lustre-MDT0000_UUID 2.1G 3.2M 2.1G 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3.6G 33.0M 3.6G 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3.6G 6.0M 3.6G 1% /mnt/lustre[OST:1] filesystem_summary: 7.2G 39.0M 7.2G 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502242 386 501856 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 117230 430 116800 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 118092 428 117664 1% /mnt/lustre2[OST:1] filesystem_summary: 234850 386 234464 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 33792 3735552 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 39936 7498752 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.5K 386 490.1K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 114.5K 430 114.1K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 115.3K 428 114.9K 1% /mnt/lustre2[OST:1] filesystem_summary: 229.3K 386 229.0K 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502242 386 501856 1% /mnt/lustre[MDT:0] filesystem_summary: 502242 386 501856 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502242 386 501856 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 117230 430 116800 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 118092 428 117664 1% /mnt/lustre2[OST:1] filesystem_summary: 234850 386 234464 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 33792 3735552 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 39936 7498752 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 33792 3735552 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 6144 3763200 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 39936 7498752 1% /mnt/lustre2 PASS 24a (5s) == sanityn test 24b: lfs df should show both filesystems ========================================================================= 18:42:21 (1745620941) PASS 24b (4s) == sanityn test 25a: change ACL on one mountpoint be seen on another ============================================================= 18:42:25 (1745620945) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] PASS 25a (6s) == sanityn test 25b: change ACL under remote dir on one mountpoint be seen on another ========================================================== 18:42:31 (1745620951) SKIP: sanityn test_25b needs >= 2 MDTs SKIP 25b (2s) == sanityn test 26a: allow mtime to get older ============ 18:42:33 (1745620953) utime: good mknod times 1745620953 <= 1745620954 <= 1745620954 for /mnt/lustre/f26a utime: good mknod times 1745620953 <= 1745620954 <= 1745620954 for /mnt/lustre2/f26a utime: good utime mtimes 100000, atime 200000 utime: updated times for /mnt/lustre2/f26a PASS 26a (6s) == sanityn test 26b: sync mtime between ost and mds ====== 18:42:39 (1745620959) PASS 26b (7s) == sanityn test 26c: set-in-past on open file is not lost on close ========================================================== 18:42:46 (1745620966) multiop /mnt/lustre/f26c.sanityn vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.7075 File: '/mnt/lustre/f26c.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205272502401 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2025-04-25 18:42:47.000000000 -0400 Birth: - File: '/mnt/lustre2/f26c.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205272502401 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2025-04-25 18:42:47.000000000 -0400 Birth: - PASS 26c (6s) SKIP: sanityn test_27 skipping excluded test 27 SKIP: sanityn test_28 skipping ALWAYS excluded test 28 == sanityn test 30: recreate file race =================== 18:42:55 (1745620975) 0 PASS 30 (7s) == sanityn test 31a: voluntary cancel / blocking ast race======================================================================== 18:43:02 (1745620982) fail_loc=0x314 PASS 31a (7s) == sanityn test 31b: voluntary OST cancel / blocking ast race======================================================================== 18:43:09 (1745620989) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg134-server mds-ost sync done. sleep 5 for ZFS MDS Waiting for MDT destroys to complete fail_loc=0x314 fail_loc=0x316 fail_loc=0 fail_loc=0 Filesystem 1K-blocks Used Available Use% Mounted on 192.168.201.134@tcp:/lustre 7542784 39936 7498752 1% /mnt/lustre2 PASS 31b (17s) == sanityn test 31r: open-rename(replace) race =========== 18:43:26 (1745621006) -rw-r--r-- 1 root root 0 Apr 25 18:43 /mnt/lustre/f31r.sanityn.target fail_loc=0x1419 fail_val=3 PASS 31r (8s) == sanityn test 31s: open should not revalidate invalid dentry ========================================================== 18:43:35 (1745621015) /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 1213: 14339 Terminated tail -f $tfile PASS 31s (6s) == sanityn test 31t: getattr should not revalidate invalid dentry ========================================================== 18:43:40 (1745621020) PASS 31t (6s) SKIP: sanityn test_33a skipping SLOW test 33a == sanityn test 33b: COS: cross create/delete, 2 clients, benchmark under remote dir ========================================================== 18:43:47 (1745621027) SKIP: sanityn test_33b Need two or more clients, have 1 SKIP 33b (3s) == sanityn test 33c: Cancel cross-MDT lock should trigger Sync-on-Lock-Cancel ========================================================== 18:43:50 (1745621030) SKIP: sanityn test_33c needs >= 2 MDTs SKIP 33c (2s) == sanityn test 33d: dependent transactions should trigger COS ========================================================== 18:43:52 (1745621032) SKIP: sanityn test_33d needs >= 2 MDTs SKIP 33d (2s) == sanityn test 33e: independent transactions shouldn't trigger COS ========================================================== 18:43:55 (1745621035) SKIP: sanityn test_33e needs >= 2 MDTs SKIP 33e (2s) == sanityn test 34: no lock timeout under IO ============= 18:43:57 (1745621037) fail_loc=0x512 fail_loc=0x512 lock should not expire writing on client1 reading on client2 success fail_loc=0x511 fail_loc=0x511 lock should expire writing on client1 reading on client2 success oleg134-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff88012a619800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff88012a619800.ost_server_uuid in FULL state after 0 sec oleg134-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff88012a619800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff88012a619800.ost_server_uuid in IDLE state after 0 sec oleg134-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff88012a619800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff88012a619800.ost_server_uuid in FULL state after 0 sec oleg134-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff88012a619800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff88012a619800.ost_server_uuid in IDLE state after 0 sec oleg134-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff88012a619800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff88012a619800.ost_server_uuid in FULL state after 0 sec oleg134-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff88012a619800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff88012a619800.ost_server_uuid in IDLE state after 0 sec PASS 34 (113s) == sanityn test 35: -EINTR cp_ast vs. bl_ast race does not evict client ========================================================== 18:45:50 (1745621150) fail_loc=0x80000317 Race attempt 0 Wait for 21013 21053 for 60 sec... - open/close 882 (time 1745621166.62 total 10.01 last 88.13) - open/close 1743 (time 1745621176.62 total 20.01 last 86.07) - open/close 2697 (time 1745621186.62 total 30.01 last 95.40) - open/close 3644 (time 1745621196.63 total 40.02 last 94.61) total: 4000 open/close in 44.00 seconds: 90.91 ops/second fail_loc=0x0 Filesystem Size Used Avail Use% Mounted on 192.168.201.134@tcp:/lustre 7.2G 40M 7.2G 1% /mnt/lustre 192.168.201.134@tcp:/lustre 7.2G 40M 7.2G 1% /mnt/lustre2 PASS 35 (70s) == sanityn test 36: handle ESTALE/open-unlink correctly == 18:47:00 (1745621220) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg134-server mds-ost sync done. Waiting for MDT destroys to complete 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 1.06544 s, 49.2 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7075 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(0) *** before(7497728) after_dd(7443456) after(7494656) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.658643 s, 79.6 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7075 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(1) *** before(7494656) after_dd(7440384) after(7491584) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.702235 s, 74.7 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7075 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(2) *** before(7491584) after_dd(7443456) after(7494656) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.866813 s, 60.5 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7075 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(3) *** before(7494656) after_dd(7445504) after(7496704) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.851024 s, 61.6 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7075 sleep 5 for ZFS MDS Waiting for MDT destroys to complete *** cycle(4) *** before(7496704) after_dd(7441408) after(7492608) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.988132 s, 53.1 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7075 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(5) *** before(7492608) after_dd(7440384) after(7491584) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.965603 s, 54.3 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7075 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(6) *** before(7491584) after_dd(7443456) after(7494656) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.704708 s, 74.4 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7075 sleep 5 for ZFS MDS Waiting for MDT destroys to complete *** cycle(7) *** before(7494656) after_dd(7440384) after(7491584) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.768017 s, 68.3 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7075 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(8) *** before(7491584) after_dd(7440384) after(7491584) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 1.02361 s, 51.2 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7075 sleep 5 for ZFS MDS Waiting for MDT destroys to complete *** cycle(9) *** before(7491584) after_dd(7443456) after(7494656) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.868066 s, 60.4 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.7075 sleep 5 for ZFS MDS Waiting for MDT destroys to complete *** cycle(10) *** before(7494656) after_dd(7441408) after(7492608) PASS 36 (230s) == sanityn test 37: check i_size is not updated for directory on close (bug 18695) ======================================================================== 18:50:50 (1745621450) multiop /mnt/lustre/d37.sanityn vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.7075 - create 1915 (time 1745621463.45 total 10.00 last 191.48) - create 3952 (time 1745621473.45 total 20.00 last 203.62) - create 6027 (time 1745621483.45 total 30.01 last 207.44) - create 7862 (time 1745621493.45 total 40.01 last 183.47) - create 9894 (time 1745621503.46 total 50.01 last 203.09) total: 10000 create in 50.62 seconds: 197.54 ops/second PASS 37 (58s) == sanityn test 39a: file mtime does not change after rename ========================================================== 18:51:48 (1745621508) repeat after cancel_lru_locks PASS 39a (5s) == sanityn test 39b: file mtime the same on clients with/out lock ========================================================== 18:51:53 (1745621513) repeat after cancel_lru_locks PASS 39b (6s) == sanityn test 39c: check truncate mtime update ================================================================================ 18:51:59 (1745621519) repeat after cancel_lru_locks PASS 39c (6s) == sanityn test 39d: sync write should update mtime ====== 18:52:06 (1745621526) fail_loc=0x411 fail_loc=0 PASS 39d (5s) SKIP: sanityn test_40a skipping ALWAYS excluded test 40a == sanityn test 40b: pdirops: open|create and others ======================================================================== 18:52:12 (1745621532) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40b (13s) == sanityn test 40c: pdirops: link and others ======================================================================== 18:52:25 (1745621545) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40c (13s) == sanityn test 40d: pdirops: unlink and others ======================================================================== 18:52:38 (1745621558) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40d (14s) == sanityn test 40e: pdirops: rename and others ======================================================================== 18:52:52 (1745621572) No conflict No conflict No conflict No conflict No conflict No conflict PASS 40e (13s) == sanityn test 41a: pdirops: create vs mkdir ======================================================================== 18:53:05 (1745621585) mkdir: cannot create directory '/mnt/lustre2/f41a.sanityn': File exists Conflict PASS 41a (11s) == sanityn test 41b: pdirops: create vs create ======================================================================== 18:53:16 (1745621596) open: File exists Conflict PASS 41b (10s) == sanityn test 41c: pdirops: create vs link ======================================================================== 18:53:26 (1745621606) link: cannot create link '/mnt/lustre2/f41c.sanityn' to '/mnt/lustre2/f41c.sanityn-2': File exists Conflict PASS 41c (10s) == sanityn test 41d: pdirops: create vs unlink ======================================================================== 18:53:36 (1745621616) Conflict PASS 41d (9s) == sanityn test 41e: pdirops: create and rename (tgt) ======================================================================== 18:53:45 (1745621625) Conflict PASS 41e (9s) == sanityn test 41f: pdirops: create and rename (src) ======================================================================== 18:53:54 (1745621634) Conflict PASS 41f (9s) == sanityn test 41g: pdirops: create vs getattr ======================================================================== 18:54:03 (1745621643) Conflict PASS 41g (9s) == sanityn test 41h: pdirops: create vs readdir ======================================================================== 18:54:12 (1745621652) Conflict PASS 41h (11s) == sanityn test 41i: reint_open: create vs create ======== 18:54:23 (1745621663) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 41i (864s) == sanityn test 42a: pdirops: mkdir vs mkdir ======================================================================== 19:08:47 (1745622527) mkdir: cannot create directory '/mnt/lustre2/f42a.sanityn': File exists Conflict PASS 42a (7s) == sanityn test 42b: pdirops: mkdir vs create ======================================================================== 19:08:54 (1745622534) open: File exists Conflict PASS 42b (8s) == sanityn test 42c: pdirops: mkdir vs link ======================================================================== 19:09:02 (1745622542) link: cannot create link '/mnt/lustre2/f42c.sanityn' to '/mnt/lustre2/f42c.sanityn-2': File exists Conflict PASS 42c (7s) == sanityn test 42d: pdirops: mkdir vs unlink ======================================================================== 19:09:09 (1745622549) Conflict PASS 42d (8s) == sanityn test 42e: pdirops: mkdir and rename (tgt) ======================================================================== 19:09:17 (1745622557) mv: cannot overwrite directory '/mnt/lustre2/f42e.sanityn' with non-directory Conflict PASS 42e (7s) == sanityn test 42f: pdirops: mkdir and rename (src) ======================================================================== 19:09:25 (1745622565) Conflict PASS 42f (9s) == sanityn test 42g: pdirops: mkdir vs getattr ======================================================================== 19:09:33 (1745622573) Conflict PASS 42g (8s) == sanityn test 42h: pdirops: mkdir vs readdir ======================================================================== 19:09:41 (1745622581) Conflict PASS 42h (8s) == sanityn test 43a: rmdir,mkdir doesn't return -EEXIST ======================================================================== 19:09:49 (1745622589) PASS 43a (46s) == sanityn test 43b: pdirops: unlink vs create ======================================================================== 19:10:35 (1745622635) Conflict PASS 43b (10s) == sanityn test 43c: pdirops: unlink vs link ======================================================================== 19:10:45 (1745622645) Conflict PASS 43c (10s) == sanityn test 43d: pdirops: unlink vs unlink ======================================================================== 19:10:55 (1745622655) rm: cannot remove '/mnt/lustre2/f43d.sanityn': No such file or directory Conflict PASS 43d (10s) == sanityn test 43e: pdirops: unlink and rename (tgt) ======================================================================== 19:11:05 (1745622665) Conflict PASS 43e (9s) == sanityn test 43f: pdirops: unlink and rename (src) ======================================================================== 19:11:14 (1745622674) mv: cannot stat '/mnt/lustre2/f43f.sanityn': No such file or directory Conflict PASS 43f (8s) == sanityn test 43g: pdirops: unlink vs getattr ======================================================================== 19:11:23 (1745622683) stat: cannot stat '/mnt/lustre2/f43g.sanityn': No such file or directory Conflict PASS 43g (9s) == sanityn test 43h: pdirops: unlink vs readdir ======================================================================== 19:11:31 (1745622691) Conflict PASS 43h (10s) == sanityn test 43i: pdirops: unlink vs remote mkdir ===== 19:11:41 (1745622701) SKIP: sanityn test_43i needs >= 2 MDTs SKIP 43i (2s) == sanityn test 43j: racy mkdir return EEXIST ======================================================================== 19:11:43 (1745622703) mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists PASS 43j (87s) == sanityn test 43k: unlink vs create ==================== 19:13:10 (1745622790) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 43k (641s) == sanityn test 44a: pdirops: rename tgt vs mkdir ======================================================================== 19:23:51 (1745623431) mkdir: cannot create directory '/mnt/lustre2/f44a.sanityn': File exists Conflict Fri Apr 25 19:23:56 EDT 2025 PASS 44a (7s) == sanityn test 44b: pdirops: rename tgt vs create ======================================================================== 19:23:58 (1745623438) open: File exists Conflict PASS 44b (7s) == sanityn test 44c: pdirops: rename tgt vs link ======================================================================== 19:24:05 (1745623445) link: cannot create link '/mnt/lustre2/f44c.sanityn' to '/mnt/lustre2/f44c.sanityn-3': File exists Conflict PASS 44c (7s) == sanityn test 44d: pdirops: rename tgt vs unlink ======================================================================== 19:24:12 (1745623452) Conflict PASS 44d (6s) == sanityn test 44e: pdirops: rename tgt and rename (tgt) ======================================================================== 19:24:18 (1745623458) Conflict PASS 44e (6s) == sanityn test 44f: pdirops: rename tgt and rename (src) ======================================================================== 19:24:24 (1745623464) Conflict PASS 44f (7s) == sanityn test 44g: pdirops: rename tgt vs getattr ======================================================================== 19:24:31 (1745623471) Conflict PASS 44g (6s) == sanityn test 44h: pdirops: rename tgt vs readdir ======================================================================== 19:24:38 (1745623478) Conflict PASS 44h (7s) == sanityn test 44i: pdirops: rename tgt vs remote mkdir ========================================================== 19:24:44 (1745623484) SKIP: sanityn test_44i needs >= 2 MDTs SKIP 44i (1s) == sanityn test 45a: rename,mkdir doesn't return -EEXIST ======================================================================== 19:24:45 (1745623485) PASS 45a (51s) == sanityn test 45b: pdirops: rename src vs create ======================================================================== 19:25:36 (1745623536) Conflict PASS 45b (6s) == sanityn test 45c: pdirops: rename src vs link ======================================================================== 19:25:42 (1745623542) Conflict PASS 45c (6s) == sanityn test 45d: pdirops: rename src vs unlink ======================================================================== 19:25:48 (1745623548) rm: cannot remove '/mnt/lustre2/f45d.sanityn': No such file or directory Conflict PASS 45d (7s) == sanityn test 45e: pdirops: rename src and rename (tgt) ======================================================================== 19:25:55 (1745623555) Conflict PASS 45e (6s) == sanityn test 45f: pdirops: rename src and rename (src) ======================================================================== 19:26:01 (1745623561) mv: cannot stat '/mnt/lustre2/f45f.sanityn': No such file or directory Conflict PASS 45f (7s) == sanityn test 45g: pdirops: rename src vs getattr ======================================================================== 19:26:08 (1745623568) stat: cannot stat '/mnt/lustre2/f45g.sanityn': No such file or directory Conflict PASS 45g (6s) == sanityn test 45h: pdirops: unlink vs readdir ======================================================================== 19:26:14 (1745623574) Conflict PASS 45h (6s) == sanityn test 45i: pdirops: rename src vs remote mkdir ========================================================== 19:26:20 (1745623580) SKIP: sanityn test_45i needs >= 2 MDTs SKIP 45i (1s) == sanityn test 45j: read vs rename ====================== 19:26:21 (1745623581) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 45j (563s) == sanityn test 46a: pdirops: link vs mkdir ======================================================================== 19:35:44 (1745624144) mkdir: cannot create directory '/mnt/lustre2/f46a.sanityn': File exists Conflict PASS 46a (6s) == sanityn test 46b: pdirops: link vs create ======================================================================== 19:35:50 (1745624150) open: File exists Conflict PASS 46b (6s) == sanityn test 46c: pdirops: link vs link ======================================================================== 19:35:56 (1745624156) link: cannot create link '/mnt/lustre2/f46c.sanityn' to '/mnt/lustre2/f46c.sanityn': File exists Conflict PASS 46c (6s) == sanityn test 46d: pdirops: link vs unlink ======================================================================== 19:36:02 (1745624162) Conflict PASS 46d (6s) == sanityn test 46e: pdirops: link and rename (tgt) ======================================================================== 19:36:08 (1745624168) Conflict PASS 46e (7s) == sanityn test 46f: pdirops: link and rename (src) ======================================================================== 19:36:15 (1745624175) Conflict PASS 46f (6s) == sanityn test 46g: pdirops: link vs getattr ======================================================================== 19:36:21 (1745624181) Conflict PASS 46g (7s) == sanityn test 46h: pdirops: link vs readdir ======================================================================== 19:36:28 (1745624188) Conflict PASS 46h (6s) == sanityn test 46i: pdirops: link vs remote mkdir ======= 19:36:35 (1745624195) SKIP: sanityn test_46i needs >= 2 MDTs SKIP 46i (1s) == sanityn test 47a: pdirops: remote mkdir vs mkdir ====== 19:36:36 (1745624196) SKIP: sanityn test_47a needs >= 2 MDTs SKIP 47a (1s) == sanityn test 47b: pdirops: remote mkdir vs create ===== 19:36:37 (1745624197) SKIP: sanityn test_47b needs >= 2 MDTs SKIP 47b (1s) == sanityn test 47c: pdirops: remote mkdir vs link ======= 19:36:38 (1745624198) SKIP: sanityn test_47c needs >= 2 MDTs SKIP 47c (2s) == sanityn test 47d: pdirops: remote mkdir vs unlink ===== 19:36:40 (1745624200) SKIP: sanityn test_47d needs >= 2 MDTs SKIP 47d (1s) == sanityn test 47e: pdirops: remote mkdir and rename (tgt) ========================================================== 19:36:41 (1745624201) SKIP: sanityn test_47e needs >= 2 MDTs SKIP 47e (2s) == sanityn test 47f: pdirops: remote mkdir and rename (src) ========================================================== 19:36:43 (1745624203) SKIP: sanityn test_47f needs >= 2 MDTs SKIP 47f (1s) == sanityn test 47g: pdirops: remote mkdir vs getattr ==== 19:36:44 (1745624204) SKIP: sanityn test_47g needs >= 2 MDTs SKIP 47g (1s) == sanityn test 50: osc lvb attrs: enqueue vs. CP AST ======================================================================== 19:36:45 (1745624205) 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.0144456 s, 709 kB/s fail_loc=0x410 fail_loc=0x0 PASS 50 (8s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 19:36:53 (1745624213) 0+1 records in 0+1 records out 159 bytes (159 B) copied, 0.00792023 s, 20.1 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3519: kill: (10536) - No such process PASS 51a (5s) == sanityn test 51b: layout lock: glimpse should be able to restart if layout changed ========================================================== 19:36:58 (1745624218) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00669559 s, 153 kB/s fail_loc=0x1404 fail_val=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0311952 s, 33.6 MB/s 3145728 PASS 51b (15s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 19:37:13 (1745624233) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00955541 s, 107 kB/s PASS 51c (7s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 19:37:20 (1745624240) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133682 s, 78.4 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (3s) == sanityn test 51e: lfs getstripe does not break leases, part 2 ========================================================== 19:37:24 (1745624244) /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2450 0x992 0x280000400 write lease(2) has applied. /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2450 0x992 0x280000400 read lease(1) has applied. PASS 51e (4s) == sanityn test 54: rename locking ======================= 19:37:28 (1745624248) llite.lustre-ffff88012a619800.xattr_cache=1 llite.lustre-ffff88012ab18800.xattr_cache=1 ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505014 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-04-25 19:37:29.000000000 -0400 Modify: 2025-04-25 19:37:29.000000000 -0400 Change: 2025-04-25 19:37:29.000000000 -0400 Birth: - ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000154 File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505017 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-04-25 19:37:34.000000000 -0400 Modify: 2025-04-25 19:37:35.000000000 -0400 Change: 2025-04-25 19:37:35.000000000 -0400 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505020 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-04-25 19:37:40.000000000 -0400 Modify: 2025-04-25 19:37:40.000000000 -0400 Change: 2025-04-25 19:37:40.000000000 -0400 Birth: - open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505019 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-04-25 19:37:40.000000000 -0400 Modify: 2025-04-25 19:37:40.000000000 -0400 Change: 2025-04-25 19:37:40.000000000 -0400 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000154 open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505022 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-04-25 19:37:45.000000000 -0400 Modify: 2025-04-25 19:37:46.000000000 -0400 Change: 2025-04-25 19:37:46.000000000 -0400 Birth: - File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505023 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-04-25 19:37:45.000000000 -0400 Modify: 2025-04-25 19:37:46.000000000 -0400 Change: 2025-04-25 19:37:46.000000000 -0400 Birth: - PASS 54 (24s) == sanityn test 55a: rename vs unlink target dir ========= 19:37:53 (1745624273) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55a.sanityn/d1/d2' to '/mnt/lustre/d55a.sanityn/d3/d2': No such file or directory PASS 55a (8s) == sanityn test 55b: rename vs unlink source dir ========= 19:38:01 (1745624281) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55b.sanityn/d1/d2' to '/mnt/lustre/d55b.sanityn/d3/d2': No such file or directory PASS 55b (7s) == sanityn test 55c: rename vs unlink orphan target dir == 19:38:08 (1745624288) fail_loc=0x156 mv: cannot move '/mnt/lustre/d55c.sanityn/d1/d2' to '/mnt/lustre/d55c.sanityn/d3/d2': No such file or directory PASS 55c (13s) == sanityn test 55d: rename file vs link ================= 19:38:21 (1745624301) fail_loc=0x155 mv: cannot move '/mnt/lustre/d55d.sanityn/f1' to '/mnt/lustre/d55d.sanityn/d55d.sanityn': Is a directory PASS 55d (10s) == sanityn test 56a: test llverdev with single large stripe ========================================================== 19:38:31 (1745624311) run_llverdev /mnt/lustre/f56a.sanityn -p -s 16000000 -c 4k llverdev: /mnt/lustre/f56a.sanityn is 16777216000000 bytes (15625 GB) in size timestamp: 1745624312 chunksize: 4096 size: 16777216000000 write offset: 16384000000kB 1.5651 MB/s read offset: 16384000000kB inf MB/s llverdev: data verified successfully PASS 56a (42s) == sanityn test 56b: test llverdev and partial verify of wide stripe file ========================================================== 19:39:13 (1745624353) run_llverdev /mnt/lustre/f56b.sanityn -p -s 32000000 -c 4k llverdev: read /mnt/lustre/f56b.sanityn@33554431995904+4096 no data: Success llverdev: read /mnt/lustre/f56b.sanityn@33554431995904+4096 no data: Success llverdev: /mnt/lustre/f56b.sanityn is 33554432000000 bytes (31250 GB) in size timestamp: 1745624355 chunksize: 4096 size: 33554432000000 write offset: 32768000000kB 2.90653 MB/s read offset: 32768000000kB -nan MB/s llverdev: data verified successfully PASS 56b (48s) == sanityn test 60: Verify data_version behaviour ======== 19:40:01 (1745624401) PASS 60 (3s) == sanityn test 70a: cd directory && rm directory ======== 19:40:04 (1745624404) PASS 70a (2s) == sanityn test 70b: remove files after calling rm_entry ========================================================== 19:40:06 (1745624406) PASS 70b (3s) == sanityn test 71a: correct file map just after write operation is finished ========================================================== 19:40:09 (1745624409) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00564354 s, 11.6 MB/s SKIP: sanityn test_71a ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71a (2s) == sanityn test 71b: check fiemap support for stripecount > 1 ========================================================== 19:40:11 (1745624411) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00585335 s, 11.2 MB/s SKIP: sanityn test_71b ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71b (1s) == sanityn test 71c: check FIEMAP_EXTENT_LAST flag with different extents number ========================================================== 19:40:13 (1745624413) SKIP: sanityn test_71c support only ldiskfs ost SKIP 71c (1s) == sanityn test 71d: fiemap corruption test with fm_extent_count=0 ========================================================== 19:40:14 (1745624414) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00939257 s, 7.0 MB/s SKIP: sanityn test_71d ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71d (2s) == sanityn test 72: getxattr/setxattr cache should be consistent between nodes ========================================================== 19:40:16 (1745624416) llite.lustre-ffff88012a619800.xattr_cache=1 llite.lustre-ffff88012ab18800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names user.attr1="value1" getfattr: Removing leading '/' from absolute path names user.attr1="value2" getfattr: Removing leading '/' from absolute path names getfattr: Removing leading '/' from absolute path names b362740ad371eae580e7f85452e8830b - 870e072da1ebfc20ea8c0cd3d6bdf3b6 - PASS 72 (3s) == sanityn test 73: getxattr should not cause xattr lock cancellation ========================================================== 19:40:19 (1745624419) llite.lustre-ffff88012a619800.xattr_cache=1 llite.lustre-ffff88012ab18800.xattr_cache=1 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" PASS 73 (3s) == sanityn test 74: flock deadlock: different mounts ======================================================================== 19:40:22 (1745624422) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00879945 s, 116 kB/s 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00696639 s, 147 kB/s 23007: get lock2 23008: get lock1 23007: done 23007: get lock1 23008: done 23008: get lock2 fcntl cmd 7 failed: Resource deadlock avoided 23008: cannot get lock2: Resource deadlock avoided 23008: exit rc=0 23007: done 23007: exit rc=0 PASS 74 (7s) == sanityn test 75: osc: upcall after unuse lock============================================================================= 19:40:29 (1745624429) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0223982 s, 93.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0196367 s, 53.4 MB/s fail_loc=0x31d /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 4108: 23650 Killed stat -c %s $DIR1/$tfile fail_loc=0 PASS 75 (8s) == sanityn test 76: Verify MDT open_files listing ======== 19:40:37 (1745624437) opening files: ........ closing files: ........ PASS 76 (25s) == sanityn test 77a: check FIFO NRS policy =============== 19:41:02 (1745624462) ost.OSS.ost.nrs_policies=fifo ost.OSS.ost_create.nrs_policies=fifo ost.OSS.ost_io.nrs_policies=fifo ost.OSS.ost_out.nrs_policies=fifo ost.OSS.ost_seq.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.146059 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0149062 s, 70.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203342 s, 51.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125649 s, 83.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0153678 s, 68.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0619177 s, 16.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0629078 s, 16.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0662747 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0679734 s, 15.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0731701 s, 14.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0806887 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0782437 s, 13.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0621075 s, 16.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0801754 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0718188 s, 14.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0814801 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0858892 s, 12.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0217328 s, 48.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0141488 s, 74.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142855 s, 73.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0169375 s, 61.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136838 s, 76.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0139598 s, 75.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142956 s, 73.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.019058 s, 55.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0134133 s, 78.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0137331 s, 76.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143035 s, 73.3 MB/s , 0.0185049 s, 56.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0183852 s, 57.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0161183 s, 65.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0162019 s, 64.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0168252 s, 62.3 MB/s removed '/mnt/lustre/d77a.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77a.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77a.sanityn' PASS 77a (3s) == sanityn test 77b: check CRR-N NRS policy ============== 19:41:05 (1745624465) ost.OSS.ost.nrs_policies=crrn ost.OSS.ost_create.nrs_policies=crrn ost.OSS.ost_io.nrs_policies=crrn ost.OSS.ost_out.nrs_policies=crrn ost.OSS.ost_seq.nrs_policies=crrn ost.OSS.ost.nrs_crrn_quantum=1 ost.OSS.ost_create.nrs_crrn_quantum=1 ost.OSS.ost_io.nrs_crrn_quantum=1 ost.OSS.ost_out.nrs_crrn_quantum=1 ost.OSS.ost_seq.nrs_crrn_quantum=1 policy: crr-n, crrn_quantum 1 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.160692 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0170092 s, 61.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0224055 s, 46.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0249223 s, 42.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0190937 s, 54.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0405714 s, 25.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.019318 s, 54.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0205414 s, 51.0 MB/s , 0.0267637 s, 39.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143247 s, 73.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.080136 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.098278 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0831278 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0933263 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.105653 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0708719 s, 14.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0888385 s, 11.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0188487 s, 55.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.019324 s, 54.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0185593 s, 56.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203278 s, 51.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212082 s, 49.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0164789 s, 63.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0236001 s, 44.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0189023 s, 55.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0195278 s, 53.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0215761 s, 48.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.024693 s, 42.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0247223 s, 42.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0254733 s, 41.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0259896 s, 40.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0263111 s, 39.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0384188 s, 27.3 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost.nrs_crrn_quantum=64 ost.OSS.ost_create.nrs_crrn_quantum=64 ost.OSS.ost_io.nrs_crrn_quantum=64 ost.OSS.ost_out.nrs_crrn_quantum=64 ost.OSS.ost_seq.nrs_crrn_quantum=64 policy: crr-n, crrn_quantum 64 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.164457 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00903339 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0173738 s, 60.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0194334 s, 54.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0581253 s, 18.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0709542 s, 14.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0717567 s, 14.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0742414 s, 14.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0726104 s, 14.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0728665 s, 14.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0779553 s, 13.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0789188 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0801475 s, 13.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0703647 s, 14.9 MB/s 1048576 bytes (1.0 MB) copied, 0.076196 s, 13.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0768869 s, 13.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0789261 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203981 s, 51.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146215 s, 71.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.013548 s, 77.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0222004 s, 47.2 MB/s , 0.0251593 s, 41.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00793472 s, 132 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0137882 s, 76.0 MB/s , 0.0263049 s, 39.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138542 s, 75.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0158164 s, 66.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0157702 s, 66.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156717 s, 66.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0127952 s, 82.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0169434 s, 61.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0154149 s, 68.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142853 s, 73.4 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77b (5s) == sanityn test 77c: check ORR NRS policy ================ 19:41:10 (1745624470) ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_orr_quantum=1 ost.OSS.ost_io.nrs_orr_offset_type=physical ost.OSS.ost_io.nrs_orr_supported=reads policy: orr, orr_quantum 1, orr_offset_type physical, orr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.161945 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0201636 s, 52.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0246635 s, 42.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0183418 s, 57.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0242241 s, 43.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0648886 s, 16.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0539962 s, 19.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0698555 s, 15.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0727949 s, 14.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0671148 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0737061 s, 14.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0775944 s, 13.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0964301 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.105124 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0840928 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102084 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0957701 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00546484 s, 192 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0238992 s, 43.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00686645 s, 153 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0196171 s, 53.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00750112 s, 140 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00807438 s, 130 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00881486 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142863 s, 73.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0189104 s, 55.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121878 s, 86.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0153245 s, 68.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0161533 s, 64.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.016584 s, 63.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0176588 s, 59.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0185639 s, 56.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0186346 s, 56.3 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=writes ost.OSS.ost_io.nrs_orr_quantum=64 policy: orr, orr_quantum 64, orr_offset_type physical, orr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.200985 s, 83.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0158332 s, 66.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0195894 s, 53.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0635744 s, 16.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0615347 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0661644 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0798055 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0913379 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0797566 s, 13.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0956421 s, 11.0 MB/s , 0.0959773 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0959773 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.104737 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0910769 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.10601 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.10489 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.137283 s, 7.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0217322 s, 48.2 MB/s , 0.0186371 s, 56.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0214865 s, 48.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.020481 s, 51.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0149553 s, 70.1 MB/s , 0.0220032 s, 47.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152244 s, 68.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152325 s, 68.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0252345 s, 41.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0264226 s, 39.7 MB/s , 0.0180592 s, 58.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0183458 s, 57.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0174525 s, 60.1 MB/s , 0.0209369 s, 50.1 MB/s , 0.0209038 s, 50.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0252297 s, 41.6 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=reads_and_writes ost.OSS.ost_io.nrs_orr_offset_type=logical policy: orr, orr_quantum 64, orr_offset_type logical, orr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.135235 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.013351 s, 78.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011062 s, 94.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0176845 s, 59.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0242821 s, 43.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0793409 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0963726 s, 10.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0895252 s, 11.7 MB/s , 0.0895597 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0952891 s, 11.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.112328 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.107919 s, 9.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.104694 s, 10.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.105653 s, 9.9 MB/s 1048576 bytes (1.0 MB) copied, 0.118509 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.104506 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.115166 s, 9.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00304748 s, 344 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120131 s, 87.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0099508 s, 105 MB/s 1048576 bytes (1.0 MB) copied, 0.00365538 s, 287 MB/s , 0.0131309 s, 79.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00585865 s, 179 MB/s , 0.00575169 s, 182 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0192283 s, 54.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0156755 s, 66.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.016019 s, 65.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0127481 s, 82.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0172274 s, 60.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152138 s, 68.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0171961 s, 61.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0184357 s, 56.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0217532 s, 48.2 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77c (6s) == sanityn test 77d: check TRR nrs policy ================ 19:41:16 (1745624476) ost.OSS.ost_io.nrs_policies=trr ost.OSS.ost_io.nrs_trr_quantum=1 ost.OSS.ost_io.nrs_trr_offset_type=physical ost.OSS.ost_io.nrs_trr_supported=reads policy: trr, trr_quantum 1, trr_offset_type physical, trr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.120273 s, 139 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0228256 s, 45.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0233428 s, 44.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0664832 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0597926 s, 17.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0751188 s, 14.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0865428 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0812059 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0867636 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0838311 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0782069 s, 13.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.085507 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0863252 s, 12.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0930319 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0966996 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0895392 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0946773 s, 11.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00817062 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00836431 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0088066 s, 119 MB/s , 0.011546 s, 90.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0154965 s, 67.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0173812 s, 60.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0143351 s, 73.1 MB/s , 0.0111728 s, 93.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113476 s, 92.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146947 s, 71.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141375 s, 74.2 MB/s , 0.0139091 s, 75.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155862 s, 67.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0165381 s, 63.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0195411 s, 53.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.019934 s, 52.6 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=writes ost.OSS.ost_io.nrs_trr_quantum=64 policy: trr, trr_quantum 64, trr_offset_type physical, trr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.135178 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0150286 s, 69.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206537 s, 50.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0609809 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0669883 s, 15.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0686353 s, 15.3 MB/s , 0.0689326 s, 15.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0737352 s, 14.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0730546 s, 14.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0652677 s, 16.1 MB/s , 0.0730278 s, 14.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0830766 s, 12.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0779779 s, 13.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0733698 s, 14.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.08644 s, 12.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0850793 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0846693 s, 12.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00213506 s, 491 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0175472 s, 59.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155376 s, 67.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0162439 s, 64.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0146373 s, 71.6 MB/s , 0.00185531 s, 565 MB/s , 0.0281231 s, 37.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0253016 s, 41.4 MB/s , 0.0254506 s, 41.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00179492 s, 584 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0441228 s, 23.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00801081 s, 131 MB/s , 0.0207078 s, 50.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0447591 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0252775 s, 41.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0286434 s, 36.6 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=reads_and_writes ost.OSS.ost_io.nrs_trr_offset_type=logical policy: trr, trr_quantum 64, trr_offset_type logical, trr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.127899 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0153378 s, 68.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0181159 s, 57.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0377238 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0452825 s, 23.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0389299 s, 26.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0535386 s, 19.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0715607 s, 14.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0741939 s, 14.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0791523 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0682187 s, 15.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0812771 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0821181 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0894953 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0911151 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0828409 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0968039 s, 10.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0164104 s, 63.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105957 s, 99.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109144 s, 96.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119882 s, 87.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133773 s, 78.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0130381 s, 80.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0159182 s, 65.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0175727 s, 59.7 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0157112 s, 66.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0153764 s, 68.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155185 s, 67.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0171612 s, 61.1 MB/s , 0.0170005 s, 61.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0189992 s, 55.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0199519 s, 52.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212074 s, 49.4 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77d (6s) == sanityn test 77e: check TBF NID nrs policy ============ 19:41:22 (1745624482) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_tbf_rule=start localhost nid={0@lo} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start clients nid={192.168.201.34@tcp} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start others nid={*.*.*.*@tcp} rate=50 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.15345 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.020625 s, 50.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0263067 s, 39.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0414287 s, 25.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0605662 s, 17.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0666917 s, 15.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0764465 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.05756 s, 18.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0817121 s, 12.8 MB/s 1048576 bytes (1.0 MB) copied, 0.09258 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0832502 s, 12.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0978296 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0851576 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.079693 s, 13.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0908024 s, 11.5 MB/s 1048576 bytes (1.0 MB) copied, 0.100852 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.10077 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0163868 s, 64.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0165159 s, 63.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00233701 s, 449 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.039246 s, 26.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0365923 s, 28.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00213759 s, 491 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0339643 s, 30.9 MB/s , 0.0268386 s, 39.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0292554 s, 35.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0208699 s, 50.2 MB/s , 0.0357091 s, 29.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0317874 s, 33.0 MB/s , 0.0200117 s, 52.4 MB/s , 0.00325769 s, 322 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0261825 s, 40.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125678 s, 83.4 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change localhost rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change clients rate=101 ost.OSS.ost_io.nrs_tbf_rule=change others rate=51 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.153496 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.031406 s, 33.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0285658 s, 36.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0574623 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0816636 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0696666 s, 15.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0691649 s, 15.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0803017 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0784616 s, 13.4 MB/s , 0.0757389 s, 13.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.128685 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.136164 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.138467 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.141391 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.131788 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.154391 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.160521 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.016573 s, 63.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0166425 s, 63.0 MB/s 1048576 bytes (1.0 MB) copied, 0.00226466 s, 463 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0168327 s, 62.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0410252 s, 25.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0194647 s, 53.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.023368 s, 44.9 MB/s , 0.0233645 s, 44.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0394901 s, 26.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0250167 s, 41.9 MB/s , 0.00536299 s, 196 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0290472 s, 36.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0158273 s, 66.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.027124 s, 38.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0264251 s, 39.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.028617 s, 36.6 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop localhost ost.OSS.ost_io.nrs_tbf_rule=stop clients ost.OSS.ost_io.nrs_tbf_rule=stop others 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.182253 s, 92.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0191039 s, 54.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0228697 s, 45.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0795192 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0840255 s, 12.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.091739 s, 11.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0860066 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.091738 s, 11.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.087151 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.09941 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102223 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.101116 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.106589 s, 9.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.106008 s, 9.9 MB/s 1048576 bytes (1.0 MB) copied, 0.111094 s, 9.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.115287 s, 9.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.131 s, 8.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.004372 s, 240 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0221321 s, 47.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0195805 s, 53.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00422662 s, 248 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0166539 s, 63.0 MB/s , 0.0137832 s, 76.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125977 s, 83.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.001961 s, 535 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00318611 s, 329 MB/s , 0.0030891 s, 339 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00232646 s, 451 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0340022 s, 30.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0213997 s, 49.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0148717 s, 70.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00732372 s, 143 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00442259 s, 237 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.170591 s, 98.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0182947 s, 57.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0173824 s, 60.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0654976 s, 16.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0695512 s, 15.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0730878 s, 14.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0804747 s, 13.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0805432 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0810914 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0860072 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0912032 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0935515 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0957271 s, 11.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0924819 s, 11.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0919947 s, 11.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0986539 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.106558 s, 9.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00180986 s, 579 MB/s , 0.0143466 s, 73.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0149697 s, 70.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00242078 s, 433 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0182992 s, 57.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144675 s, 72.5 MB/s 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0131128 s, 80.0 MB/s , 0.00569271 s, 184 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0335795 s, 31.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0276358 s, 37.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0314373 s, 33.4 MB/s , 0.0251427 s, 41.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0219663 s, 47.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00348868 s, 301 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0158487 s, 66.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0238346 s, 44.0 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' PASS 77e (11s) == sanityn test 77f: check TBF JobID nrs policy ========== 19:41:33 (1745624493) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start runas jobid={iozone.500 dd.500 tiotest.500} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start iozone_runas jobid={iozone.500} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.256215 s, 65.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0306695 s, 34.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0315882 s, 33.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0788416 s, 13.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0821181 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.101302 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.104483 s, 10.0 MB/s , 0.100956 s, 10.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.10629 s, 9.9 MB/s , 0.103052 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0995628 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.117606 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.115029 s, 9.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.11361 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.11442 s, 9.2 MB/s , 0.11959 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.129179 s, 8.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0245148 s, 42.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0245554 s, 42.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0179804 s, 58.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01469 s, 71.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.026887 s, 39.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0285721 s, 36.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0162736 s, 64.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0368165 s, 28.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0193579 s, 54.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0205112 s, 51.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0196745 s, 53.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.022221 s, 47.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0221824 s, 47.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0232628 s, 45.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0247172 s, 42.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.02802 s, 37.4 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change runas rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change iozone_runas rate=101 ost.OSS.ost_io.nrs_tbf_rule=change dd_runas rate=51 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.178547 s, 94.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102561 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0232725 s, 45.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103943 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143722 s, 73.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0245395 s, 42.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0270385 s, 38.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.138066 s, 7.6 MB/s , 0.138115 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.125086 s, 8.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.191651 s, 5.5 MB/s 1048576 bytes (1.0 MB) copied, 0.183604 s, 5.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.17346 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.196544 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.197303 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.186282 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.181627 s, 5.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.025526 s, 41.1 MB/s , 0.0197541 s, 53.1 MB/s , 0.0196333 s, 53.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0226509 s, 46.3 MB/s , 0.0280067 s, 37.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0248599 s, 42.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0257659 s, 40.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0253987 s, 41.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0228839 s, 45.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.029793 s, 35.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0264376 s, 39.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0305064 s, 34.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0331388 s, 31.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0303192 s, 34.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0323377 s, 32.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0350722 s, 29.9 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop runas ost.OSS.ost_io.nrs_tbf_rule=stop iozone_runas ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.175878 s, 95.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0232634 s, 45.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0300591 s, 34.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0431311 s, 24.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0771166 s, 13.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0948406 s, 11.1 MB/s , 0.0698543 s, 15.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0908559 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0870436 s, 12.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0803555 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102558 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0736261 s, 14.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.100272 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0898561 s, 11.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0809834 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0894956 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.109532 s, 9.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0200049 s, 52.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0239117 s, 43.9 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0186159 s, 56.3 MB/s , 0.0224505 s, 46.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0226341 s, 46.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0261965 s, 40.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0273793 s, 38.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0278128 s, 37.7 MB/s , 0.0277018 s, 37.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0274874 s, 38.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0318404 s, 32.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0299097 s, 35.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0299697 s, 35.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0289406 s, 36.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0321798 s, 32.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0363468 s, 28.8 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_policies=fifo running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.174313 s, 96.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.018604 s, 56.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0172619 s, 60.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0383127 s, 27.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.048519 s, 21.6 MB/s , 0.0427684 s, 24.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0559479 s, 18.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0605941 s, 17.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0656124 s, 16.0 MB/s 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0612937 s, 17.1 MB/s , 0.0584214 s, 17.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0761271 s, 13.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0706715 s, 14.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0700498 s, 15.0 MB/s 1048576 bytes (1.0 MB) copied, 0.063183 s, 16.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0614836 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0650918 s, 16.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00178499 s, 587 MB/s , 0.0128194 s, 81.8 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00777654 s, 135 MB/s 1048576 bytes (1.0 MB) copied, 0.008153 s, 129 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0340814 s, 30.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0310618 s, 33.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0348312 s, 30.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0285092 s, 36.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00269219 s, 389 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0306101 s, 34.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00732175 s, 143 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0309917 s, 33.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0274289 s, 38.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0321901 s, 32.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0134144 s, 78.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0174963 s, 59.9 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' PASS 77f (11s) == sanityn test 77g: Change TBF type directly ============ 19:41:44 (1745624504) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 ost.OSS.ost_io.nrs_policies=fifo PASS 77g (5s) == sanityn test 77h: Wrong policy name should report error, not LBUG ========================================================== 19:41:49 (1745624509) oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=abc: No such file or directory oleg134-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='abc': No such file or directory pdsh@oleg134-client: oleg134-server: ssh exited with exit code 2 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc: Unknown error 524 oleg134-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf abc': Unknown error 524 pdsh@oleg134-client: oleg134-server: ssh exited with exit code 12 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf reg abc: Unknown error 524 oleg134-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf reg abc': Unknown error 524 pdsh@oleg134-client: oleg134-server: ssh exited with exit code 12 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc efg: Unknown error 524 oleg134-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf abc efg': Unknown error 524 pdsh@oleg134-client: oleg134-server: ssh exited with exit code 12 PASS 77h (6s) == sanityn test 77i: Change rank of TBF rule ============= 19:41:55 (1745624515) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start before jobid={jobid} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start after jobid={jobid} rate=1000 rank=default ost.OSS.ost_io.nrs_tbf_rule=start target jobid={jobid} rate=1000 rank=after Move before itself ost.OSS.ost_io.nrs_tbf_rule=change target rank=target Move to higher rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=before Move to lower rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=after Move before default ost.OSS.ost_io.nrs_tbf_rule=change target rank=default ost.OSS.ost_io.nrs_policies=fifo PASS 77i (9s) == sanityn test 77j: check TBF-OPCode NRS policy ========= 19:42:04 (1745624524) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf opcode ost.OSS.ost_io.nrs_tbf_rule=start ost_r opcode={ost_read} rate=5 ost.OSS.ost_io.nrs_tbf_rule=start ost_w opcode={ost_write} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.325444 s, 51.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0219077 s, 47.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0248263 s, 42.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0589261 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.06202 s, 16.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0662438 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0595017 s, 17.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0707439 s, 14.8 MB/s 1048576 bytes (1.0 MB) copied, 0.066219 s, 15.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0716179 s, 14.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0904517 s, 11.6 MB/s , 0.0862818 s, 12.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.079198 s, 13.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.213169 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.217905 s, 4.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.269781 s, 3.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.274961 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.024527 s, 42.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00226657 s, 463 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0217198 s, 48.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00351319 s, 298 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0231698 s, 45.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00178297 s, 588 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0186123 s, 56.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00177059 s, 592 MB/s , 0.020717 s, 50.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.020361 s, 51.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0205403 s, 51.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0218806 s, 47.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0180234 s, 58.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0154565 s, 67.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0246142 s, 42.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00544769 s, 192 MB/s removed '/mnt/lustre/d77j.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77j.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77j.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 5 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.34928 s, 19.6 MB/s Write runtime is 7 s, speed is 14.285714 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.4633 s, 5.4 MB/s Read runtime is 20 s, speed is 5.000000 IOPS cleanup_tbf /mnt/lustre/d77j.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_r ost.OSS.ost_io.nrs_tbf_rule=stop ost_w ost.OSS.ost_io.nrs_policies=fifo PASS 77j (54s) == sanityn test 77ja: check TBF-UID/GID NRS policy ======= 19:42:58 (1745624578) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg134-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg134-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [777] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg134-client.virtnet] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg134-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.2354 s, 13.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0296129 s, 35.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0353751 s, 29.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0470046 s, 22.3 MB/s , 0.0453607 s, 23.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0546325 s, 19.2 MB/s , 0.056267 s, 18.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0610186 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0626154 s, 16.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.136127 s, 7.7 MB/s , 0.141547 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.159874 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.159796 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.162714 s, 6.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.193245 s, 5.4 MB/s 1048576 bytes (1.0 MB) copied, 0.194374 s, 5.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.196831 s, 5.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0200258 s, 52.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0196181 s, 53.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203697 s, 51.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0221224 s, 47.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0227464 s, 46.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0291704 s, 35.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0258521 s, 40.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0262038 s, 40.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0270422 s, 38.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0326822 s, 32.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0287268 s, 36.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0306586 s, 34.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0339141 s, 30.9 MB/s , 0.0316279 s, 33.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0316535 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0326318 s, 32.1 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.808 s, 5.3 MB/s Write runtime is 20 s, speed is 5.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.919 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg134-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg134-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [777] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg134-client.virtnet] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg134-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.24027 s, 13.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0320173 s, 32.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0325815 s, 32.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.061619 s, 17.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0453091 s, 23.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.059031 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0715651 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0808911 s, 13.0 MB/s , 0.0761083 s, 13.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0899653 s, 11.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.105392 s, 9.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.1131 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.120793 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.129822 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.150208 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.152409 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.155668 s, 6.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203837 s, 51.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0163674 s, 64.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187465 s, 55.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0232314 s, 45.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.029871 s, 35.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0229349 s, 45.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0243211 s, 43.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0322225 s, 32.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0323361 s, 32.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0280187 s, 37.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0287336 s, 36.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0283324 s, 37.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.029027 s, 36.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0288922 s, 36.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0300479 s, 34.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0313015 s, 33.5 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.8516 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9238 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77ja (136s) == sanityn test 77jb: check TBF-UID/GID NRS policy on files that don't belong to us ========================================================== 19:45:14 (1745624714) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 0/500/0/500, groups: 500 [touch] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg134-client.virtnet] running as uid/gid/euid/egid 0/500/0/500, groups: 500 [touch] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg134-client.virtnet] running as uid/gid/euid/egid 0/500/0/500, groups: 500 [chmod] [777] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg134-client.virtnet] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg134-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.23656 s, 13.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0208244 s, 50.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0249014 s, 42.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0464077 s, 22.6 MB/s , 0.0441566 s, 23.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0490584 s, 21.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0814218 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0877678 s, 11.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.084984 s, 12.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.146779 s, 7.1 MB/s , 0.146809 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.166721 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.182125 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.18143 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.182301 s, 5.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.185458 s, 5.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.198106 s, 5.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.016681 s, 62.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0165938 s, 63.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0184879 s, 56.7 MB/s , 0.0184081 s, 57.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0201284 s, 52.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0174824 s, 60.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0210243 s, 49.9 MB/s , 0.0211349 s, 49.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0209394 s, 50.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0208186 s, 50.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0206869 s, 50.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0205411 s, 51.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.025435 s, 41.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0224958 s, 46.6 MB/s 1048576 bytes (1.0 MB) copied, 0.025557 s, 41.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0294885 s, 35.6 MB/s removed '/mnt/lustre/d77jb.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77jb.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77jb.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 0/500/0/500, groups: 500 [touch] [/mnt/lustre/d77jb.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.8267 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77jb.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9149 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77jb.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/0/500/0, groups: 0 [touch] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg134-client.virtnet] running as uid/gid/euid/egid 500/0/500/0, groups: 0 [touch] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg134-client.virtnet] running as uid/gid/euid/egid 500/0/500/0, groups: 0 [chmod] [777] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg134-client.virtnet] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg134-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.507764 s, 33.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0166716 s, 62.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0344212 s, 30.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.033763 s, 31.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0347581 s, 30.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0715204 s, 14.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0823289 s, 12.7 MB/s , 0.0822746 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0794234 s, 13.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.267101 s, 3.9 MB/s , 0.267892 s, 3.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.290444 s, 3.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.291022 s, 3.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.300754 s, 3.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.28598 s, 3.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.309354 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.337663 s, 3.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0275068 s, 38.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0229221 s, 45.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0291224 s, 36.0 MB/s , 0.0206451 s, 50.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0284544 s, 36.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0265602 s, 39.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0274784 s, 38.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0299399 s, 35.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0334858 s, 31.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0337551 s, 31.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0341623 s, 30.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0374908 s, 28.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0413469 s, 25.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0455781 s, 23.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0410419 s, 25.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0435398 s, 24.1 MB/s removed '/mnt/lustre/d77jb.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77jb.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77jb.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/0/500/0, groups: 0 [touch] [/mnt/lustre/d77jb.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.8081 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77jb.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.8528 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77jb.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77jb (134s) == sanityn test 77k: check TBF policy with UID/GID/JobID/OPCode expression ========================================================== 19:47:28 (1745624848) ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_tbf_rule=start ext_w jobid={dd.500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r jobid={dd.500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.276552 s, 60.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0218741 s, 47.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0298402 s, 35.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0438958 s, 23.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0564239 s, 18.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0619962 s, 16.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0656183 s, 16.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0676394 s, 15.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0733425 s, 14.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0747324 s, 14.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0766912 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0806256 s, 13.0 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0783367 s, 13.4 MB/s , 0.0709359 s, 14.8 MB/s , 0.0845262 s, 12.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.080944 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0880971 s, 11.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.002286 s, 459 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00255672 s, 410 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00222554 s, 471 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00197086 s, 532 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.002428 s, 432 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out , 0.03115 s, 33.7 MB/s 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0365611 s, 28.7 MB/s , 0.0312112 s, 33.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0319886 s, 32.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0304985 s, 34.4 MB/s , 0.0273914 s, 38.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0208797 s, 50.2 MB/s , 0.044005 s, 23.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0176942 s, 59.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120186 s, 87.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00477008 s, 220 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.13417 s, 20.4 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.76283 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext_w nid={0@lo 192.168.201.34@tcp}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r nid={0@lo 192.168.201.34@tcp}&opcode={ost_read} rate=10 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.220384 s, 76.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212821 s, 49.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126117 s, 83.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0209445 s, 50.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0268295 s, 39.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0462735 s, 22.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0628763 s, 16.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0668707 s, 15.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.101217 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0816911 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0811117 s, 12.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.10886 s, 9.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.108132 s, 9.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0934062 s, 11.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.106776 s, 9.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.145027 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.141935 s, 7.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00739973 s, 142 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00891087 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00200067 s, 524 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122515 s, 85.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00760966 s, 138 MB/s , 0.0133666 s, 78.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0196769 s, 53.3 MB/s , 0.0160757 s, 65.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00209431 s, 501 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0232441 s, 45.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0183015 s, 57.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125342 s, 83.7 MB/s , 0.018397 s, 57.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00981767 s, 107 MB/s , 0.0187782 s, 55.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00208502 s, 503 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.11003 s, 20.5 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.7543 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext nid={0@lo 192.168.201.34@tcp}&jobid={dd.500} rate=20 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.1298 s, 129 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124676 s, 84.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0162247 s, 64.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0348598 s, 30.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0405966 s, 25.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0426306 s, 24.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0415567 s, 25.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0373482 s, 28.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0527615 s, 19.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.04978 s, 21.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0516426 s, 20.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0490973 s, 21.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0569131 s, 18.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0541753 s, 19.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0586619 s, 17.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0609901 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.062629 s, 16.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00301321 s, 348 MB/s 1048576 bytes (1.0 MB) copied, 0.00542442 s, 193 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0194931 s, 53.8 MB/s 1048576 bytes (1.0 MB) copied, 0.00397469 s, 264 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00529022 s, 198 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0178015 s, 58.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0140331 s, 74.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00196301 s, 534 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00178469 s, 588 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00836659 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00855749 s, 123 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00323635 s, 324 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00187983 s, 558 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0017128 s, 612 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00215138 s, 487 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00153496 s, 683 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.99028 s, 21.0 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.88764 s, 21.5 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext ost.OSS.ost_io.nrs_tbf_rule=start ext_a jobid={dd.500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b jobid={dd.500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.534668 s, 31.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0183774 s, 57.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0395226 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0484318 s, 21.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0321138 s, 32.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0467639 s, 22.4 MB/s , 0.0464838 s, 22.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0984337 s, 10.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.120245 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.142849 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.121537 s, 8.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.139669 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.085116 s, 12.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.155929 s, 6.7 MB/s , 0.145481 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.153846 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.110615 s, 9.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0186945 s, 56.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.028647 s, 36.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0231461 s, 45.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0237382 s, 44.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00730615 s, 144 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00212178 s, 494 MB/s , 0.0199937 s, 52.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0239714 s, 43.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0267588 s, 39.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0331224 s, 31.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0140406 s, 74.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0029172 s, 359 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0355841 s, 29.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0330132 s, 31.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.033212 s, 31.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012616 s, 83.1 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.9038 s, 10.6 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.78359 s, 10.7 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.15538 s, 20.3 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.75858 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_tbf_rule=start ext_ug uid={500}&gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.920229 s, 18.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0134018 s, 78.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00888806 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0252722 s, 41.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0556025 s, 18.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0558084 s, 18.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0567565 s, 18.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0613286 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0591445 s, 17.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.136382 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.165605 s, 6.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.162051 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.171583 s, 6.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.190806 s, 5.5 MB/s , 0.188527 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.191885 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.186605 s, 5.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0155205 s, 67.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0150086 s, 69.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0158418 s, 66.2 MB/s , 0.0184703 s, 56.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0167594 s, 62.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0173166 s, 60.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.018558 s, 56.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.020302 s, 51.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0203531 s, 51.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0206421 s, 50.8 MB/s , 0.0207386 s, 50.6 MB/s , 0.0186393 s, 56.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0214173 s, 49.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0227414 s, 46.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0227909 s, 46.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0264925 s, 39.6 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.5879 s, 5.4 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.4526 s, 5.4 MB/s Read runtime is 20 s, speed is 5.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_ug ost.OSS.ost_io.nrs_tbf_rule=start ext_uw uid={500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_ur uid={500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.153257 s, 109 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148047 s, 70.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.014988 s, 70.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0370441 s, 28.3 MB/s , 0.039764 s, 26.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0363636 s, 28.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.040287 s, 26.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0372162 s, 28.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0453027 s, 23.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0431047 s, 24.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0462789 s, 22.7 MB/s , 0.0449517 s, 23.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.049708 s, 21.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0816633 s, 12.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.079788 s, 13.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0712292 s, 14.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0923063 s, 11.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160036 s, 65.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0161584 s, 64.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011623 s, 90.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126987 s, 82.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0196053 s, 53.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136575 s, 76.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142935 s, 73.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0149506 s, 70.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.016347 s, 64.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0165298 s, 63.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0171113 s, 61.3 MB/s 1048576 bytes (1.0 MB) copied, 0.01813 s, 57.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.016587 s, 63.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0172866 s, 60.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187171 s, 56.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0189105 s, 55.4 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.04219 s, 20.8 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.74914 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_uw ost.OSS.ost_io.nrs_tbf_rule=stop ext_ur ost.OSS.ost_io.nrs_tbf_rule=start ext_a uid={500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b uid={500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.151998 s, 110 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116911 s, 89.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0230436 s, 45.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0232395 s, 45.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0234711 s, 44.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0298146 s, 35.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0352842 s, 29.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0413062 s, 25.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0322921 s, 32.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.025852 s, 40.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0302978 s, 34.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0794796 s, 13.2 MB/s , 0.0767315 s, 13.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0929102 s, 11.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0959918 s, 10.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.146517 s, 7.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.150603 s, 7.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103769 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00778595 s, 135 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00792119 s, 132 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00789947 s, 133 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0178845 s, 58.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141293 s, 74.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131134 s, 80.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0168987 s, 62.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100011 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113794 s, 92.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126984 s, 82.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0142422 s, 73.6 MB/s , 0.0142223 s, 73.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135124 s, 77.6 MB/s , 0.0125321 s, 83.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0196187 s, 53.4 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.80335 s, 10.7 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.75522 s, 10.7 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.80608 s, 10.7 MB/s Write runtime is 10 s, speed is 10.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.75195 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_policies=fifo PASS 77k (351s) == sanityn test 77l: check the output of NRS policies for generic TBF ========================================================== 19:53:19 (1745625199) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_policies=fifo PASS 77l (3s) == sanityn test 77m: check NRS Delay slows write RPC processing ========================================================== 19:53:22 (1745625202) ost.OSS.ost_io.nrs_policies=delay ost.OSS.ost_io.nrs_delay_min=4 ost.OSS.ost_io.nrs_delay_max=4 ost.OSS.ost_io.nrs_delay_pct=100 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg134-client.virtnet] [bs=1M] [count=1] [oflag=direct] [conv=fdatasync] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 3.91107 s, 268 kB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg134-client.virtnet] [bs=1M] [count=10] [oflag=direct] [conv=fdatasync] 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 40.0409 s, 262 kB/s ost.OSS.ost_io.nrs_policies=fifo PASS 77m (51s) == sanityn test 77n: check wildcard support for TBF JobID NRS policy ========================================================== 19:54:13 (1745625253) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={*.500} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.112206 s, 150 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.018746 s, 55.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0100211 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0174395 s, 60.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131651 s, 79.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0401303 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0404558 s, 25.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0412474 s, 25.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0451812 s, 23.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.053778 s, 19.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0591047 s, 17.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0524973 s, 20.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0559612 s, 18.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.062214 s, 16.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0469675 s, 22.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0634246 s, 16.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0666273 s, 15.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151201 s, 69.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00231567 s, 453 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0214946 s, 48.8 MB/s 1048576 bytes (1.0 MB) copied, 0.00387167 s, 271 MB/s 1048576 bytes (1.0 MB) copied, 0.0173073 s, 60.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00274575 s, 382 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.006934 s, 151 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0193198 s, 54.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00285598 s, 367 MB/s , 0.00305652 s, 343 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0209207 s, 50.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0192681 s, 54.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0250433 s, 41.9 MB/s , 0.0251537 s, 41.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156263 s, 67.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0234973 s, 44.6 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77n.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.08168 s, 20.6 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77n.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.98528 s, 21.0 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.*} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.239425 s, 70.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0174222 s, 60.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.025403 s, 41.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0413822 s, 25.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0316565 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0475213 s, 22.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0555345 s, 18.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0546617 s, 19.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0415601 s, 25.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0514588 s, 20.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0579319 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0483671 s, 21.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0565853 s, 18.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.262527 s, 4.0 MB/s , 0.261441 s, 4.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.295452 s, 3.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.294683 s, 3.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0127844 s, 82.0 MB/s , 0.0138584 s, 75.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0075607 s, 139 MB/s , 0.0122945 s, 85.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00995061 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152973 s, 68.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00372876 s, 281 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00602441 s, 174 MB/s 1048576 bytes (1.0 MB) copied, 0.00403062 s, 260 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108326 s, 96.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108287 s, 96.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111451 s, 94.1 MB/s 1048576 bytes (1.0 MB) copied, 0.00393702 s, 266 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120996 s, 86.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122629 s, 85.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142403 s, 73.6 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.02407 s, 20.9 MB/s Write runtime is 7 s, speed is 14.285714 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.97385 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_policies=fifo PASS 77n (65s) == sanityn test 77o: Changing rank should not panic ====== 19:55:18 (1745625318) mds.MDS.mdt.nrs_policies=tbf nid mds.MDS.mdt.nrs_tbf_rule=start name nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=start name1 nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=change name1 rank=name mds.MDS.mdt.nrs_tbf_rule=stop name mds.MDS.mdt.nrs_policies=fifo PASS 77o (5s) == sanityn test 77q: Parallel TBF rule definitions should not panic ========================================================== 19:55:23 (1745625323) mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_policies=fifo PASS 77q (41s) == sanityn test 77p: Check validity of rule names for TBF policies ========================================================== 19:56:04 (1745625364) mds.MDS.mdt.nrs_policies=tbf oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_overflo uid={500} rate=500: File name too long oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test_77p_overflo uid={500} rate=500': File name too long pdsh@oleg134-client: oleg134-server: ssh exited with exit code 36 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_empty: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test_77p_empty': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p@spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p@spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p.spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p.spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p~spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p~spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p#spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p#spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p/spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p/spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p^spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p^spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p%spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p%spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p*spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p*spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p;spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p;spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p,spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p,spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p?spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p?spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77pspec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p>spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p:spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p:spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p+spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p+spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p=spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p=spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p)spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p)spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p(spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p(spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p{spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p{spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p}spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p}spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p|spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p|spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p[spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p[spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p]spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p]spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p!spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p!spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p&spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p&spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p$spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p$spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p`spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p`spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p\spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p\spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 mds.MDS.mdt.nrs_policies=fifo PASS 77p (11s) == sanityn test 77r: Change type of tbf policy at run time ========================================================== 19:56:15 (1745625375) mds.MDS.mdt.nrs_policies=tbf uid mds.MDS.mdt.nrs_tbf_rule=start md_rule uid={500} rate=1 mds.MDS.mdt.nrs_policies=tbf gid mds.MDS.mdt.nrs_tbf_rule=start md_rule gid={500} rate=1 mds.MDS.mdt.nrs_policies=tbf jobid mds.MDS.mdt.nrs_tbf_rule=start md_rule jobid={*.500} rate=1 mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start md_rule uid={500} rate=1 mds.MDS.mdt.nrs_policies=fifo check the number of requests in queue: fifo: 0 crrn: 0 tbf: 0 delay: 0 fifo: 0 crrn: 0 tbf: 0 delay: 0 cleanup 77r 20629 kill md_thread xargs /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 1: kill: (25656) - No such process PASS 77r (38s) == sanityn test 78: Enable policy and specify tunings right away ========================================================== 19:56:53 (1745625413) ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_orr_quantum=1 ost.OSS.ost_io.nrs_policies=fifo PASS 78 (3s) == sanityn test 79: xattr: intent error ================== 19:56:56 (1745625416) File: '/mnt/lustre/d79.sanityn' Size: 512 Blocks: 1 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272506192 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-04-25 19:56:56.000000000 -0400 Modify: 2025-04-25 19:56:56.000000000 -0400 Change: 2025-04-25 19:56:56.000000000 -0400 Birth: - fail_val=0 fail_loc=0x80000160 fail_val=0 fail_loc=0x80000131 # file: mnt/lustre/d79.sanityn trusted.name1="value1" PASS 79 (12s) == sanityn test 80a: migrate directory when some children is being opened ========================================================== 19:57:08 (1745625428) SKIP: sanityn test_80a needs >= 2 MDTs SKIP 80a (1s) == sanityn test 80b: Accessing directory during migration ========================================================== 19:57:09 (1745625429) SKIP: sanityn test_80b needs >= 2 MDTs SKIP 80b (1s) == sanityn test 81a: rename and stat under striped directory ========================================================== 19:57:10 (1745625430) SKIP: sanityn test_81a needs >= 2 MDTs SKIP 81a (1s) == sanityn test 81b: rename under striped directory doesn't deadlock ========================================================== 19:57:11 (1745625431) SKIP: sanityn test_81b We need at least 2 MDTs for this test SKIP 81b (1s) == sanityn test 81c: rename revoke LOOKUP lock for remote object ========================================================== 19:57:12 (1745625432) SKIP: sanityn test_81c needs >= 4 MDTs SKIP 81c (1s) == sanityn test 81d: parallel rename file cross-dir on same MDT ========================================================== 19:57:13 (1745625433) total: 2500 open/close in 6.66 seconds: 375.43 ops/second snapshot_time 1745625461.870170712 secs.nsecs start_time 1745625434.504549887 secs.nsecs elapsed_time 27.365620825 secs.nsecs open 2505 samples [usecs] 87 1905 876898 370870192 close 2504 samples [usecs] 49 2931 269148 57260188 mknod 2501 samples [usecs] 148 1877 778969 296892821 unlink 2500 samples [usecs] 257 19533 1757402 5112273292 mkdir 2 samples [usecs] 639 679 1318 869362 rmdir 2 samples [usecs] 3071 6184 9255 47672897 rename 2500 samples [usecs] 234 10683 4189367 11948358309 getattr 3760 samples [usecs] 5 1191 81814 10189880 parallel_rename_file 2500 samples [usecs] 234 10683 4189367 11948358309 crossdir_rename 2500 samples [usecs] 234 10683 4189367 11948358309 PASS 81d (30s) == sanityn test 82: fsetxattr and fgetxattr on orphan files ========================================================== 19:57:43 (1745625463) multiop /mnt/lustre/f82.sanityn vO_ac TMPPIPE=/tmp/multiop_open_wait_pipe.7075 multiop /mnt/lustre2/f82.sanityn vo_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.7075 PASS 82 (2s) == sanityn test 83: access striped directory while it is being created/unlinked ========================================================== 19:57:45 (1745625465) SKIP: sanityn test_83 needs >= 2 MDTs SKIP 83 (1s) == sanityn test 84: 0-nlink race in lu_object_find() ===== 19:57:46 (1745625466) fail_loc=0x8000060b PASS 84 (8s) == sanityn test 85: Lustre API root cache race =========== 19:57:54 (1745625474) Starting: llapi_root_test /mnt/lustre/f85.sanityn /mnt/lustre2/f85.sanityn Starting test test1 at 1745625474 Finishing test test1 at 1745625475 PASS 85 (3s) == sanityn test 90: open/create and unlink striped directory ========================================================== 19:57:57 (1745625477) SKIP: sanityn test_90 needs >= 2 MDTs SKIP 90 (1s) == sanityn test 91: chmod and unlink striped directory === 19:57:58 (1745625478) SKIP: sanityn test_91 needs >= 2 MDTs SKIP 91 (1s) == sanityn test 92: create remote directory under orphan directory ========================================================== 19:57:59 (1745625479) SKIP: sanityn test_92 needs >= 2 MDTs SKIP 92 (1s) == sanityn test 93: alloc_rr should not allocate on same ost ========================================================== 19:58:00 (1745625480) fail_loc=0x00000163 fail_loc=0x0 /mnt/lustre/f93.sanityn-1/file1 lmm_stripe_count: 2 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 5565 0x15bd 0x240000400 1 5552 0x15b0 0x280000400 /mnt/lustre2/f93.sanityn-2/file2 lmm_stripe_count: 2 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 5566 0x15be 0x240000400 1 5553 0x15b1 0x280000400 rc1=0 and rc2=0 PASS 93 (8s) == sanityn test 94: signal vs CP callback race =========== 19:58:08 (1745625488) osc.lustre-OST0000-osc-ffff88012a619800.idle_timeout=0 osc.lustre-OST0000-osc-ffff88012ab18800.idle_timeout=0 osc.lustre-OST0001-osc-ffff88012a619800.idle_timeout=0 osc.lustre-OST0001-osc-ffff88012ab18800.idle_timeout=0 2+0 records in 2+0 records out 8192 bytes (8.2 kB) copied, 0.037113 s, 221 kB/s fail_val=5 fail_loc=0x80000312 fail_val=6 fail_loc=0x80000329 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 3.0075 s, 1.4 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 5764: 6160 Alarm clock dd if=/dev/zero of=$DIR/$tfile conv=notrunc oflag=append bs=4k count=1 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0144802 s, 283 kB/s osc.lustre-OST0000-osc-ffff88012a619800.idle_timeout=debug osc.lustre-OST0000-osc-ffff88012ab18800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012a619800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012ab18800.idle_timeout=debug PASS 94 (10s) == sanityn test 95a: Check readpage() on a page that was removed from page cache ========================================================== 19:58:18 (1745625498) llite.lustre-ffff88012a619800.fast_read=0 llite.lustre-ffff88012ab18800.fast_read=0 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0177575 s, 118 MB/s fail_loc=0x80001421 fail_val=7 fail_loc=0x80001422 fail_val=10 llite.lustre-ffff88012a619800.fast_read=1 llite.lustre-ffff88012ab18800.fast_read=1 PASS 95a (19s) == sanityn test 95b: Check readpage() on a page that is no longer uptodate ========================================================== 19:58:37 (1745625517) llite.lustre-ffff88012a619800.fast_read=0 llite.lustre-ffff88012ab18800.fast_read=0 1+0 records in 1+0 records out 12288 bytes (12 kB) copied, 0.00261192 s, 4.7 MB/s fail_loc=0x80001424 fail_val=5 fail_loc=0 llite.lustre-ffff88012a619800.fast_read=1 llite.lustre-ffff88012ab18800.fast_read=1 PASS 95b (8s) == sanityn test 100a: DoM: glimpse RPCs for stat without IO lock (DoM only file) ========================================================== 19:58:46 (1745625526) SKIP: sanityn test_100a Reserved for glimpse-ahead SKIP 100a (1s) == sanityn test 100b: DoM: no glimpse RPC for stat with IO lock (DoM only file) ========================================================== 19:58:47 (1745625527) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00327081 s, 1.3 MB/s /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK PASS 100b (2s) == sanityn test 100c: DoM: write vs stat without IO lock (combined file) ========================================================== 19:58:49 (1745625529) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.031954 s, 65.6 MB/s /mnt/lustre/d100c.sanityn/dom has type file OK /mnt/lustre/d100c.sanityn/dom has size 2097152 OK PASS 100c (2s) == sanityn test 100d: DoM: write+truncate vs stat without IO lock (combined file) ========================================================== 19:58:51 (1745625531) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0320684 s, 65.4 MB/s /mnt/lustre/d100d.sanityn/dom has type file OK /mnt/lustre/d100d.sanityn/dom has size 4096 OK PASS 100d (3s) == sanityn test 100e: DoM: read on open and file size ==== 19:58:54 (1745625534) 1+0 records in 1+0 records out 12000 bytes (12 kB) copied, 0.00212628 s, 5.6 MB/s PASS 100e (2s) == sanityn test 101a: Discard DoM data on unlink ========= 19:58:56 (1745625536) /mnt/lustre/f101a.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.000784593 s, 5.2 MB/s PASS 101a (2s) == sanityn test 101b: Discard DoM data on rename ========= 19:58:58 (1745625538) /mnt/lustre/f101b.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.000812423 s, 5.0 MB/s PASS 101b (3s) == sanityn test 101c: Discard DoM data on close-unlink === 19:59:01 (1745625541) /mnt/lustre/f101c.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00105194 s, 3.9 MB/s PASS 101c (4s) SKIP: sanityn test_102 skipping ALWAYS excluded test 102 == sanityn test 103: Test size correctness with lockahead ========================================================== 19:59:05 (1745625545) fail_loc=0x415 fail_loc=0x415 fail_val=2 Incorrect size expected (no glimpse fix): Starting test test23 at 1745625546 lockahead_test: lockahead_test.c:1191: test23: assertion 'sb.st_size == sb2.st_size' failed: size on /mnt/lustre/d103.sanityn/f103.sanityn and /mnt/lustre2/d103.sanityn/f103.sanityn differs: 0 vs 1048576 fail_loc=0 fail_loc=0x214 fail_val=2 Starting test test23 at 1745625549 Finishing test test23 at 1745625549 PASS 103 (8s) == sanityn test 104: Verify that MDS stores atime/mtime/ctime during close ========================================================== 19:59:13 (1745625553) SKIP: sanityn test_104 ldiskfs only test SKIP 104 (1s) == sanityn test 105: Glimpse and lock cancel race ======== 19:59:14 (1745625554) fail_loc=0x416 PASS 105 (22s) == sanityn test 106a: Verify the btime via statx() ======= 19:59:36 (1745625576) SKIP: sanityn test_106a Test only for ldiskfs and statx() supported SKIP 106a (2s) == sanityn test 106b: Glimpse RPCs test for statx ======== 19:59:38 (1745625578) SKIP: sanityn test_106b statx() only test SKIP 106b (1s) == sanityn test 106c: Verify statx attributes mask ======= 19:59:39 (1745625579) SKIP: sanityn test_106c statx() only test SKIP 106c (1s) == sanityn test 107a: Basic grouplock conflict =========== 19:59:40 (1745625580) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.09542 s, 110 MB/s /mnt/lustre/f107a.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 5558 0x15b6 0x280000400 multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.7075 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.7075 First grouplock blocks second one PASS 107a (4s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 19:59:44 (1745625584) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0917544 s, 114 MB/s /mnt/lustre/f107b.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 5574 0x15c6 0x240000400 multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.7075 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (9s) == sanityn test 108a: lseek: parallel updates ============ 19:59:53 (1745625593) 1+0 records in 1+0 records out 10000 bytes (10 kB) copied, 0.00198965 s, 5.0 MB/s fail_val=4 fail_loc=0x80000414 1+0 records in 1+0 records out 8388608 bytes (8.4 MB) copied, 4.24487 s, 2.0 MB/s PASS 108a (6s) == sanityn test 109: Race with several mount instances on 1 node ========================================================== 19:59:59 (1745625599) 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Starting race between client mount instances (50 iterations): Iteration 1 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 3 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 4 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 5 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 6 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 7 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 8 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 9 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 10 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 11 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 12 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 13 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 14 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 15 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 16 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 17 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 18 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 19 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 20 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 21 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 22 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 23 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 24 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 25 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 26 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 27 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 28 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 29 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 30 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 31 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 32 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 33 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 34 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 35 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 36 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 37 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 38 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 39 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 40 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 41 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 42 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 43 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 44 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 45 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 46 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 47 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 48 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 49 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 50 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,noencrypt,flock,lazystatfs,lruresize,nolock,statfs_project,nouser_fid2path,user_xattr,verbose 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 PASS 109 (450s) == sanityn test 110: do not grant another lock on resend ========================================================== 20:07:29 (1745626049) fail_loc=0x525 fail_val=3 fail_loc=0x534 File: '/mnt/lustre/f110.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205306056707 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2025-04-25 20:07:30.000000000 -0400 Modify: 2025-04-25 20:07:30.000000000 -0400 Change: 2025-04-25 20:07:30.000000000 -0400 Birth: - fail_loc=0 fail_val=0 Connected clients: oleg134-client.virtnet oleg134-client.virtnet PASS 110 (65s) == sanityn test 111: A racy rename/link an open file should not cause fs corruption ========================================================== 20:08:34 (1745626114) SKIP: sanityn test_111 needs >= 2 MDTs SKIP 111 (1s) == sanityn test 112: update max-inherit in default LMV === 20:08:36 (1745626116) SKIP: sanityn test_112 We need at least 2 MDTs for this test SKIP 112 (1s) == sanityn test 113: check servers of specified fs ======= 20:08:37 (1745626117) lustre-OST0000-osc-ffff8800b58fc800 active. lustre-OST0001-osc-ffff8800b58fc800 active. lustre-OST0000-osc-ffff8800b58fc800 active. lustre-OST0001-osc-ffff8800b58fc800 active. MGC192.168.201.134@tcp active. PASS 113 (2s) == sanityn test 114: implicit default LMV inherit ======== 20:08:39 (1745626119) SKIP: sanityn test_114 We need at least 2 MDTs for this test SKIP 114 (0s) == sanityn test 115: ldiskfs doesn't check direntry for uniqueness ========================================================== 20:08:40 (1745626120) SKIP: sanityn test_115 ldiskfs only test SKIP 115 (0s) == sanityn test 116: DNE: Set default LMV layout from a remote client ========================================================== 20:08:41 (1745626121) SKIP: sanityn test_116 needs >= 2 MDTs SKIP 116 (0s) == sanityn test 200: service remains healthy while able to process request ========================================================== 20:08:42 (1745626122) at_max=10 at_unhealthy_factor=3 ost.OSS.ost_io.threads_max=21 fail_loc=0x1e1 fail_val=20 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.0415 s, 0.2 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied, 20.0535 s, 0.2 kB/s , 20.0483 s, 0.2 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied, 20.0503 s, 0.2 kB/s , 20.0465 s, 0.2 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied, 20.0452 s, 0.2 kB/s , 20.065 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.0591 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.0603 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.031 s, 0.1 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied, 40.0533 s, 0.1 kB/s , 40.057 s, 0.1 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied, 40.052 s, 0.1 kB/s 1+0 records in 1+0 records out , 40.0383 s, 0.1 kB/s 4096 bytes (4.1 kB) copied1+0 records in 1+0 records out , 40.05 s, 0.1 kB/s 4096 bytes (4.1 kB) copied, 40.054 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.0756 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.0665 s, 0.1 kB/s