-----============= acceptance-small: sanityn ============----- Tue Dec 17 05:18:05 EST 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 oleg134-server: ls: cannot access /home/green/git/lustre-release/lustre/tests/except/sanityn.*ex: No such file or directory excepting tests: 27 28 102 skipping tests SLOW=no: 33a === sanityn: start setup 05:18:12 (1734430692) === Starting client oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Started clients oleg134-client.virtnet: 192.168.201.134@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) oleg134-client.virtnet: executing check_config_client /mnt/lustre oleg134-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg134-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800a9871800.idle_timeout=debug osc.lustre-OST0000-osc-ffff8800aea1a000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800a9871800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800aea1a000.idle_timeout=debug disable quota as required oleg134-server: oleg134-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanityn: finish setup 05:18:22 (1734430702) === 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109338 s, 95.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f6964] == sanityn test 0: do_node_vp() and do_facet_vp() do the right thing ========================================================== 05:18:22 (1734430702) PASS 0 (3s) == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 05:18:25 (1734430705) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (2s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 05:18:27 (1734430707) -rw-r--r-- 1 root root 0 Dec 17 05:18 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (2s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 05:18:29 (1734430709) -rw-r--r-- 1 root root 0 Dec 17 05:18 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (2s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 05:18:31 (1734430711) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (2s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 05:18:33 (1734430713) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (1s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 05:18:34 (1734430714) total 1 -rwxrwxrwx 1 root root 0 Dec 17 05:18 f2a -rwxrwxrwx 1 root root 0 Dec 17 05:18 f2b total 1 -rwxrwxrwx 1 root root 0 Dec 17 05:18 f2a -rwxrwxrwx 1 root root 0 Dec 17 05:18 f2b running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes (512 B) copied, 0.00564059 s, 90.8 kB/s PASS 2e (2s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 05:18:36 (1734430716) SKIP: sanityn test_2f needs >= 2 MDTs SKIP 2f (1s) == sanityn test 2g: check blocks update on sync write ==== 05:18:37 (1734430717) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.115168 s, 18.2 MB/s /mnt/lustre/f2g.sanityn has 4103 blocks /mnt/lustre2/f2g.sanityn has 4103 blocks PASS 2g (2s) == sanityn test 3: symlink on one mtpt, readlink on another ===================================================================== 05:18:39 (1734430719) PASS 3 (2s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 05:18:41 (1734430721) PASS 4 (3s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 05:18:44 (1734430724) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (2s) == sanityn test 6: remove of open file on other node ============================================================================ 05:18:46 (1734430726) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (1s) == sanityn test 7: remove of open directory on other node ======================================================================= 05:18:47 (1734430727) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (2s) == sanityn test 8: remove of open special file on other node ==================================================================== 05:18:49 (1734430729) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (2s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 05:18:51 (1734430731) PASS 9a (1s) == sanityn test 9b: append to striped sparse file ======== 05:18:53 (1734430733) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0189946 s, 55.2 MB/s 3+0 records in 3+0 records out 3 bytes (3 B) copied, 0.0151848 s, 0.2 kB/s Data read (expecting 'foo'): foo PASS 9b (1s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 05:18:55 (1734430735) 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00260393 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00472913 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00296875 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00435895 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00339288 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00284549 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00465452 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00394255 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00377788 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00258112 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00424584 s, 0.2 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00351575 s, 0.3 kB/s PASS 10a (2s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 05:18:57 (1734430737) 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00539667 s, 569 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0101502 s, 404 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.000243367 s, 12.6 MB/s PASS 10b (2s) == sanityn test 11: execution of file opened for write should return error ============================================================== 05:18:59 (1734430739) multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.6964 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 301: /mnt/lustre2/d11/f: Text file busy PASS 11 (2s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 05:19:01 (1734430741) warning: '-runtime' deprecated, use '-t runtime' instead - link 1474 (time 1734430751.97 total 10.00 last 147.34) - link 2782 (time 1734430761.97 total 20.00 last 130.79) - link 4118 (time 1734430771.97 total 30.01 last 133.58) - link 5748 (time 1734430781.98 total 40.01 last 162.93) - link 6913 (time 1734430791.98 total 50.01 last 116.48) - link 8356 (time 1734430801.98 total 60.02 last 144.24) - link 10000 (time 1734430810.01 total 68.05 last 204.76) - link 11641 (time 1734430820.01 total 78.05 last 164.09) - link 13066 (time 1734430830.02 total 88.05 last 142.44) - link 14425 (time 1734430840.02 total 98.05 last 135.85) total: 14697 link in 100.00 seconds: 146.97 ops/second using seed 236234783 running for 100 seconds - stat 10000 (time 1734430749 ; total 7 ; last 7) - stat 20000 (time 1734430755 ; total 13 ; last 6) - stat 30000 (time 1734430761 ; total 19 ; last 6) - stat 40000 (time 1734430767 ; total 25 ; last 6) - stat 50000 (time 1734430773 ; total 31 ; last 6) - stat 60000 (time 1734430779 ; total 37 ; last 6) - stat 70000 (time 1734430785 ; total 43 ; last 6) - stat 80000 (time 1734430791 ; total 49 ; last 6) - stat 86618 (time 1734430802 ; total 60 ; last 11) - stat 90000 (time 1734430807 ; total 65 ; last 5) - stat 95683 (time 1734430818 ; total 76 ; last 11) - stat 100000 (time 1734430825 ; total 83 ; last 7) - stat 105007 (time 1734430836 ; total 94 ; last 11) total: 108121 stats in 100 seconds: 1081.209961 stats/second - unlinked 0 (time 1734430792 ; total 0 ; last 0) - unlinked 10000 (time 1734430867 ; total 75 ; last 75) unlink(/mnt/lustre2/lockdir/lockfile14697) error: No such file or directory total: 14696 unlinks in 101 seconds: 145.504944 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (21979) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (21982) - No such process PASS 12 (154s) == sanityn test 13: test directory page revocation ======= 05:21:35 (1734430895) f13 f13 PASS 13 (2s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 05:21:37 (1734430897) multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.6964 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 336: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4860: 23381 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (2s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 05:21:39 (1734430899) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4860: 24015 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (2s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 05:21:41 (1734430901) truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 351: 24646 Terminated $DIR1/$tdir/sleep 60 PASS 14b (2s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 05:21:43 (1734430903) cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 363: 25281 Terminated $DIR1/$tdir/sleep 60 PASS 14c (2s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 05:21:45 (1734430905) chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 374: 25917 Terminated $DIR1/$tdir/sleep 60 PASS 14d (3s) == sanityn test 15: test out-of-space with multiple writers ===================================================================== 05:21:48 (1734430908) PATH=/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/opt/iozone/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin: mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_CODE=117440512 CLIENT_OS_VERSION_ID=7 STRIPECOUNT=2 ORIGFREE=7521280 MAXFREE=800000 SKIP: oos2 test_15 oos2.sh: 7521280kB free gt MAXFREE 800000kB, increase 800000 (or reduce test fs size) to proceed sleep 5 for ZFS MDS Waiting for MDT destroys to complete SKIP 15 (14s) == sanityn test 16a: 500 iterations of dual-mount fsx ==== 05:22:02 (1734430922) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.230518 s, 36.4 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.202007 s, 41.5 MB/s Chance of close/open is 1 in 50 Seed set to 923 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x3095e0 000008[0] 1734430924.050006 trunc from 00000000 to 0x3095df (0x3095e0 bytes) 000010[1] 1734430924.079340 mapwrite 0x47bb2c thru 0x47d08e (0x1563 bytes) truncating to largest ever: 0x4e0ad6 000016[0] 1734430924.202160 trunc from 0x47d08f to 0x4e0ad5 (0x63a47 bytes) 000017[0] 1734430924.239169 read 0x0c050d thru 0x0c902c (0x8b20 bytes) 000018[1] 1734430924.249745 read 0x4d1411 thru 0x4dc335 (0xaf25 bytes) 000020[1] 1734430924.275901 mapread 0x30793f thru 0x312443 (0xab05 bytes) 000023[0] 1734430924.301414 read 0x3f5ac7 thru 0x4047de (0xed18 bytes) 000025[1] 1734430924.352379 write 0x4d79b5 thru 0x4e6477 (0xeac3 bytes) truncating to largest ever: 0x960066 000027[1] 1734430924.362746 trunc from 0x4e6478 to 0x960065 (0x479bee bytes) 000028[0] 1734430924.385607 mapwrite 0x844497 thru 0x84f861 (0xb3cb bytes) 000032[0] 1734430924.500615 mapread 0x88096b thru 0x881bc2 (0x1258 bytes) 000034[0] 1734430924.532176 mapwrite 0x48228d thru 0x48b156 (0x8eca bytes) 000035[1] 1734430924.665629 mapread 0x93bfd2 thru 0x93ecfa (0x2d29 bytes) 000039[1] 1734430924.702173 read 0x95bab9 thru 0x95cb5d (0x10a5 bytes) 000044[1] 1734430924.762180 mapwrite 0x851084 thru 0x851bd3 (0xb50 bytes) 000045[1] 1734430924.821093 mapread 0x69ccd5 thru 0x69e5c9 (0x18f5 bytes) 000047[0] 1734430924.905638 read 0x951d38 thru 0x9575a3 (0x586c bytes) 000051[0] 1734430924.999956 mapwrite 0x051e47 thru 0x054b3c (0x2cf6 bytes) 000054[1] 1734430925.078604 trunc from 0x960066 to 0x6f9c86 (0x2663df bytes) 000058[1] 1734430925.131858 mapwrite 0x6cd818 thru 0x6d8d02 (0xb4eb bytes) 000060[0] 1734430925.239183 mapread 0x0d3fae thru 0x0da2e4 (0x6337 bytes) 000062[1] 1734430925.302127 trunc from 0x6f9c87 to 0x5d8b3f (0x121147 bytes) 000066[0] 1734430925.371532 write 0x2e3af6 thru 0x2f0ea2 (0xd3ad bytes) 000068[0] 1734430925.401532 mapread 0x50aba3 thru 0x50ae0a (0x268 bytes) 000069[1] 1734430925.426287 read 0x24fac8 thru 0x257262 (0x779b bytes) 000071[1] 1734430925.492511 mapwrite 0x783749 thru 0x78cc5c (0x9514 bytes) 000073[1] 1734430925.620385 read 0x5e79a9 thru 0x5f48c1 (0xcf19 bytes) 000074[1] 1734430925.621110 trunc from 0x78cc5d to 0x53afb2 (0x251caa bytes) 000080[0] 1734430925.652376 mapread 0x2c403f thru 0x2c41b4 (0x176 bytes) 000081[0] 1734430925.675328 read 0x0853be thru 0x089ee9 (0x4b2c bytes) 000082[1] 1734430925.734263 trunc from 0x53afb3 to 0x2b26bf (0x2888f3 bytes) 000085[1] 1734430925.775082 write 0x63166e thru 0x63647b (0x4e0e bytes) 000086[1] 1734430925.784385 read 0x54b6e2 thru 0x54e492 (0x2db1 bytes) 000089[1] 1734430925.812543 mapread 0x0343dc thru 0x03f554 (0xb179 bytes) 000090[1] 1734430925.838486 trunc from 0x63647c to 0x1256c5 (0x510db6 bytes) 000093[1] 1734430925.901387 read 0x0f3033 thru 0x0f421c (0x11ea bytes) 000094[0] 1734430925.902548 mapread 0x07b9d2 thru 0x07c946 (0xf75 bytes) 000096[0] 1734430925.954398 read 0x0c2392 thru 0x0c6340 (0x3faf bytes) 000097[1] 1734430925.976872 write 0x394a49 thru 0x396b0a (0x20c2 bytes) 000098[1] 1734430925.984742 read 0x04c97e thru 0x053d74 (0x73f7 bytes) 000101[1] 1734430926.048593 mapread 0x0187f7 thru 0x01c2c7 (0x3ad1 bytes) 000102[0] 1734430926.059897 mapwrite 0x4b99b2 thru 0x4b9a16 (0x65 bytes) 000103[1] 1734430926.160567 read 0x468598 thru 0x470d1b (0x8784 bytes) 000104[0] 1734430926.218406 mapread 0x272a09 thru 0x274950 (0x1f48 bytes) 000106[1] 1734430926.230219 trunc from 0x4b9a17 to 0x9233ea (0x4699d4 bytes) 000107[0] 1734430926.268110 read 0x334f10 thru 0x33f762 (0xa853 bytes) 000109[0] 1734430926.331748 mapread 0x2cf8c3 thru 0x2dc461 (0xcb9f bytes) 000111[0] 1734430926.339928 mapread 0x0887e2 thru 0x08dd2b (0x554a bytes) 000113[0] 1734430926.353524 mapread 0x682b4a thru 0x68bd12 (0x91c9 bytes) 000114[0] 1734430926.401685 write 0x26df07 thru 0x2755f0 (0x76ea bytes) 000115[0] 1734430926.430016 mapread 0x735a7b thru 0x73cac6 (0x704c bytes) 000118[0] 1734430926.441399 mapwrite 0x4c2b56 thru 0x4cb7f5 (0x8ca0 bytes) 000119[0] 1734430926.547281 read 0x2d2cbf thru 0x2de29b (0xb5dd bytes) 000120[1] 1734430926.600148 write 0x05568d thru 0x06292b (0xd29f bytes) 000122[1] 1734430926.681779 read 0x2f7067 thru 0x300c25 (0x9bbf bytes) 000124[0] 1734430926.696546 write 0x81b46a thru 0x81f7b7 (0x434e bytes) 000125[0] 1734430926.717672 read 0x6ddf22 thru 0x6de306 (0x3e5 bytes) 000126[1] 1734430926.718188 write 0x1e5d3f thru 0x1eab3e (0x4e00 bytes) 000130[0] 1734430926.818047 trunc from 0x9233eb to 0x6cb052 (0x258398 bytes) 000133[0] 1734430926.855116 mapread 0x1f6de9 thru 0x1fefa7 (0x81bf bytes) 000134[1] 1734430926.888914 write 0x0fe924 thru 0x101497 (0x2b74 bytes) 000136[0] 1734430926.929759 mapwrite 0x797670 thru 0x79770a (0x9b bytes) 000139[0] 1734430927.011678 trunc from 0x79770b to 0x18ab8f (0x60cb7b bytes) 000142[1] 1734430927.052021 trunc from 0x18ab90 to 0x507b2d (0x37cf9e bytes) 000144[0] 1734430927.120644 read 0x1e88d5 thru 0x1ec512 (0x3c3e bytes) 000145[0] 1734430927.184001 read 0x46dd16 thru 0x478602 (0xa8ed bytes) 000151[1] 1734430927.233409 write 0x52602a thru 0x530806 (0xa7dd bytes) 000152[0] 1734430927.240402 mapread 0x2945d3 thru 0x29a0ac (0x5ada bytes) 000153[1] 1734430927.263755 mapread 0x44be8f thru 0x44e2ca (0x243c bytes) 000154[1] 1734430927.282047 mapread 0x26ff03 thru 0x27c892 (0xc990 bytes) 000155[1] 1734430927.329940 mapwrite 0x39224e thru 0x396e55 (0x4c08 bytes) 000159[0] 1734430927.456366 mapwrite 0x2432ef thru 0x252f8e (0xfca0 bytes) 000160[1] 1734430927.573144 write 0x075f5a thru 0x0817ca (0xb871 bytes) 000161[0] 1734430927.590910 mapwrite 0x1b2cb9 thru 0x1c2c99 (0xffe1 bytes) truncating to largest ever: 0x9b1b8d 000163[1] 1734430927.714029 trunc from 0x530807 to 0x9b1b8c (0x481386 bytes) 000165[0] 1734430927.744486 read 0x8caa00 thru 0x8cf0f1 (0x46f2 bytes) 000166[1] 1734430927.843003 read 0x942603 thru 0x94bed0 (0x98ce bytes) 000169[0] 1734430927.916105 read 0x7b0651 thru 0x7baafe (0xa4ae bytes) 000170[1] 1734430927.987061 mapread 0x7ffe12 thru 0x804ce4 (0x4ed3 bytes) 000171[0] 1734430927.993034 write 0x9a5554 thru 0x9ae7e2 (0x928f bytes) 000172[0] 1734430928.020648 mapread 0x73e2a7 thru 0x73eca5 (0x9ff bytes) 000173[1] 1734430928.021241 write 0x900064 thru 0x90238a (0x2327 bytes) 000174[0] 1734430928.063074 read 0x5f1f72 thru 0x5f6eeb (0x4f7a bytes) 000179[1] 1734430928.081371 write 0x4d29ab thru 0x4d7d3d (0x5393 bytes) 000180[1] 1734430928.107688 write 0x8148f9 thru 0x81f382 (0xaa8a bytes) 000184[0] 1734430928.145686 trunc from 0x9b1b8d to 0x5fc0f6 (0x3b5a96 bytes) 000185[1] 1734430928.214200 read 0x225b38 thru 0x2358f1 (0xfdba bytes) 000186[0] 1734430928.328999 write 0x753b11 thru 0x759deb (0x62db bytes) 000187[1] 1734430928.339257 trunc from 0x759dec to 0x6cd36a (0x8ca81 bytes) 000188[1] 1734430928.381916 trunc from 0x6cd36b to 0x020c47 (0x6ac723 bytes) 000191[1] 1734430928.418282 trunc from 0x020c48 to 0x16f21f (0x14e5d8 bytes) 000192[0] 1734430928.448404 mapwrite 0x67019a thru 0x671d8d (0x1bf4 bytes) 000193[0] 1734430928.569996 mapread 0x0ea416 thru 0x0ee2de (0x3ec9 bytes) 000194[0] 1734430928.578945 mapread 0x5577d8 thru 0x561ffd (0xa826 bytes) 000195[0] 1734430928.581540 write 0x762e18 thru 0x770b86 (0xdd6f bytes) 000196[1] 1734430928.588509 write 0x0cf73f thru 0x0d08b7 (0x1179 bytes) 000199[1] 1734430928.625789 trunc from 0x770b87 to 0x93077c (0x1bfbf6 bytes) 000202[1] 1734430928.678001 mapwrite 0x70e6ff thru 0x70f794 (0x1096 bytes) 000204[1] 1734430928.789980 write 0x646fc9 thru 0x64f981 (0x89b9 bytes) 000205[0] 1734430928.791401 trunc from 0x93077d to 0x5100ec (0x420690 bytes) 000208[0] 1734430928.858950 mapwrite 0x9d8bdb thru 0x9e11a7 (0x85cd bytes) 000209[1] 1734430928.943756 read 0x3c7604 thru 0x3cdce7 (0x66e4 bytes) 000210[0] 1734430929.001601 mapread 0x382906 thru 0x38aab7 (0x81b2 bytes) 000211[1] 1734430929.042363 trunc from 0x9e11a8 to 0x45bcde (0x5854c9 bytes) 000214[0] 1734430929.112312 write 0x88c8ba thru 0x89678b (0x9ed2 bytes) 000219[0] 1734430929.187485 mapread 0x2a702b thru 0x2aa287 (0x325d bytes) 000222[1] 1734430929.248921 mapwrite 0x7cc131 thru 0x7ce9b1 (0x2881 bytes) 000225[0] 1734430929.386953 read 0x2c0866 thru 0x2cf345 (0xeae0 bytes) 000226[1] 1734430929.421468 mapread 0x1fc6f4 thru 0x204623 (0x7f30 bytes) 000228[1] 1734430929.489992 mapwrite 0x804940 thru 0x812ab6 (0xe177 bytes) 000234[0] 1734430929.628373 mapwrite 0x588a0f thru 0x595e67 (0xd459 bytes) 000235[0] 1734430929.743759 trunc from 0x89678c to 0x048590 (0x84e1fb bytes) 000236[0] 1734430929.775078 read 0x0353b3 thru 0x03ac22 (0x5870 bytes) 000237[1] 1734430929.785567 write 0x66a819 thru 0x6717f4 (0x6fdc bytes) 000238[0] 1734430929.807359 mapread 0x1cabc9 thru 0x1d4e6f (0xa2a7 bytes) 000240[0] 1734430929.911988 mapread 0x179399 thru 0x1857b8 (0xc420 bytes) 000243[1] 1734430930.017288 mapwrite 0x393840 thru 0x39f6f5 (0xbeb6 bytes) 000244[1] 1734430930.130321 mapread 0x0287e4 thru 0x02c8f4 (0x4111 bytes) 000247[1] 1734430930.170538 write 0x213506 thru 0x214d35 (0x1830 bytes) 000249[0] 1734430930.179259 read 0x386507 thru 0x392dbd (0xc8b7 bytes) 000250[1] 1734430930.242361 write 0x0d3262 thru 0x0d44ce (0x126d bytes) 000251[0] 1734430930.269850 read 0x3b1a65 thru 0x3c0022 (0xe5be bytes) 000252[1] 1734430930.385310 mapread 0x356491 thru 0x36459d (0xe10d bytes) 000253[0] 1734430930.450719 read 0x09e629 thru 0x0a0d92 (0x276a bytes) 000256[1] 1734430930.474404 mapread 0x5f3af0 thru 0x600f87 (0xd498 bytes) 000259[0] 1734430930.523736 write 0x888d16 thru 0x88e13c (0x5427 bytes) 000263[1] 1734430930.570532 mapread 0x55f094 thru 0x561d43 (0x2cb0 bytes) 000264[0] 1734430930.592316 mapread 0x566bf3 thru 0x57657b (0xf989 bytes) 000265[1] 1734430930.669723 write 0x744fd4 thru 0x7484f1 (0x351e bytes) 000267[0] 1734430930.696074 trunc from 0x88e13d to 0x217c03 (0x676539 bytes) 000268[0] 1734430930.724271 write 0x7d25bc thru 0x7d4f9a (0x29df bytes) 000269[1] 1734430930.735166 read 0x243e82 thru 0x2444b3 (0x632 bytes) 000271[0] 1734430930.799561 read 0x07a0a2 thru 0x080895 (0x67f4 bytes) 000272[1] 1734430930.837524 read 0x573006 thru 0x57ca7d (0x9a78 bytes) 000277[0] 1734430930.894547 read 0x3cc372 thru 0x3d4e09 (0x8a98 bytes) 000278[0] 1734430930.928831 read 0x493cfd thru 0x494316 (0x61a bytes) truncating to largest ever: 0x9f1d86 000279[1] 1734430930.943073 trunc from 0x7d4f9b to 0x9f1d85 (0x21cdeb bytes) 000280[0] 1734430930.991158 write 0x4b9ee3 thru 0x4bacab (0xdc9 bytes) 000283[0] 1734430931.030943 write 0x4db148 thru 0x4e32c6 (0x817f bytes) 000285[1] 1734430931.054803 trunc from 0x9f1d86 to 0x1a7e9c (0x849ee9 bytes) 000288[1] 1734430931.111607 write 0x7cb1a8 thru 0x7d61ab (0xb004 bytes) 000289[1] 1734430931.114268 read 0x308f90 thru 0x30ca78 (0x3ae9 bytes) 000290[1] 1734430931.145697 read 0x67271c thru 0x674623 (0x1f08 bytes) 000291[1] 1734430931.156922 mapwrite 0x2aa481 thru 0x2b40d5 (0x9c55 bytes) 000293[0] 1734430931.263754 trunc from 0x7d61ac to 0x79ce49 (0x39362 bytes) 000294[1] 1734430931.293703 trunc from 0x79ce4a to 0x713cc4 (0x89185 bytes) 000298[1] 1734430931.333591 trunc from 0x713cc5 to 0x1536c9 (0x5c05fb bytes) 000299[0] 1734430931.351059 write 0x391b7c thru 0x39479b (0x2c20 bytes) 000300[0] 1734430931.367078 trunc from 0x39479c to 0x67ac76 (0x2e64db bytes) 000302[1] 1734430931.414377 mapwrite 0x939dc5 thru 0x93e1dd (0x4419 bytes) 000304[1] 1734430931.587366 mapread 0x78f96f thru 0x794e0c (0x549e bytes) 000306[1] 1734430931.589146 read 0x8a134b thru 0x8aedc4 (0xda7a bytes) 000307[0] 1734430931.590089 mapwrite 0x6e9325 thru 0x6f3314 (0x9ff0 bytes) 000308[1] 1734430931.732062 write 0x70da37 thru 0x718ff0 (0xb5ba bytes) 000312[0] 1734430931.845726 read 0x03b486 thru 0x04af48 (0xfac3 bytes) 000313[1] 1734430931.922930 mapwrite 0x62903d thru 0x634c29 (0xbbed bytes) 000315[0] 1734430931.968316 write 0x3fa586 thru 0x404017 (0x9a92 bytes) 000316[1] 1734430932.020768 trunc from 0x93e1de to 0x7bae70 (0x18336d bytes) 000317[1] 1734430932.061894 write 0x21bed3 thru 0x2222d7 (0x6405 bytes) 000319[0] 1734430932.088187 trunc from 0x7bae71 to 0x3be9a8 (0x3fc4c8 bytes) 000320[1] 1734430932.126684 mapread 0x313e30 thru 0x31beed (0x80be bytes) 000321[0] 1734430932.196851 write 0x011a52 thru 0x01cc29 (0xb1d8 bytes) 000322[0] 1734430932.221832 mapwrite 0x9a213c thru 0x9aca41 (0xa906 bytes) 000323[0] 1734430932.387528 read 0x6f9850 thru 0x6fe6da (0x4e8b bytes) 000324[0] 1734430932.388033 read 0x1dfbe2 thru 0x1ea348 (0xa767 bytes) 000326[1] 1734430932.432343 mapread 0x6ac458 thru 0x6ae711 (0x22ba bytes) 000327[1] 1734430932.483531 mapwrite 0x79e28c thru 0x7a6609 (0x837e bytes) 000328[0] 1734430932.609473 trunc from 0x9aca42 to 0x1283a6 (0x88469b bytes) 000330[1] 1734430932.654377 read 0x016b60 thru 0x017e9d (0x133e bytes) 000333[1] 1734430932.694374 trunc from 0x1283a7 to 0x0826eb (0xa5cbb bytes) 000334[0] 1734430932.711194 trunc from 0x0826ec to 0x19d9ac (0x11b2c1 bytes) 000335[1] 1734430932.736643 read 0x0065de thru 0x013ca6 (0xd6c9 bytes) 000336[1] 1734430932.783680 write 0x043871 thru 0x047fa3 (0x4733 bytes) 000338[1] 1734430932.829885 read 0x0232cb thru 0x02e035 (0xad6b bytes) 000339[1] 1734430932.871061 read 0x189d26 thru 0x190289 (0x6564 bytes) 000343[0] 1734430932.922150 mapread 0x03435b thru 0x036432 (0x20d8 bytes) 000352[1] 1734430933.037012 mapwrite 0x687a26 thru 0x6935ff (0xbbda bytes) 000356[1] 1734430933.238031 mapwrite 0x2ef20c thru 0x2fe666 (0xf45b bytes) 000357[1] 1734430933.294002 mapread 0x4b25d2 thru 0x4b5f13 (0x3942 bytes) 000358[0] 1734430933.294306 write 0x5dc40b thru 0x5ea27f (0xde75 bytes) 000359[1] 1734430933.318997 trunc from 0x693600 to 0x412ef9 (0x280706 bytes) 000361[0] 1734430933.374647 read 0x2d1367 thru 0x2db185 (0x9e1f bytes) 000362[1] 1734430933.425548 mapread 0x3d6f31 thru 0x3e0607 (0x96d7 bytes) 000367[1] 1734430933.456114 write 0x4b1742 thru 0x4b6386 (0x4c45 bytes) 000368[1] 1734430933.458107 mapread 0x189609 thru 0x18a113 (0xb0b bytes) 000369[1] 1734430933.474400 read 0x3ad705 thru 0x3bb2c2 (0xdbbe bytes) 000371[1] 1734430933.479348 mapread 0x08568c thru 0x09527a (0xfbef bytes) 000374[1] 1734430933.504072 read 0x493b40 thru 0x49d6b0 (0x9b71 bytes) 000375[1] 1734430933.540023 write 0x028ffa thru 0x02cb0f (0x3b16 bytes) 000380[1] 1734430933.633618 read 0x18e1f9 thru 0x195969 (0x7771 bytes) 000381[1] 1734430933.677029 trunc from 0x4b6387 to 0x314ffb (0x1a138b bytes) 000383[1] 1734430933.706343 read 0x148f55 thru 0x155e09 (0xceb5 bytes) 000384[1] 1734430933.717808 mapwrite 0x9f778e thru 0x9fc1ad (0x4a20 bytes) 000385[1] 1734430933.880923 write 0x64e2e4 thru 0x65bf85 (0xdca2 bytes) 000390[0] 1734430933.926205 read 0x5a8915 thru 0x5b73f7 (0xeae3 bytes) 000391[0] 1734430933.987479 mapwrite 0x334495 thru 0x336c9c (0x2808 bytes) 000393[0] 1734430934.111395 mapwrite 0x6fd464 thru 0x700653 (0x31f0 bytes) 000396[0] 1734430934.292524 mapread 0x2e012b thru 0x2ee58a (0xe460 bytes) 000398[0] 1734430934.294272 read 0x1afb6f thru 0x1b4f97 (0x5429 bytes) 000404[0] 1734430934.357266 read 0x2cd53f thru 0x2d9fad (0xca6f bytes) 000406[1] 1734430934.369651 trunc from 0x9fc1ae to 0x27171d (0x78aa90 bytes) 000411[0] 1734430934.441281 mapread 0x2670a6 thru 0x27171d (0xa678 bytes) 000415[0] 1734430934.554329 write 0x79a079 thru 0x79a653 (0x5db bytes) 000416[0] 1734430934.566947 read 0x034da0 thru 0x037452 (0x26b3 bytes) 000417[1] 1734430934.568336 write 0x0f1c0b thru 0x0f2815 (0xc0b bytes) 000418[0] 1734430934.601100 trunc from 0x79a654 to 0x913f68 (0x179915 bytes) 000419[0] 1734430934.649077 write 0x68ec00 thru 0x6995a0 (0xa9a1 bytes) 000421[1] 1734430934.724323 trunc from 0x913f69 to 0x9dfb7b (0xcbc13 bytes) 000422[1] 1734430934.777692 mapread 0x781be3 thru 0x78697f (0x4d9d bytes) 000423[1] 1734430934.805359 trunc from 0x9dfb7c to 0x1e9e04 (0x7f5d77 bytes) 000424[1] 1734430934.824139 read 0x11ffbf thru 0x129715 (0x9757 bytes) 000425[1] 1734430934.844766 write 0x47e76f thru 0x4888ae (0xa140 bytes) 000426[0] 1734430934.856307 mapread 0x12cafe thru 0x13bd85 (0xf288 bytes) 000428[1] 1734430934.919848 read 0x476767 thru 0x47d145 (0x69df bytes) 000431[1] 1734430934.958609 mapread 0x2a258d thru 0x2ac4b7 (0x9f2b bytes) 000432[0] 1734430934.988646 read 0x4678eb thru 0x46baca (0x41e0 bytes) 000433[1] 1734430935.028493 write 0x57c3e6 thru 0x58b62c (0xf247 bytes) 000434[1] 1734430935.035157 write 0x04b5b3 thru 0x04f83f (0x428d bytes) 000436[0] 1734430935.051961 write 0x6a1de1 thru 0x6a2925 (0xb45 bytes) 000438[0] 1734430935.086640 read 0x2af684 thru 0x2b74c1 (0x7e3e bytes) 000440[0] 1734430935.165694 mapread 0x091dd1 thru 0x092400 (0x630 bytes) 000441[0] 1734430935.166295 mapwrite 0x429a85 thru 0x431a5f (0x7fdb bytes) 000442[1] 1734430935.267198 write 0x2e9430 thru 0x2f4665 (0xb236 bytes) 000443[0] 1734430935.308194 mapread 0x4f5282 thru 0x4f995e (0x46dd bytes) 000444[1] 1734430935.354643 read 0x26de90 thru 0x270e88 (0x2ff9 bytes) 000445[1] 1734430935.403857 mapwrite 0x20a51f thru 0x20e69c (0x417e bytes) 000446[0] 1734430935.514107 mapread 0x49fcc3 thru 0x4af934 (0xfc72 bytes) 000449[0] 1734430935.601622 write 0x15e880 thru 0x16866d (0x9dee bytes) 000454[0] 1734430935.686929 read 0x3f2bbe thru 0x40237f (0xf7c2 bytes) 000456[0] 1734430935.820622 read 0x598209 thru 0x5a204d (0x9e45 bytes) 000457[0] 1734430935.863262 write 0x758fc6 thru 0x75a312 (0x134d bytes) 000459[0] 1734430935.892521 write 0x464003 thru 0x46e4de (0xa4dc bytes) 000460[0] 1734430935.914618 write 0x4faddd thru 0x4fc08b (0x12af bytes) 000461[0] 1734430935.941736 mapread 0x64c933 thru 0x654651 (0x7d1f bytes) 000462[1] 1734430935.969964 trunc from 0x75a313 to 0x89b2ac (0x140f9a bytes) 000463[0] 1734430936.014276 write 0x2972a7 thru 0x2a0e4e (0x9ba8 bytes) 000464[0] 1734430936.045105 mapwrite 0x37135c thru 0x372f39 (0x1bde bytes) 000465[0] 1734430936.113304 mapread 0x2f7d75 thru 0x305815 (0xdaa1 bytes) 000466[1] 1734430936.131313 mapread 0x3d6b40 thru 0x3d867c (0x1b3d bytes) 000467[1] 1734430936.178817 trunc from 0x89b2ad to 0x7bae87 (0xe0425 bytes) 000470[1] 1734430936.233097 write 0x49b19d thru 0x49fb08 (0x496c bytes) 000472[0] 1734430936.279649 mapread 0x37c911 thru 0x388005 (0xb6f5 bytes) 000475[0] 1734430936.354326 mapwrite 0x331ebf thru 0x33ad82 (0x8ec4 bytes) 000478[1] 1734430936.455644 write 0x07e595 thru 0x08763c (0x90a8 bytes) 000479[1] 1734430936.466788 mapread 0x0cf0b2 thru 0x0d6cf6 (0x7c45 bytes) 000481[1] 1734430936.487291 mapwrite 0x5ffb4d thru 0x603515 (0x39c9 bytes) 000482[1] 1734430936.534151 trunc from 0x7bae88 to 0x5f86f1 (0x1c2796 bytes) 000483[1] 1734430936.543333 read 0x003b8a thru 0x005e52 (0x22c9 bytes) 000484[1] 1734430936.588450 trunc from 0x5f86f2 to 0x0971c3 (0x56152e bytes) 000485[1] 1734430936.609352 mapread 0x03e6c9 thru 0x0433ec (0x4d24 bytes) 000486[0] 1734430936.610267 write 0x0353f3 thru 0x038b6f (0x377d bytes) 000487[1] 1734430936.650291 mapwrite 0x7602c9 thru 0x76a2cd (0xa005 bytes) 000488[0] 1734430936.725634 read 0x171c3c thru 0x179edb (0x82a0 bytes) 000490[0] 1734430936.784992 mapread 0x2afd2c thru 0x2bdbc5 (0xde9a bytes) 000491[0] 1734430936.788727 write 0x363aca thru 0x3688b4 (0x4deb bytes) 000492[1] 1734430936.822237 trunc from 0x76a2ce to 0x4e832c (0x281fa1 bytes) 000494[1] 1734430936.877216 mapwrite 0x51a1c5 thru 0x526240 (0xc07c bytes) 000497[0] 1734430936.970934 trunc from 0x526241 to 0x872dea (0x34cbaa bytes) 000498[1] 1734430936.996486 trunc from 0x872deb to 0x7fe92b (0x744bf bytes) 000499[0] 1734430937.020037 trunc from 0x7fe92c to 0x725f58 (0xd89d3 bytes) 000500[1] 1734430937.040273 mapread 0x654aff thru 0x657202 (0x2704 bytes) All operations completed A-OK! Chance of close/open is 1 in 50 Seed set to 937 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000002[1] 1734430937.345714 write 0x97e000 thru 0x9807e3 (0x27e4 bytes) 000004[1] 1734430937.367044 read 0x824000 thru 0x829da6 (0x5da7 bytes) truncating to largest ever: 0x916fac 000009[0] 1734430937.400180 trunc from 0x9807e4 to 0x916fab (0x69838 bytes) 000013[1] 1734430937.444104 mapwrite 0x7ce000 thru 0x7ce63b (0x63c bytes) 000016[0] 1734430937.524413 mapwrite 0x645000 thru 0x64b586 (0x6587 bytes) 000017[0] 1734430937.590062 write 0x80d000 thru 0x8177eb (0xa7ec bytes) 000018[0] 1734430937.595058 trunc from 0x916fac to 0x03a5d7 (0x8dc9d4 bytes) 000019[1] 1734430937.605884 mapwrite 0x9ac000 thru 0x9b68a6 (0xa8a7 bytes) 000022[0] 1734430937.671707 mapread 0x7c5000 thru 0x7cc2f2 (0x72f3 bytes) 000023[0] 1734430937.691563 mapread 0x1d1000 thru 0x1dd794 (0xc795 bytes) 000024[1] 1734430937.703760 write 0x5aa000 thru 0x5aadc2 (0xdc3 bytes) 000027[0] 1734430937.713845 mapread 0x3dc000 thru 0x3deddc (0x2ddd bytes) 000029[1] 1734430937.740011 trunc from 0x9b68a7 to 0x6aa02c (0x30c87a bytes) 000032[0] 1734430937.763373 mapread 0x347000 thru 0x34dfaf (0x6fb0 bytes) 000033[0] 1734430937.777642 mapread 0x346000 thru 0x34a8ca (0x48cb bytes) 000034[1] 1734430937.778016 mapread 0x57f000 thru 0x585390 (0x6391 bytes) 000036[0] 1734430937.785158 mapread 0x069000 thru 0x0782b9 (0xf2ba bytes) 000037[0] 1734430937.797123 read 0x138000 thru 0x13a831 (0x2832 bytes) 000038[0] 1734430937.799774 trunc from 0x6aa02d to 0x35b5ab (0x34ea81 bytes) 000040[0] 1734430937.813386 write 0x47f000 thru 0x489d5f (0xad60 bytes) 000042[1] 1734430937.823847 read 0x2e0000 thru 0x2e5522 (0x5523 bytes) 000044[0] 1734430937.872116 mapread 0x12c000 thru 0x12cc5d (0xc5e bytes) 000049[0] 1734430937.882391 read 0x14b000 thru 0x1558a2 (0xa8a3 bytes) 000051[0] 1734430937.883196 read 0x04d000 thru 0x05983d (0xc83e bytes) 000052[1] 1734430937.912118 read 0x260000 thru 0x26be75 (0xbe76 bytes) 000053[1] 1734430937.912372 mapread 0x188000 thru 0x18edab (0x6dac bytes) 000055[0] 1734430937.912943 trunc from 0x489d60 to 0x0ab112 (0x3dec4d bytes) 000056[0] 1734430937.942556 mapread 0x08b000 thru 0x08f396 (0x4397 bytes) 000059[1] 1734430937.985356 write 0x5f7000 thru 0x5f863f (0x1640 bytes) 000061[1] 1734430938.005157 write 0x953000 thru 0x95ba42 (0x8a43 bytes) 000062[0] 1734430938.018268 mapwrite 0x9c0000 thru 0x9c8621 (0x8622 bytes) 000063[1] 1734430938.107822 read 0x889000 thru 0x88cc69 (0x3c6a bytes) 000064[1] 1734430938.186996 trunc from 0x9c8622 to 0x8afa66 (0x118bbb bytes) 000067[1] 1734430938.211357 read 0x88c000 thru 0x895360 (0x9361 bytes) 000072[1] 1734430938.276094 trunc from 0x8afa67 to 0x4cc075 (0x3e39f1 bytes) 000074[0] 1734430938.291151 trunc from 0x4cc076 to 0x30b9d5 (0x1c06a0 bytes) 000075[1] 1734430938.307299 mapwrite 0x1da000 thru 0x1e81d0 (0xe1d1 bytes) 000076[0] 1734430938.382837 mapread 0x0f3000 thru 0x10219e (0xf19f bytes) 000077[1] 1734430938.428583 write 0x036000 thru 0x03d8b0 (0x78b1 bytes) 000078[1] 1734430938.439993 mapread 0x1c4000 thru 0x1d0cb0 (0xccb1 bytes) 000079[0] 1734430938.479618 write 0x3c5000 thru 0x3c95d1 (0x45d2 bytes) 000080[1] 1734430938.497187 mapwrite 0x9ea000 thru 0x9f2c4d (0x8c4e bytes) truncating to largest ever: 0x9eba77 000081[1] 1734430938.594517 trunc from 0x9f2c4e to 0x9eba76 (0x71d7 bytes) 000088[0] 1734430938.644786 write 0x55c000 thru 0x55f1d7 (0x31d8 bytes) 000090[1] 1734430938.672508 write 0x47e000 thru 0x486420 (0x8421 bytes) 000091[1] 1734430938.681382 read 0x9db000 thru 0x9ddbab (0x2bac bytes) 000092[1] 1734430938.764465 trunc from 0x9eba77 to 0x222ccf (0x7c8da7 bytes) 000096[0] 1734430938.797816 write 0x946000 thru 0x94faeb (0x9aec bytes) 000097[1] 1734430938.816217 mapread 0x18d000 thru 0x194486 (0x7487 bytes) 000100[0] 1734430938.854405 write 0x9c2000 thru 0x9cc343 (0xa344 bytes) 000103[0] 1734430938.890241 mapwrite 0x6a0000 thru 0x6aac56 (0xac57 bytes) 000104[1] 1734430938.972134 read 0x6c8000 thru 0x6cfd8e (0x7d8f bytes) 000105[0] 1734430939.042105 trunc from 0x9cc344 to 0x686b57 (0x3457ec bytes) 000109[0] 1734430939.067666 trunc from 0x686b58 to 0x2c2a40 (0x3c4117 bytes) 000110[1] 1734430939.078078 mapread 0x120000 thru 0x126f91 (0x6f92 bytes) 000112[1] 1734430939.112966 mapwrite 0x66d000 thru 0x670656 (0x3657 bytes) 000116[1] 1734430939.196168 mapread 0x279000 thru 0x283145 (0xa146 bytes) 000117[1] 1734430939.231959 mapread 0x148000 thru 0x14ea13 (0x6a14 bytes) 000121[1] 1734430939.265338 read 0x2d1000 thru 0x2d7572 (0x6573 bytes) 000127[1] 1734430939.353774 write 0x1c3000 thru 0x1c350e (0x50f bytes) 000128[0] 1734430939.361335 trunc from 0x670657 to 0x1837f0 (0x4ece66 bytes) 000130[0] 1734430939.400862 trunc from 0x1837f1 to 0x913b53 (0x790363 bytes) 000135[0] 1734430939.437270 write 0x5f6000 thru 0x603888 (0xd889 bytes) 000136[0] 1734430939.441752 mapwrite 0x3a9000 thru 0x3b7b16 (0xeb17 bytes) 000140[0] 1734430939.537177 write 0x68c000 thru 0x699ed3 (0xded4 bytes) 000141[0] 1734430939.549525 mapwrite 0x158000 thru 0x167de3 (0xfde4 bytes) 000142[0] 1734430939.640764 read 0x07d000 thru 0x08abbc (0xdbbd bytes) 000143[0] 1734430939.721565 write 0x002000 thru 0x010272 (0xe273 bytes) 000144[0] 1734430939.736010 mapwrite 0x73c000 thru 0x7462e5 (0xa2e6 bytes) 000147[0] 1734430939.808648 mapwrite 0x320000 thru 0x326411 (0x6412 bytes) 000148[1] 1734430939.862734 write 0x7a9000 thru 0x7aeeac (0x5ead bytes) 000149[0] 1734430939.911905 read 0x34e000 thru 0x35220d (0x420e bytes) 000150[0] 1734430940.004188 mapread 0x29e000 thru 0x2adccb (0xfccc bytes) 000152[0] 1734430940.008095 mapwrite 0x3bf000 thru 0x3ce87d (0xf87e bytes) 000153[0] 1734430940.135824 write 0x6cb000 thru 0x6cf6a9 (0x46aa bytes) 000155[1] 1734430940.138626 read 0x1cf000 thru 0x1dbf42 (0xcf43 bytes) 000159[1] 1734430940.197928 read 0x381000 thru 0x38dcc8 (0xccc9 bytes) 000161[0] 1734430940.203490 mapwrite 0x2dc000 thru 0x2de8e6 (0x28e7 bytes) 000162[1] 1734430940.273907 trunc from 0x913b54 to 0x46f8d8 (0x4a427b bytes) 000163[1] 1734430940.292387 read 0x2ed000 thru 0x2f2163 (0x5164 bytes) 000164[0] 1734430940.333987 trunc from 0x46f8d9 to 0x86c58e (0x3fccb6 bytes) 000167[0] 1734430940.379678 read 0x06a000 thru 0x06d2a1 (0x32a2 bytes) 000171[1] 1734430940.450986 trunc from 0x86c58f to 0x4a662f (0x3c5f5f bytes) 000173[0] 1734430940.494327 mapread 0x15a000 thru 0x1696f4 (0xf6f5 bytes) 000175[1] 1734430940.548833 trunc from 0x4a6630 to 0x71e3e6 (0x277db7 bytes) 000176[1] 1734430940.585684 mapwrite 0x3bc000 thru 0x3c39ec (0x79ed bytes) 000177[1] 1734430940.686210 trunc from 0x71e3e7 to 0x3a59a4 (0x378a42 bytes) 000179[0] 1734430940.709111 mapread 0x242000 thru 0x249a8b (0x7a8c bytes) 000184[0] 1734430940.751056 mapwrite 0x6ca000 thru 0x6caae8 (0xae9 bytes) 000188[0] 1734430940.839843 write 0x39c000 thru 0x3a4d72 (0x8d73 bytes) 000189[0] 1734430940.844664 write 0x833000 thru 0x842b2f (0xfb30 bytes) 000192[1] 1734430940.860630 mapwrite 0x135000 thru 0x138246 (0x3247 bytes) 000195[1] 1734430940.958410 read 0x44b000 thru 0x44c542 (0x1543 bytes) 000202[0] 1734430941.051050 mapread 0x246000 thru 0x24b5e3 (0x55e4 bytes) 000203[0] 1734430941.107054 read 0x2ae000 thru 0x2b2ed7 (0x4ed8 bytes) 000206[1] 1734430941.177813 mapread 0x6c0000 thru 0x6c420c (0x420d bytes) 000208[0] 1734430941.187714 read 0x09c000 thru 0x09d1a0 (0x11a1 bytes) 000209[0] 1734430941.187987 trunc from 0x842b30 to 0x8b5ca1 (0x73172 bytes) 000212[0] 1734430941.228732 read 0x3fa000 thru 0x402155 (0x8156 bytes) 000213[0] 1734430941.332099 trunc from 0x8b5ca2 to 0x594c6c (0x321035 bytes) 000216[0] 1734430941.374959 write 0x7ff000 thru 0x80582d (0x682e bytes) 000218[1] 1734430941.391849 mapwrite 0x15a000 thru 0x1684ce (0xe4cf bytes) 000221[0] 1734430941.483339 mapwrite 0x617000 thru 0x620513 (0x9514 bytes) 000222[1] 1734430941.569666 read 0x791000 thru 0x79a6cd (0x96ce bytes) 000223[0] 1734430941.633346 mapwrite 0x3a9000 thru 0x3ad048 (0x4049 bytes) 000224[0] 1734430941.715085 write 0x46d000 thru 0x47b5dd (0xe5de bytes) 000226[0] 1734430941.721561 read 0x75d000 thru 0x7684fc (0xb4fd bytes) 000227[1] 1734430941.794189 write 0x4f2000 thru 0x4f7efd (0x5efe bytes) 000229[1] 1734430941.825820 write 0x1c0000 thru 0x1c6dcc (0x6dcd bytes) 000230[0] 1734430941.836054 write 0x0a8000 thru 0x0ae2d0 (0x62d1 bytes) 000237[0] 1734430941.899757 mapread 0x6da000 thru 0x6e8b98 (0xeb99 bytes) 000241[1] 1734430941.995351 write 0x737000 thru 0x742fc4 (0xbfc5 bytes) 000243[1] 1734430942.019231 mapwrite 0x0bc000 thru 0x0c34b1 (0x74b2 bytes) 000244[0] 1734430942.099380 write 0x632000 thru 0x63bf47 (0x9f48 bytes) 000245[0] 1734430942.114872 mapread 0x044000 thru 0x04f30e (0xb30f bytes) 000246[0] 1734430942.164998 trunc from 0x80582e to 0x7247d5 (0xe1058 bytes) 000248[1] 1734430942.197340 mapwrite 0x1c5000 thru 0x1c6eb4 (0x1eb5 bytes) 000249[1] 1734430942.271027 mapwrite 0x826000 thru 0x82c802 (0x6803 bytes) 000251[0] 1734430942.328943 read 0x39c000 thru 0x3a8dd2 (0xcdd3 bytes) 000252[1] 1734430942.395176 mapwrite 0x523000 thru 0x52efdb (0xbfdc bytes) 000254[1] 1734430942.508436 trunc from 0x82c803 to 0x5ba9af (0x271e53 bytes) 000255[0] 1734430942.520992 mapwrite 0x7ad000 thru 0x7ae4f8 (0x14f9 bytes) 000257[1] 1734430942.622272 read 0x02f000 thru 0x0379e1 (0x89e2 bytes) 000258[0] 1734430942.687830 mapwrite 0x2e7000 thru 0x2e9d51 (0x2d52 bytes) 000259[0] 1734430942.745473 mapwrite 0x0eb000 thru 0x0f7f8d (0xcf8e bytes) 000262[0] 1734430942.822746 write 0x036000 thru 0x03b7e8 (0x57e9 bytes) 000263[1] 1734430942.841988 mapwrite 0x780000 thru 0x78632f (0x6330 bytes) 000264[1] 1734430942.926941 mapwrite 0x4bc000 thru 0x4c0e95 (0x4e96 bytes) 000265[1] 1734430942.989400 mapwrite 0x392000 thru 0x395f9d (0x3f9e bytes) 000266[1] 1734430943.030652 read 0x523000 thru 0x52398f (0x990 bytes) 000268[1] 1734430943.108989 trunc from 0x7ae4f9 to 0x7e5aed (0x375f5 bytes) 000269[0] 1734430943.118620 read 0x2be000 thru 0x2ccfad (0xefae bytes) 000270[0] 1734430943.205304 read 0x739000 thru 0x73c8d4 (0x38d5 bytes) 000273[0] 1734430943.207552 read 0x4e5000 thru 0x4ebf6e (0x6f6f bytes) 000277[1] 1734430943.210254 mapread 0x601000 thru 0x60a3ab (0x93ac bytes) 000280[1] 1734430943.251000 mapread 0x369000 thru 0x373357 (0xa358 bytes) 000281[0] 1734430943.281755 read 0x0b0000 thru 0x0bcba9 (0xcbaa bytes) 000282[0] 1734430943.282056 mapwrite 0x632000 thru 0x638c23 (0x6c24 bytes) 000285[1] 1734430943.429636 mapread 0x4e4000 thru 0x4e681d (0x281e bytes) 000286[1] 1734430943.455202 mapread 0x780000 thru 0x783750 (0x3751 bytes) 000287[1] 1734430943.467986 read 0x64c000 thru 0x65b84e (0xf84f bytes) 000288[1] 1734430943.523709 trunc from 0x7e5aee to 0x5e2b85 (0x202f68 bytes) 000291[1] 1734430943.583568 mapread 0x3b4000 thru 0x3c20ae (0xe0af bytes) 000294[0] 1734430943.651409 write 0x511000 thru 0x5118e6 (0x8e7 bytes) 000295[0] 1734430943.659197 mapwrite 0x9f6000 thru 0x9faa46 (0x4a47 bytes) 000297[1] 1734430943.741198 trunc from 0x9faa47 to 0x3426d1 (0x6b8375 bytes) 000299[0] 1734430943.761037 trunc from 0x3426d2 to 0x7c2bc6 (0x4804f5 bytes) 000300[1] 1734430943.783506 mapwrite 0x420000 thru 0x426ab1 (0x6ab2 bytes) 000301[0] 1734430943.853788 read 0x651000 thru 0x651b76 (0xb77 bytes) 000302[1] 1734430943.900288 trunc from 0x7c2bc7 to 0x4bb509 (0x3076bd bytes) 000306[1] 1734430943.940986 trunc from 0x4bb50a to 0x5c7401 (0x10bef8 bytes) 000307[0] 1734430943.949067 read 0x596000 thru 0x597ff5 (0x1ff6 bytes) 000308[1] 1734430944.000684 write 0x33d000 thru 0x347cd5 (0xacd6 bytes) 000310[1] 1734430944.030536 mapwrite 0x744000 thru 0x745aa4 (0x1aa5 bytes) 000313[0] 1734430944.110847 mapwrite 0x650000 thru 0x65977d (0x977e bytes) 000315[0] 1734430944.197668 mapwrite 0x5e1000 thru 0x5eca29 (0xba2a bytes) 000317[0] 1734430944.232761 mapwrite 0x2dc000 thru 0x2e8012 (0xc013 bytes) 000318[1] 1734430944.324571 read 0x5ab000 thru 0x5b97dd (0xe7de bytes) 000319[0] 1734430944.375395 read 0x0bc000 thru 0x0c6e45 (0xae46 bytes) 000323[0] 1734430944.413872 mapwrite 0x5af000 thru 0x5af48e (0x48f bytes) 000325[0] 1734430944.455718 mapwrite 0x020000 thru 0x029757 (0x9758 bytes) 000326[0] 1734430944.508263 mapread 0x078000 thru 0x07ff61 (0x7f62 bytes) 000327[1] 1734430944.533686 mapread 0x394000 thru 0x3a0722 (0xc723 bytes) 000329[0] 1734430944.564105 trunc from 0x745aa5 to 0x64030b (0x105799 bytes) 000332[0] 1734430944.578177 mapread 0x39a000 thru 0x3a1d63 (0x7d64 bytes) 000333[1] 1734430944.602040 mapread 0x17f000 thru 0x18734a (0x834b bytes) 000336[0] 1734430944.646458 trunc from 0x64030c to 0x52a9a1 (0x11596a bytes) 000340[1] 1734430944.679507 mapwrite 0x6a8000 thru 0x6b6559 (0xe55a bytes) 000341[0] 1734430944.767243 read 0x486000 thru 0x48a8ad (0x48ae bytes) 000342[1] 1734430944.822850 mapwrite 0x336000 thru 0x33a0c9 (0x40ca bytes) 000344[1] 1734430944.919659 write 0x333000 thru 0x342ee6 (0xfee7 bytes) 000345[0] 1734430944.922586 trunc from 0x6b655a to 0x850d19 (0x19a7c0 bytes) 000346[1] 1734430944.957838 trunc from 0x850d1a to 0x142e17 (0x70df02 bytes) 000348[1] 1734430944.994182 write 0x053000 thru 0x0550a2 (0x20a3 bytes) 000349[0] 1734430944.999557 write 0x3f4000 thru 0x3fc4dc (0x84dd bytes) 000350[0] 1734430945.006795 trunc from 0x3fc4dd to 0x6b43d3 (0x2b7ef7 bytes) 000351[1] 1734430945.016767 trunc from 0x6b43d4 to 0x671c7e (0x42755 bytes) 000352[1] 1734430945.038243 write 0x7bb000 thru 0x7c9c93 (0xec94 bytes) 000354[1] 1734430945.049076 write 0x673000 thru 0x67ba11 (0x8a12 bytes) 000355[0] 1734430945.065132 read 0x7b1000 thru 0x7b1f4b (0xf4c bytes) 000356[0] 1734430945.101040 write 0x9c6000 thru 0x9cf2a1 (0x92a2 bytes) 000358[0] 1734430945.161925 trunc from 0x9cf2a2 to 0x3d1bcb (0x5fd6d6 bytes) 000360[1] 1734430945.193210 write 0x5fa000 thru 0x608c8e (0xec8f bytes) 000361[1] 1734430945.210283 mapread 0x03c000 thru 0x047249 (0xb24a bytes) 000362[1] 1734430945.242039 mapread 0x523000 thru 0x52777a (0x477b bytes) 000364[0] 1734430945.278954 mapread 0x4e5000 thru 0x4f3e33 (0xee34 bytes) 000365[0] 1734430945.342455 read 0x36c000 thru 0x374ae0 (0x8ae1 bytes) 000366[1] 1734430945.390035 mapwrite 0x39c000 thru 0x39dd78 (0x1d79 bytes) 000367[0] 1734430945.445343 read 0x5d5000 thru 0x5e2f10 (0xdf11 bytes) 000368[0] 1734430945.498812 read 0x44e000 thru 0x450076 (0x2077 bytes) 000371[0] 1734430945.502236 mapwrite 0x6f6000 thru 0x700300 (0xa301 bytes) 000373[0] 1734430945.596077 mapread 0x276000 thru 0x279f2b (0x3f2c bytes) 000374[0] 1734430945.613322 mapread 0x0b5000 thru 0x0bea09 (0x9a0a bytes) 000376[1] 1734430945.619258 mapwrite 0x85d000 thru 0x8692f7 (0xc2f8 bytes) 000379[0] 1734430945.709101 write 0x97b000 thru 0x983341 (0x8342 bytes) 000381[1] 1734430945.725587 mapwrite 0x6b2000 thru 0x6bf780 (0xd781 bytes) 000384[0] 1734430945.813935 mapread 0x051000 thru 0x05b480 (0xa481 bytes) 000386[1] 1734430945.874033 mapwrite 0x38f000 thru 0x39d5b6 (0xe5b7 bytes) 000387[0] 1734430945.946076 mapread 0x5ea000 thru 0x5f31f3 (0x91f4 bytes) 000388[1] 1734430945.990806 trunc from 0x983342 to 0x42a843 (0x558afe bytes) 000390[0] 1734430946.021834 write 0x672000 thru 0x67c284 (0xa285 bytes) 000391[1] 1734430946.041275 trunc from 0x67c285 to 0x213fb6 (0x4682ce bytes) 000392[0] 1734430946.061914 write 0x268000 thru 0x26a16d (0x216e bytes) 000393[1] 1734430946.069144 trunc from 0x26a16e to 0x62071b (0x3b65ae bytes) 000395[1] 1734430946.113380 trunc from 0x62071c to 0x6e59f5 (0xc52da bytes) 000396[1] 1734430946.129343 read 0x16c000 thru 0x1705c8 (0x45c9 bytes) 000398[1] 1734430946.190211 mapread 0x4ca000 thru 0x4cb7fc (0x17fd bytes) 000403[0] 1734430946.199520 write 0x02b000 thru 0x034166 (0x9167 bytes) 000406[0] 1734430946.229314 mapwrite 0x6a8000 thru 0x6acffa (0x4ffb bytes) 000408[1] 1734430946.277604 write 0x8f3000 thru 0x8f4ab5 (0x1ab6 bytes) 000409[0] 1734430946.291717 mapread 0x6f7000 thru 0x6f7b1a (0xb1b bytes) 000411[0] 1734430946.304163 mapwrite 0x6b9000 thru 0x6c1e0a (0x8e0b bytes) 000414[1] 1734430946.387786 trunc from 0x8f4ab6 to 0x57cf02 (0x377bb3 bytes) 000415[0] 1734430946.410947 mapwrite 0x87d000 thru 0x87d587 (0x588 bytes) 000416[0] 1734430946.459640 trunc from 0x87d588 to 0x316f35 (0x566652 bytes) 000417[0] 1734430946.471644 mapwrite 0x697000 thru 0x69f0ea (0x80eb bytes) 000418[0] 1734430946.548140 mapwrite 0x7a3000 thru 0x7a441b (0x141c bytes) 000419[1] 1734430946.612460 write 0x323000 thru 0x329d08 (0x6d09 bytes) 000421[0] 1734430946.650199 mapwrite 0x281000 thru 0x285269 (0x426a bytes) 000422[1] 1734430946.729076 trunc from 0x7a441c to 0x0fd00a (0x6a7411 bytes) 000423[0] 1734430946.748073 write 0x4fc000 thru 0x500ca3 (0x4ca4 bytes) 000426[1] 1734430946.773689 mapwrite 0x128000 thru 0x136cdc (0xecdd bytes) 000429[0] 1734430946.906167 mapwrite 0x074000 thru 0x079f7f (0x5f80 bytes) 000434[1] 1734430946.986809 read 0x06d000 thru 0x077b36 (0xab37 bytes) 000437[1] 1734430947.015642 mapread 0x336000 thru 0x343bf7 (0xdbf8 bytes) 000438[0] 1734430947.015995 mapwrite 0x714000 thru 0x7232e4 (0xf2e5 bytes) 000440[0] 1734430947.124857 mapread 0x0ce000 thru 0x0d4730 (0x6731 bytes) 000442[0] 1734430947.158009 trunc from 0x7232e5 to 0x2a579e (0x47db46 bytes) 000446[0] 1734430947.191055 mapread 0x131000 thru 0x1359b0 (0x49b1 bytes) 000447[0] 1734430947.204373 mapwrite 0x2ba000 thru 0x2bd259 (0x325a bytes) 000449[0] 1734430947.267752 mapread 0x0bc000 thru 0x0ca75e (0xe75f bytes) 000451[0] 1734430947.337073 mapread 0x022000 thru 0x027530 (0x5531 bytes) 000454[1] 1734430947.366960 read 0x1e6000 thru 0x1e9946 (0x3947 bytes) 000460[1] 1734430947.399735 read 0x2bb000 thru 0x2bb3be (0x3bf bytes) 000462[0] 1734430947.400224 mapread 0x186000 thru 0x1893a0 (0x33a1 bytes) 000464[1] 1734430947.407679 mapread 0x1f6000 thru 0x1fd944 (0x7945 bytes) 000465[1] 1734430947.408086 read 0x17f000 thru 0x18742d (0x842e bytes) 000466[1] 1734430947.408332 read 0x11c000 thru 0x11f688 (0x3689 bytes) 000468[1] 1734430947.408708 trunc from 0x2bd25a to 0x755313 (0x4980ba bytes) 000469[0] 1734430947.444221 write 0x5ca000 thru 0x5d0212 (0x6213 bytes) 000471[1] 1734430947.461407 mapwrite 0x941000 thru 0x9500b6 (0xf0b7 bytes) 000473[1] 1734430947.642363 write 0x201000 thru 0x2074cc (0x64cd bytes) 000474[0] 1734430947.643680 mapread 0x275000 thru 0x279785 (0x4786 bytes) 000475[0] 1734430947.684997 mapwrite 0x248000 thru 0x255a40 (0xda41 bytes) 000477[0] 1734430947.759655 trunc from 0x9500b7 to 0x6bb354 (0x294d62 bytes) 000486[0] 1734430947.801502 read 0x206000 thru 0x20ac9c (0x4c9d bytes) 000488[0] 1734430947.852871 mapwrite 0x40c000 thru 0x4134af (0x74b0 bytes) 000489[0] 1734430947.883384 write 0x6ae000 thru 0x6bad09 (0xcd0a bytes) 000490[1] 1734430947.884214 mapread 0x681000 thru 0x683131 (0x2132 bytes) 000491[1] 1734430947.914688 trunc from 0x6bb355 to 0x469c91 (0x2516c3 bytes) 000497[0] 1734430947.959756 trunc from 0x469c92 to 0x0c4b5d (0x3a5134 bytes) 000498[0] 1734430947.976374 write 0x03e000 thru 0x043f8c (0x5f8d bytes) 000500[0] 1734430947.989014 mapwrite 0x391000 thru 0x394701 (0x3702 bytes) All operations completed A-OK! PASS 16a (27s) == sanityn test 16b: 500 iterations of dual-mount fsx at small size ========================================================== 05:22:29 (1734430949) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.229482 s, 36.6 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.208217 s, 40.3 MB/s Chance of close/open is 1 in 50 Seed set to 950 fd 0: /mnt/lustre/f16b.sanityn fd 1: /mnt/lustre2/f16b.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000008[1] 1734430951.214669 mapwrite 0x2f28b7 thru 0x2f4443 (0x1b8d bytes) 000009[1] 1734430951.315585 mapwrite 0x03abbe thru 0x03c6ca (0x1b0d bytes) 000010[1] 1734430951.381225 mapwrite 0x7cff62 thru 0x7d03be (0x45d bytes) 000013[1] 1734430951.478531 read 0x0c913a thru 0x0c9406 (0x2cd bytes) truncating to largest ever: 0x3e987e 000014[1] 1734430951.495759 trunc from 0x7d03bf to 0x3e987d (0x3e6b41 bytes) 000015[1] 1734430951.521363 read 0x298af4 thru 0x298c65 (0x172 bytes) 000016[0] 1734430951.615358 mapread 0x3a0e86 thru 0x3a1aef (0xc6a bytes) 000017[1] 1734430951.643976 mapwrite 0x2f730b thru 0x2f7386 (0x7c bytes) truncating to largest ever: 0x850149 000019[0] 1734430951.697865 trunc from 0x3e987e to 0x850148 (0x4668cb bytes) 000021[0] 1734430951.724830 mapread 0x81f124 thru 0x820c6c (0x1b49 bytes) 000023[0] 1734430951.758310 trunc from 0x850149 to 0x5085de (0x347b6a bytes) 000025[0] 1734430951.779117 write 0x843e70 thru 0x845d22 (0x1eb3 bytes) truncating to largest ever: 0x99858e 000027[1] 1734430951.791037 trunc from 0x845d23 to 0x99858d (0x15286b bytes) 000030[1] 1734430951.871692 trunc from 0x99858e to 0x179cd9 (0x81e8b4 bytes) 000031[1] 1734430951.886476 trunc from 0x179cda to 0x7f6d1e (0x67d045 bytes) 000033[1] 1734430951.918962 mapwrite 0x31b080 thru 0x31ba2c (0x9ad bytes) 000035[1] 1734430951.994946 write 0x5d12c1 thru 0x5d1ef1 (0xc31 bytes) 000036[1] 1734430952.043529 mapread 0x79d225 thru 0x79d332 (0x10e bytes) 000037[1] 1734430952.049291 mapwrite 0x888016 thru 0x8893c2 (0x13ad bytes) 000038[1] 1734430952.110809 mapwrite 0x0c90f9 thru 0x0c9ef0 (0xdf8 bytes) 000040[1] 1734430952.163455 mapwrite 0x655b77 thru 0x655f18 (0x3a2 bytes) 000042[1] 1734430952.223951 read 0x07d1c0 thru 0x07eddc (0x1c1d bytes) 000046[0] 1734430952.286849 trunc from 0x8893c3 to 0x19c4e2 (0x6ecee0 bytes) 000050[0] 1734430952.358396 mapread 0x066996 thru 0x067ecd (0x1538 bytes) 000053[0] 1734430952.381336 mapwrite 0x8c31db thru 0x8c4a4b (0x1871 bytes) 000057[1] 1734430952.472823 mapread 0x1e5085 thru 0x1e53a6 (0x322 bytes) 000058[1] 1734430952.502648 read 0x757a8a thru 0x758489 (0xa00 bytes) 000059[0] 1734430952.561649 mapwrite 0x3de065 thru 0x3df640 (0x15dc bytes) 000060[1] 1734430952.638823 mapwrite 0x295572 thru 0x295e3e (0x8cd bytes) 000061[1] 1734430952.685006 mapread 0x0f90b8 thru 0x0f9602 (0x54b bytes) 000062[1] 1734430952.689685 mapwrite 0x5fb31a thru 0x5fc20d (0xef4 bytes) 000063[0] 1734430952.757151 trunc from 0x8c4a4c to 0x004def (0x8bfc5c bytes) 000067[0] 1734430952.825508 trunc from 0x004df0 to 0x84d8c2 (0x848ad3 bytes) 000068[1] 1734430952.850666 mapread 0x370e33 thru 0x372046 (0x1214 bytes) 000072[0] 1734430952.913052 trunc from 0x84d8c3 to 0x33fd72 (0x50db50 bytes) 000074[1] 1734430952.955664 mapread 0x260e6e thru 0x261a9a (0xc2d bytes) 000079[1] 1734430952.988061 read 0x14791f thru 0x148c5d (0x133f bytes) 000080[0] 1734430953.040538 write 0x371cb5 thru 0x372a7c (0xdc8 bytes) 000083[0] 1734430953.070334 write 0x11ec1f thru 0x11febf (0x12a1 bytes) 000084[0] 1734430953.077222 mapwrite 0x9e022b thru 0x9e106b (0xe41 bytes) 000086[0] 1734430953.145934 mapread 0x2e64a8 thru 0x2e68dc (0x435 bytes) 000088[1] 1734430953.153679 read 0x871e4e thru 0x872efd (0x10b0 bytes) 000090[1] 1734430953.211965 mapwrite 0x6933cc thru 0x6942e9 (0xf1e bytes) 000093[1] 1734430953.333329 read 0x7dab04 thru 0x7dc185 (0x1682 bytes) 000095[1] 1734430953.347827 mapwrite 0x9c8a3a thru 0x9c9d2b (0x12f2 bytes) 000097[1] 1734430953.440557 trunc from 0x9e106c to 0x16e0f6 (0x872f75 bytes) 000098[1] 1734430953.461567 read 0x0fabb3 thru 0x0fb71a (0xb68 bytes) 000100[0] 1734430953.471188 read 0x0f0418 thru 0x0f1432 (0x101b bytes) 000103[1] 1734430953.497711 write 0x45d785 thru 0x45da8d (0x309 bytes) 000105[0] 1734430953.517814 read 0x3276d4 thru 0x328589 (0xeb6 bytes) 000106[0] 1734430953.560625 mapwrite 0x9abb28 thru 0x9ad465 (0x193e bytes) 000107[0] 1734430953.696967 mapread 0x9910eb thru 0x991db8 (0xcce bytes) 000109[0] 1734430953.705696 trunc from 0x9ad466 to 0x289a3a (0x723a2b bytes) 000110[1] 1734430953.723766 write 0x44f6e9 thru 0x450c39 (0x1551 bytes) truncating to largest ever: 0x9da0c9 000111[1] 1734430953.738925 trunc from 0x450c3a to 0x9da0c8 (0x58948f bytes) 000113[1] 1734430953.776740 read 0x343fb7 thru 0x344dba (0xe04 bytes) 000114[0] 1734430953.813265 read 0x3f8061 thru 0x3f9279 (0x1219 bytes) 000117[1] 1734430953.880996 mapwrite 0x1bdfa2 thru 0x1be624 (0x683 bytes) 000118[1] 1734430953.951197 read 0x5fee79 thru 0x5feec8 (0x50 bytes) 000120[1] 1734430953.966006 mapwrite 0x642389 thru 0x642681 (0x2f9 bytes) 000121[1] 1734430954.006621 write 0x79dd88 thru 0x79e85f (0xad8 bytes) 000122[1] 1734430954.016662 read 0x50c992 thru 0x50e84a (0x1eb9 bytes) 000127[1] 1734430954.042149 trunc from 0x9da0c9 to 0x0d4a7a (0x90564e bytes) 000129[0] 1734430954.055337 trunc from 0x0d4a7b to 0x5dd70a (0x508c90 bytes) 000130[1] 1734430954.074676 trunc from 0x5dd70b to 0x1aee92 (0x42e878 bytes) 000131[1] 1734430954.095841 read 0x0e543f thru 0x0e6e30 (0x19f2 bytes) 000140[0] 1734430954.173088 mapread 0x144676 thru 0x145942 (0x12cd bytes) 000141[1] 1734430954.194792 mapread 0x1332f6 thru 0x13461f (0x132a bytes) 000143[1] 1734430954.207075 mapread 0x03c38a thru 0x03df51 (0x1bc8 bytes) 000144[1] 1734430954.213307 write 0x429613 thru 0x42a6fb (0x10e9 bytes) 000148[1] 1734430954.229685 trunc from 0x42a6fc to 0x0714ff (0x3b91fc bytes) 000149[0] 1734430954.254178 write 0x0d6389 thru 0x0d6683 (0x2fb bytes) 000150[0] 1734430954.272536 mapread 0x06de38 thru 0x06e01f (0x1e8 bytes) 000153[0] 1734430954.315264 read 0x0ac2e9 thru 0x0adb06 (0x181e bytes) 000154[0] 1734430954.340559 read 0x00b864 thru 0x00c88d (0x102a bytes) 000155[0] 1734430954.352184 write 0x70a12a thru 0x70a876 (0x74d bytes) 000157[0] 1734430954.375356 mapread 0x0d65bb thru 0x0d7e5c (0x18a2 bytes) 000158[1] 1734430954.378601 trunc from 0x70a877 to 0x8dcef8 (0x1d2682 bytes) 000160[0] 1734430954.411137 write 0x5f6a33 thru 0x5f6fd9 (0x5a7 bytes) 000164[0] 1734430954.442201 read 0x6e459f thru 0x6e4f02 (0x964 bytes) 000165[0] 1734430954.452855 write 0x6e122c thru 0x6e14ff (0x2d4 bytes) 000167[1] 1734430954.466466 mapread 0x735391 thru 0x737146 (0x1db6 bytes) 000168[1] 1734430954.530349 mapread 0x581382 thru 0x58231b (0xf9a bytes) 000169[0] 1734430954.531222 mapwrite 0x1b6a81 thru 0x1b7900 (0xe80 bytes) 000171[0] 1734430954.617120 trunc from 0x8dcef9 to 0x40d432 (0x4cfac6 bytes) 000174[1] 1734430954.664462 mapread 0x0b71a9 thru 0x0b84dc (0x1334 bytes) 000176[1] 1734430954.689533 trunc from 0x40d433 to 0x6ba58f (0x2ad15d bytes) 000178[0] 1734430954.720671 mapread 0x0ac058 thru 0x0ac082 (0x2b bytes) 000179[1] 1734430954.737210 mapwrite 0x0f33a5 thru 0x0f4210 (0xe6c bytes) 000180[1] 1734430954.779181 mapwrite 0x1bd196 thru 0x1be0fe (0xf69 bytes) 000181[0] 1734430954.816908 write 0x8db10f thru 0x8dba5a (0x94c bytes) 000183[0] 1734430954.839557 mapwrite 0x13dbe1 thru 0x13f557 (0x1977 bytes) 000187[0] 1734430954.927515 mapread 0x0b7052 thru 0x0b8cf6 (0x1ca5 bytes) 000191[1] 1734430954.967251 write 0x4d2b58 thru 0x4d3017 (0x4c0 bytes) 000192[1] 1734430954.978416 mapread 0x658e48 thru 0x659756 (0x90f bytes) 000195[0] 1734430955.003164 trunc from 0x8dba5b to 0x85c4e6 (0x7f574 bytes) 000198[0] 1734430955.021331 mapread 0x72e9eb thru 0x7303bd (0x19d3 bytes) 000199[0] 1734430955.058138 trunc from 0x85c4e7 to 0x5b0b9d (0x2ab949 bytes) 000201[1] 1734430955.082981 trunc from 0x5b0b9e to 0x6b1c04 (0x101067 bytes) 000202[1] 1734430955.101829 mapwrite 0x618739 thru 0x6194d3 (0xd9b bytes) 000204[1] 1734430955.147779 mapwrite 0x12943a thru 0x129adb (0x6a2 bytes) 000207[0] 1734430955.208561 mapread 0x4b8cf0 thru 0x4b9497 (0x7a8 bytes) 000209[0] 1734430955.236291 mapwrite 0x921f05 thru 0x922142 (0x23e bytes) 000211[0] 1734430955.313568 mapwrite 0x8511d1 thru 0x852894 (0x16c4 bytes) 000213[1] 1734430955.359587 mapwrite 0x5217e9 thru 0x5233b5 (0x1bcd bytes) 000215[1] 1734430955.430503 write 0x1e74c7 thru 0x1e8c51 (0x178b bytes) 000217[0] 1734430955.462993 mapread 0x3150cc thru 0x315977 (0x8ac bytes) 000219[0] 1734430955.498215 trunc from 0x922143 to 0x0498d8 (0x8d886a bytes) 000220[0] 1734430955.520768 write 0x579e49 thru 0x57a41c (0x5d4 bytes) 000222[1] 1734430955.530933 read 0x3a1a16 thru 0x3a2f55 (0x1540 bytes) 000223[0] 1734430955.564556 write 0x1b797b thru 0x1b81ca (0x850 bytes) 000226[0] 1734430955.608825 trunc from 0x57a41d to 0x541d96 (0x38686 bytes) 000227[1] 1734430955.623204 trunc from 0x541d97 to 0x9b528f (0x4734f9 bytes) 000231[0] 1734430955.658724 trunc from 0x9b5290 to 0x0eadfe (0x8ca491 bytes) 000241[0] 1734430955.712059 trunc from 0x0eadff to 0x81ae32 (0x730034 bytes) 000242[1] 1734430955.729206 write 0x9dc05e thru 0x9dc0d1 (0x74 bytes) 000243[0] 1734430955.738605 mapwrite 0x876a79 thru 0x8771c8 (0x750 bytes) 000244[0] 1734430955.802269 mapread 0x7d9898 thru 0x7da2cc (0xa35 bytes) 000245[0] 1734430955.809293 mapread 0x002a37 thru 0x003e7b (0x1445 bytes) 000247[0] 1734430955.824010 read 0x4c48e5 thru 0x4c5253 (0x96f bytes) 000249[0] 1734430955.853750 mapread 0x6ab606 thru 0x6ace5c (0x1857 bytes) 000250[0] 1734430955.876087 mapread 0x4ff7d8 thru 0x500018 (0x841 bytes) 000255[0] 1734430955.896586 mapwrite 0x70ef44 thru 0x70f0d4 (0x191 bytes) 000256[1] 1734430955.938091 mapread 0x934db6 thru 0x93679e (0x19e9 bytes) 000259[0] 1734430956.000190 trunc from 0x9dc0d2 to 0x66eb60 (0x36d571 bytes) 000261[0] 1734430956.038079 read 0x278eb3 thru 0x27a569 (0x16b7 bytes) 000264[1] 1734430956.084673 write 0x41183b thru 0x411a19 (0x1df bytes) 000265[1] 1734430956.119760 read 0x52b3d1 thru 0x52c780 (0x13b0 bytes) 000267[0] 1734430956.130680 mapwrite 0x7a1a71 thru 0x7a3365 (0x18f5 bytes) 000268[0] 1734430956.205460 mapwrite 0x94228b thru 0x943f28 (0x1c9e bytes) 000270[0] 1734430956.281278 write 0x6cc0ed thru 0x6cc31e (0x232 bytes) 000272[1] 1734430956.282283 mapwrite 0x804cb5 thru 0x80698d (0x1cd9 bytes) 000273[1] 1734430956.370824 mapread 0x758448 thru 0x7594bf (0x1078 bytes) 000274[1] 1734430956.414775 mapread 0x163675 thru 0x1647e8 (0x1174 bytes) 000275[0] 1734430956.421786 mapread 0x68cc6d thru 0x68dd9d (0x1131 bytes) 000277[0] 1734430956.446406 mapread 0x5a5127 thru 0x5a6f16 (0x1df0 bytes) 000280[0] 1734430956.482543 read 0x211936 thru 0x213765 (0x1e30 bytes) 000281[0] 1734430956.538201 write 0x32c210 thru 0x32cc77 (0xa68 bytes) 000284[1] 1734430956.586326 mapread 0x88e983 thru 0x88ec7f (0x2fd bytes) 000286[1] 1734430956.606980 mapread 0x11919e thru 0x11a157 (0xfba bytes) 000287[1] 1734430956.613003 mapread 0x607e23 thru 0x6099a7 (0x1b85 bytes) 000288[1] 1734430956.616894 mapread 0x1d32e8 thru 0x1d4c98 (0x19b1 bytes) 000290[1] 1734430956.623405 write 0x10162b thru 0x101b7c (0x552 bytes) 000291[1] 1734430956.649670 mapread 0x5940c5 thru 0x594c07 (0xb43 bytes) 000292[0] 1734430956.659013 mapread 0x56a4ba thru 0x56b1a7 (0xcee bytes) 000293[0] 1734430956.670396 trunc from 0x943f29 to 0x783cf1 (0x1c0237 bytes) 000294[0] 1734430956.709857 write 0x6e7e0e thru 0x6e982f (0x1a22 bytes) 000295[0] 1734430956.716727 mapwrite 0x9f0aae thru 0x9f0df6 (0x349 bytes) 000297[0] 1734430956.807948 mapread 0x725a02 thru 0x726c9d (0x129c bytes) 000298[1] 1734430956.815573 mapwrite 0x943346 thru 0x9435a6 (0x261 bytes) 000299[1] 1734430956.877197 write 0x3a9218 thru 0x3aa0a4 (0xe8d bytes) 000301[0] 1734430956.909970 write 0x70a961 thru 0x70c0ee (0x178e bytes) 000304[0] 1734430956.945514 trunc from 0x9f0df7 to 0x7768db (0x27a51b bytes) 000311[1] 1734430956.986451 read 0x63f4fe thru 0x63fe66 (0x969 bytes) 000317[1] 1734430957.026241 write 0x92e92e thru 0x93051b (0x1bee bytes) 000318[1] 1734430957.042399 mapwrite 0x5fb636 thru 0x5fc5bf (0xf8a bytes) 000319[1] 1734430957.097302 read 0x6ac8ca thru 0x6ae0f1 (0x1828 bytes) 000322[0] 1734430957.193359 write 0x5fe760 thru 0x5ffa1d (0x12be bytes) 000324[1] 1734430957.223625 read 0x8d1384 thru 0x8d1530 (0x1ad bytes) 000331[0] 1734430957.300333 trunc from 0x93051c to 0x549517 (0x3e7004 bytes) 000333[0] 1734430957.347525 mapread 0x3610fc thru 0x3623c0 (0x12c5 bytes) 000334[1] 1734430957.367590 read 0x352168 thru 0x35353a (0x13d3 bytes) 000335[0] 1734430957.420068 write 0x6f47f8 thru 0x6f5513 (0xd1c bytes) 000337[1] 1734430957.436102 trunc from 0x6f5514 to 0x26b653 (0x489ec0 bytes) 000342[0] 1734430957.528998 mapwrite 0x1ea096 thru 0x1eb6dc (0x1647 bytes) 000343[1] 1734430957.593991 trunc from 0x26b654 to 0x1943e8 (0xd726b bytes) 000344[1] 1734430957.608714 mapread 0x068d9a thru 0x06ac59 (0x1ec0 bytes) 000346[0] 1734430957.633914 mapwrite 0x254fbc thru 0x255ee1 (0xf26 bytes) 000347[1] 1734430957.688476 mapread 0x079ab5 thru 0x07b415 (0x1961 bytes) 000348[1] 1734430957.707058 read 0x201e37 thru 0x203037 (0x1201 bytes) 000349[0] 1734430957.731344 mapread 0x1e85ba thru 0x1e8b01 (0x548 bytes) 000350[0] 1734430957.743691 mapread 0x250c34 thru 0x2529de (0x1dab bytes) 000351[1] 1734430957.756081 mapread 0x1a3918 thru 0x1a5299 (0x1982 bytes) 000353[0] 1734430957.773773 mapwrite 0x642ecc thru 0x6439b7 (0xaec bytes) 000354[1] 1734430957.826289 mapread 0x0240a8 thru 0x025c08 (0x1b61 bytes) 000355[1] 1734430957.865963 mapread 0x419484 thru 0x41a4d8 (0x1055 bytes) 000357[1] 1734430957.900330 trunc from 0x6439b8 to 0x5b43bf (0x8f5f8 bytes) 000358[1] 1734430957.942831 mapwrite 0x833622 thru 0x83461a (0xff9 bytes) 000361[1] 1734430958.017364 mapread 0x0bdcd0 thru 0x0bf196 (0x14c7 bytes) 000362[1] 1734430958.031300 mapread 0x35a15f thru 0x35a57a (0x41c bytes) 000363[1] 1734430958.034229 read 0x746e72 thru 0x748c69 (0x1df8 bytes) 000364[0] 1734430958.034587 mapread 0x7d1e98 thru 0x7d37b1 (0x191a bytes) 000365[1] 1734430958.070546 mapwrite 0x1b7b02 thru 0x1b87e2 (0xce1 bytes) 000366[0] 1734430958.148329 mapwrite 0x851f70 thru 0x8539b1 (0x1a42 bytes) 000367[1] 1734430958.215188 trunc from 0x8539b2 to 0x1ab204 (0x6a87ad bytes) 000368[0] 1734430958.245769 mapwrite 0x54110e thru 0x541983 (0x876 bytes) 000369[0] 1734430958.324343 read 0x05cea4 thru 0x05cf67 (0xc4 bytes) 000372[0] 1734430958.369650 mapwrite 0x78195a thru 0x781e68 (0x50f bytes) 000373[0] 1734430958.462378 mapread 0x77f85d thru 0x780a0f (0x11b3 bytes) 000374[0] 1734430958.465268 write 0x1ce5af thru 0x1ce948 (0x39a bytes) 000375[0] 1734430958.465876 mapwrite 0x21f6c7 thru 0x2204df (0xe19 bytes) 000377[0] 1734430958.507746 mapwrite 0x617d3a thru 0x618380 (0x647 bytes) 000379[1] 1734430958.542672 mapread 0x1635dc thru 0x164845 (0x126a bytes) 000380[0] 1734430958.570159 mapwrite 0x43f3e3 thru 0x43f4a8 (0xc6 bytes) 000383[0] 1734430958.607874 trunc from 0x781e69 to 0x6d573b (0xac72d bytes) 000385[0] 1734430958.639176 trunc from 0x6d573c to 0x7f867c (0x122f41 bytes) 000387[1] 1734430958.659810 write 0x89b95d thru 0x89ca76 (0x111a bytes) 000391[0] 1734430958.696101 write 0x8c256c thru 0x8c390f (0x13a4 bytes) 000395[0] 1734430958.714126 trunc from 0x8c3910 to 0x3467b2 (0x57d15d bytes) 000396[1] 1734430958.733634 write 0x0dbc8b thru 0x0dc2c1 (0x637 bytes) truncating to largest ever: 0x9e2a28 000398[0] 1734430958.762066 trunc from 0x3467b3 to 0x9e2a27 (0x69c275 bytes) 000402[1] 1734430958.795287 mapread 0x11d09e thru 0x11e44a (0x13ad bytes) 000403[0] 1734430958.810518 write 0x5fc0b6 thru 0x5fcd57 (0xca2 bytes) 000404[0] 1734430958.821100 mapread 0x8be332 thru 0x8be7ad (0x47c bytes) 000405[0] 1734430958.846118 write 0x736e65 thru 0x7373bc (0x558 bytes) 000406[0] 1734430958.854354 mapread 0x160e50 thru 0x161a07 (0xbb8 bytes) 000407[0] 1734430958.868599 write 0x3d8e0e thru 0x3d9120 (0x313 bytes) 000409[0] 1734430958.888799 mapread 0x1e42fd thru 0x1e560c (0x1310 bytes) 000411[0] 1734430958.905070 mapwrite 0x537d36 thru 0x539c4a (0x1f15 bytes) 000413[1] 1734430958.952803 read 0x41b58a thru 0x41c12c (0xba3 bytes) 000414[0] 1734430958.972923 write 0x796249 thru 0x797cbf (0x1a77 bytes) 000416[1] 1734430959.004466 trunc from 0x9e2a28 to 0x2213e2 (0x7c1645 bytes) 000418[0] 1734430959.039086 trunc from 0x2213e3 to 0x2445a0 (0x231be bytes) 000420[1] 1734430959.061842 mapread 0x18739a thru 0x188e22 (0x1a89 bytes) 000421[1] 1734430959.096865 write 0x29931a thru 0x299948 (0x62f bytes) 000423[0] 1734430959.115080 mapread 0x0edcfc thru 0x0efcc8 (0x1fcd bytes) 000427[1] 1734430959.151012 mapwrite 0x816184 thru 0x816dc5 (0xc42 bytes) 000431[1] 1734430959.224916 trunc from 0x816dc6 to 0x5cae8a (0x24bf3b bytes) 000432[1] 1734430959.243233 mapwrite 0x0806f9 thru 0x081b35 (0x143d bytes) 000434[0] 1734430959.290665 write 0x6b12ad thru 0x6b148a (0x1de bytes) 000436[0] 1734430959.313558 trunc from 0x6b148b to 0x614596 (0x9cef4 bytes) 000440[0] 1734430959.329809 mapread 0x4a9469 thru 0x4aaac3 (0x165b bytes) 000443[1] 1734430959.344737 read 0x3bcee8 thru 0x3bec33 (0x1d4c bytes) 000444[0] 1734430959.384357 write 0x3d6b02 thru 0x3d8605 (0x1b04 bytes) 000450[0] 1734430959.425217 trunc from 0x614597 to 0x0193ff (0x5fb197 bytes) 000451[0] 1734430959.455537 write 0x057920 thru 0x05901f (0x1700 bytes) 000452[0] 1734430959.458697 mapwrite 0x19e6e6 thru 0x19f99f (0x12ba bytes) 000455[1] 1734430959.518631 write 0x301b27 thru 0x302e03 (0x12dd bytes) 000456[1] 1734430959.533735 write 0x2af382 thru 0x2b10e5 (0x1d64 bytes) 000457[0] 1734430959.548935 mapwrite 0x539af5 thru 0x53aed4 (0x13e0 bytes) 000458[1] 1734430959.602837 mapread 0x420c35 thru 0x4216fe (0xaca bytes) 000459[0] 1734430959.641832 write 0x67f39f thru 0x67f3a7 (0x9 bytes) 000461[1] 1734430959.652119 read 0x3800d4 thru 0x381263 (0x1190 bytes) 000462[0] 1734430959.712390 read 0x325110 thru 0x326fd4 (0x1ec5 bytes) 000463[0] 1734430959.746836 trunc from 0x67f3a8 to 0x2aaef9 (0x3d44ae bytes) truncating to largest ever: 0x9fd88d 000466[1] 1734430959.791690 trunc from 0x2aaefa to 0x9fd88c (0x752993 bytes) 000469[0] 1734430959.835878 mapwrite 0x7dd998 thru 0x7df47c (0x1ae5 bytes) 000471[1] 1734430959.921779 read 0x42cec4 thru 0x42d67c (0x7b9 bytes) 000472[0] 1734430959.973223 trunc from 0x9fd88d to 0x507aed (0x4f5d9f bytes) 000475[0] 1734430960.017903 read 0x19229d thru 0x194176 (0x1eda bytes) 000476[0] 1734430960.065059 mapread 0x1f6cd0 thru 0x1f7324 (0x655 bytes) 000483[1] 1734430960.094403 trunc from 0x507aee to 0x397dba (0x16fd33 bytes) 000486[0] 1734430960.152216 write 0x020221 thru 0x020240 (0x20 bytes) 000487[0] 1734430960.167846 trunc from 0x397dbb to 0x4fb31d (0x163563 bytes) 000500[0] 1734430960.269635 write 0x0966d6 thru 0x097a21 (0x134c bytes) All operations completed A-OK! PASS 16b (12s) == sanityn test 16c: verify data consistency on ldiskfs with cache disabled (b=17397) ========================================================== 05:22:41 (1734430961) SKIP: sanityn test_16c dio on ldiskfs only SKIP 16c (2s) == sanityn test 16d: Verify DIO and buffer IO with two clients ========================================================== 05:22:43 (1734430963) 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.299904 s, 28.0 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.22611 s, 37.1 MB/s ldlm.namespaces.MGC192.168.201.134@tcp.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8800a9871800.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8800aea1a000.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8800a9871800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8800aea1a000.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8800a9871800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8800aea1a000.lru_size=clear 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 6.64107 s, 15.8 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.40442 s, 74.7 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.763542 s, 137 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 2.25345 s, 46.5 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.3814 s, 23.9 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.01087 s, 104 MB/s PASS 16d (21s) == sanityn test 16e: Verify size consistency for O_DIRECT write ========================================================== 05:23:04 (1734430984) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0865151 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0614118 s, 17.1 MB/s PASS 16e (3s) == sanityn test 16f: rw sequential consistency vs drop_caches ========================================================== 05:23:07 (1734430987) TIMEOUT PASS 16f (23s) == sanityn test 16g: mmap rw sequential consistency vs drop_caches ========================================================== 05:23:30 (1734431010) TIMEOUT PASS 16g (23s) == sanityn test 16h: mmap read after truncate file ======= 05:23:53 (1734431033) ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16h (3s) == sanityn test 16i: read after truncate file ============ 05:23:56 (1734431036) ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16i (3s) == sanityn test 16j: race dio with buffered i/o ========== 05:23:59 (1734431039) 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 0.455207 s, 57.6 MB/s bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.355008 s, 73.8 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.97263 s, 27.0 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.191809 s, 137 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.855988 s, 30.6 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.180698 s, 145 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.892096 s, 29.4 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.63642 s, 41.2 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.66144 s, 39.6 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 1.28591 s, 20.4 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 1.31902 s, 19.9 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.288452 s, 90.9 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.401724 s, 65.3 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.981298 s, 26.7 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 1.05657 s, 24.8 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.325332 s, 80.6 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.471746 s, 55.6 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 1.46912 s, 17.8 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 1.49247 s, 17.6 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK PASS 16j (12s) == sanityn test 16k: Parallel FSX and drop caches should not panic ========================================================== 05:24:11 (1734431051) + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.1 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.2 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.3 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.4 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.5 -l 67108864 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x1a7062c fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x232e1d3 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x1a7062c truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x232e1d3 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x32cce75 truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x1a7062c truncating to largest ever: 0x32cce75 truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x3c569db truncating to largest ever: 0x32cce75 truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x32cce75 truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab All operations completed A-OK! + fsx 1 done: rc=0 Tue Dec 17 05:25:01 EST 2024 All operations completed A-OK! All operations completed A-OK! + fsx 2 done: rc=0 Tue Dec 17 05:25:04 EST 2024 All operations completed A-OK! All operations completed A-OK! + fsx 3 done: rc=0 Tue Dec 17 05:25:07 EST 2024 + fsx 4 done: rc=0 Tue Dec 17 05:25:07 EST 2024 + fsx 5 done: rc=0 Tue Dec 17 05:25:07 EST 2024 PASS 16k (58s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 05:25:09 (1734431109) fail_loc=0x8000030a PASS 17 (5s) == sanityn test 18: mmap sanity check =========================================================================================== 05:25:14 (1734431114) mmap test1: basic mmap operation (PASS, 0.055543s) mmap test2: MAP_PRIVATE not write back (PASS, 0.034405s) mmap test3: concurrent mmap ops on two nodes (PASS, 8.1901s) mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 4.2961s) mmap test5: read/write file to/from the buffer which mmapped to just this file (PASS, 0.081327s) mmap test6: check mmap write/read content on two nodes (PASS, 0.10727s) mmap test7: file i/o with an unmapped buffer (SKIPPED, 0s) mmap test8: SIGBUS for beyond file size (SKIPPED, 0s) mmap test9: SIGBUS for negative file offset (SKIPPED, 0s) mmap test10: multi-thread mmap access (PASS, 0.46686s) mmap test11: multi-thread shared mmap (PASS, 0.46408s) mmap test10: mtime not change for readonly mmap access (PASS, 1.0467s) PASS 18 (19s) == sanityn test 19: test concurrent uncached read races ========================================================================= 05:25:33 (1734431133) oleg134-server: error: get_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory pdsh@oleg134-client: oleg134-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (2s) == sanityn test 20: test extra readahead page left in cache ============================================================== 05:25:35 (1734431135) PASS 20 (2s) == sanityn test 21: Try to remove mountpoint on another dir ============================================================== 05:25:37 (1734431137) rmdir: removing directory, '/mnt/lustre/d21.sanityn' rmdir: failed to remove '/mnt/lustre/d21.sanityn': Device or resource busy rmdir: removing directory, '/mnt/lustre2/d21.sanityn' Removed mounted directory from another mountpoint, needs to be fixed PASS 21 (3s) == sanityn test 23: others should see updated atime while another read============================================================== 05:25:40 (1734431140) now is 1734431141 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.6964 new atime is 1734431202 PASS 23 (64s) == sanityn test 24a: lfs df [-ih] [path] test =================================================================================== 05:26:44 (1734431204) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 32768 3736576 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 38912 7499776 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 6144 3763200 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 32768 3736576 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 38912 7499776 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.5K 386 490.1K 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 115.3K 402 114.9K 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 114.5K 398 114.1K 1% /mnt/lustre[OST:1] filesystem_summary: 229.4K 386 229.0K 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.5K 386 490.1K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.3K 402 114.9K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 114.5K 398 114.1K 1% /mnt/lustre2[OST:1] filesystem_summary: 229.4K 386 229.0K 1% /mnt/lustre2 UUID bytes Used Available Use% Mounted on lustre-MDT0000_UUID 2.1G 3.2M 2.1G 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3.6G 6.0M 3.6G 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3.6G 32.0M 3.6G 1% /mnt/lustre[OST:1] filesystem_summary: 7.2G 38.0M 7.2G 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502242 386 501856 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118066 402 117664 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 117230 398 116832 1% /mnt/lustre2[OST:1] filesystem_summary: 234882 386 234496 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 32768 3736576 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 38912 7499776 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.5K 386 490.1K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.3K 402 114.9K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 114.5K 398 114.1K 1% /mnt/lustre2[OST:1] filesystem_summary: 229.4K 386 229.0K 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502242 386 501856 1% /mnt/lustre[MDT:0] filesystem_summary: 502242 386 501856 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502242 386 501856 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118066 402 117664 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 117230 398 116832 1% /mnt/lustre2[OST:1] filesystem_summary: 234882 386 234496 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 32768 3736576 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 38912 7499776 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 6144 3763200 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 32768 3736576 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 38912 7499776 1% /mnt/lustre2 PASS 24a (3s) == sanityn test 24b: lfs df should show both filesystems ========================================================================= 05:26:47 (1734431207) PASS 24b (3s) == sanityn test 25a: change ACL on one mountpoint be seen on another ============================================================= 05:26:50 (1734431210) running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: 500 [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] PASS 25a (3s) == sanityn test 25b: change ACL under remote dir on one mountpoint be seen on another ========================================================== 05:26:53 (1734431213) SKIP: sanityn test_25b needs >= 2 MDTs SKIP 25b (1s) == sanityn test 26a: allow mtime to get older ============ 05:26:54 (1734431214) utime: good mknod times 1734431214 <= 1734431215 <= 1734431215 for /mnt/lustre/f26a utime: good mknod times 1734431214 <= 1734431215 <= 1734431215 for /mnt/lustre2/f26a utime: good utime mtimes 100000, atime 200000 utime: updated times for /mnt/lustre2/f26a PASS 26a (4s) == sanityn test 26b: sync mtime between ost and mds ====== 05:26:58 (1734431218) PASS 26b (4s) == sanityn test 26c: set-in-past on open file is not lost on close ========================================================== 05:27:02 (1734431222) multiop /mnt/lustre/f26c.sanityn vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.6964 File: '/mnt/lustre/f26c.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205272502398 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2024-12-17 05:27:03.000000000 -0500 Birth: - File: '/mnt/lustre2/f26c.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205272502398 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2024-12-17 05:27:03.000000000 -0500 Birth: - PASS 26c (4s) SKIP: sanityn test_27 skipping excluded test 27 SKIP: sanityn test_28 skipping ALWAYS excluded test 28 == sanityn test 30: recreate file race =================== 05:27:07 (1734431227) 0 PASS 30 (4s) == sanityn test 31a: voluntary cancel / blocking ast race======================================================================== 05:27:11 (1734431231) fail_loc=0x314 PASS 31a (3s) == sanityn test 31b: voluntary OST cancel / blocking ast race======================================================================== 05:27:14 (1734431234) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg134-server mds-ost sync done. sleep 5 for ZFS MDS Waiting for MDT destroys to complete fail_loc=0x314 fail_loc=0x316 fail_loc=0 fail_loc=0 Filesystem 1K-blocks Used Available Use% Mounted on 192.168.201.134@tcp:/lustre 7542784 38912 7497728 1% /mnt/lustre2 PASS 31b (12s) == sanityn test 31r: open-rename(replace) race =========== 05:27:27 (1734431247) -rw-r--r-- 1 root root 0 Dec 17 05:27 /mnt/lustre/f31r.sanityn.target fail_loc=0x1419 fail_val=3 mv: failed to access '/mnt/lustre2/f31r.sanityn.target': Input/output error PASS 31r (6s) == sanityn test 31s: open should not revalidate invalid dentry ========================================================== 05:27:32 (1734431252) /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 1213: 13415 Terminated tail -f $tfile PASS 31s (2s) == sanityn test 31t: getattr should not revalidate invalid dentry ========================================================== 05:27:34 (1734431254) PASS 31t (4s) SKIP: sanityn test_33a skipping SLOW test 33a == sanityn test 33b: COS: cross create/delete, 2 clients, benchmark under remote dir ========================================================== 05:27:38 (1734431258) SKIP: sanityn test_33b Need two or more clients, have 1 SKIP 33b (2s) == sanityn test 33c: Cancel cross-MDT lock should trigger Sync-on-Lock-Cancel ========================================================== 05:27:40 (1734431260) SKIP: sanityn test_33c needs >= 2 MDTs SKIP 33c (1s) == sanityn test 33d: dependent transactions should trigger COS ========================================================== 05:27:41 (1734431261) SKIP: sanityn test_33d needs >= 2 MDTs SKIP 33d (1s) == sanityn test 33e: independent transactions shouldn't trigger COS ========================================================== 05:27:42 (1734431262) SKIP: sanityn test_33e needs >= 2 MDTs SKIP 33e (1s) == sanityn test 34: no lock timeout under IO ============= 05:27:43 (1734431263) fail_loc=0x512 fail_loc=0x512 lock should not expire writing on client1 reading on client2 success fail_loc=0x511 fail_loc=0x511 lock should expire writing on client1 reading on client2 success oleg134-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800a9871800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800a9871800.ost_server_uuid in FULL state after 0 sec oleg134-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800a9871800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800a9871800.ost_server_uuid in IDLE state after 0 sec oleg134-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800a9871800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800a9871800.ost_server_uuid in FULL state after 0 sec oleg134-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800a9871800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800a9871800.ost_server_uuid in IDLE state after 0 sec oleg134-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800a9871800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800a9871800.ost_server_uuid in FULL state after 0 sec oleg134-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800a9871800.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800a9871800.ost_server_uuid in IDLE state after 0 sec PASS 34 (93s) == sanityn test 35: -EINTR cp_ast vs. bl_ast race does not evict client ========================================================== 05:29:16 (1734431356) fail_loc=0x80000317 Race attempt 0 Wait for 20054 20195 for 60 sec... - open/close 1662 (time 1734431368.44 total 10.00 last 166.16) - open/close 3348 (time 1734431378.44 total 20.01 last 168.45) total: 4000 open/close in 24.01 seconds: 166.57 ops/second fail_loc=0x0 Filesystem Size Used Avail Use% Mounted on 192.168.201.134@tcp:/lustre 7.2G 39M 7.2G 1% /mnt/lustre 192.168.201.134@tcp:/lustre 7.2G 39M 7.2G 1% /mnt/lustre2 PASS 35 (65s) == sanityn test 36: handle ESTALE/open-unlink correctly == 05:30:21 (1734431421) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg134-server mds-ost sync done. Waiting for MDT destroys to complete 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.525599 s, 99.8 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6964 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(0) *** before(7498752) after_dd(7440384) after(7491584) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.397764 s, 132 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6964 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(1) *** before(7491584) after_dd(7441408) after(7492608) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.488384 s, 107 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6964 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(2) *** before(7492608) after_dd(7443456) after(7494656) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.375271 s, 140 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6964 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(3) *** before(7494656) after_dd(7441408) after(7492608) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.423817 s, 124 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6964 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(4) *** before(7492608) after_dd(7441408) after(7492608) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.313058 s, 167 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6964 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(5) *** before(7492608) after_dd(7445504) after(7496704) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.423937 s, 124 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6964 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(6) *** before(7496704) after_dd(7443456) after(7494656) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.321851 s, 163 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6964 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(7) *** before(7494656) after_dd(7440384) after(7491584) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.403689 s, 130 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6964 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(8) *** before(7491584) after_dd(7443456) after(7494656) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.395345 s, 133 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6964 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(9) *** before(7494656) after_dd(7441408) after(7492608) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.361751 s, 145 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6964 sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete *** cycle(10) *** before(7492608) after_dd(7443456) after(7494656) PASS 36 (227s) == sanityn test 37: check i_size is not updated for directory on close (bug 18695) ======================================================================== 05:34:08 (1734431648) multiop /mnt/lustre/d37.sanityn vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.6964 - create 3924 (time 1734431659.96 total 10.00 last 392.29) - create 7861 (time 1734431669.96 total 20.00 last 393.65) total: 10000 create in 25.28 seconds: 395.58 ops/second PASS 37 (29s) == sanityn test 39a: file mtime does not change after rename ========================================================== 05:34:37 (1734431677) repeat after cancel_lru_locks PASS 39a (2s) == sanityn test 39b: file mtime the same on clients with/out lock ========================================================== 05:34:39 (1734431679) repeat after cancel_lru_locks PASS 39b (4s) == sanityn test 39c: check truncate mtime update ================================================================================ 05:34:43 (1734431683) repeat after cancel_lru_locks PASS 39c (4s) == sanityn test 39d: sync write should update mtime ====== 05:34:47 (1734431687) fail_loc=0x411 fail_loc=0 PASS 39d (3s) == sanityn test 40a: pdirops: create vs others ======================================================================== 05:34:50 (1734431690) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40a (9s) == sanityn test 40b: pdirops: open|create and others ======================================================================== 05:34:59 (1734431699) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40b (10s) == sanityn test 40c: pdirops: link and others ======================================================================== 05:35:09 (1734431709) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40c (9s) == sanityn test 40d: pdirops: unlink and others ======================================================================== 05:35:18 (1734431718) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40d (10s) == sanityn test 40e: pdirops: rename and others ======================================================================== 05:35:29 (1734431729) No conflict No conflict No conflict No conflict No conflict No conflict PASS 40e (10s) == sanityn test 41a: pdirops: create vs mkdir ======================================================================== 05:35:38 (1734431738) mkdir: cannot create directory '/mnt/lustre2/f41a.sanityn': File exists Conflict PASS 41a (6s) == sanityn test 41b: pdirops: create vs create ======================================================================== 05:35:44 (1734431744) open: File exists Conflict PASS 41b (6s) == sanityn test 41c: pdirops: create vs link ======================================================================== 05:35:50 (1734431750) link: cannot create link '/mnt/lustre2/f41c.sanityn' to '/mnt/lustre2/f41c.sanityn-2': File exists Conflict PASS 41c (6s) == sanityn test 41d: pdirops: create vs unlink ======================================================================== 05:35:56 (1734431756) Conflict PASS 41d (6s) == sanityn test 41e: pdirops: create and rename (tgt) ======================================================================== 05:36:02 (1734431762) Conflict PASS 41e (5s) == sanityn test 41f: pdirops: create and rename (src) ======================================================================== 05:36:07 (1734431767) Conflict PASS 41f (5s) == sanityn test 41g: pdirops: create vs getattr ======================================================================== 05:36:13 (1734431773) Conflict PASS 41g (5s) == sanityn test 41h: pdirops: create vs readdir ======================================================================== 05:36:18 (1734431778) Conflict PASS 41h (6s) == sanityn test 41i: reint_open: create vs create ======== 05:36:24 (1734431784) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 41i (678s) == sanityn test 42a: pdirops: mkdir vs mkdir ======================================================================== 05:47:42 (1734432462) mkdir: cannot create directory '/mnt/lustre2/f42a.sanityn': File exists Conflict PASS 42a (4s) == sanityn test 42b: pdirops: mkdir vs create ======================================================================== 05:47:46 (1734432466) open: File exists Conflict PASS 42b (5s) == sanityn test 42c: pdirops: mkdir vs link ======================================================================== 05:47:51 (1734432471) link: cannot create link '/mnt/lustre2/f42c.sanityn' to '/mnt/lustre2/f42c.sanityn-2': File exists Conflict PASS 42c (5s) == sanityn test 42d: pdirops: mkdir vs unlink ======================================================================== 05:47:56 (1734432476) Conflict PASS 42d (4s) == sanityn test 42e: pdirops: mkdir and rename (tgt) ======================================================================== 05:48:00 (1734432480) mv: cannot overwrite directory '/mnt/lustre2/f42e.sanityn' with non-directory Conflict PASS 42e (4s) == sanityn test 42f: pdirops: mkdir and rename (src) ======================================================================== 05:48:05 (1734432485) Conflict PASS 42f (4s) == sanityn test 42g: pdirops: mkdir vs getattr ======================================================================== 05:48:09 (1734432489) Conflict PASS 42g (5s) == sanityn test 42h: pdirops: mkdir vs readdir ======================================================================== 05:48:14 (1734432494) Conflict PASS 42h (4s) == sanityn test 43a: rmdir,mkdir doesn't return -EEXIST ======================================================================== 05:48:18 (1734432498) PASS 43a (17s) == sanityn test 43b: pdirops: unlink vs create ======================================================================== 05:48:35 (1734432515) Conflict PASS 43b (4s) == sanityn test 43c: pdirops: unlink vs link ======================================================================== 05:48:39 (1734432519) Conflict PASS 43c (5s) == sanityn test 43d: pdirops: unlink vs unlink ======================================================================== 05:48:44 (1734432524) rm: cannot remove '/mnt/lustre2/f43d.sanityn': No such file or directory Conflict PASS 43d (5s) == sanityn test 43e: pdirops: unlink and rename (tgt) ======================================================================== 05:48:49 (1734432529) Conflict PASS 43e (4s) == sanityn test 43f: pdirops: unlink and rename (src) ======================================================================== 05:48:53 (1734432533) mv: cannot stat '/mnt/lustre2/f43f.sanityn': No such file or directory Conflict PASS 43f (5s) == sanityn test 43g: pdirops: unlink vs getattr ======================================================================== 05:48:58 (1734432538) stat: cannot stat '/mnt/lustre2/f43g.sanityn': No such file or directory Conflict PASS 43g (5s) == sanityn test 43h: pdirops: unlink vs readdir ======================================================================== 05:49:03 (1734432543) Conflict PASS 43h (5s) == sanityn test 43i: pdirops: unlink vs remote mkdir ===== 05:49:08 (1734432548) SKIP: sanityn test_43i needs >= 2 MDTs SKIP 43i (0s) == sanityn test 43j: racy mkdir return EEXIST ======================================================================== 05:49:09 (1734432549) mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists PASS 43j (41s) == sanityn test 43k: unlink vs create ==================== 05:49:50 (1734432590) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 43k (394s) == sanityn test 44a: pdirops: rename tgt vs mkdir ======================================================================== 05:56:24 (1734432984) mkdir: cannot create directory '/mnt/lustre2/f44a.sanityn': File exists Conflict Tue Dec 17 05:56:28 EST 2024 PASS 44a (5s) == sanityn test 44b: pdirops: rename tgt vs create ======================================================================== 05:56:29 (1734432989) open: File exists Conflict PASS 44b (5s) == sanityn test 44c: pdirops: rename tgt vs link ======================================================================== 05:56:34 (1734432994) link: cannot create link '/mnt/lustre2/f44c.sanityn' to '/mnt/lustre2/f44c.sanityn-3': File exists Conflict PASS 44c (4s) == sanityn test 44d: pdirops: rename tgt vs unlink ======================================================================== 05:56:38 (1734432998) Conflict PASS 44d (5s) == sanityn test 44e: pdirops: rename tgt and rename (tgt) ======================================================================== 05:56:43 (1734433003) Conflict PASS 44e (4s) == sanityn test 44f: pdirops: rename tgt and rename (src) ======================================================================== 05:56:47 (1734433007) Conflict PASS 44f (5s) == sanityn test 44g: pdirops: rename tgt vs getattr ======================================================================== 05:56:52 (1734433012) Conflict PASS 44g (4s) == sanityn test 44h: pdirops: rename tgt vs readdir ======================================================================== 05:56:56 (1734433016) Conflict PASS 44h (5s) == sanityn test 44i: pdirops: rename tgt vs remote mkdir ========================================================== 05:57:01 (1734433021) SKIP: sanityn test_44i needs >= 2 MDTs SKIP 44i (0s) == sanityn test 45a: rename,mkdir doesn't return -EEXIST ======================================================================== 05:57:01 (1734433021) PASS 45a (27s) == sanityn test 45b: pdirops: rename src vs create ======================================================================== 05:57:28 (1734433048) Conflict PASS 45b (5s) == sanityn test 45c: pdirops: rename src vs link ======================================================================== 05:57:33 (1734433053) Conflict PASS 45c (4s) == sanityn test 45d: pdirops: rename src vs unlink ======================================================================== 05:57:37 (1734433057) rm: cannot remove '/mnt/lustre2/f45d.sanityn': No such file or directory Conflict PASS 45d (5s) == sanityn test 45e: pdirops: rename src and rename (tgt) ======================================================================== 05:57:42 (1734433062) Conflict PASS 45e (5s) == sanityn test 45f: pdirops: rename src and rename (src) ======================================================================== 05:57:47 (1734433067) mv: cannot stat '/mnt/lustre2/f45f.sanityn': No such file or directory Conflict PASS 45f (5s) == sanityn test 45g: pdirops: rename src vs getattr ======================================================================== 05:57:52 (1734433072) stat: cannot stat '/mnt/lustre2/f45g.sanityn': No such file or directory Conflict PASS 45g (5s) == sanityn test 45h: pdirops: unlink vs readdir ======================================================================== 05:57:57 (1734433077) Conflict PASS 45h (5s) == sanityn test 45i: pdirops: rename src vs remote mkdir ========================================================== 05:58:02 (1734433082) SKIP: sanityn test_45i needs >= 2 MDTs SKIP 45i (0s) == sanityn test 45j: read vs rename ====================== 05:58:03 (1734433083) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 45j (378s) == sanityn test 46a: pdirops: link vs mkdir ======================================================================== 06:04:21 (1734433461) mkdir: cannot create directory '/mnt/lustre2/f46a.sanityn': File exists Conflict PASS 46a (5s) == sanityn test 46b: pdirops: link vs create ======================================================================== 06:04:26 (1734433466) open: File exists Conflict PASS 46b (4s) == sanityn test 46c: pdirops: link vs link ======================================================================== 06:04:30 (1734433470) link: cannot create link '/mnt/lustre2/f46c.sanityn' to '/mnt/lustre2/f46c.sanityn': File exists Conflict PASS 46c (5s) == sanityn test 46d: pdirops: link vs unlink ======================================================================== 06:04:35 (1734433475) Conflict PASS 46d (4s) == sanityn test 46e: pdirops: link and rename (tgt) ======================================================================== 06:04:39 (1734433479) Conflict PASS 46e (5s) == sanityn test 46f: pdirops: link and rename (src) ======================================================================== 06:04:44 (1734433484) Conflict PASS 46f (4s) == sanityn test 46g: pdirops: link vs getattr ======================================================================== 06:04:48 (1734433488) Conflict PASS 46g (5s) == sanityn test 46h: pdirops: link vs readdir ======================================================================== 06:04:53 (1734433493) Conflict PASS 46h (4s) == sanityn test 46i: pdirops: link vs remote mkdir ======= 06:04:57 (1734433497) SKIP: sanityn test_46i needs >= 2 MDTs SKIP 46i (1s) == sanityn test 47a: pdirops: remote mkdir vs mkdir ====== 06:04:58 (1734433498) SKIP: sanityn test_47a needs >= 2 MDTs SKIP 47a (1s) == sanityn test 47b: pdirops: remote mkdir vs create ===== 06:04:59 (1734433499) SKIP: sanityn test_47b needs >= 2 MDTs SKIP 47b (1s) == sanityn test 47c: pdirops: remote mkdir vs link ======= 06:05:00 (1734433500) SKIP: sanityn test_47c needs >= 2 MDTs SKIP 47c (0s) == sanityn test 47d: pdirops: remote mkdir vs unlink ===== 06:05:00 (1734433500) SKIP: sanityn test_47d needs >= 2 MDTs SKIP 47d (1s) == sanityn test 47e: pdirops: remote mkdir and rename (tgt) ========================================================== 06:05:01 (1734433501) SKIP: sanityn test_47e needs >= 2 MDTs SKIP 47e (1s) == sanityn test 47f: pdirops: remote mkdir and rename (src) ========================================================== 06:05:02 (1734433502) SKIP: sanityn test_47f needs >= 2 MDTs SKIP 47f (0s) == sanityn test 47g: pdirops: remote mkdir vs getattr ==== 06:05:02 (1734433502) SKIP: sanityn test_47g needs >= 2 MDTs SKIP 47g (1s) == sanityn test 50: osc lvb attrs: enqueue vs. CP AST ======================================================================== 06:05:03 (1734433503) 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.00425483 s, 2.4 MB/s fail_loc=0x410 fail_loc=0x0 PASS 50 (7s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 06:05:10 (1734433510) 0+1 records in 0+1 records out 159 bytes (159 B) copied, 0.00304054 s, 52.3 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3518: kill: (31336) - No such process PASS 51a (3s) == sanityn test 51b: layout lock: glimpse should be able to restart if layout changed ========================================================== 06:05:13 (1734433513) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.0020654 s, 496 kB/s fail_loc=0x1404 fail_val=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107662 s, 97.4 MB/s 3145728 PASS 51b (14s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 06:05:27 (1734433527) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00302949 s, 338 kB/s PASS 51c (6s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 06:05:33 (1734433533) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00983118 s, 107 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (2s) == sanityn test 51e: lfs getstripe does not break leases, part 2 ========================================================== 06:05:35 (1734433535) /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2450 0x992 0x280000400 write lease(2) has applied. /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2450 0x992 0x280000400 read lease(1) has applied. PASS 51e (4s) == sanityn test 54: rename locking ======================= 06:05:39 (1734433539) llite.lustre-ffff8800a9871800.xattr_cache=1 llite.lustre-ffff8800aea1a000.xattr_cache=1 ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 512 Blocks: 1 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505012 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-12-17 06:05:39.000000000 -0500 Modify: 2024-12-17 06:05:39.000000000 -0500 Change: 2024-12-17 06:05:39.000000000 -0500 Birth: - ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000154 File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505015 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-12-17 06:05:45.000000000 -0500 Modify: 2024-12-17 06:05:45.000000000 -0500 Change: 2024-12-17 06:05:45.000000000 -0500 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 512 Blocks: 1 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505018 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-12-17 06:05:50.000000000 -0500 Modify: 2024-12-17 06:05:50.000000000 -0500 Change: 2024-12-17 06:05:50.000000000 -0500 Birth: - open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505017 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-12-17 06:05:50.000000000 -0500 Modify: 2024-12-17 06:05:50.000000000 -0500 Change: 2024-12-17 06:05:50.000000000 -0500 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000154 open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505021 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-12-17 06:05:55.000000000 -0500 Modify: 2024-12-17 06:05:56.000000000 -0500 Change: 2024-12-17 06:05:56.000000000 -0500 Birth: - File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505020 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-12-17 06:05:55.000000000 -0500 Modify: 2024-12-17 06:05:56.000000000 -0500 Change: 2024-12-17 06:05:56.000000000 -0500 Birth: - PASS 54 (23s) == sanityn test 55a: rename vs unlink target dir ========= 06:06:02 (1734433562) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55a.sanityn/d1/d2' to '/mnt/lustre/d55a.sanityn/d3/d2': No such file or directory PASS 55a (7s) == sanityn test 55b: rename vs unlink source dir ========= 06:06:09 (1734433569) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55b.sanityn/d1/d2' to '/mnt/lustre/d55b.sanityn/d3/d2': No such file or directory PASS 55b (7s) == sanityn test 55c: rename vs unlink orphan target dir == 06:06:16 (1734433576) fail_loc=0x156 mv: cannot move '/mnt/lustre/d55c.sanityn/d1/d2' to '/mnt/lustre/d55c.sanityn/d3/d2': No such file or directory PASS 55c (12s) == sanityn test 55d: rename file vs link ================= 06:06:28 (1734433588) fail_loc=0x155 mv: cannot move '/mnt/lustre/d55d.sanityn/f1' to '/mnt/lustre/d55d.sanityn/d55d.sanityn': Is a directory PASS 55d (9s) == sanityn test 56a: test llverdev with single large stripe ========================================================== 06:06:37 (1734433597) run_llverdev /mnt/lustre/f56a.sanityn -p -s 16000000 -c 4k llverdev: /mnt/lustre/f56a.sanityn is 16777216000000 bytes (15625 GB) in size timestamp: 1734433597 chunksize: 4096 size: 16777216000000 write offset: 16384000000kB 2.7745 MB/s read offset: 16384000000kB inf MB/s llverdev: data verified successfully PASS 56a (23s) == sanityn test 56b: test llverdev and partial verify of wide stripe file ========================================================== 06:07:00 (1734433620) run_llverdev /mnt/lustre/f56b.sanityn -p -s 32000000 -c 4k llverdev: read /mnt/lustre/f56b.sanityn@33554431995904+4096 no data: Success llverdev: read /mnt/lustre/f56b.sanityn@33554431995904+4096 no data: Success llverdev: /mnt/lustre/f56b.sanityn is 33554432000000 bytes (31250 GB) in size timestamp: 1734433621 chunksize: 4096 size: 33554432000000 write offset: 32768000000kB 4.20946 MB/s read offset: 32768000000kB -nan MB/s llverdev: data verified successfully PASS 56b (33s) == sanityn test 60: Verify data_version behaviour ======== 06:07:33 (1734433653) PASS 60 (1s) == sanityn test 70a: cd directory && rm directory ======== 06:07:34 (1734433654) PASS 70a (2s) == sanityn test 70b: remove files after calling rm_entry ========================================================== 06:07:36 (1734433656) PASS 70b (2s) == sanityn test 71a: correct file map just after write operation is finished ========================================================== 06:07:38 (1734433658) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00287563 s, 22.8 MB/s SKIP: sanityn test_71a ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71a (1s) == sanityn test 71b: check fiemap support for stripecount > 1 ========================================================== 06:07:39 (1734433659) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.0041191 s, 15.9 MB/s SKIP: sanityn test_71b ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71b (1s) == sanityn test 71c: check FIEMAP_EXTENT_LAST flag with different extents number ========================================================== 06:07:40 (1734433660) SKIP: sanityn test_71c support only ldiskfs ost SKIP 71c (0s) == sanityn test 71d: fiemap corruption test with fm_extent_count=0 ========================================================== 06:07:41 (1734433661) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00382799 s, 17.1 MB/s SKIP: sanityn test_71d ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71d (0s) == sanityn test 72: getxattr/setxattr cache should be consistent between nodes ========================================================== 06:07:42 (1734433662) llite.lustre-ffff8800a9871800.xattr_cache=1 llite.lustre-ffff8800aea1a000.xattr_cache=1 getfattr: Removing leading '/' from absolute path names user.attr1="value1" getfattr: Removing leading '/' from absolute path names user.attr1="value2" getfattr: Removing leading '/' from absolute path names getfattr: Removing leading '/' from absolute path names b362740ad371eae580e7f85452e8830b - 870e072da1ebfc20ea8c0cd3d6bdf3b6 - PASS 72 (1s) == sanityn test 73: getxattr should not cause xattr lock cancellation ========================================================== 06:07:43 (1734433663) llite.lustre-ffff8800a9871800.xattr_cache=1 llite.lustre-ffff8800aea1a000.xattr_cache=1 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" PASS 73 (2s) == sanityn test 74: flock deadlock: different mounts ======================================================================== 06:07:45 (1734433665) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00209372 s, 489 kB/s 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00251148 s, 408 kB/s 11368: get lock2 11369: get lock1 11368: done 11368: get lock1 11369: done 11369: get lock2 fcntl cmd 7 failed: Resource deadlock avoided 11368: cannot get lock1: Resource deadlock avoided fcntl cmd 7 failed: Resource deadlock avoided 11369: cannot get lock2: Resource deadlock avoided 11369: exit rc=0 11368: done 11368: exit rc=0 PASS 74 (6s) == sanityn test 75: osc: upcall after unuse lock============================================================================= 06:07:51 (1734433671) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0154644 s, 136 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00856399 s, 122 MB/s fail_loc=0x31d /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 4107: 12010 Killed stat -c %s $DIR1/$tfile fail_loc=0 PASS 75 (6s) == sanityn test 76: Verify MDT open_files listing ======== 06:07:57 (1734433677) opening files: ........ closing files: ........ PASS 76 (16s) == sanityn test 77a: check FIFO NRS policy =============== 06:08:13 (1734433693) ost.OSS.ost.nrs_policies=fifo ost.OSS.ost_create.nrs_policies=fifo ost.OSS.ost_io.nrs_policies=fifo ost.OSS.ost_out.nrs_policies=fifo ost.OSS.ost_seq.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0960467 s, 175 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112841 s, 92.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00918761 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114585 s, 91.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.019118 s, 54.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0351444 s, 29.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0506425 s, 20.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.053913 s, 19.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0584131 s, 18.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0574455 s, 18.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.058691 s, 17.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0606115 s, 17.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0574672 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0573644 s, 18.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0580866 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0623404 s, 16.8 MB/s ldlm.namespaces.lustre-OST0000-osc-ffff8800aea1a000.lock_unused_count=7 ldlm.namespaces.lustre-OST0001-osc-ffff8800aea1a000.lock_unused_count=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0556713 s, 18.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0090479 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00146953 s, 714 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00766757 s, 137 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122144 s, 85.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109266 s, 96.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00489415 s, 214 MB/s 1048576 bytes (1.0 MB) copied, 0.0116778 s, 89.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142196 s, 73.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0153698 s, 68.2 MB/s , 0.0125947 s, 83.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00203448 s, 515 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128909 s, 81.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125863 s, 83.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125943 s, 83.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136829 s, 76.6 MB/s ldlm.namespaces.lustre-OST0001-osc-ffff8800aea1a000.lock_unused_count=3 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00188959 s, 555 MB/s removed '/mnt/lustre/d77a.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77a.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77a.sanityn' PASS 77a (2s) == sanityn test 77b: check CRR-N NRS policy ============== 06:08:15 (1734433695) ost.OSS.ost.nrs_policies=crrn ost.OSS.ost_create.nrs_policies=crrn ost.OSS.ost_io.nrs_policies=crrn ost.OSS.ost_out.nrs_policies=crrn ost.OSS.ost_seq.nrs_policies=crrn ost.OSS.ost.nrs_crrn_quantum=1 ost.OSS.ost_create.nrs_crrn_quantum=1 ost.OSS.ost_io.nrs_crrn_quantum=1 ost.OSS.ost_out.nrs_crrn_quantum=1 ost.OSS.ost_seq.nrs_crrn_quantum=1 policy: crr-n, crrn_quantum 1 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.103733 s, 162 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0134132 s, 78.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112332 s, 93.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112261 s, 93.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.016725 s, 62.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0405401 s, 25.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0406645 s, 25.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.043765 s, 24.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0469484 s, 22.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0518439 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0549824 s, 19.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0510298 s, 20.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0610152 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0586847 s, 17.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0631054 s, 16.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0659612 s, 15.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0722675 s, 14.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00990038 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0186692 s, 56.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0171172 s, 61.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206366 s, 50.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00961401 s, 109 MB/s , 0.0114651 s, 91.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0127685 s, 82.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011978 s, 87.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119284 s, 87.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141506 s, 74.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135106 s, 77.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0217493 s, 48.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136136 s, 77.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0235847 s, 44.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015499 s, 67.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0174665 s, 60.0 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost.nrs_crrn_quantum=64 ost.OSS.ost_create.nrs_crrn_quantum=64 ost.OSS.ost_io.nrs_crrn_quantum=64 ost.OSS.ost_out.nrs_crrn_quantum=64 ost.OSS.ost_seq.nrs_crrn_quantum=64 policy: crr-n, crrn_quantum 64 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.158532 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0171079 s, 61.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0168139 s, 62.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0268244 s, 39.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0491941 s, 21.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0504722 s, 20.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0506274 s, 20.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0570916 s, 18.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0533042 s, 19.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0587283 s, 17.9 MB/s 1048576 bytes (1.0 MB) copied, 0.047656 s, 22.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0567595 s, 18.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0588683 s, 17.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0528539 s, 19.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0482154 s, 21.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0518111 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0622593 s, 16.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100036 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00901609 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00633106 s, 166 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00648794 s, 162 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00774733 s, 135 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00777818 s, 135 MB/s , 0.00779855 s, 134 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00865068 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00929902 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00978991 s, 107 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0100921 s, 104 MB/s , 0.00959075 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105165 s, 99.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115944 s, 90.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104246 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124525 s, 84.2 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77b (3s) == sanityn test 77c: check ORR NRS policy ================ 06:08:18 (1734433698) ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_orr_quantum=1 ost.OSS.ost_io.nrs_orr_offset_type=physical ost.OSS.ost_io.nrs_orr_supported=reads policy: orr, orr_quantum 1, orr_offset_type physical, orr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0919067 s, 183 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00953123 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00946387 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.016723 s, 62.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0200676 s, 52.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0254243 s, 41.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0373596 s, 28.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0336333 s, 31.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0406608 s, 25.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.034088 s, 30.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0336205 s, 31.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0318523 s, 32.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0473455 s, 22.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0414656 s, 25.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0457294 s, 22.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0397859 s, 26.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0466932 s, 22.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00762031 s, 138 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0076584 s, 137 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00937563 s, 112 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00967474 s, 108 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012113 s, 86.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0100624 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104385 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00953836 s, 110 MB/s 1048576 bytes (1.0 MB) copied, 0.010555 s, 99.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00994827 s, 105 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0116908 s, 89.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0104467 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011535 s, 90.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111441 s, 94.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108336 s, 96.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0134276 s, 78.1 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=writes ost.OSS.ost_io.nrs_orr_quantum=64 policy: orr, orr_quantum 64, orr_offset_type physical, orr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.101363 s, 166 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010178 s, 103 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00931696 s, 113 MB/s 1048576 bytes (1.0 MB) copied, 0.0193539 s, 54.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0207693 s, 50.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.022853 s, 45.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120764 s, 86.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0177825 s, 59.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0215645 s, 48.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0241883 s, 43.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0534777 s, 19.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0537232 s, 19.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0353932 s, 29.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0462886 s, 22.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0493499 s, 21.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0607915 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0584694 s, 17.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00906181 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0085943 s, 122 MB/s , 0.00277387 s, 378 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00883604 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00966414 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125416 s, 83.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106428 s, 98.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107745 s, 97.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124873 s, 84.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110528 s, 94.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0131405 s, 79.8 MB/s , 0.0134331 s, 78.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138753 s, 75.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155644 s, 67.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0140125 s, 74.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0159204 s, 65.9 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=reads_and_writes ost.OSS.ost_io.nrs_orr_offset_type=logical policy: orr, orr_quantum 64, orr_offset_type logical, orr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.103233 s, 163 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114476 s, 91.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0130225 s, 80.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0400564 s, 26.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0487116 s, 21.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.049602 s, 21.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0399424 s, 26.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0556437 s, 18.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0449427 s, 23.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0544759 s, 19.2 MB/s , 0.0413022 s, 25.4 MB/s , 0.0535129 s, 19.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0483881 s, 21.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.046916 s, 22.4 MB/s 1048576 bytes (1.0 MB) copied, 0.054137 s, 19.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.058217 s, 18.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0621483 s, 16.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00958167 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00974673 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116656 s, 89.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010711 s, 97.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110712 s, 94.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138292 s, 75.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114229 s, 91.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011215 s, 93.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113092 s, 92.7 MB/s , 0.0134502 s, 78.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141595 s, 74.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0137271 s, 76.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0133666 s, 78.4 MB/s , 0.0130349 s, 80.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131493 s, 79.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0167909 s, 62.4 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77c (4s) == sanityn test 77d: check TRR nrs policy ================ 06:08:22 (1734433702) ost.OSS.ost_io.nrs_policies=trr ost.OSS.ost_io.nrs_trr_quantum=1 ost.OSS.ost_io.nrs_trr_offset_type=physical ost.OSS.ost_io.nrs_trr_supported=reads policy: trr, trr_quantum 1, trr_offset_type physical, trr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.104437 s, 161 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00861304 s, 122 MB/s , 0.00880579 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128164 s, 81.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136681 s, 76.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00880485 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0196474 s, 53.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0089441 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00958027 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00740652 s, 142 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0391222 s, 26.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0411188 s, 25.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.026066 s, 40.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0422543 s, 24.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0323218 s, 32.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0348854 s, 30.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0303074 s, 34.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00969565 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114024 s, 92.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0193896 s, 54.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010256 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114378 s, 91.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0115919 s, 90.5 MB/s , 0.0224763 s, 46.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0218442 s, 48.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0132862 s, 78.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0157417 s, 66.6 MB/s 1048576 bytes (1.0 MB) copied, 0.015669 s, 66.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0169342 s, 61.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0165375 s, 63.4 MB/s 1+0 records in 1+0 records out , 0.0179064 s, 58.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0179931 s, 58.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0188572 s, 55.6 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=writes ost.OSS.ost_io.nrs_trr_quantum=64 policy: trr, trr_quantum 64, trr_offset_type physical, trr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.101628 s, 165 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152121 s, 68.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133298 s, 78.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206069 s, 50.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0359434 s, 29.2 MB/s , 0.0441293 s, 23.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0465528 s, 22.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0564555 s, 18.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0429799 s, 24.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.054897 s, 19.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0516604 s, 20.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0589068 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0580872 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0613425 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0574925 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0681132 s, 15.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0677041 s, 15.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00797186 s, 132 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102892 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00200882 s, 522 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00916359 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113103 s, 92.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106438 s, 98.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107492 s, 97.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0118577 s, 88.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011978 s, 87.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128718 s, 81.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128185 s, 81.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136155 s, 77.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142492 s, 73.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131914 s, 79.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146709 s, 71.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0149223 s, 70.3 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=reads_and_writes ost.OSS.ost_io.nrs_trr_offset_type=logical policy: trr, trr_quantum 64, trr_offset_type logical, trr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.122768 s, 137 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117229 s, 89.4 MB/s , 0.0135764 s, 77.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129739 s, 80.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0154997 s, 67.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0379678 s, 27.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.032595 s, 32.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0429302 s, 24.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0439409 s, 23.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0372394 s, 28.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0481821 s, 21.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0462725 s, 22.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0527551 s, 19.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.046512 s, 22.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0480334 s, 21.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0476149 s, 22.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0618542 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104537 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00893294 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111627 s, 93.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00701236 s, 150 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00883749 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0134679 s, 77.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00813234 s, 129 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00829841 s, 126 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101738 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103765 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107118 s, 97.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0113089 s, 92.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0118877 s, 88.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117292 s, 89.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0120574 s, 87.0 MB/s , 0.0132891 s, 78.9 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77d (4s) == sanityn test 77e: check TBF NID nrs policy ============ 06:08:26 (1734433706) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_tbf_rule=start localhost nid={0@lo} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start clients nid={192.168.201.34@tcp} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start others nid={*.*.*.*@tcp} rate=50 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.112282 s, 149 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0137587 s, 76.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155138 s, 67.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0407384 s, 25.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0542345 s, 19.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0549859 s, 19.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0451611 s, 23.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0594093 s, 17.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0598402 s, 17.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0577254 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0600754 s, 17.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0556424 s, 18.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0590527 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0620919 s, 16.9 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0603568 s, 17.4 MB/s , 0.063232 s, 16.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0527845 s, 19.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00964308 s, 109 MB/s 1048576 bytes (1.0 MB) copied, 0.00593622 s, 177 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00675425 s, 155 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.014063 s, 74.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144508 s, 72.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131741 s, 79.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109713 s, 95.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00835134 s, 126 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107875 s, 97.2 MB/s 1048576 bytes (1.0 MB) copied, 0.010957 s, 95.7 MB/s 1048576 bytes (1.0 MB) copied, 0.011677 s, 89.8 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0124942 s, 83.9 MB/s , 0.012519 s, 83.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136446 s, 76.8 MB/s , 0.0134011 s, 78.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141973 s, 73.9 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change localhost rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change clients rate=101 ost.OSS.ost_io.nrs_tbf_rule=change others rate=51 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.10166 s, 165 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00968779 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128636 s, 81.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116151 s, 90.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0439608 s, 23.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0417006 s, 25.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0538404 s, 19.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0575727 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0519898 s, 20.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0504727 s, 20.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0514586 s, 20.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0594986 s, 17.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0517083 s, 20.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0619458 s, 16.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0572286 s, 18.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0596173 s, 17.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0707061 s, 14.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00710255 s, 148 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0086208 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011545 s, 90.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126241 s, 83.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00919944 s, 114 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00900892 s, 116 MB/s , 0.00911905 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010686 s, 98.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112133 s, 93.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111515 s, 94.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122891 s, 85.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0117928 s, 88.9 MB/s , 0.0123452 s, 84.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126151 s, 83.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135486 s, 77.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0147776 s, 71.0 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop localhost ost.OSS.ost_io.nrs_tbf_rule=stop clients ost.OSS.ost_io.nrs_tbf_rule=stop others 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.112812 s, 149 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0150558 s, 69.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.018109 s, 57.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0395678 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0433834 s, 24.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.044838 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0531062 s, 19.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0560337 s, 18.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0581258 s, 18.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0536652 s, 19.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0607646 s, 17.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.054806 s, 19.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0617816 s, 17.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0612176 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0649481 s, 16.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0645083 s, 16.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0673534 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125162 s, 83.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00872266 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00832824 s, 126 MB/s , 0.0119609 s, 87.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113415 s, 92.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0127967 s, 81.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138701 s, 75.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120178 s, 87.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01207 s, 86.9 MB/s , 0.0118924 s, 88.2 MB/s , 0.013398 s, 78.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136333 s, 76.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128915 s, 81.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.014462 s, 72.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0130552 s, 80.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148674 s, 70.5 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.106056 s, 158 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0157215 s, 66.7 MB/s , 0.0138944 s, 75.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0474655 s, 22.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0618909 s, 16.9 MB/s , 0.0495317 s, 21.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0634034 s, 16.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0622801 s, 16.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0607154 s, 17.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0648586 s, 16.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0655582 s, 16.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0626309 s, 16.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.060998 s, 17.2 MB/s , 0.0707083 s, 14.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0592705 s, 17.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0771149 s, 13.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.078459 s, 13.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00926169 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00761507 s, 138 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00813359 s, 129 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125226 s, 83.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00962646 s, 109 MB/s , 0.00941541 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100553 s, 104 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011582 s, 90.5 MB/s 1048576 bytes (1.0 MB) copied, 0.012024 s, 87.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109849 s, 95.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00847991 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125116 s, 83.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129876 s, 80.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0127867 s, 82.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.013244 s, 79.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015352 s, 68.3 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' PASS 77e (7s) == sanityn test 77f: check TBF JobID nrs policy ========== 06:08:33 (1734433713) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start runas jobid={iozone.500 dd.500 tiotest.500} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start iozone_runas jobid={iozone.500} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.105935 s, 158 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0092958 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129285 s, 81.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0276886 s, 37.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0289967 s, 36.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0323465 s, 32.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0323215 s, 32.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0329357 s, 31.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0309891 s, 33.8 MB/s , 0.0313971 s, 33.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0468127 s, 22.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.044588 s, 23.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0445032 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0501212 s, 20.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0534138 s, 19.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.047938 s, 21.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0564552 s, 18.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00573186 s, 183 MB/s , 0.00917798 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00960279 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00951918 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011459 s, 91.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110522 s, 94.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00904426 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00851569 s, 123 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107738 s, 97.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0130931 s, 80.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101301 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00169868 s, 617 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109941 s, 95.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111105 s, 94.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109449 s, 95.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012079 s, 86.8 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change runas rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change iozone_runas rate=101 ost.OSS.ost_io.nrs_tbf_rule=change dd_runas rate=51 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0803409 s, 209 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102621 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00995981 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0247353 s, 42.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0246488 s, 42.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0261424 s, 40.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0374411 s, 28.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.037108 s, 28.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0392404 s, 26.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0297083 s, 35.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0387585 s, 27.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0379738 s, 27.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.037802 s, 27.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0314315 s, 33.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0361956 s, 29.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0396393 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0490627 s, 21.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00379868 s, 276 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104669 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104222 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00154563 s, 678 MB/s 1048576 bytes (1.0 MB) copied, 0.0110476 s, 94.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0147794 s, 70.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104619 s, 100 MB/s , 0.0090936 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126489 s, 82.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00155416 s, 675 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148113 s, 70.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0133197 s, 78.7 MB/s 1048576 bytes (1.0 MB) copied, 0.00860125 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141412 s, 74.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142134 s, 73.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148883 s, 70.4 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop runas ost.OSS.ost_io.nrs_tbf_rule=stop iozone_runas ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0853802 s, 197 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00983716 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123203 s, 85.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0316073 s, 33.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0362645 s, 28.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0354616 s, 29.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0359243 s, 29.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0365422 s, 28.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0433335 s, 24.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0470558 s, 22.3 MB/s , 0.0452643 s, 23.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.04721 s, 22.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0480339 s, 21.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0444092 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0526354 s, 19.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0509699 s, 20.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0539355 s, 19.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00895033 s, 117 MB/s , 0.00755019 s, 139 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00767545 s, 137 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00893932 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00863278 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00866937 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00763261 s, 137 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00386827 s, 271 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00924039 s, 113 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00937503 s, 112 MB/s 1048576 bytes (1.0 MB) copied, 0.00867706 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00909337 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00809207 s, 130 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00878416 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00899051 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00912192 s, 115 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_policies=fifo running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0922305 s, 182 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00937482 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103139 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00957719 s, 109 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0285677 s, 36.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0341174 s, 30.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0419432 s, 25.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0406221 s, 25.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0415334 s, 25.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0467482 s, 22.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0466253 s, 22.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0471441 s, 22.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0480465 s, 21.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0446622 s, 23.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0379033 s, 27.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0417136 s, 25.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0499249 s, 21.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00753983 s, 139 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00806481 s, 130 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125535 s, 83.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142215 s, 73.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0152007 s, 69.0 MB/s 1048576 bytes (1.0 MB) copied, 0.00944281 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142395 s, 73.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0169442 s, 61.9 MB/s , 0.0110109 s, 95.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0194312 s, 54.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112079 s, 93.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0127205 s, 82.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115383 s, 90.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0135439 s, 77.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0129758 s, 80.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143823 s, 72.9 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' PASS 77f (6s) == sanityn test 77g: Change TBF type directly ============ 06:08:39 (1734433719) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 ost.OSS.ost_io.nrs_policies=fifo PASS 77g (2s) == sanityn test 77h: Wrong policy name should report error, not LBUG ========================================================== 06:08:41 (1734433721) oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=abc: No such file or directory oleg134-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='abc': No such file or directory pdsh@oleg134-client: oleg134-server: ssh exited with exit code 2 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc: Unknown error 524 oleg134-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf abc': Unknown error 524 pdsh@oleg134-client: oleg134-server: ssh exited with exit code 12 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf reg abc: Unknown error 524 oleg134-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf reg abc': Unknown error 524 pdsh@oleg134-client: oleg134-server: ssh exited with exit code 12 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc efg: Unknown error 524 oleg134-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf abc efg': Unknown error 524 pdsh@oleg134-client: oleg134-server: ssh exited with exit code 12 PASS 77h (3s) == sanityn test 77i: Change rank of TBF rule ============= 06:08:44 (1734433724) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start before jobid={jobid} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start after jobid={jobid} rate=1000 rank=default ost.OSS.ost_io.nrs_tbf_rule=start target jobid={jobid} rate=1000 rank=after Move before itself ost.OSS.ost_io.nrs_tbf_rule=change target rank=target Move to higher rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=before Move to lower rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=after Move before default ost.OSS.ost_io.nrs_tbf_rule=change target rank=default ost.OSS.ost_io.nrs_policies=fifo PASS 77i (6s) == sanityn test 77j: check TBF-OPCode NRS policy ========= 06:08:50 (1734433730) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf opcode ost.OSS.ost_io.nrs_tbf_rule=start ost_r opcode={ost_read} rate=5 ost.OSS.ost_io.nrs_tbf_rule=start ost_w opcode={ost_write} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0705215 s, 238 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00808939 s, 130 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00931833 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0161907 s, 64.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0258762 s, 40.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0283219 s, 37.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0280282 s, 37.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0307791 s, 34.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0245669 s, 42.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.027537 s, 38.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0258864 s, 40.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.023889 s, 43.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0349788 s, 30.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0336211 s, 31.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0349662 s, 30.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0360826 s, 29.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0301847 s, 34.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00833995 s, 126 MB/s , 0.00715939 s, 146 MB/s , 0.00818369 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00806176 s, 130 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105549 s, 99.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00791066 s, 133 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00827245 s, 127 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00820956 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00950395 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00993619 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105351 s, 99.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104119 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106425 s, 98.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119051 s, 88.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104522 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123518 s, 84.9 MB/s removed '/mnt/lustre/d77j.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77j.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77j.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 5 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.91604 s, 21.3 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.43 s, 5.4 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77j.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_r ost.OSS.ost_io.nrs_tbf_rule=stop ost_w ost.OSS.ost_io.nrs_policies=fifo PASS 77j (55s) == sanityn test 77ja: check TBF-UID/GID NRS policy ======= 06:09:45 (1734433785) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg134-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg134-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [777] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg134-client.virtnet] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg134-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.27926 s, 13.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0361201 s, 29.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0540733 s, 19.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0672082 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0804362 s, 13.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.074 s, 14.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.103271 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.112649 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.102145 s, 10.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.103208 s, 10.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.117807 s, 8.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.150339 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.154873 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.158778 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.161972 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.16861 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.173339 s, 6.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0248485 s, 42.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0237447 s, 44.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0261046 s, 40.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206708 s, 50.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0305858 s, 34.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0285244 s, 36.8 MB/s , 0.0288335 s, 36.4 MB/s , 0.0267614 s, 39.2 MB/s , 0.0254606 s, 41.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0311812 s, 33.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0350251 s, 29.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0324007 s, 32.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0314678 s, 33.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0394705 s, 26.6 MB/s , 0.0401155 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0445643 s, 23.5 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.7964 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9674 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg134-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg134-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [chmod] [777] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg134-client.virtnet] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg134-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.447503 s, 37.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148246 s, 70.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015665 s, 66.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0226249 s, 46.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.01713 s, 61.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144656 s, 72.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00616338 s, 170 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133537 s, 78.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0162027 s, 64.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.139284 s, 7.5 MB/s 1048576 bytes (1.0 MB) copied, 0.141538 s, 7.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.131162 s, 8.0 MB/s 1048576 bytes (1.0 MB) copied, 0.148331 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.14911 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.141162 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.158276 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.140887 s, 7.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0133089 s, 78.8 MB/s , 0.0131385 s, 79.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135064 s, 77.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119242 s, 87.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146237 s, 71.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0132525 s, 79.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0147119 s, 71.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151556 s, 69.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0154149 s, 68.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0183961 s, 57.0 MB/s , 0.0164033 s, 63.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0193058 s, 54.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0165283 s, 63.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.019503 s, 53.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0183585 s, 57.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0213032 s, 49.2 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d77ja.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.8546 s, 5.3 MB/s Write runtime is 20 s, speed is 5.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9437 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77ja (133s) == sanityn test 77jb: check TBF-UID/GID NRS policy on files that don't belong to us ========================================================== 06:11:58 (1734433918) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 0/500/0/500, groups: 500 [touch] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg134-client.virtnet] running as uid/gid/euid/egid 0/500/0/500, groups: 500 [touch] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg134-client.virtnet] running as uid/gid/euid/egid 0/500/0/500, groups: 500 [chmod] [777] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg134-client.virtnet] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg134-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.2369 s, 13.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0389584 s, 26.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0342431 s, 30.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0614307 s, 17.1 MB/s , 0.0538285 s, 19.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.062071 s, 16.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0628309 s, 16.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0693615 s, 15.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0993528 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.116104 s, 9.0 MB/s , 0.116137 s, 9.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.131452 s, 8.0 MB/s , 0.138326 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.143603 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.147049 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.155533 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.160067 s, 6.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136111 s, 77.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0130488 s, 80.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0147818 s, 70.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0147535 s, 71.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148678 s, 70.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151967 s, 69.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160095 s, 65.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160894 s, 65.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0148395 s, 70.7 MB/s , 0.0169392 s, 61.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0158313 s, 66.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160303 s, 65.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156879 s, 66.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155941 s, 67.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0179293 s, 58.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0190013 s, 55.2 MB/s removed '/mnt/lustre/d77jb.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77jb.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77jb.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 0/500/0/500, groups: 500 [touch] [/mnt/lustre/d77jb.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.8415 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77jb.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9687 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77jb.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/0/500/0, groups: 0 [touch] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg134-client.virtnet] running as uid/gid/euid/egid 500/0/500/0, groups: 0 [touch] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg134-client.virtnet] running as uid/gid/euid/egid 500/0/500/0, groups: 0 [chmod] [777] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg134-client.virtnet] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg134-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.444938 s, 37.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133925 s, 78.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00931809 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0234409 s, 44.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156732 s, 66.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00976971 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0448768 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0304372 s, 34.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0444901 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.140648 s, 7.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.13913 s, 7.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.150291 s, 7.0 MB/s , 0.14083 s, 7.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.154255 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.137798 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.162385 s, 6.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.164825 s, 6.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0192485 s, 54.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0249037 s, 42.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0206007 s, 50.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0204044 s, 51.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0211922 s, 49.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212475 s, 49.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0246964 s, 42.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0232549 s, 45.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.024587 s, 42.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0253076 s, 41.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0256351 s, 40.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0274457 s, 38.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0275309 s, 38.1 MB/s , 0.0276931 s, 37.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0324606 s, 32.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0362241 s, 28.9 MB/s removed '/mnt/lustre/d77jb.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77jb.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77jb.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/0/500/0, groups: 0 [touch] [/mnt/lustre/d77jb.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.7216 s, 5.3 MB/s Write runtime is 20 s, speed is 5.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77jb.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9623 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77jb.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77jb (129s) == sanityn test 77k: check TBF policy with UID/GID/JobID/OPCode expression ========================================================== 06:14:07 (1734434047) ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_tbf_rule=start ext_w jobid={dd.500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r jobid={dd.500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.104662 s, 160 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00879455 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00845961 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0258186 s, 40.6 MB/s , 0.0245454 s, 42.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0162756 s, 64.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0349977 s, 30.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0229522 s, 45.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0331273 s, 31.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0388264 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0343463 s, 30.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.03886 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0354745 s, 29.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0324239 s, 32.3 MB/s , 0.0432511 s, 24.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0462978 s, 22.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0499594 s, 21.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00726612 s, 144 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00824698 s, 127 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0102745 s, 102 MB/s , 0.00817588 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00840897 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00939364 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00960007 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00985358 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104704 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010779 s, 97.3 MB/s , 0.0111467 s, 94.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109902 s, 95.4 MB/s , 0.0110043 s, 95.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101854 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115446 s, 90.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103323 s, 101 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.93457 s, 21.2 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.738 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext_w nid={0@lo 192.168.201.34@tcp}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r nid={0@lo 192.168.201.34@tcp}&opcode={ost_read} rate=10 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.122678 s, 137 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00956741 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144553 s, 72.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0323339 s, 32.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0348553 s, 30.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0349196 s, 30.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0264769 s, 39.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0426328 s, 24.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0319027 s, 32.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0407656 s, 25.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0385606 s, 27.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0343181 s, 30.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0445093 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.21291 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.211971 s, 4.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.254129 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.252854 s, 4.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111127 s, 94.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129971 s, 80.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155288 s, 67.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102603 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00973573 s, 108 MB/s , 0.0144788 s, 72.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0164197 s, 63.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0180577 s, 58.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126676 s, 82.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123514 s, 84.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124515 s, 84.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136452 s, 76.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138212 s, 75.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156059 s, 67.2 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0158955 s, 66.0 MB/s , 0.0154535 s, 67.9 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.95032 s, 21.2 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.74181 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext nid={0@lo 192.168.201.34@tcp}&jobid={dd.500} rate=20 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.117485 s, 143 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0127292 s, 82.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00959507 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101209 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0306445 s, 34.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0295824 s, 35.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0325789 s, 32.2 MB/s , 0.03066 s, 34.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0369839 s, 28.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0332213 s, 31.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0388723 s, 27.0 MB/s , 0.0383932 s, 27.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0323546 s, 32.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0666842 s, 15.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.053182 s, 19.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0565164 s, 18.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0697508 s, 15.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0126661 s, 82.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0167255 s, 62.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0167082 s, 62.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136519 s, 76.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138266 s, 75.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136176 s, 77.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0147606 s, 71.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0150827 s, 69.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155825 s, 67.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0161538 s, 64.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.017233 s, 60.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0181804 s, 57.7 MB/s , 0.0183161 s, 57.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.018242 s, 57.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0183058 s, 57.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0224899 s, 46.6 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.93359 s, 21.3 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.88032 s, 21.5 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext ost.OSS.ost_io.nrs_tbf_rule=start ext_a jobid={dd.500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b jobid={dd.500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0955954 s, 176 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105243 s, 99.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.023009 s, 45.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0159014 s, 65.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.023967 s, 43.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0266556 s, 39.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0229723 s, 45.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0294359 s, 35.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0304756 s, 34.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0311797 s, 33.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0300902 s, 34.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0300736 s, 34.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0377722 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.127504 s, 8.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.125286 s, 8.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.123581 s, 8.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.124055 s, 8.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00744794 s, 141 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00995637 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00894811 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00830257 s, 126 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0083023 s, 126 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00901622 s, 116 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00912988 s, 115 MB/s 1048576 bytes (1.0 MB) copied, 0.00920552 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00988183 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00999862 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101697 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00929858 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00889949 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00941231 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102887 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120376 s, 87.1 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.81753 s, 10.7 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.73634 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.92567 s, 21.3 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.73103 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_tbf_rule=start ext_ug uid={500}&gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.84272 s, 19.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104316 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155287 s, 67.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187544 s, 55.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0139553 s, 75.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0242195 s, 43.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0161978 s, 64.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0237939 s, 44.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0209319 s, 50.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.175173 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.191482 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.191288 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.191693 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.188586 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.202642 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.202924 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.208111 s, 5.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00701098 s, 150 MB/s , 0.00393457 s, 267 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102045 s, 103 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0096489 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00532945 s, 197 MB/s 1048576 bytes (1.0 MB) copied, 0.0148065 s, 70.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00957459 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00669467 s, 157 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108841 s, 96.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108604 s, 96.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00860389 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00904666 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102837 s, 102 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.012482 s, 84.0 MB/s , 0.0124759 s, 84.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128711 s, 81.5 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.7698 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.449 s, 5.4 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_ug ost.OSS.ost_io.nrs_tbf_rule=start ext_uw uid={500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_ur uid={500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.115981 s, 145 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101082 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101746 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119275 s, 87.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135884 s, 77.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0282512 s, 37.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0219564 s, 47.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0254752 s, 41.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0361662 s, 29.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0294412 s, 35.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0384401 s, 27.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0248668 s, 42.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0365044 s, 28.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0492406 s, 21.3 MB/s , 0.0587839 s, 17.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0621048 s, 16.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0524878 s, 20.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010419 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00872928 s, 120 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.009018 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107625 s, 97.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104021 s, 101 MB/s 1048576 bytes (1.0 MB) copied, 0.0104675 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107626 s, 97.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109676 s, 95.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110101 s, 95.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111069 s, 94.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105584 s, 99.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.011581 s, 90.5 MB/s , 0.0115504 s, 90.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010136 s, 103 MB/s 1048576 bytes (1.0 MB) copied, 0.0121873 s, 86.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011376 s, 92.2 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.96759 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.73628 s, 10.8 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_uw ost.OSS.ost_io.nrs_tbf_rule=stop ext_ur ost.OSS.ost_io.nrs_tbf_rule=start ext_a uid={500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b uid={500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.449852 s, 37.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_w] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00964461 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0257907 s, 40.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.029087 s, 36.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0259528 s, 40.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0709971 s, 14.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0718179 s, 14.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0656764 s, 16.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0705717 s, 14.9 MB/s , 0.0723176 s, 14.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0853094 s, 12.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0915184 s, 11.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0931233 s, 11.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.331901 s, 3.2 MB/s , 0.323189 s, 3.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.38186 s, 2.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.38281 s, 2.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [declare] [-a] [pids_r] execvp fails running declare (13): Permission denied 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00928127 s, 113 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00887225 s, 118 MB/s , 0.0118955 s, 88.1 MB/s , 0.00518003 s, 202 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00801733 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0119483 s, 87.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0120171 s, 87.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0073011 s, 144 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0161893 s, 64.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00801412 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0147066 s, 71.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104023 s, 101 MB/s 1048576 bytes (1.0 MB) copied, 0.0103348 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114615 s, 91.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121926 s, 86.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125732 s, 83.4 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.82783 s, 10.7 MB/s Write runtime is 10 s, speed is 10.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.73362 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.78139 s, 10.7 MB/s Write runtime is 10 s, speed is 10.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.73202 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_policies=fifo PASS 77k (356s) == sanityn test 77l: check the output of NRS policies for generic TBF ========================================================== 06:20:04 (1734434404) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_policies=fifo PASS 77l (2s) == sanityn test 77m: check NRS Delay slows write RPC processing ========================================================== 06:20:06 (1734434406) ost.OSS.ost_io.nrs_policies=delay ost.OSS.ost_io.nrs_delay_min=4 ost.OSS.ost_io.nrs_delay_max=4 ost.OSS.ost_io.nrs_delay_pct=100 running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg134-client.virtnet] [bs=1M] [count=1] [oflag=direct] [conv=fdatasync] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 3.08891 s, 339 kB/s running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg134-client.virtnet] [bs=1M] [count=10] [oflag=direct] [conv=fdatasync] 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 40.0133 s, 262 kB/s ost.OSS.ost_io.nrs_policies=fifo PASS 77m (49s) == sanityn test 77n: check wildcard support for TBF JobID NRS policy ========================================================== 06:20:55 (1734434455) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={*.500} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0915449 s, 183 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107576 s, 97.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133142 s, 78.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0257019 s, 40.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0280584 s, 37.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0309208 s, 33.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0349521 s, 30.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0391759 s, 26.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0395348 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0346051 s, 30.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0399079 s, 26.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0399713 s, 26.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0314848 s, 33.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0351582 s, 29.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0447606 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0392461 s, 26.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.044057 s, 23.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00795602 s, 132 MB/s 1048576 bytes (1.0 MB) copied, 0.00790833 s, 133 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011096 s, 94.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00984349 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111595 s, 94.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.010713 s, 97.9 MB/s 1048576 bytes (1.0 MB) copied, 0.00970911 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115937 s, 90.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011259 s, 93.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111487 s, 94.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109908 s, 95.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123507 s, 84.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115468 s, 90.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124027 s, 84.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.013814 s, 75.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155605 s, 67.4 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg134-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/dev/zero] [of=/mnt/lustre/d77n.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.95569 s, 21.2 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: 500 [dd] [if=/mnt/lustre/d77n.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.97019 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.*} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.231852 s, 72.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00874647 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116572 s, 90.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106241 s, 98.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0248469 s, 42.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0287204 s, 36.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0229314 s, 45.7 MB/s , 0.0327139 s, 32.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0350073 s, 30.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0232741 s, 45.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.027762 s, 37.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.130655 s, 8.0 MB/s 1048576 bytes (1.0 MB) copied, 0.135046 s, 7.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.135707 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.136545 s, 7.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.275747 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.279016 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0126197 s, 83.1 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116048 s, 90.4 MB/s , 0.0162801 s, 64.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110184 s, 95.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.018312 s, 57.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010987 s, 95.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0196061 s, 53.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101601 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0157353 s, 66.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00977811 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115726 s, 90.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105893 s, 99.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117127 s, 89.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.012013 s, 87.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0127118 s, 82.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123132 s, 85.2 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg134-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg134-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.93935 s, 21.2 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.97028 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS MDS sleep 5 for ZFS OST Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_policies=fifo PASS 77n (64s) == sanityn test 77o: Changing rank should not panic ====== 06:21:59 (1734434519) mds.MDS.mdt.nrs_policies=tbf nid mds.MDS.mdt.nrs_tbf_rule=start name nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=start name1 nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=change name1 rank=name mds.MDS.mdt.nrs_tbf_rule=stop name mds.MDS.mdt.nrs_policies=fifo PASS 77o (3s) == sanityn test 77q: Parallel TBF rule definitions should not panic ========================================================== 06:22:02 (1734434522) mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_policies=fifo PASS 77q (27s) == sanityn test 77p: Check validity of rule names for TBF policies ========================================================== 06:22:29 (1734434549) mds.MDS.mdt.nrs_policies=tbf oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_overflo uid={500} rate=500: File name too long oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test_77p_overflo uid={500} rate=500': File name too long pdsh@oleg134-client: oleg134-server: ssh exited with exit code 36 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_empty: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test_77p_empty': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p@spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p@spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p.spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p.spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p~spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p~spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p#spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p#spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p/spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p/spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p^spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p^spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p%spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p%spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p*spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p*spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p;spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p;spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p,spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p,spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p?spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p?spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77pspec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p>spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p:spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p:spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p+spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p+spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p=spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p=spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p)spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p)spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p(spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p(spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p{spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p{spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p}spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p}spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p|spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p|spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p[spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p[spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p]spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p]spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p!spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p!spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p&spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p&spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p$spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p$spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p`spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p`spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 oleg134-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p\spec uid={500} rate=500: Invalid argument oleg134-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p\spec uid={500} rate=500': Invalid argument pdsh@oleg134-client: oleg134-server: ssh exited with exit code 22 mds.MDS.mdt.nrs_policies=fifo PASS 77p (10s) == sanityn test 77r: Change type of tbf policy at run time ========================================================== 06:22:39 (1734434559) mds.MDS.mdt.nrs_policies=tbf uid mds.MDS.mdt.nrs_tbf_rule=start md_rule uid={500} rate=1 mds.MDS.mdt.nrs_policies=tbf gid mds.MDS.mdt.nrs_tbf_rule=start md_rule gid={500} rate=1 mds.MDS.mdt.nrs_policies=tbf jobid mds.MDS.mdt.nrs_tbf_rule=start md_rule jobid={*.500} rate=1 mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start md_rule uid={500} rate=1 mds.MDS.mdt.nrs_policies=fifo check the number of requests in queue: fifo: 0 crrn: 0 tbf: 0 delay: 0 fifo: 0 crrn: 0 tbf: 0 delay: 0 cleanup 77r 9598 kill md_thread xargs PASS 77r (38s) == sanityn test 78: Enable policy and specify tunings right away ========================================================== 06:23:17 (1734434597) ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_orr_quantum=1 ost.OSS.ost_io.nrs_policies=fifo PASS 78 (2s) == sanityn test 79: xattr: intent error ================== 06:23:19 (1734434599) File: '/mnt/lustre/d79.sanityn' Size: 512 Blocks: 1 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272506230 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-12-17 06:23:20.000000000 -0500 Modify: 2024-12-17 06:23:20.000000000 -0500 Change: 2024-12-17 06:23:20.000000000 -0500 Birth: - fail_val=0 fail_loc=0x80000160 fail_val=0 fail_loc=0x80000131 # file: mnt/lustre/d79.sanityn trusted.name1="value1" PASS 79 (12s) == sanityn test 80a: migrate directory when some children is being opened ========================================================== 06:23:31 (1734434611) SKIP: sanityn test_80a needs >= 2 MDTs SKIP 80a (1s) == sanityn test 80b: Accessing directory during migration ========================================================== 06:23:32 (1734434612) SKIP: sanityn test_80b needs >= 2 MDTs SKIP 80b (1s) == sanityn test 81a: rename and stat under striped directory ========================================================== 06:23:33 (1734434613) SKIP: sanityn test_81a needs >= 2 MDTs SKIP 81a (1s) == sanityn test 81b: rename under striped directory doesn't deadlock ========================================================== 06:23:34 (1734434614) SKIP: sanityn test_81b We need at least 2 MDTs for this test SKIP 81b (1s) == sanityn test 81c: rename revoke LOOKUP lock for remote object ========================================================== 06:23:35 (1734434615) SKIP: sanityn test_81c needs >= 4 MDTs SKIP 81c (1s) == sanityn test 81d: parallel rename file cross-dir on same MDT ========================================================== 06:23:36 (1734434616) total: 2500 open/close in 8.75 seconds: 285.87 ops/second snapshot_time 1734434640.064533411 secs.nsecs start_time 1734434616.472430575 secs.nsecs elapsed_time 23.592102836 secs.nsecs open 2505 samples [usecs] 67 3044 1188485 647418579 close 2504 samples [usecs] 53 1729 374490 76480438 mknod 2501 samples [usecs] 164 2967 1069152 531751060 unlink 2500 samples [usecs] 246 11503 1233939 1728535697 mkdir 2 samples [usecs] 638 954 1592 1317160 rmdir 2 samples [usecs] 2184 3544 5728 17329792 rename 2500 samples [usecs] 231 13223 3159748 6569150602 getattr 3760 samples [usecs] 4 5836 74431 48744183 parallel_rename_file 2500 samples [usecs] 231 13223 3159748 6569150602 crossdir_rename 2500 samples [usecs] 231 13223 3159748 6569150602 PASS 81d (25s) == sanityn test 82: fsetxattr and fgetxattr on orphan files ========================================================== 06:24:01 (1734434641) multiop /mnt/lustre/f82.sanityn vO_ac TMPPIPE=/tmp/multiop_open_wait_pipe.6964 multiop /mnt/lustre2/f82.sanityn vo_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.6964 PASS 82 (2s) == sanityn test 83: access striped directory while it is being created/unlinked ========================================================== 06:24:03 (1734434643) SKIP: sanityn test_83 needs >= 2 MDTs SKIP 83 (1s) == sanityn test 84: 0-nlink race in lu_object_find() ===== 06:24:04 (1734434644) fail_loc=0x8000060b PASS 84 (7s) == sanityn test 85: Lustre API root cache race =========== 06:24:11 (1734434651) Starting: llapi_root_test /mnt/lustre/f85.sanityn /mnt/lustre2/f85.sanityn Starting test test1 at 1734434651 Finishing test test1 at 1734434652 PASS 85 (2s) == sanityn test 90: open/create and unlink striped directory ========================================================== 06:24:13 (1734434653) SKIP: sanityn test_90 needs >= 2 MDTs SKIP 90 (1s) == sanityn test 91: chmod and unlink striped directory === 06:24:14 (1734434654) SKIP: sanityn test_91 needs >= 2 MDTs SKIP 91 (1s) == sanityn test 92: create remote directory under orphan directory ========================================================== 06:24:15 (1734434655) SKIP: sanityn test_92 needs >= 2 MDTs SKIP 92 (0s) == sanityn test 93: alloc_rr should not allocate on same ost ========================================================== 06:24:16 (1734434656) fail_loc=0x00000163 fail_loc=0x0 /mnt/lustre/f93.sanityn-1/file1 lmm_stripe_count: 2 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 5594 0x15da 0x240000400 1 5582 0x15ce 0x280000400 /mnt/lustre2/f93.sanityn-2/file2 lmm_stripe_count: 2 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 5595 0x15db 0x240000400 1 5583 0x15cf 0x280000400 rc1=0 and rc2=0 PASS 93 (8s) == sanityn test 94: signal vs CP callback race =========== 06:24:23 (1734434663) osc.lustre-OST0000-osc-ffff8800a9871800.idle_timeout=0 osc.lustre-OST0000-osc-ffff8800aea1a000.idle_timeout=0 osc.lustre-OST0001-osc-ffff8800a9871800.idle_timeout=0 osc.lustre-OST0001-osc-ffff8800aea1a000.idle_timeout=0 2+0 records in 2+0 records out 8192 bytes (8.2 kB) copied, 0.0443639 s, 185 kB/s fail_val=5 fail_loc=0x80000312 fail_val=6 fail_loc=0x80000329 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 3.00139 s, 1.4 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 5743: 27663 Alarm clock dd if=/dev/zero of=$DIR/$tfile conv=notrunc oflag=append bs=4k count=1 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0155678 s, 263 kB/s osc.lustre-OST0000-osc-ffff8800a9871800.idle_timeout=debug osc.lustre-OST0000-osc-ffff8800aea1a000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800a9871800.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800aea1a000.idle_timeout=debug PASS 94 (10s) == sanityn test 95a: Check readpage() on a page that was removed from page cache ========================================================== 06:24:33 (1734434673) llite.lustre-ffff8800a9871800.fast_read=0 llite.lustre-ffff8800aea1a000.fast_read=0 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.015062 s, 139 MB/s fail_loc=0x80001421 fail_val=7 fail_loc=0x80001422 fail_val=10 llite.lustre-ffff8800a9871800.fast_read=1 llite.lustre-ffff8800aea1a000.fast_read=1 PASS 95a (19s) == sanityn test 95b: Check readpage() on a page that is no longer uptodate ========================================================== 06:24:52 (1734434692) llite.lustre-ffff8800a9871800.fast_read=0 llite.lustre-ffff8800aea1a000.fast_read=0 1+0 records in 1+0 records out 12288 bytes (12 kB) copied, 0.00208242 s, 5.9 MB/s fail_loc=0x80001424 fail_val=5 fail_loc=0 llite.lustre-ffff8800a9871800.fast_read=1 llite.lustre-ffff8800aea1a000.fast_read=1 PASS 95b (8s) == sanityn test 100a: DoM: glimpse RPCs for stat without IO lock (DoM only file) ========================================================== 06:25:00 (1734434700) SKIP: sanityn test_100a Reserved for glimpse-ahead SKIP 100a (1s) == sanityn test 100b: DoM: no glimpse RPC for stat with IO lock (DoM only file) ========================================================== 06:25:01 (1734434701) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00113569 s, 3.6 MB/s /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK PASS 100b (1s) == sanityn test 100c: DoM: write vs stat without IO lock (combined file) ========================================================== 06:25:02 (1734434702) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0180962 s, 116 MB/s /mnt/lustre/d100c.sanityn/dom has type file OK /mnt/lustre/d100c.sanityn/dom has size 2097152 OK PASS 100c (2s) == sanityn test 100d: DoM: write+truncate vs stat without IO lock (combined file) ========================================================== 06:25:04 (1734434704) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0209326 s, 100 MB/s /mnt/lustre/d100d.sanityn/dom has type file OK /mnt/lustre/d100d.sanityn/dom has size 4096 OK PASS 100d (2s) == sanityn test 100e: DoM: read on open and file size ==== 06:25:06 (1734434706) 1+0 records in 1+0 records out 12000 bytes (12 kB) copied, 0.00272127 s, 4.4 MB/s PASS 100e (1s) == sanityn test 101a: Discard DoM data on unlink ========= 06:25:07 (1734434707) /mnt/lustre/f101a.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.000602516 s, 6.8 MB/s PASS 101a (2s) == sanityn test 101b: Discard DoM data on rename ========= 06:25:09 (1734434709) /mnt/lustre/f101b.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.000552924 s, 7.4 MB/s PASS 101b (2s) == sanityn test 101c: Discard DoM data on close-unlink === 06:25:11 (1734434711) /mnt/lustre/f101c.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0005394 s, 7.6 MB/s PASS 101c (3s) SKIP: sanityn test_102 skipping ALWAYS excluded test 102 == sanityn test 103: Test size correctness with lockahead ========================================================== 06:25:14 (1734434714) fail_loc=0x415 fail_loc=0x415 fail_val=2 Incorrect size expected (no glimpse fix): Starting test test23 at 1734434715 lockahead_test: lockahead_test.c:1191: test23: assertion 'sb.st_size == sb2.st_size' failed: size on /mnt/lustre/d103.sanityn/f103.sanityn and /mnt/lustre2/d103.sanityn/f103.sanityn differs: 0 vs 1048576 fail_loc=0 fail_loc=0x214 fail_val=2 Starting test test23 at 1734434717 Finishing test test23 at 1734434718 PASS 103 (7s) == sanityn test 104: Verify that MDS stores atime/mtime/ctime during close ========================================================== 06:25:21 (1734434721) SKIP: sanityn test_104 ldiskfs only test SKIP 104 (1s) == sanityn test 105: Glimpse and lock cancel race ======== 06:25:22 (1734434722) fail_loc=0x416 PASS 105 (21s) == sanityn test 106a: Verify the btime via statx() ======= 06:25:43 (1734434743) SKIP: sanityn test_106a Test only for ldiskfs and statx() supported SKIP 106a (1s) == sanityn test 106b: Glimpse RPCs test for statx ======== 06:25:44 (1734434744) SKIP: sanityn test_106b statx() only test SKIP 106b (1s) == sanityn test 106c: Verify statx attributes mask ======= 06:25:45 (1734434745) SKIP: sanityn test_106c statx() only test SKIP 106c (1s) == sanityn test 107a: Basic grouplock conflict =========== 06:25:46 (1734434746) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0555736 s, 189 MB/s /mnt/lustre/f107a.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 5588 0x15d4 0x280000400 multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.6964 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.6964 First grouplock blocks second one PASS 107a (3s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 06:25:49 (1734434749) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.056225 s, 186 MB/s /mnt/lustre/f107b.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 5603 0x15e3 0x240000400 multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.6964 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (8s) == sanityn test 108a: lseek: parallel updates ============ 06:25:57 (1734434757) 1+0 records in 1+0 records out 10000 bytes (10 kB) copied, 0.00212474 s, 4.7 MB/s fail_val=4 fail_loc=0x80000414 1+0 records in 1+0 records out 8388608 bytes (8.4 MB) copied, 4.19373 s, 2.0 MB/s PASS 108a (6s) == sanityn test 109: Race with several mount instances on 1 node ========================================================== 06:26:03 (1734434763) 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Starting race between client mount instances (50 iterations): Iteration 1 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 3 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 4 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 5 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 6 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 7 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 8 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 9 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 10 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 11 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 12 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 13 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 14 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 15 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 16 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 17 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 18 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 19 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 20 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 21 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 22 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 23 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 24 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 25 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 26 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 27 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 28 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 29 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 30 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 31 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 32 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 33 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 34 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 35 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 36 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 37 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 38 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 39 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 40 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 41 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 42 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 43 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 44 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 45 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_refcnt: could not read integer from '/sys/module/pcc_cpufreq/refcnt': 'No such device' oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 46 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions oleg134-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 47 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 48 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 49 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Iteration 50 Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 192.168.201.134@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.201.134@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg134-client.virtnet /mnt/lustre (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs MODOPTS_LIBCFS= Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg134-server' oleg134-server: oleg134-server.virtnet: executing load_modules_local oleg134-server: Loading modules from /home/green/git/lustre-release/lustre oleg134-server: detected 4 online CPUs by sysfs oleg134-server: MODOPTS_LIBCFS= oleg134-server: Force libcfs to create 2 CPU partitions Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre Starting client: oleg134-client.virtnet: -o user_xattr,flock 192.168.201.134@tcp:/lustre /mnt/lustre2 PASS 109 (396s) == sanityn test 110: do not grant another lock on resend ========================================================== 06:32:39 (1734435159) fail_loc=0x525 fail_val=3 fail_loc=0x534 File: '/mnt/lustre/f110.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205306056707 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-12-17 06:32:39.000000000 -0500 Modify: 2024-12-17 06:32:39.000000000 -0500 Change: 2024-12-17 06:32:39.000000000 -0500 Birth: - fail_loc=0 fail_val=0 Connected clients: oleg134-client.virtnet oleg134-client.virtnet PASS 110 (64s) == sanityn test 111: A racy rename/link an open file should not cause fs corruption ========================================================== 06:33:43 (1734435223) SKIP: sanityn test_111 needs >= 2 MDTs SKIP 111 (1s) == sanityn test 112: update max-inherit in default LMV === 06:33:44 (1734435224) SKIP: sanityn test_112 We need at least 2 MDTs for this test SKIP 112 (1s) == sanityn test 113: check servers of specified fs ======= 06:33:45 (1734435225) lustre-OST0000-osc-ffff88013779a000 active. lustre-OST0001-osc-ffff88013779a000 active. lustre-OST0000-osc-ffff88013779a000 active. lustre-OST0001-osc-ffff88013779a000 active. MGC192.168.201.134@tcp active. PASS 113 (2s) == sanityn test 114: implicit default LMV inherit ======== 06:33:47 (1734435227) SKIP: sanityn test_114 We need at least 2 MDTs for this test SKIP 114 (1s) == sanityn test 115: ldiskfs doesn't check direntry for uniqueness ========================================================== 06:33:48 (1734435228) SKIP: sanityn test_115 ldiskfs only test SKIP 115 (0s) == sanityn test 116: DNE: Set default LMV layout from a remote client ========================================================== 06:33:48 (1734435228) SKIP: sanityn test_116 needs >= 2 MDTs SKIP 116 (1s) == sanityn test 200: service remains healthy while able to process request ========================================================== 06:33:49 (1734435229) at_max=10 at_unhealthy_factor=3 ost.OSS.ost_io.threads_max=21 fail_loc=0x1e1 fail_val=20 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 20.0206 s, 0.2 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied, 20.1116 s, 0.2 kB/s , 20.1134 s, 0.2 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied, 20.1198 s, 0.2 kB/s , 20.1166 s, 0.2 kB/s , 20.1182 s, 0.2 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied, 20.1179 s, 0.2 kB/s , 20.1215 s, 0.2 kB/s , 20.1232 s, 0.2 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.1194 s, 0.1 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied, 40.1679 s, 0.1 kB/s , 40.1986 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.1735 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.212 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.2072 s, 0.1 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied, 40.2026 s, 0.1 kB/s , 40.1773 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 40.201 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.2389 s, 0.1 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied, 60.2892 s, 0.1 kB/s , 60.2601 s, 0.1 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied, 60.2978 s, 0.1 kB/s , 60.3131 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 60.2958 s, 0.1 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied, 60.2709 s, 0.1 kB/s , 60.3193 s, 0.1 kB/s , 60.337 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.2889 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.346 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.3078 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.3535 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 80.3814 s, 0.1 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied, 80.3758 s, 0.1 kB/s , 80.3776 s, 0.1 kB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied4096 bytes (4.1 kB) copied, 80.4024 s, 0.1 kB/s , 80.4071 s, 0.1 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 100.393 s, 0.0 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 100.433 s, 0.0 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 100.473 s, 0.0 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 100.418 s, 0.0 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 100.486 s, 0.0 kB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 100.511 s, 0.0 kB/s at_max=600 at_unhealthy_factor=3 ost.OSS.ost_io.threads_max=116 oleg134-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800b656b800.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800b656b800.ost_server_uuid in IDLE state after 0 sec PASS 200 (105s) cleanup: ====================================================== == sanityn test complete, duration 4650 sec ============== 06:35:35 (1734435335) === sanityn: start cleanup 06:35:35 (1734435335) === Stopping clients: oleg134-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg134-client.virtnet /mnt/lustre2 opts: === sanityn: finish cleanup 06:36:10 (1734435370) ===