-----============= acceptance-small: sanityn ============----- Fri Aug 9 21:17:25 EDT 2024 mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_ID=7 CLIENT_OS_VERSION_CODE=117440512 excepting tests: 27 28 102 skipping tests SLOW=no: 33a === sanityn: start setup 21:17:30 (1723252650) === Starting client oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 Started clients oleg243-client.virtnet: 192.168.202.143@tcp:/lustre on /mnt/lustre2 type lustre (rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project) oleg243-client.virtnet: executing check_config_client /mnt/lustre oleg243-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg243-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8800ab0de800.idle_timeout=debug osc.lustre-OST0000-osc-ffff88012aab2000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800ab0de800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012aab2000.idle_timeout=debug disable quota as required oleg243-server: oleg243-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanityn: finish setup 21:17:36 (1723252656) === 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106767 s, 98.2 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [true] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d0_runas_test/f6965] == sanityn test 0: do_node_vp() and do_facet_vp() do the right thing ========================================================== 21:17:36 (1723252656) PASS 0 (2s) == sanityn test 1: Check attribute updates on 2 mount points ========================================================== 21:17:38 (1723252658) /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0777 OK /mnt/lustre/f1.sanityn has type file OK /mnt/lustre/f1.sanityn has perms 0666 OK /mnt/lustre/f1.sanityn: absent OK PASS 1 (2s) == sanityn test 2a: check cached attribute updates on 2 mtpt's ================================================================== 21:17:40 (1723252660) -rw-r--r-- 1 root root 0 Aug 9 21:17 /mnt/lustre2/f2a /mnt/lustre/f2a has type file OK /mnt/lustre/f2a has perms 0777 OK PASS 2a (1s) == sanityn test 2b: check cached attribute updates on 2 mtpt's ================================================================== 21:17:41 (1723252661) -rw-r--r-- 1 root root 0 Aug 9 21:17 /mnt/lustre2/f2b /mnt/lustre2/f2b has type file OK /mnt/lustre2/f2b has perms 0777 OK PASS 2b (2s) == sanityn test 2c: check cached attribute updates on 2 mtpt's root ============================================================= 21:17:43 (1723252663) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0777 OK PASS 2c (1s) == sanityn test 2d: check cached attribute updates on 2 mtpt's root ============================================================= 21:17:44 (1723252664) /mnt/lustre2 has type dir OK /mnt/lustre2 has perms 0755 OK PASS 2d (2s) == sanityn test 2e: check chmod on root is propagated to others ========================================================== 21:17:46 (1723252666) total 1 -rwxrwxrwx 1 root root 0 Aug 9 21:17 f2a -rwxrwxrwx 1 root root 0 Aug 9 21:17 f2b total 1 -rwxrwxrwx 1 root root 0 Aug 9 21:17 f2a -rwxrwxrwx 1 root root 0 Aug 9 21:17 f2b running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre2/f2e.sanityn] [count=1] 1+0 records in 1+0 records out 512 bytes (512 B) copied, 0.00265983 s, 192 kB/s PASS 2e (2s) == sanityn test 2f: check attr/owner updates on DNE with 2 mtpt's ========================================================== 21:17:48 (1723252668) SKIP: sanityn test_2f needs >= 2 MDTs SKIP 2f (0s) == sanityn test 2g: check blocks update on sync write ==== 21:17:48 (1723252668) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.095362 s, 22.0 MB/s /mnt/lustre/f2g.sanityn has 4103 blocks /mnt/lustre2/f2g.sanityn has 4103 blocks PASS 2g (2s) == sanityn test 3: symlink on one mtpt, readlink on another ===================================================================== 21:17:50 (1723252670) PASS 3 (1s) == sanityn test 4: fstat validation on multiple mount points ==================================================================== 21:17:51 (1723252671) PASS 4 (3s) == sanityn test 5: create a file on one mount, truncate it on the other ========================================================== 21:17:54 (1723252674) /mnt/lustre/f5 has type file OK /mnt/lustre/f5 has size 100 OK PASS 5 (2s) == sanityn test 6: remove of open file on other node ============================================================================ 21:17:56 (1723252676) opening writing unlinking /mnt/lustre2/f6.sanityn accessing (1) seeking (1) accessing (2) fstat... reading comparing data truncating seeking (2) writing again seeking (3) reading again comparing data again closing SUCCESS - goto beer PASS 6 (1s) == sanityn test 7: remove of open directory on other node ======================================================================= 21:17:57 (1723252677) creating directory /mnt/lustre/d7 opening directory unlinking /mnt/lustre/d7 Ok, everything goes well. PASS 7 (2s) == sanityn test 8: remove of open special file on other node ==================================================================== 21:17:59 (1723252679) creating special file /mnt/lustre/f8.sanityn opening file unlinking /mnt/lustre/f8.sanityn Ok, everything goes well. PASS 8 (1s) == sanityn test 9a: append of file with sub-page size on multiple mounts ========================================================== 21:18:00 (1723252680) PASS 9a (2s) == sanityn test 9b: append to striped sparse file ======== 21:18:02 (1723252682) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00982135 s, 107 MB/s 3+0 records in 3+0 records out 3 bytes (3 B) copied, 0.00956282 s, 0.3 kB/s Data read (expecting 'foo'): foo PASS 9b (1s) == sanityn test 10a: write of file with sub-page size on multiple mounts ========================================================== 21:18:03 (1723252683) 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00135242 s, 0.7 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00216633 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00311065 s, 0.3 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00221717 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00213304 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00236347 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.0020776 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00229295 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00255733 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00223341 s, 0.4 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00216213 s, 0.5 kB/s 1+0 records in 1+0 records out 1 byte (1 B) copied, 0.00251331 s, 0.4 kB/s PASS 10a (2s) == sanityn test 10b: write of file with sub-page size on multiple mounts ========================================================== 21:18:05 (1723252685) 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.00198892 s, 1.5 MB/s 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00524611 s, 781 kB/s 1+0 records in 1+0 records out 3072 bytes (3.1 kB) copied, 0.000163772 s, 18.8 MB/s PASS 10b (1s) == sanityn test 11: execution of file opened for write should return error ============================================================== 21:18:06 (1723252686) multiop /mnt/lustre/d11/f vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.6965 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 301: /mnt/lustre2/d11/f: Text file busy PASS 11 (2s) == sanityn test 12: test lock ordering (link, stat, unlink) ========================================================== 21:18:08 (1723252688) warning: '-runtime' deprecated, use '-t runtime' instead - link 2858 (time 1723252698.54 total 10.00 last 285.77) - link 5882 (time 1723252708.54 total 20.00 last 302.32) - link 9040 (time 1723252718.54 total 30.00 last 315.78) - link 10000 (time 1723252721.67 total 33.14 last 306.28) - link 13091 (time 1723252731.67 total 43.14 last 309.09) - link 16121 (time 1723252741.68 total 53.14 last 302.98) - link 17669 (time 1723252751.68 total 63.15 last 154.72) - link 18577 (time 1723252761.68 total 73.15 last 90.77) - link 20000 (time 1723252771.31 total 82.77 last 147.91) - link 21764 (time 1723252781.31 total 92.77 last 176.40) total: 23342 link in 100.00 seconds: 233.42 ops/second using seed 1712769362 running for 100 seconds - stat 10000 (time 1723252694 ; total 5 ; last 5) - stat 20000 (time 1723252699 ; total 10 ; last 5) - stat 30000 (time 1723252704 ; total 15 ; last 5) - stat 40000 (time 1723252708 ; total 19 ; last 4) - stat 50000 (time 1723252713 ; total 24 ; last 5) - stat 60000 (time 1723252718 ; total 29 ; last 5) - stat 70000 (time 1723252723 ; total 34 ; last 5) - stat 80000 (time 1723252728 ; total 39 ; last 5) - stat 90000 (time 1723252733 ; total 44 ; last 5) - stat 100000 (time 1723252737 ; total 48 ; last 4) - stat 109698 (time 1723252748 ; total 59 ; last 11) - stat 110000 (time 1723252749 ; total 60 ; last 1) - stat 114267 (time 1723252760 ; total 71 ; last 11) - stat 119400 (time 1723252771 ; total 82 ; last 11) - stat 120000 (time 1723252772 ; total 83 ; last 1) - stat 126676 (time 1723252783 ; total 94 ; last 11) - stat 130000 (time 1723252788 ; total 99 ; last 5) total: 131050 stats in 100 seconds: 1310.500000 stats/second - unlinked 0 (time 1723252739 ; total 0 ; last 0) - unlinked 10000 (time 1723252815 ; total 76 ; last 76) - unlinked 20000 (time 1723252851 ; total 112 ; last 36) unlink(/mnt/lustre2/lockdir/lockfile23342) error: No such file or directory total: 23341 unlinks in 129 seconds: 180.937988 unlinks/second /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 77: kill: (21281) - No such process /home/green/git/lustre-release/lustre/tests/lockorder.sh: line 78: kill: (21284) - No such process PASS 12 (182s) == sanityn test 13: test directory page revocation ======= 21:21:10 (1723252870) f13 f13 PASS 13 (3s) == sanityn test 14aa: execution of file open for write returns -ETXTBSY ========================================================== 21:21:13 (1723252873) multiop /mnt/lustre/d14aa.sanityn/f14aa.sanityn vOw_c TMPPIPE=/tmp/multiop_open_wait_pipe.6965 /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 336: /mnt/lustre2/d14aa.sanityn/f14aa.sanityn: Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4819: 22698 Terminated $MULTIOP_PROG $FILE v$ARGS > $TMPPIPE (wd: ~) PASS 14aa (3s) == sanityn test 14ab: open(RDWR) of executing file returns -ETXTBSY ========================================================== 21:21:16 (1723252876) open(O_RDWR|O_CREAT): Text file busy /home/green/git/lustre-release/lustre/tests/test-framework.sh: line 4819: 23329 Terminated $DIR1/$tdir/sleep 60 (wd: ~) PASS 14ab (2s) == sanityn test 14b: truncate of executing file returns -ETXTBSY ================================================================ 21:21:18 (1723252878) truncate: cannot truncate '/mnt/lustre2/d14b.sanityn/sleep' to length 60: Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 351: 23960 Terminated $DIR1/$tdir/sleep 60 PASS 14b (3s) == sanityn test 14c: open(O_TRUNC) of executing file return -ETXTBSY ============================================================ 21:21:21 (1723252881) cp: cannot create regular file '/mnt/lustre2/d14c.sanityn/sleep': Text file busy /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 363: 24591 Terminated $DIR1/$tdir/sleep 60 PASS 14c (2s) == sanityn test 14d: chmod of executing file is still possible ================================================================== 21:21:23 (1723252883) chmod /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 374: 25222 Terminated $DIR1/$tdir/sleep 60 PASS 14d (3s) == sanityn test 15: test out-of-space with multiple writers ===================================================================== 21:21:26 (1723252886) PATH=/opt/iozone/bin:/opt/iozone/bin:/home/green/git/lustre-release/lustre/tests/mpi:/home/green/git/lustre-release/lustre/tests/racer:/home/green/git/lustre-release/lustre/../lustre-iokit/sgpdd-survey:/home/green/git/lustre-release/lustre/tests:/home/green/git/lustre-release/lustre/utils/gss:/home/green/git/lustre-release/lustre/utils:/opt/iozone/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin: mgs: CentOS Linux release 7.9.2009 (Core) MGS_OS_VERSION_ID=7 MGS_OS_ID=centos MGS_OS_VERSION_CODE=117440512 MGS_OS_ID_LIKE=rhel fedora centos mds1: CentOS Linux release 7.9.2009 (Core) MDS1_OS_ID_LIKE=rhel fedora centos MDS1_OS_ID=centos MDS1_OS_VERSION_ID=7 MDS1_OS_VERSION_CODE=117440512 ost1: CentOS Linux release 7.9.2009 (Core) OST1_OS_VERSION_CODE=117440512 OST1_OS_VERSION_ID=7 OST1_OS_ID_LIKE=rhel fedora centos OST1_OS_ID=centos client: CentOS Linux release 7.9.2009 (Core) CLIENT_OS_ID=centos CLIENT_OS_ID_LIKE=rhel fedora centos CLIENT_OS_VERSION_CODE=117440512 CLIENT_OS_VERSION_ID=7 STRIPECOUNT=2 ORIGFREE=7521280 MAXFREE=800000 SKIP: oos2 test_15 oos2.sh: 7521280kB free gt MAXFREE 800000kB, increase 800000 (or reduce test fs size) to proceed sleep 5 for ZFS zfs Waiting for MDT destroys to complete SKIP 15 (16s) == sanityn test 16a: 500 iterations of dual-mount fsx ==== 21:21:42 (1723252902) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.276311 s, 30.4 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.274168 s, 30.6 MB/s Chance of close/open is 1 in 50 Seed set to 2904 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported 000002[0] 1723252904.874918 write 0x2338e5 thru 0x243655 (0xfd71 bytes) truncating to largest ever: 0x30fd0a 000003[0] 1723252904.897350 trunc from 0x243656 to 0x30fd09 (0xcc6b4 bytes) 000004[0] 1723252904.921268 mapread 0x236d88 thru 0x241451 (0xa6ca bytes) 000005[1] 1723252904.935427 mapwrite 0x53bf38 thru 0x53ca8e (0xb57 bytes) 000008[1] 1723252905.073597 trunc from 0x53ca8f to 0x19dcb9 (0x39edd5 bytes) 000009[0] 1723252905.095586 write 0x996b10 thru 0x99f024 (0x8515 bytes) 000010[1] 1723252905.116960 write 0x60dad1 thru 0x6140c3 (0x65f3 bytes) 000012[1] 1723252905.143304 read 0x5e9a72 thru 0x5f0868 (0x6df7 bytes) 000014[0] 1723252905.174991 mapwrite 0x27f3d4 thru 0x287950 (0x857d bytes) truncating to largest ever: 0x7f59d7 000016[1] 1723252905.275227 trunc from 0x99f025 to 0x7f59d6 (0x1a964e bytes) 000019[1] 1723252905.299575 mapread 0x5c45f2 thru 0x5cac52 (0x6661 bytes) 000020[0] 1723252905.325332 mapwrite 0x8dfef6 thru 0x8eb683 (0xb78e bytes) 000024[1] 1723252905.454361 mapread 0x5649f3 thru 0x569b1d (0x512b bytes) 000025[1] 1723252905.478875 mapwrite 0x4fab4d thru 0x4ff9ba (0x4e6e bytes) 000026[0] 1723252905.558848 trunc from 0x8eb684 to 0x124676 (0x7c700d bytes) 000027[0] 1723252905.586300 mapwrite 0x7e1e70 thru 0x7edb5a (0xbceb bytes) truncating to largest ever: 0x941618 000028[1] 1723252905.691294 trunc from 0x7edb5b to 0x941617 (0x153abd bytes) 000029[1] 1723252905.715238 mapwrite 0x1f0882 thru 0x1fffdb (0xf75a bytes) 000030[1] 1723252905.813524 write 0x10e209 thru 0x11e011 (0xfe09 bytes) 000033[0] 1723252905.858613 read 0x4e0ddb thru 0x4e5597 (0x47bd bytes) 000034[0] 1723252905.873574 trunc from 0x941618 to 0x7730a0 (0x1ce577 bytes) 000035[1] 1723252905.919629 mapwrite 0x504fe3 thru 0x5071bf (0x21dd bytes) 000037[1] 1723252906.030604 mapwrite 0x1ea048 thru 0x1ed156 (0x310f bytes) 000038[0] 1723252906.104281 mapread 0x4962ee thru 0x4a35ce (0xd2e1 bytes) 000043[0] 1723252906.199240 mapwrite 0x172df1 thru 0x17f4bb (0xc6cb bytes) 000044[1] 1723252906.294560 read 0x2ee119 thru 0x2f430d (0x61f5 bytes) 000045[0] 1723252906.364459 trunc from 0x7730a1 to 0x17d433 (0x5f5c6d bytes) 000048[0] 1723252906.439331 mapread 0x16eed8 thru 0x16f320 (0x449 bytes) 000053[1] 1723252906.492292 mapwrite 0x677011 thru 0x686fcb (0xffbb bytes) 000054[1] 1723252906.632848 write 0x23afc8 thru 0x2427aa (0x77e3 bytes) 000055[1] 1723252906.662128 mapread 0x2b6543 thru 0x2bf760 (0x921e bytes) 000057[0] 1723252906.707743 write 0x8778a1 thru 0x8852e6 (0xda46 bytes) 000059[1] 1723252906.747497 mapwrite 0x1a3403 thru 0x1ad17c (0x9d7a bytes) 000061[1] 1723252906.884313 trunc from 0x8852e7 to 0x191167 (0x6f417f bytes) 000062[0] 1723252906.924052 mapread 0x0f3332 thru 0x0fed34 (0xba03 bytes) 000065[0] 1723252906.973218 read 0x0782f6 thru 0x07f51d (0x7228 bytes) 000066[1] 1723252906.994940 read 0x12833d thru 0x1309f8 (0x86bc bytes) 000067[1] 1723252907.029217 mapwrite 0x6f86ca thru 0x6fd0dc (0x4a13 bytes) 000069[0] 1723252907.183497 read 0x6c5929 thru 0x6c90b6 (0x378e bytes) 000070[0] 1723252907.224459 read 0x246639 thru 0x25544a (0xee12 bytes) 000075[1] 1723252907.312557 trunc from 0x6fd0dd to 0x926e2a (0x229d4e bytes) 000077[1] 1723252907.359798 mapwrite 0x502149 thru 0x50b534 (0x93ec bytes) 000078[1] 1723252907.494611 mapread 0x63234e thru 0x63c96b (0xa61e bytes) 000079[0] 1723252907.565610 trunc from 0x926e2b to 0x1f18c5 (0x735565 bytes) 000081[1] 1723252907.604924 write 0x6024a9 thru 0x610703 (0xe25b bytes) 000082[0] 1723252907.623049 write 0x708395 thru 0x70a226 (0x1e92 bytes) 000084[1] 1723252907.646959 mapwrite 0x66fc90 thru 0x670b49 (0xeba bytes) 000088[1] 1723252907.770913 mapread 0x3c6df2 thru 0x3d546e (0xe67d bytes) 000090[1] 1723252907.853835 trunc from 0x70a227 to 0x4dac39 (0x22f5ed bytes) 000094[1] 1723252907.903896 mapwrite 0x9c1972 thru 0x9c2066 (0x6f5 bytes) 000096[1] 1723252907.978120 trunc from 0x9c2067 to 0x4ada88 (0x5145de bytes) 000100[0] 1723252908.009242 write 0x1a1698 thru 0x1aaded (0x9756 bytes) 000104[1] 1723252908.075407 write 0x9f9061 thru 0x9fe5ca (0x556a bytes) 000105[1] 1723252908.093802 mapwrite 0x1b52b6 thru 0x1c126d (0xbfb8 bytes) 000106[0] 1723252908.183610 mapread 0x96899c thru 0x975c71 (0xd2d6 bytes) 000107[0] 1723252908.245056 read 0x4aceba thru 0x4b292d (0x5a74 bytes) 000114[0] 1723252908.322601 write 0x73eff9 thru 0x7473b3 (0x83bb bytes) 000115[1] 1723252908.342786 read 0x5f00b4 thru 0x5f165b (0x15a8 bytes) 000119[0] 1723252908.358221 trunc from 0x9fe5cb to 0x7be8cb (0x23fcff bytes) 000120[1] 1723252908.382342 trunc from 0x7be8cc to 0x139750 (0x68517b bytes) 000123[0] 1723252908.419310 write 0x9b3f48 thru 0x9bf960 (0xba19 bytes) 000125[0] 1723252908.443901 write 0x832543 thru 0x837f33 (0x59f1 bytes) 000126[0] 1723252908.461534 trunc from 0x9bf961 to 0x1ffc07 (0x7bfd59 bytes) 000127[0] 1723252908.476262 trunc from 0x1ffc08 to 0x27bd48 (0x7c141 bytes) 000128[0] 1723252908.492658 mapwrite 0x247fbf thru 0x24c5a2 (0x45e4 bytes) 000129[1] 1723252908.549117 mapwrite 0x357ebd thru 0x35b30c (0x3450 bytes) 000130[1] 1723252908.617706 mapwrite 0x5b3b35 thru 0x5c0130 (0xc5fc bytes) 000131[0] 1723252908.690100 mapwrite 0x72b8e4 thru 0x73af20 (0xf63d bytes) 000132[1] 1723252908.783880 write 0x1fbd0b thru 0x203bd8 (0x7ece bytes) 000136[1] 1723252908.834517 mapwrite 0x4da28b thru 0x4e3980 (0x96f6 bytes) 000137[1] 1723252908.911492 write 0x4af04a thru 0x4bb71e (0xc6d5 bytes) 000138[0] 1723252908.932323 write 0x39811c thru 0x3a377f (0xb664 bytes) 000139[1] 1723252908.952598 write 0x1e1495 thru 0x1ec5f4 (0xb160 bytes) 000141[1] 1723252908.966052 mapwrite 0x1e31a2 thru 0x1f0d8c (0xdbeb bytes) 000142[0] 1723252909.030248 mapread 0x34e335 thru 0x351619 (0x32e5 bytes) 000143[1] 1723252909.060079 write 0x9b2415 thru 0x9be2ce (0xbeba bytes) 000145[0] 1723252909.066626 write 0x2191ce thru 0x21f798 (0x65cb bytes) 000147[0] 1723252909.097541 mapread 0x478740 thru 0x47fc0b (0x74cc bytes) 000148[1] 1723252909.134189 mapread 0x9ac3f7 thru 0x9acebd (0xac7 bytes) 000149[1] 1723252909.149162 read 0x2421f2 thru 0x24465f (0x246e bytes) 000151[1] 1723252909.202346 trunc from 0x9be2cf to 0x0f7536 (0x8c6d98 bytes) 000157[1] 1723252909.299953 mapwrite 0x320840 thru 0x32c5a7 (0xbd68 bytes) 000158[1] 1723252909.378992 read 0x163106 thru 0x16cef4 (0x9def bytes) 000160[1] 1723252909.413869 mapwrite 0x49bda8 thru 0x4a5b5d (0x9db6 bytes) 000161[0] 1723252909.493394 mapwrite 0x31f1d9 thru 0x321334 (0x215c bytes) 000162[0] 1723252909.552490 write 0x61a6d6 thru 0x620cae (0x65d9 bytes) 000163[1] 1723252909.559771 read 0x15c311 thru 0x16731b (0xb00b bytes) 000167[0] 1723252909.627428 write 0x9fe974 thru 0x9fffff (0x168c bytes) 000168[0] 1723252909.639383 trunc from 0xa00000 to 0x933ec1 (0xcc13e bytes) 000171[0] 1723252909.681929 mapread 0x22a23b thru 0x22a4d3 (0x299 bytes) 000177[0] 1723252909.722069 write 0x020bf0 thru 0x0275b6 (0x69c7 bytes) 000182[0] 1723252909.749743 mapwrite 0x87b552 thru 0x8842c8 (0x8d77 bytes) 000184[0] 1723252909.812427 trunc from 0x933ec2 to 0x6869fc (0x2ad4c5 bytes) 000186[1] 1723252909.825419 read 0x08fa64 thru 0x095b31 (0x60ce bytes) 000189[0] 1723252909.882746 write 0x2c4e4b thru 0x2c9f75 (0x512b bytes) 000191[0] 1723252909.914042 mapread 0x136d0c thru 0x142172 (0xb467 bytes) 000194[0] 1723252909.947497 mapread 0x071050 thru 0x0731ab (0x215c bytes) 000197[0] 1723252909.968567 write 0x695820 thru 0x697ec6 (0x26a7 bytes) 000198[1] 1723252909.969161 trunc from 0x697ec7 to 0x71e01a (0x86154 bytes) 000200[0] 1723252909.996013 mapread 0x45c6fd thru 0x46a2f8 (0xdbfc bytes) 000201[0] 1723252910.052652 read 0x37b75b thru 0x37b8f1 (0x197 bytes) 000202[1] 1723252910.061887 mapwrite 0x7baa52 thru 0x7bdd14 (0x32c3 bytes) 000203[1] 1723252910.154765 mapwrite 0x53286d thru 0x542134 (0xf8c8 bytes) 000204[1] 1723252910.194280 trunc from 0x7bdd15 to 0x251e7c (0x56be98 bytes) 000209[1] 1723252910.240891 mapwrite 0x410135 thru 0x41b9af (0xb87b bytes) 000210[0] 1723252910.360418 mapread 0x36c41f thru 0x36d4b7 (0x1099 bytes) 000214[0] 1723252910.423757 mapwrite 0x04229c thru 0x050089 (0xddee bytes) 000215[0] 1723252910.495820 trunc from 0x41b9b0 to 0x116cc8 (0x304ce7 bytes) 000216[0] 1723252910.507599 mapread 0x0473de thru 0x054e79 (0xda9c bytes) 000217[0] 1723252910.508353 write 0x197f2c thru 0x19feb1 (0x7f86 bytes) truncating to largest ever: 0x95ede9 000218[1] 1723252910.519815 trunc from 0x19feb2 to 0x95ede8 (0x7bef37 bytes) 000219[0] 1723252910.553492 mapwrite 0x4440f1 thru 0x4482d5 (0x41e5 bytes) 000223[0] 1723252910.664204 trunc from 0x95ede9 to 0x0e7bf6 (0x8771f2 bytes) 000224[0] 1723252910.684920 mapwrite 0x580b60 thru 0x58b0ca (0xa56b bytes) 000225[0] 1723252910.761167 mapwrite 0x08b3d9 thru 0x092d54 (0x797c bytes) 000229[0] 1723252910.844854 mapread 0x0a1326 thru 0x0afb26 (0xe801 bytes) 000236[1] 1723252910.894392 trunc from 0x58b0cb to 0x4f2a75 (0x98655 bytes) 000238[0] 1723252910.920514 write 0x019a5a thru 0x021a8a (0x8031 bytes) 000240[1] 1723252910.959852 trunc from 0x4f2a76 to 0x833bc1 (0x34114c bytes) 000242[1] 1723252910.983614 mapread 0x444b7d thru 0x44c532 (0x79b6 bytes) 000244[0] 1723252911.015045 mapwrite 0x6fbb41 thru 0x70a3e1 (0xe8a1 bytes) 000246[1] 1723252911.111018 write 0x665b6b thru 0x6759bc (0xfe52 bytes) 000248[1] 1723252911.139608 mapwrite 0x2a3e7f thru 0x2a8c84 (0x4e06 bytes) 000250[0] 1723252911.222186 trunc from 0x833bc2 to 0x3fad71 (0x438e50 bytes) 000251[1] 1723252911.246917 mapread 0x3efff7 thru 0x3fad71 (0xad7b bytes) 000253[1] 1723252911.320801 write 0x0d44a4 thru 0x0df8f2 (0xb44f bytes) 000254[0] 1723252911.343894 mapwrite 0x57ec3b thru 0x588aba (0x9e80 bytes) 000255[1] 1723252911.440501 write 0x243a1c thru 0x2459c4 (0x1fa9 bytes) 000258[0] 1723252911.495831 mapread 0x4e1052 thru 0x4ed5ad (0xc55c bytes) 000260[1] 1723252911.526528 mapwrite 0x136b5d thru 0x13ff66 (0x940a bytes) 000261[0] 1723252911.594448 read 0x39fefb thru 0x3a728d (0x7393 bytes) 000262[1] 1723252911.660621 mapread 0x0ad96a thru 0x0b7c92 (0xa329 bytes) 000266[1] 1723252911.719072 read 0x180d18 thru 0x18d8bb (0xcba4 bytes) 000268[1] 1723252911.761612 read 0x1355fb thru 0x138e60 (0x3866 bytes) 000270[0] 1723252911.762224 mapread 0x2aeb8a thru 0x2b60b1 (0x7528 bytes) 000271[0] 1723252911.763300 mapread 0x3e37df thru 0x3eee17 (0xb639 bytes) 000272[1] 1723252911.764485 trunc from 0x588abb to 0x611b50 (0x89096 bytes) 000273[1] 1723252911.798110 mapread 0x419f5f thru 0x423578 (0x961a bytes) 000274[1] 1723252911.853052 write 0x62d6bd thru 0x635bb5 (0x84f9 bytes) 000275[0] 1723252911.864062 mapread 0x52a1db thru 0x538563 (0xe389 bytes) 000276[0] 1723252911.974345 mapread 0x13696b thru 0x14674f (0xfde5 bytes) 000277[0] 1723252912.068100 trunc from 0x635bb6 to 0x621bd8 (0x13fdd bytes) 000282[0] 1723252912.113214 read 0x3c4095 thru 0x3c850b (0x4477 bytes) 000283[1] 1723252912.156807 mapread 0x024895 thru 0x031df9 (0xd565 bytes) 000284[1] 1723252912.237587 mapwrite 0x6e5b76 thru 0x6e8f95 (0x3420 bytes) 000286[0] 1723252912.332635 mapwrite 0x9e8234 thru 0x9f3306 (0xb0d3 bytes) 000288[0] 1723252912.439340 trunc from 0x9f3307 to 0x2253cf (0x7cdf37 bytes) 000289[0] 1723252912.451132 trunc from 0x2253d0 to 0x09b89b (0x189b34 bytes) 000290[0] 1723252912.460211 mapread 0x021384 thru 0x02d2c6 (0xbf43 bytes) 000292[0] 1723252912.511393 mapwrite 0x4e6833 thru 0x4e83aa (0x1b78 bytes) 000297[1] 1723252912.601146 trunc from 0x4e83ab to 0x02e7b5 (0x4b9bf5 bytes) 000298[1] 1723252912.626801 trunc from 0x02e7b6 to 0x8ee8f1 (0x8c013c bytes) 000299[0] 1723252912.639805 read 0x19869e thru 0x19a277 (0x1bda bytes) 000302[1] 1723252912.696053 mapread 0x1b856c thru 0x1bef55 (0x69ea bytes) 000304[0] 1723252912.745819 read 0x2fbfc4 thru 0x30afc0 (0xeffd bytes) 000305[1] 1723252912.746294 write 0x78bbcb thru 0x793598 (0x79ce bytes) 000306[0] 1723252912.759875 mapwrite 0x39cd45 thru 0x3a6ec8 (0xa184 bytes) 000308[0] 1723252912.879824 read 0x69da00 thru 0x6a13b7 (0x39b8 bytes) 000310[1] 1723252912.939607 trunc from 0x8ee8f2 to 0x6740f8 (0x27a7f9 bytes) 000311[1] 1723252912.978441 write 0x70ed35 thru 0x713c68 (0x4f34 bytes) 000312[1] 1723252912.982169 read 0x66d188 thru 0x677b3f (0xa9b8 bytes) 000313[1] 1723252913.021052 read 0x1312f1 thru 0x13577f (0x448f bytes) 000314[1] 1723252913.033435 trunc from 0x713c69 to 0x5e122c (0x132a3c bytes) 000315[1] 1723252913.049911 read 0x3ddb65 thru 0x3e3986 (0x5e22 bytes) 000316[0] 1723252913.052592 trunc from 0x5e122d to 0x0cface (0x51175e bytes) 000317[0] 1723252913.076903 mapread 0x070e50 thru 0x0749a4 (0x3b55 bytes) 000318[1] 1723252913.091953 write 0x480b43 thru 0x486ddb (0x6299 bytes) 000321[1] 1723252913.128655 trunc from 0x486ddc to 0x900682 (0x4798a7 bytes) 000323[1] 1723252913.163451 mapread 0x8dd7c9 thru 0x8e0cf9 (0x3531 bytes) 000324[0] 1723252913.237282 read 0x4d4ab3 thru 0x4e47a3 (0xfcf1 bytes) 000325[0] 1723252913.292196 write 0x694302 thru 0x69d414 (0x9113 bytes) 000327[1] 1723252913.319866 write 0x377970 thru 0x378817 (0xea8 bytes) 000329[1] 1723252913.339108 mapwrite 0x12645a thru 0x130047 (0x9bee bytes) 000332[1] 1723252913.407591 write 0x4c5965 thru 0x4cfea2 (0xa53e bytes) 000333[0] 1723252913.423394 mapwrite 0x3161da thru 0x31aa98 (0x48bf bytes) 000335[1] 1723252913.513737 mapread 0x517391 thru 0x524b4e (0xd7be bytes) 000338[0] 1723252913.592560 write 0x632503 thru 0x632c52 (0x750 bytes) 000341[1] 1723252913.661657 write 0x38adf1 thru 0x395ba2 (0xadb2 bytes) 000344[0] 1723252913.703115 write 0x681c66 thru 0x689b5b (0x7ef6 bytes) 000345[0] 1723252913.710658 mapread 0x4249f2 thru 0x42dd1d (0x932c bytes) 000346[0] 1723252913.723219 mapread 0x77d981 thru 0x785dba (0x843a bytes) 000347[1] 1723252913.736508 read 0x666d79 thru 0x675b56 (0xedde bytes) 000348[0] 1723252913.822143 read 0x26fd36 thru 0x271277 (0x1542 bytes) 000351[0] 1723252913.875252 mapwrite 0x32e1b7 thru 0x33489a (0x66e4 bytes) 000352[0] 1723252913.979579 trunc from 0x900683 to 0x6ab542 (0x255140 bytes) 000354[0] 1723252914.005564 mapwrite 0x5d1a0a thru 0x5dc995 (0xaf8c bytes) 000355[0] 1723252914.072111 write 0x868da3 thru 0x8757a2 (0xca00 bytes) 000357[0] 1723252914.081120 mapread 0x16d3a0 thru 0x17c743 (0xf3a4 bytes) 000359[1] 1723252914.120143 trunc from 0x8757a3 to 0x948749 (0xd2fa7 bytes) 000360[1] 1723252914.142205 mapread 0x5885a2 thru 0x58eee0 (0x693f bytes) truncating to largest ever: 0x9bcc9b 000362[1] 1723252914.172942 trunc from 0x94874a to 0x9bcc9a (0x74551 bytes) 000366[1] 1723252914.207846 trunc from 0x9bcc9b to 0x6d08c0 (0x2ec3da bytes) 000367[1] 1723252914.238254 mapread 0x125f5e thru 0x12a82a (0x48cd bytes) 000369[0] 1723252914.254343 mapread 0x24c6ce thru 0x25ae4e (0xe781 bytes) 000370[0] 1723252914.313642 read 0x4d2c51 thru 0x4ddaec (0xae9c bytes) 000371[0] 1723252914.361492 trunc from 0x6d08c1 to 0x567be1 (0x168cdf bytes) 000372[1] 1723252914.394701 mapread 0x053dde thru 0x05683b (0x2a5e bytes) 000374[0] 1723252914.421588 read 0x47e92c thru 0x48338c (0x4a61 bytes) 000376[1] 1723252914.449605 mapwrite 0x9ee483 thru 0x9fbdd5 (0xd953 bytes) 000379[0] 1723252914.553039 write 0x32d57f thru 0x334161 (0x6be3 bytes) 000381[0] 1723252914.589329 mapread 0x590bc1 thru 0x595ada (0x4f1a bytes) 000382[1] 1723252914.637098 read 0x7f083e thru 0x7fed21 (0xe4e4 bytes) 000383[0] 1723252914.682203 mapwrite 0x4e77da thru 0x4f3d66 (0xc58d bytes) 000384[1] 1723252914.791779 mapwrite 0x167487 thru 0x173276 (0xbdf0 bytes) 000385[1] 1723252914.891395 read 0x51843c thru 0x51c6b2 (0x4277 bytes) 000387[0] 1723252914.954959 read 0x5fa5ca thru 0x6033db (0x8e12 bytes) 000388[0] 1723252914.994616 read 0x5ab8ea thru 0x5baf99 (0xf6b0 bytes) 000389[0] 1723252915.045166 read 0x387244 thru 0x394f3b (0xdcf8 bytes) 000392[0] 1723252915.127739 read 0x8d5b8f thru 0x8e443d (0xe8af bytes) 000393[0] 1723252915.151406 mapread 0x62973f thru 0x636956 (0xd218 bytes) 000395[0] 1723252915.161181 trunc from 0x9fbdd6 to 0x4b8289 (0x543b4c bytes) 000396[0] 1723252915.208112 trunc from 0x4b828a to 0x402a57 (0xb5832 bytes) 000397[0] 1723252915.220895 mapwrite 0x30cd15 thru 0x314f28 (0x8214 bytes) 000398[0] 1723252915.302026 mapwrite 0x7ff88a thru 0x8016ea (0x1e61 bytes) 000402[1] 1723252915.431225 read 0x426e61 thru 0x4271f7 (0x397 bytes) 000403[0] 1723252915.448572 mapwrite 0x84c237 thru 0x85322d (0x6ff7 bytes) 000404[1] 1723252915.518502 mapwrite 0x2e52ae thru 0x2ec6a2 (0x73f5 bytes) 000405[0] 1723252915.615099 read 0x17198d thru 0x178aa5 (0x7119 bytes) 000408[0] 1723252915.687690 mapread 0x06e62d thru 0x06f3f4 (0xdc8 bytes) 000409[1] 1723252915.688806 mapread 0x831ec2 thru 0x835f18 (0x4057 bytes) 000410[1] 1723252915.721166 trunc from 0x85322e to 0x53d1b1 (0x31607c bytes) 000411[1] 1723252915.772124 mapwrite 0x465812 thru 0x4726c9 (0xceb8 bytes) 000412[1] 1723252915.849810 trunc from 0x53d1b2 to 0x96ad62 (0x42dbb1 bytes) 000414[0] 1723252915.876519 read 0x198756 thru 0x1a78a3 (0xf14e bytes) 000415[0] 1723252915.936262 mapread 0x7f0cf3 thru 0x7f267c (0x198a bytes) 000416[1] 1723252915.983960 mapwrite 0x1c625e thru 0x1d5df2 (0xfb95 bytes) 000417[0] 1723252916.128015 mapread 0x64e97d thru 0x6565fd (0x7c81 bytes) 000418[0] 1723252916.145087 mapread 0x2d48a5 thru 0x2e018d (0xb8e9 bytes) 000419[1] 1723252916.228531 write 0x100e13 thru 0x102996 (0x1b84 bytes) 000425[0] 1723252916.259875 mapread 0x1b8400 thru 0x1c3d6c (0xb96d bytes) 000427[0] 1723252916.291659 write 0x838533 thru 0x840706 (0x81d4 bytes) 000431[1] 1723252916.307545 mapread 0x86231c thru 0x86675f (0x4444 bytes) 000433[1] 1723252916.327726 read 0x8d5fff thru 0x8d69d8 (0x9da bytes) 000434[1] 1723252916.373836 mapwrite 0x369d61 thru 0x36fe4f (0x60ef bytes) 000436[1] 1723252916.448317 trunc from 0x96ad63 to 0x0174f2 (0x953870 bytes) 000437[1] 1723252916.466848 mapread 0x00c72e thru 0x016881 (0xa154 bytes) 000438[0] 1723252916.497240 write 0x5fd9ca thru 0x60d4a4 (0xfadb bytes) 000440[1] 1723252916.514467 mapwrite 0x3055e7 thru 0x30c6a9 (0x70c3 bytes) 000441[1] 1723252916.629002 mapread 0x005219 thru 0x00cddb (0x7bc3 bytes) 000442[1] 1723252916.647439 write 0x08fa1b thru 0x0916db (0x1cc1 bytes) 000444[0] 1723252916.666441 trunc from 0x60d4a5 to 0x1b8b84 (0x454920 bytes) 000447[0] 1723252916.690266 write 0x9d5f73 thru 0x9e3993 (0xda21 bytes) 000449[0] 1723252916.701487 mapwrite 0x4c1403 thru 0x4c617c (0x4d7a bytes) 000450[0] 1723252916.761851 trunc from 0x9e3994 to 0x43f865 (0x5a412e bytes) 000451[1] 1723252916.781027 mapwrite 0x14a270 thru 0x1508d5 (0x6666 bytes) 000456[1] 1723252916.881702 mapwrite 0x0f2613 thru 0x10025c (0xdc4a bytes) 000458[1] 1723252916.953171 write 0x59eccb thru 0x59fec5 (0x11fb bytes) 000462[0] 1723252916.971602 mapwrite 0x421096 thru 0x42ecc7 (0xdc32 bytes) 000463[1] 1723252917.069000 mapread 0x3b8563 thru 0x3c1da0 (0x983e bytes) 000466[1] 1723252917.119643 write 0x167392 thru 0x172e51 (0xbac0 bytes) 000467[1] 1723252917.135005 write 0x7814cd thru 0x79060f (0xf143 bytes) 000468[1] 1723252917.149748 mapwrite 0x0aec36 thru 0x0b1c8a (0x3055 bytes) 000470[0] 1723252917.201897 mapwrite 0x3acfd4 thru 0x3ad4f5 (0x522 bytes) 000472[1] 1723252917.274429 trunc from 0x790610 to 0x02783d (0x768dd2 bytes) 000477[1] 1723252917.323976 mapwrite 0x33233c thru 0x33cf83 (0xac48 bytes) 000478[1] 1723252917.412081 mapread 0x1c4470 thru 0x1d251a (0xe0ab bytes) 000479[0] 1723252917.452578 write 0x245263 thru 0x250cd7 (0xba75 bytes) 000481[1] 1723252917.477823 mapwrite 0x7bc76b thru 0x7c2a1c (0x62b2 bytes) 000482[0] 1723252917.540407 write 0x5eaf3b thru 0x5fa6f8 (0xf7be bytes) 000483[0] 1723252917.554410 write 0x6c4ad3 thru 0x6c7a4b (0x2f79 bytes) 000491[0] 1723252917.623191 write 0x64b38c thru 0x65871c (0xd391 bytes) 000494[0] 1723252917.648880 write 0x8ee47b thru 0x8ee7d2 (0x358 bytes) 000498[0] 1723252917.654231 mapwrite 0x5a8ed8 thru 0x5b2cef (0x9e18 bytes) 000499[1] 1723252917.723293 read 0x52fe9b thru 0x5332d6 (0x343c bytes) All operations completed A-OK! Chance of close/open is 1 in 50 Seed set to 2917 fd 0: /mnt/lustre/f16a.sanityn fd 1: /mnt/lustre2/f16a.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read 000002[0] 1723252918.049093 write_OD 0x413000 thru 0x41bfff (0x9000 bytes) 000003[1] 1723252918.079628 write 0x35e000 thru 0x3689cc (0xa9cd bytes) 000004[1] 1723252918.092589 read 0x223000 thru 0x226272 (0x3273 bytes) truncating to largest ever: 0x1f0a9d 000005[0] 1723252918.105714 trunc from 0x41c000 to 0x1f0a9c (0x22b563 bytes) 000010[1] 1723252918.142759 mapread 0x157000 thru 0x16386e (0xc86f bytes) 000014[1] 1723252918.171431 mapwrite 0x2de000 thru 0x2e3370 (0x5371 bytes) 000018[0] 1723252918.257262 write 0x4c0000 thru 0x4c2cda (0x2cdb bytes) 000022[0] 1723252918.276406 read 0x239000 thru 0x23f5a9 (0x65aa bytes) truncating to largest ever: 0x52795c 000023[1] 1723252918.287585 trunc from 0x4c2cdb to 0x52795b (0x64c81 bytes) 000025[1] 1723252918.304227 mapwrite 0x7a7000 thru 0x7b2e45 (0xbe46 bytes) truncating to largest ever: 0x833d5c 000027[0] 1723252918.371989 trunc from 0x7b2e46 to 0x833d5b (0x80f16 bytes) 000028[0] 1723252918.397493 mapwrite 0x955000 thru 0x95f2e6 (0xa2e7 bytes) 000029[0] 1723252918.468022 trunc from 0x95f2e7 to 0x1c1cb1 (0x79d635 bytes) 000031[1] 1723252918.489220 read 0x19b000 thru 0x1a641b (0xb41c bytes) 000032[0] 1723252918.517849 read 0x0df000 thru 0x0e74b7 (0x84b8 bytes) 000033[1] 1723252918.540420 trunc from 0x1c1cb2 to 0x3c6167 (0x2044b6 bytes) 000035[1] 1723252918.557641 read 0x225000 thru 0x233851 (0xe852 bytes) 000037[0] 1723252918.601829 read 0x37f000 thru 0x38e891 (0xf892 bytes) 000038[0] 1723252918.649081 write 0x830000 thru 0x8323e0 (0x23e1 bytes) 000042[0] 1723252918.681164 write 0x962000 thru 0x96fa8c (0xda8d bytes) 000043[1] 1723252918.694111 write 0x6cc000 thru 0x6d72ed (0xb2ee bytes) 000045[0] 1723252918.747597 mapread 0x8d9000 thru 0x8e7701 (0xe702 bytes) 000046[1] 1723252918.831093 trunc from 0x96fa8d to 0x4c4300 (0x4ab78c bytes) 000047[1] 1723252918.870261 trunc from 0x4c4301 to 0x5c4c54 (0x100954 bytes) 000053[0] 1723252918.912363 mapread 0x163000 thru 0x163fe4 (0xfe5 bytes) 000055[0] 1723252918.925044 read 0x076000 thru 0x08110e (0xb10f bytes) 000057[0] 1723252918.975529 trunc from 0x5c4c55 to 0x2805b2 (0x3446a2 bytes) 000059[1] 1723252919.021270 write 0x0da000 thru 0x0e6014 (0xc015 bytes) 000060[1] 1723252919.031601 read 0x26f000 thru 0x27e539 (0xf53a bytes) 000062[0] 1723252919.059869 read 0x119000 thru 0x1214bb (0x84bc bytes) 000063[1] 1723252919.097414 write 0x4b4000 thru 0x4c34ee (0xf4ef bytes) 000066[0] 1723252919.124543 mapwrite 0x9ee000 thru 0x9f78f9 (0x98fa bytes) 000068[0] 1723252919.298301 read 0x16c000 thru 0x176dbf (0xadc0 bytes) 000069[0] 1723252919.343517 mapwrite 0x02b000 thru 0x0310d9 (0x60da bytes) 000073[1] 1723252919.411960 write 0x054000 thru 0x05404f (0x50 bytes) 000075[0] 1723252919.496449 mapread 0x8c6000 thru 0x8cbd39 (0x5d3a bytes) 000077[1] 1723252919.536426 read 0x4d5000 thru 0x4d6270 (0x1271 bytes) 000082[1] 1723252919.616035 trunc from 0x9f78fa to 0x28510c (0x7727ed bytes) 000083[0] 1723252919.644923 write 0x5ad000 thru 0x5b4aad (0x7aae bytes) 000086[0] 1723252919.655372 mapread 0x2df000 thru 0x2e63ef (0x73f0 bytes) 000089[0] 1723252919.705703 read 0x12a000 thru 0x134c52 (0xac53 bytes) 000091[1] 1723252919.758017 mapread 0x025000 thru 0x02b9ce (0x69cf bytes) 000092[0] 1723252919.806033 write 0x1d0000 thru 0x1dc74a (0xc74b bytes) 000096[1] 1723252919.855593 read 0x2a7000 thru 0x2b278f (0xb790 bytes) 000099[1] 1723252919.923012 write 0x968000 thru 0x977041 (0xf042 bytes) 000101[1] 1723252919.935255 write 0x092000 thru 0x094af5 (0x2af6 bytes) 000102[0] 1723252919.968811 write 0x5ad000 thru 0x5addf3 (0xdf4 bytes) 000104[1] 1723252920.021618 read 0x786000 thru 0x793708 (0xd709 bytes) 000105[1] 1723252920.143110 mapread 0x3d7000 thru 0x3e1abb (0xaabc bytes) 000108[0] 1723252920.148227 read 0x5fd000 thru 0x601b1e (0x4b1f bytes) 000109[0] 1723252920.223918 trunc from 0x977042 to 0x724775 (0x2528cc bytes) 000115[0] 1723252920.289642 write 0x472000 thru 0x477b13 (0x5b14 bytes) 000117[0] 1723252920.309922 write 0x1d7000 thru 0x1da75d (0x375e bytes) 000118[1] 1723252920.313260 mapread 0x023000 thru 0x02543f (0x2440 bytes) 000124[0] 1723252920.340260 trunc from 0x724776 to 0x31043f (0x414336 bytes) 000125[0] 1723252920.362649 mapread 0x024000 thru 0x02c98b (0x898c bytes) 000127[1] 1723252920.396116 trunc from 0x310440 to 0x5e7e03 (0x2d79c4 bytes) 000128[0] 1723252920.427223 write 0x16c000 thru 0x16f2aa (0x32ab bytes) 000129[1] 1723252920.446106 mapwrite 0x65c000 thru 0x665e65 (0x9e66 bytes) 000131[1] 1723252920.536103 mapread 0x017000 thru 0x01ea8b (0x7a8c bytes) 000132[1] 1723252920.558733 mapread 0x2d6000 thru 0x2dac1b (0x4c1c bytes) truncating to largest ever: 0x994540 000133[0] 1723252920.581682 trunc from 0x665e66 to 0x99453f (0x32e6da bytes) 000134[1] 1723252920.606793 write 0x37d000 thru 0x3870e0 (0xa0e1 bytes) 000135[0] 1723252920.621784 trunc from 0x994540 to 0x0163b4 (0x97e18b bytes) 000138[1] 1723252920.675862 mapread 0x005000 thru 0x012bb2 (0xdbb3 bytes) 000140[1] 1723252920.722727 mapwrite 0x036000 thru 0x042c10 (0xcc11 bytes) 000142[1] 1723252920.830217 mapwrite 0x2e1000 thru 0x2ee1dc (0xd1dd bytes) 000143[1] 1723252920.932471 mapread 0x12f000 thru 0x139c7b (0xac7c bytes) 000144[1] 1723252920.970706 mapread 0x181000 thru 0x18d479 (0xc47a bytes) 000146[0] 1723252921.005347 mapwrite 0x197000 thru 0x1a4f4e (0xdf4f bytes) 000147[1] 1723252921.097146 mapwrite 0x689000 thru 0x690677 (0x7678 bytes) 000149[1] 1723252921.184186 mapwrite 0x563000 thru 0x569b9a (0x6b9b bytes) 000153[0] 1723252921.241367 read 0x38c000 thru 0x38ef74 (0x2f75 bytes) 000154[0] 1723252921.285642 read 0x3e8000 thru 0x3f673e (0xe73f bytes) 000155[0] 1723252921.286002 mapwrite 0x4c1000 thru 0x4c1421 (0x422 bytes) 000156[0] 1723252921.392276 mapwrite 0x3e3000 thru 0x3e930e (0x630f bytes) 000157[0] 1723252921.437136 read 0x5cf000 thru 0x5d13e3 (0x23e4 bytes) 000159[0] 1723252921.454994 mapwrite 0x819000 thru 0x82438a (0xb38b bytes) truncating to largest ever: 0x9fff7d 000160[0] 1723252921.529321 trunc from 0x82438b to 0x9fff7c (0x1dbbf2 bytes) 000162[0] 1723252921.562000 trunc from 0x9fff7d to 0x576121 (0x489e5b bytes) 000164[0] 1723252921.592235 write 0x122000 thru 0x12750b (0x550c bytes) 000166[0] 1723252921.602302 write 0x874000 thru 0x874a03 (0xa04 bytes) 000167[1] 1723252921.603406 trunc from 0x874a04 to 0x538010 (0x33c9f3 bytes) 000168[0] 1723252921.635044 read 0x344000 thru 0x34f01c (0xb01d bytes) 000169[1] 1723252921.682115 trunc from 0x538011 to 0x3da1b8 (0x15de58 bytes) 000170[0] 1723252921.706320 write 0x689000 thru 0x68ac66 (0x1c67 bytes) 000172[0] 1723252921.727454 mapwrite 0x824000 thru 0x8298de (0x58df bytes) 000173[0] 1723252921.809811 trunc from 0x8298df to 0x8a4c74 (0x7b396 bytes) 000174[1] 1723252921.829638 trunc from 0x8a4c75 to 0x9549e9 (0xafd75 bytes) 000175[0] 1723252921.855533 mapread 0x4b3000 thru 0x4c046f (0xd470 bytes) 000176[1] 1723252921.938390 write 0x786000 thru 0x78a4d5 (0x44d6 bytes) 000177[0] 1723252921.948932 mapread 0x8e6000 thru 0x8ea63b (0x463c bytes) 000178[1] 1723252921.973848 trunc from 0x9549ea to 0x0ea3e8 (0x86a601 bytes) 000181[0] 1723252922.003342 write 0x5d2000 thru 0x5d4687 (0x2688 bytes) 000182[1] 1723252922.019235 read 0x139000 thru 0x148f43 (0xff44 bytes) 000185[0] 1723252922.076510 mapread 0x089000 thru 0x093bfb (0xabfc bytes) 000186[1] 1723252922.102084 trunc from 0x5d4688 to 0x97b60d (0x3a6f86 bytes) 000191[1] 1723252922.142474 read 0x667000 thru 0x66b5d9 (0x45da bytes) 000195[1] 1723252922.233790 mapwrite 0x511000 thru 0x513e61 (0x2e62 bytes) 000196[0] 1723252922.266821 read 0x6c1000 thru 0x6c597f (0x4980 bytes) 000197[1] 1723252922.357916 mapwrite 0x873000 thru 0x876fbb (0x3fbc bytes) 000200[1] 1723252922.423135 write 0x969000 thru 0x977e8f (0xee90 bytes) 000201[0] 1723252922.427201 read 0x4c1000 thru 0x4cbc46 (0xac47 bytes) 000203[1] 1723252922.506111 write 0x93e000 thru 0x94be6b (0xde6c bytes) 000206[0] 1723252922.532217 read 0x651000 thru 0x65eb78 (0xdb79 bytes) 000207[1] 1723252922.606555 trunc from 0x97b60e to 0x6e5479 (0x296194 bytes) 000215[1] 1723252922.645562 mapread 0x616000 thru 0x61d71d (0x771e bytes) 000216[1] 1723252922.677052 read 0x60f000 thru 0x616e42 (0x7e43 bytes) 000223[1] 1723252922.761873 write 0x8fe000 thru 0x90c4af (0xe4b0 bytes) 000224[1] 1723252922.763189 read 0x23d000 thru 0x242247 (0x5248 bytes) 000225[1] 1723252922.775396 read 0x028000 thru 0x0302bb (0x82bc bytes) 000226[0] 1723252922.775947 read 0x3f7000 thru 0x405a2b (0xea2c bytes) 000227[0] 1723252922.884484 read 0x7c1000 thru 0x7c780d (0x680e bytes) 000228[0] 1723252922.890628 mapread 0x489000 thru 0x4918bf (0x88c0 bytes) 000229[1] 1723252922.891996 write 0x083000 thru 0x086885 (0x3886 bytes) 000231[1] 1723252922.928207 trunc from 0x90c4b0 to 0x8b8104 (0x543ab bytes) 000234[1] 1723252922.954178 mapread 0x110000 thru 0x117aea (0x7aeb bytes) 000235[1] 1723252923.016038 read 0x655000 thru 0x6602a1 (0xb2a2 bytes) 000238[0] 1723252923.033213 mapread 0x619000 thru 0x6246ee (0xb6ef bytes) 000239[0] 1723252923.125690 mapwrite 0x2eb000 thru 0x2f3185 (0x8186 bytes) 000245[1] 1723252923.244924 write 0x385000 thru 0x393d25 (0xed26 bytes) 000246[0] 1723252923.278937 read 0x3c3000 thru 0x3c7534 (0x4535 bytes) 000247[0] 1723252923.356841 write 0x151000 thru 0x151ac7 (0xac8 bytes) 000249[1] 1723252923.382001 trunc from 0x8b8105 to 0x418881 (0x49f883 bytes) 000251[0] 1723252923.409912 mapread 0x3a2000 thru 0x3ad8d9 (0xb8da bytes) 000252[1] 1723252923.448307 trunc from 0x418882 to 0x1fb487 (0x21d3fa bytes) 000256[0] 1723252923.480073 mapread 0x1c3000 thru 0x1d2dff (0xfe00 bytes) 000258[1] 1723252923.533617 write 0x05a000 thru 0x064f1a (0xaf1b bytes) 000260[1] 1723252923.553222 write 0x6ec000 thru 0x6fbc13 (0xfc14 bytes) 000261[1] 1723252923.566577 read 0x0fa000 thru 0x0ff4b0 (0x54b1 bytes) 000262[1] 1723252923.617112 mapread 0x1d2000 thru 0x1dd5a1 (0xb5a2 bytes) 000264[0] 1723252923.640104 write 0x4e9000 thru 0x4f3130 (0xa131 bytes) 000267[0] 1723252923.663516 trunc from 0x6fbc14 to 0x69667f (0x65594 bytes) 000269[1] 1723252923.691609 mapwrite 0x776000 thru 0x778b8a (0x2b8b bytes) 000270[0] 1723252923.772030 write 0x62c000 thru 0x62e51f (0x2520 bytes) 000273[1] 1723252923.788108 read 0x1b9000 thru 0x1c3652 (0xa653 bytes) 000275[1] 1723252923.861937 read 0x307000 thru 0x3117b4 (0xa7b5 bytes) 000277[0] 1723252923.862547 trunc from 0x778b8b to 0x04006c (0x738b1e bytes) 000280[0] 1723252923.899831 read 0x02b000 thru 0x02c5e1 (0x15e2 bytes) 000281[1] 1723252923.913491 read 0x008000 thru 0x0118f0 (0x98f1 bytes) 000284[1] 1723252923.929854 mapread 0x017000 thru 0x01cac1 (0x5ac2 bytes) 000285[0] 1723252923.930411 read 0x02c000 thru 0x034c15 (0x8c16 bytes) 000286[1] 1723252923.937639 mapread 0x004000 thru 0x010f4c (0xcf4d bytes) 000288[0] 1723252923.938921 mapwrite 0x1a1000 thru 0x1a99b7 (0x89b8 bytes) 000290[0] 1723252924.022266 mapwrite 0x97b000 thru 0x984d67 (0x9d68 bytes) 000291[0] 1723252924.129928 trunc from 0x984d68 to 0x97d022 (0x7d45 bytes) 000292[1] 1723252924.140233 read 0x6ca000 thru 0x6cfad9 (0x5ada bytes) 000293[0] 1723252924.234239 write 0x723000 thru 0x729e84 (0x6e85 bytes) 000295[1] 1723252924.252639 write 0x01c000 thru 0x026677 (0xa678 bytes) 000296[0] 1723252924.275844 mapwrite 0x91d000 thru 0x9226e4 (0x56e5 bytes) 000298[1] 1723252924.368052 trunc from 0x97d023 to 0x1c123b (0x7bbde7 bytes) 000300[1] 1723252924.387116 mapread 0x179000 thru 0x181121 (0x8122 bytes) 000301[1] 1723252924.404657 mapread 0x03d000 thru 0x040e06 (0x3e07 bytes) 000302[0] 1723252924.421438 trunc from 0x1c123c to 0x8952b8 (0x6d407d bytes) 000303[1] 1723252924.437518 trunc from 0x8952b9 to 0x56b658 (0x329c60 bytes) 000306[0] 1723252924.478706 mapwrite 0x6ac000 thru 0x6afd1e (0x3d1f bytes) 000308[0] 1723252924.553996 mapwrite 0x74e000 thru 0x755304 (0x7305 bytes) 000310[0] 1723252924.620015 trunc from 0x755305 to 0x56bc83 (0x1e9681 bytes) 000311[1] 1723252924.630128 write 0x042000 thru 0x0457c7 (0x37c8 bytes) 000312[0] 1723252924.641896 read 0x247000 thru 0x24c2ae (0x52af bytes) 000314[1] 1723252924.686701 mapread 0x343000 thru 0x348ff4 (0x5ff5 bytes) 000315[1] 1723252924.705474 trunc from 0x56bc84 to 0x705e1f (0x19a19c bytes) 000317[1] 1723252924.741900 write 0x9a0000 thru 0x9a210b (0x210c bytes) 000319[0] 1723252924.743507 read 0x78d000 thru 0x798ec8 (0xbec9 bytes) 000320[0] 1723252924.842269 trunc from 0x9a210c to 0x560fcd (0x44113e bytes) 000322[0] 1723252924.880607 mapwrite 0x848000 thru 0x85588d (0xd88e bytes) 000323[1] 1723252924.977998 write_OD 0x4c0000 thru 0x4c5fff (0x6000 bytes) 000325[0] 1723252925.017157 trunc from 0x85588e to 0x642c68 (0x212c25 bytes) 000327[1] 1723252925.028163 trunc from 0x642c69 to 0x2273be (0x41b8aa bytes) 000328[1] 1723252925.048958 mapwrite 0x660000 thru 0x66951d (0x951e bytes) 000330[0] 1723252925.129475 mapwrite 0x253000 thru 0x259f95 (0x6f96 bytes) 000333[1] 1723252925.202107 mapwrite 0x249000 thru 0x25021a (0x721b bytes) 000334[1] 1723252925.275406 mapread 0x317000 thru 0x325bcb (0xebcc bytes) 000342[1] 1723252925.305492 mapread 0x590000 thru 0x59ff1c (0xff1d bytes) 000343[1] 1723252925.330354 mapwrite 0x50c000 thru 0x51afe9 (0xefea bytes) 000348[0] 1723252925.411595 trunc from 0x66951e to 0x24c0f7 (0x41d426 bytes) 000349[0] 1723252925.438214 mapwrite 0x081000 thru 0x08bdd8 (0xadd9 bytes) 000350[1] 1723252925.532573 trunc from 0x24c0f8 to 0x5a3cae (0x357bb7 bytes) 000351[0] 1723252925.559847 mapwrite 0x68a000 thru 0x697744 (0xd745 bytes) 000353[0] 1723252925.640633 trunc from 0x697745 to 0x828a6f (0x19132b bytes) 000356[0] 1723252925.653550 mapwrite 0x501000 thru 0x510ad3 (0xfad4 bytes) 000357[0] 1723252925.750208 mapread 0x216000 thru 0x21e78b (0x878c bytes) 000358[0] 1723252925.786601 mapread 0x391000 thru 0x399b18 (0x8b19 bytes) 000361[0] 1723252925.820679 mapwrite 0x223000 thru 0x22760a (0x460b bytes) 000362[0] 1723252925.885390 mapread 0x270000 thru 0x27d3f5 (0xd3f6 bytes) 000364[1] 1723252925.925058 write_OD 0x444000 thru 0x445fff (0x2000 bytes) 000365[1] 1723252925.951861 read_OD 0x5a7000 thru 0x5aefff (0x8000 bytes) 000366[0] 1723252925.958994 write 0x020000 thru 0x020679 (0x67a bytes) 000367[0] 1723252925.972743 mapwrite 0x81e000 thru 0x82282c (0x482d bytes) 000368[1] 1723252926.019295 write_OD 0x0af000 thru 0x0b9fff (0xb000 bytes) 000373[1] 1723252926.054360 write_OD 0x416000 thru 0x41bfff (0x6000 bytes) 000374[0] 1723252926.096372 write 0x238000 thru 0x23fd3b (0x7d3c bytes) 000375[0] 1723252926.102404 trunc from 0x828a70 to 0x709763 (0x11f30c bytes) 000376[0] 1723252926.111113 read 0x201000 thru 0x20e2eb (0xd2ec bytes) 000377[1] 1723252926.197641 write_OD 0x08c000 thru 0x098fff (0xd000 bytes) 000380[1] 1723252926.247327 mapread 0x5ec000 thru 0x5f9087 (0xd088 bytes) 000381[0] 1723252926.276415 read 0x574000 thru 0x57fcb0 (0xbcb1 bytes) 000382[1] 1723252926.326466 write_OD 0x834000 thru 0x838fff (0x5000 bytes) 000385[0] 1723252926.379509 read 0x5c8000 thru 0x5cab5f (0x2b60 bytes) 000387[0] 1723252926.449641 mapwrite 0x133000 thru 0x1397c6 (0x67c7 bytes) 000388[1] 1723252926.548905 mapwrite 0x3d1000 thru 0x3d5584 (0x4585 bytes) 000390[0] 1723252926.624136 mapread 0x0df000 thru 0x0e840a (0x940b bytes) 000392[0] 1723252926.662364 trunc from 0x839000 to 0x55dce6 (0x2db319 bytes) 000393[1] 1723252926.679799 mapread 0x349000 thru 0x34b665 (0x2666 bytes) 000398[0] 1723252926.711475 mapread 0x080000 thru 0x082821 (0x2822 bytes) 000399[0] 1723252926.718967 read 0x096000 thru 0x09c44e (0x644f bytes) 000400[0] 1723252926.773868 trunc from 0x55dce7 to 0x9b6ad5 (0x458def bytes) 000401[1] 1723252926.802133 mapwrite 0x857000 thru 0x85f627 (0x8628 bytes) 000402[0] 1723252926.883952 trunc from 0x9b6ad6 to 0x8d3d96 (0xe2d3f bytes) 000403[1] 1723252926.906168 trunc from 0x8d3d97 to 0x863f11 (0x6fe85 bytes) 000407[0] 1723252926.949766 trunc from 0x863f12 to 0x42cff7 (0x436f1a bytes) 000408[1] 1723252926.971711 mapwrite 0x6df000 thru 0x6ea04a (0xb04b bytes) 000413[0] 1723252927.073408 write 0x9d3000 thru 0x9dc131 (0x9132 bytes) 000414[1] 1723252927.084083 mapread 0x7a3000 thru 0x7aaf4a (0x7f4b bytes) 000415[0] 1723252927.104887 mapread 0x974000 thru 0x974ebd (0xebe bytes) 000420[1] 1723252927.146828 read_OD 0x356000 thru 0x361fff (0xc000 bytes) 000421[0] 1723252927.157318 write 0x104000 thru 0x106e1e (0x2e1f bytes) 000427[1] 1723252927.193434 trunc from 0x9dc132 to 0x6db5a9 (0x300b88 bytes) 000429[1] 1723252927.225250 mapwrite 0x35a000 thru 0x35fdc1 (0x5dc2 bytes) 000430[0] 1723252927.341618 trunc from 0x6db5aa to 0x5ed694 (0xedf15 bytes) 000431[1] 1723252927.368402 mapread 0x078000 thru 0x0824dc (0xa4dd bytes) 000434[1] 1723252927.424928 read_OD 0x54f000 thru 0x55bfff (0xd000 bytes) 000436[0] 1723252927.434335 mapread 0x48a000 thru 0x496720 (0xc721 bytes) 000437[0] 1723252927.478598 write 0x27d000 thru 0x289522 (0xc523 bytes) 000439[1] 1723252927.489387 write_OD 0x187000 thru 0x195fff (0xf000 bytes) 000440[1] 1723252927.536522 mapwrite 0x162000 thru 0x1700d0 (0xe0d1 bytes) 000441[0] 1723252927.629763 trunc from 0x5ed695 to 0x2bb548 (0x33214c bytes) 000442[1] 1723252927.651944 write_OD 0x0b8000 thru 0x0b8fff (0x1000 bytes) 000443[0] 1723252927.677926 write 0x550000 thru 0x55e946 (0xe947 bytes) 000444[1] 1723252927.682027 read_OD 0x229000 thru 0x229fff (0x1000 bytes) 000446[0] 1723252927.697464 trunc from 0x55e947 to 0x01f4cf (0x53f477 bytes) 000448[0] 1723252927.718531 read 0x005000 thru 0x00fe12 (0xae13 bytes) 000449[1] 1723252927.726148 read_OD 0x01a000 thru 0x01dfff (0x4000 bytes) 000453[0] 1723252927.740042 write 0x73c000 thru 0x73c142 (0x143 bytes) 000455[1] 1723252927.757570 mapread 0x17d000 thru 0x189c24 (0xcc25 bytes) 000456[1] 1723252927.825787 mapwrite 0x63d000 thru 0x643a1d (0x6a1e bytes) 000457[0] 1723252927.902001 mapread 0x4c7000 thru 0x4d5f65 (0xef66 bytes) 000459[0] 1723252927.965349 write 0x27e000 thru 0x28aee2 (0xcee3 bytes) 000461[1] 1723252927.984437 write_OD 0x5d0000 thru 0x5d3fff (0x4000 bytes) 000463[0] 1723252928.021445 read 0x1f0000 thru 0x1fc586 (0xc587 bytes) 000465[1] 1723252928.074881 mapwrite 0x27e000 thru 0x2893a9 (0xb3aa bytes) 000467[0] 1723252928.143180 read 0x052000 thru 0x060358 (0xe359 bytes) 000468[0] 1723252928.193470 write 0x8ed000 thru 0x8f8285 (0xb286 bytes) 000469[0] 1723252928.208588 write 0x432000 thru 0x438f99 (0x6f9a bytes) 000472[0] 1723252928.233436 mapread 0x570000 thru 0x57022f (0x230 bytes) 000473[0] 1723252928.245918 trunc from 0x8f8286 to 0x916386 (0x1e101 bytes) 000477[0] 1723252928.276641 trunc from 0x916387 to 0x4c8142 (0x44e244 bytes) 000478[1] 1723252928.288790 mapwrite 0x9d4000 thru 0x9db33e (0x733f bytes) 000479[0] 1723252928.359810 write 0x799000 thru 0x7a3774 (0xa775 bytes) 000480[0] 1723252928.382337 mapread 0x075000 thru 0x07b793 (0x6794 bytes) 000481[0] 1723252928.398983 write 0x442000 thru 0x44ee9f (0xcea0 bytes) 000482[0] 1723252928.402560 trunc from 0x9db33f to 0x5b35bb (0x427d83 bytes) 000485[0] 1723252928.434126 read 0x448000 thru 0x455f8b (0xdf8c bytes) 000486[1] 1723252928.491926 trunc from 0x5b35bc to 0x4e1790 (0xd1e2b bytes) 000489[0] 1723252928.554079 trunc from 0x4e1791 to 0x4611e0 (0x805b0 bytes) 000494[0] 1723252928.601258 mapread 0x276000 thru 0x28309f (0xd0a0 bytes) 000495[0] 1723252928.637765 write 0x26f000 thru 0x273525 (0x4526 bytes) 000496[1] 1723252928.649499 write_OD 0x882000 thru 0x886fff (0x5000 bytes) 000500[0] 1723252928.700815 mapread 0x752000 thru 0x75a7f0 (0x87f1 bytes) All operations completed A-OK! PASS 16a (28s) == sanityn test 16b: 500 iterations of dual-mount fsx at small size ========================================================== 21:22:10 (1723252930) fallocate on zfs doesn't consume space fallocate not supported 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.245828 s, 34.1 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.189336 s, 44.3 MB/s Chance of close/open is 1 in 50 Seed set to 2931 fd 0: /mnt/lustre/f16b.sanityn fd 1: /mnt/lustre2/f16b.sanityn fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read 000005[1] 1723252931.492327 write 0x6f9ea4 thru 0x6fab48 (0xca5 bytes) 000006[0] 1723252931.502976 write 0x9bae43 thru 0x9bc673 (0x1831 bytes) 000007[0] 1723252931.516890 write 0x48c706 thru 0x48cb5a (0x455 bytes) truncating to largest ever: 0x1fa948 000008[0] 1723252931.525611 trunc from 0x9bc674 to 0x1fa947 (0x7c1d2c bytes) 000009[0] 1723252931.544026 mapwrite 0x6090f7 thru 0x609ee0 (0xdea bytes) 000010[1] 1723252931.612046 mapread 0x3cfc63 thru 0x3d0806 (0xba4 bytes) 000014[0] 1723252931.667114 read 0x3cbd51 thru 0x3cc8d5 (0xb85 bytes) 000017[0] 1723252931.694838 write 0x8bc87d thru 0x8be7e2 (0x1f66 bytes) 000019[1] 1723252931.711196 read 0x241f31 thru 0x242895 (0x965 bytes) truncating to largest ever: 0x82143f 000022[1] 1723252931.729760 trunc from 0x8be7e3 to 0x82143e (0x9d3a4 bytes) 000023[1] 1723252931.757611 read 0x719e1c thru 0x71bbb1 (0x1d96 bytes) 000024[1] 1723252931.820277 mapread 0x4b8f0e thru 0x4bad00 (0x1df3 bytes) 000027[1] 1723252931.831616 mapwrite 0x88f1a9 thru 0x88f5c2 (0x41a bytes) 000030[0] 1723252931.884021 mapwrite 0x7f17b2 thru 0x7f26a2 (0xef1 bytes) 000032[0] 1723252931.965994 read 0x2011c3 thru 0x20146d (0x2ab bytes) truncating to largest ever: 0x8cb5d0 000036[1] 1723252932.033995 trunc from 0x88f5c3 to 0x8cb5cf (0x3c00d bytes) 000037[0] 1723252932.065162 trunc from 0x8cb5d0 to 0x155f67 (0x775668 bytes) 000039[0] 1723252932.094104 trunc from 0x155f68 to 0x871f88 (0x71c021 bytes) 000040[1] 1723252932.108243 trunc from 0x871f89 to 0x0a79f1 (0x7ca597 bytes) 000041[1] 1723252932.134608 mapread 0x06c0a4 thru 0x06ccf7 (0xc54 bytes) 000042[0] 1723252932.140988 mapwrite 0x24874e thru 0x249e3e (0x16f1 bytes) 000045[1] 1723252932.209846 write 0x844eca thru 0x845f14 (0x104b bytes) 000046[0] 1723252932.224227 read 0x59bbbf thru 0x59c9c8 (0xe0a bytes) 000047[1] 1723252932.237835 write 0x407011 thru 0x40791f (0x90f bytes) 000049[0] 1723252932.251621 mapread 0x4960a9 thru 0x496cac (0xc04 bytes) 000051[0] 1723252932.285144 trunc from 0x845f15 to 0x7f0165 (0x55daf bytes) 000052[0] 1723252932.306743 read 0x493988 thru 0x494718 (0xd91 bytes) 000054[1] 1723252932.375707 mapread 0x35d322 thru 0x35e0db (0xdba bytes) 000055[0] 1723252932.400507 trunc from 0x7f0166 to 0x77e442 (0x71d23 bytes) 000057[0] 1723252932.439054 write 0x9af66e thru 0x9b12f5 (0x1c88 bytes) 000059[0] 1723252932.453573 read 0x6241ba thru 0x6255a5 (0x13ec bytes) 000060[1] 1723252932.462920 mapread 0x706db9 thru 0x707035 (0x27d bytes) 000062[0] 1723252932.487012 mapwrite 0x890358 thru 0x890acb (0x774 bytes) 000065[0] 1723252932.581024 trunc from 0x9b12f6 to 0x2212bc (0x790039 bytes) 000068[1] 1723252932.600118 write 0x61aeee thru 0x61bb6c (0xc7f bytes) 000069[1] 1723252932.617502 trunc from 0x61bb6d to 0x26d63e (0x3ae52e bytes) 000070[0] 1723252932.643329 mapwrite 0x23202a thru 0x23249b (0x472 bytes) 000071[1] 1723252932.719070 write 0x2449d6 thru 0x245b2f (0x115a bytes) 000072[0] 1723252932.741063 trunc from 0x26d63f to 0x08e31a (0x1df324 bytes) 000073[0] 1723252932.782867 write 0x248068 thru 0x249d33 (0x1ccc bytes) 000074[1] 1723252932.794580 read 0x143a72 thru 0x1442ae (0x83d bytes) 000076[0] 1723252932.834617 read 0x23e53e thru 0x23f377 (0xe3a bytes) 000078[1] 1723252932.862337 mapread 0x039661 thru 0x03af10 (0x18b0 bytes) 000079[0] 1723252932.876394 write 0x9dcb7b thru 0x9dd7a8 (0xc2e bytes) 000080[1] 1723252932.902582 mapwrite 0x61657d thru 0x616fd7 (0xa5b bytes) truncating to largest ever: 0x9b92d8 000084[0] 1723252932.990033 trunc from 0x9dd7a9 to 0x9b92d7 (0x244d1 bytes) 000085[0] 1723252933.011824 write 0x17f1ab thru 0x1804a4 (0x12fa bytes) 000088[1] 1723252933.082949 write 0x8905c0 thru 0x89140f (0xe50 bytes) 000089[1] 1723252933.122923 mapwrite 0x3657e4 thru 0x365ac7 (0x2e4 bytes) 000091[1] 1723252933.175569 mapwrite 0x07b53b thru 0x07bae4 (0x5aa bytes) 000092[0] 1723252933.237802 trunc from 0x9b92d8 to 0x34a6d2 (0x66ec05 bytes) 000095[0] 1723252933.274810 write 0x2de950 thru 0x2df5d6 (0xc87 bytes) 000097[0] 1723252933.294488 trunc from 0x34a6d3 to 0x687904 (0x33d232 bytes) 000098[1] 1723252933.305022 mapwrite 0x386bdc thru 0x386cd8 (0xfd bytes) 000100[0] 1723252933.367958 trunc from 0x687905 to 0x246ce8 (0x440c1c bytes) 000105[1] 1723252933.409344 read 0x1da7f1 thru 0x1dc03c (0x184c bytes) 000106[0] 1723252933.445091 mapread 0x12c2a4 thru 0x12c8b8 (0x615 bytes) 000107[1] 1723252933.455194 mapread 0x1d61f7 thru 0x1d71f1 (0xffb bytes) 000112[1] 1723252933.483984 trunc from 0x246ce9 to 0x7029d9 (0x4bbcf1 bytes) 000115[0] 1723252933.521561 read 0x63f45d thru 0x64140b (0x1faf bytes) 000118[1] 1723252933.554021 mapread 0x1a6ab1 thru 0x1a6d55 (0x2a5 bytes) 000119[1] 1723252933.582110 write 0x5498af thru 0x549bfa (0x34c bytes) 000121[1] 1723252933.615876 trunc from 0x7029da to 0x8ad06f (0x1aa696 bytes) 000123[1] 1723252933.632346 read 0x7ad477 thru 0x7ae8c7 (0x1451 bytes) 000125[0] 1723252933.670474 trunc from 0x8ad070 to 0x19cf1b (0x710154 bytes) 000126[1] 1723252933.700532 mapread 0x17e811 thru 0x1803ae (0x1b9e bytes) 000127[1] 1723252933.726734 mapwrite 0x91bf7a thru 0x91c1df (0x266 bytes) 000132[1] 1723252933.821261 mapwrite 0x6deec2 thru 0x6df988 (0xac7 bytes) 000134[0] 1723252933.871941 read 0x677b00 thru 0x67888d (0xd8e bytes) 000136[0] 1723252933.898247 trunc from 0x91c1e0 to 0x175beb (0x7a65f4 bytes) 000137[0] 1723252933.915648 read 0x1578ed thru 0x15827e (0x992 bytes) 000142[1] 1723252933.952745 mapwrite 0x9430ac thru 0x944b90 (0x1ae5 bytes) 000145[0] 1723252934.013485 mapwrite 0x9e1225 thru 0x9e1f76 (0xd52 bytes) 000147[1] 1723252934.115746 read 0x222b26 thru 0x222d7f (0x25a bytes) 000148[0] 1723252934.171894 mapread 0x058359 thru 0x059157 (0xdff bytes) 000149[1] 1723252934.227619 read 0x0ef118 thru 0x0ef9a8 (0x891 bytes) 000150[0] 1723252934.238555 write 0x394b11 thru 0x3954a6 (0x996 bytes) 000151[0] 1723252934.254106 mapread 0x0cc3f7 thru 0x0cdc1a (0x1824 bytes) 000153[1] 1723252934.267702 read 0x236ced thru 0x2380b5 (0x13c9 bytes) 000154[1] 1723252934.309972 mapwrite 0x2106b6 thru 0x2117c6 (0x1111 bytes) 000156[0] 1723252934.386378 write 0x6952e0 thru 0x6958d1 (0x5f2 bytes) 000161[1] 1723252934.426880 trunc from 0x9e1f77 to 0x76e40b (0x273b6b bytes) 000163[1] 1723252934.467976 mapwrite 0x663456 thru 0x66528d (0x1e38 bytes) 000168[1] 1723252934.559874 trunc from 0x76e40c to 0x53db3d (0x2308ce bytes) 000169[0] 1723252934.587954 write 0x8f9b79 thru 0x8fbb70 (0x1ff8 bytes) 000172[1] 1723252934.616590 trunc from 0x8fbb71 to 0x86fca2 (0x8bece bytes) 000173[1] 1723252934.644145 write 0x055562 thru 0x055a64 (0x503 bytes) 000175[1] 1723252934.670960 mapread 0x798265 thru 0x79969e (0x143a bytes) 000176[0] 1723252934.678314 write 0x879247 thru 0x87965e (0x418 bytes) 000178[1] 1723252934.700721 write 0x43f9ee thru 0x43ffd6 (0x5e9 bytes) 000180[1] 1723252934.715370 mapwrite 0x45ebaa thru 0x460172 (0x15c9 bytes) 000182[1] 1723252934.764376 mapread 0x6a1a17 thru 0x6a330b (0x18f5 bytes) 000184[1] 1723252934.788917 trunc from 0x87965f to 0x0bb89f (0x7bddbf bytes) 000187[1] 1723252934.816575 mapwrite 0x949838 thru 0x94a50b (0xcd4 bytes) 000190[0] 1723252934.894299 trunc from 0x94a50c to 0x421ecf (0x52863c bytes) 000191[1] 1723252934.921761 mapread 0x052ca1 thru 0x052d4a (0xaa bytes) 000193[0] 1723252934.938891 mapread 0x2a663d thru 0x2a8153 (0x1b17 bytes) 000195[1] 1723252934.950488 mapread 0x070c94 thru 0x07144a (0x7b7 bytes) 000197[0] 1723252934.971590 trunc from 0x421ed0 to 0x040c6d (0x3e1262 bytes) 000199[1] 1723252934.991213 read 0x015ef6 thru 0x016e86 (0xf91 bytes) 000201[0] 1723252935.008637 write 0x24c8c0 thru 0x24d341 (0xa82 bytes) 000206[0] 1723252935.029931 trunc from 0x24d342 to 0x901020 (0x6b3cdf bytes) 000207[1] 1723252935.038962 mapwrite 0x7c2f90 thru 0x7c360b (0x67c bytes) 000208[1] 1723252935.079053 trunc from 0x901021 to 0x9975e2 (0x965c2 bytes) 000210[0] 1723252935.110383 mapread 0x5cbdc4 thru 0x5cc555 (0x792 bytes) 000211[1] 1723252935.127894 trunc from 0x9975e3 to 0x737688 (0x25ff5a bytes) 000213[0] 1723252935.140568 mapread 0x28981e thru 0x28a75e (0xf41 bytes) 000214[0] 1723252935.156417 trunc from 0x737689 to 0x8f66ea (0x1bf062 bytes) 000219[0] 1723252935.177790 trunc from 0x8f66eb to 0x035545 (0x8c11a5 bytes) 000220[1] 1723252935.185437 trunc from 0x035546 to 0x257aa9 (0x222564 bytes) 000221[1] 1723252935.198935 trunc from 0x257aaa to 0x61ca28 (0x3c4f7f bytes) 000222[1] 1723252935.209695 trunc from 0x61ca29 to 0x49e137 (0x17e8f1 bytes) 000223[1] 1723252935.215978 write 0x474e38 thru 0x47593f (0xb08 bytes) 000225[0] 1723252935.252585 read 0x439cbd thru 0x43a42b (0x76f bytes) 000227[1] 1723252935.273477 trunc from 0x49e138 to 0x3502d4 (0x14de63 bytes) 000232[1] 1723252935.311816 read 0x053ba7 thru 0x054986 (0xde0 bytes) 000233[1] 1723252935.312154 write 0x8e86c0 thru 0x8e98e8 (0x1229 bytes) 000235[0] 1723252935.326060 read 0x6c240f thru 0x6c43a1 (0x1f93 bytes) 000236[0] 1723252935.347733 mapwrite 0x4830c5 thru 0x48377e (0x6ba bytes) 000238[0] 1723252935.409909 mapread 0x5cdb13 thru 0x5cdd78 (0x266 bytes) 000240[1] 1723252935.432699 mapwrite 0x79ede0 thru 0x79f902 (0xb23 bytes) 000241[1] 1723252935.506335 read 0x380d6c thru 0x38177c (0xa11 bytes) 000244[0] 1723252935.524146 mapread 0x1891b8 thru 0x18a9c1 (0x180a bytes) 000245[1] 1723252935.574948 trunc from 0x8e98e9 to 0x5beae7 (0x32ae01 bytes) 000246[0] 1723252935.599863 mapwrite 0x960eb0 thru 0x962cba (0x1e0b bytes) 000250[0] 1723252935.692755 trunc from 0x962cbb to 0x27ce86 (0x6e5e34 bytes) 000251[1] 1723252935.707478 mapread 0x1d76e8 thru 0x1d862b (0xf44 bytes) 000255[1] 1723252935.751864 mapwrite 0x15fced thru 0x1608bf (0xbd3 bytes) 000260[0] 1723252935.844073 write 0x80465b thru 0x804a9a (0x440 bytes) 000261[1] 1723252935.850317 read 0x360f7d thru 0x36280b (0x188f bytes) 000262[1] 1723252935.895455 write 0x242c0a thru 0x243724 (0xb1b bytes) 000263[1] 1723252935.917912 mapwrite 0x8401ec thru 0x840e6e (0xc83 bytes) 000264[0] 1723252935.970619 mapwrite 0x6b24af thru 0x6b366a (0x11bc bytes) 000268[1] 1723252936.039856 trunc from 0x840e6f to 0x5f800b (0x248e63 bytes) 000271[0] 1723252936.069249 trunc from 0x5f800c to 0x85396e (0x25b963 bytes) 000272[1] 1723252936.082594 mapread 0x28972c thru 0x28af40 (0x1815 bytes) truncating to largest ever: 0x9e1497 000276[0] 1723252936.120286 trunc from 0x85396f to 0x9e1496 (0x18db28 bytes) 000283[1] 1723252936.141056 mapwrite 0x906e14 thru 0x908170 (0x135d bytes) 000286[0] 1723252936.210613 write 0x141315 thru 0x141a9c (0x788 bytes) 000287[0] 1723252936.231464 mapwrite 0x2c46a6 thru 0x2c6423 (0x1d7e bytes) 000288[0] 1723252936.257584 write 0x25cc98 thru 0x25e7a6 (0x1b0f bytes) 000289[1] 1723252936.261329 trunc from 0x9e1497 to 0x68caa5 (0x3549f1 bytes) 000290[1] 1723252936.275321 mapwrite 0x137f90 thru 0x13902e (0x109f bytes) 000293[1] 1723252936.319191 mapwrite 0x491590 thru 0x492389 (0xdfa bytes) 000294[0] 1723252936.352615 write 0x3154ee thru 0x315eac (0x9bf bytes) 000296[0] 1723252936.375465 trunc from 0x68caa6 to 0x31a217 (0x37288e bytes) 000305[1] 1723252936.427080 mapwrite 0x8cfd94 thru 0x8d17c6 (0x1a33 bytes) 000306[0] 1723252936.474918 write 0x51b0b9 thru 0x51cbd7 (0x1b1f bytes) 000308[1] 1723252936.494510 mapread 0x6208ec thru 0x622321 (0x1a36 bytes) 000309[1] 1723252936.508074 write 0x007f0a thru 0x009a19 (0x1b10 bytes) 000310[0] 1723252936.516352 mapwrite 0x6fbe5b thru 0x6fcd42 (0xee8 bytes) 000311[1] 1723252936.552694 trunc from 0x8d17c7 to 0x9835ff (0xb1e39 bytes) 000314[1] 1723252936.572825 trunc from 0x983600 to 0x843d01 (0x13f8fe bytes) 000316[1] 1723252936.582152 mapwrite 0x998618 thru 0x998ffa (0x9e3 bytes) 000320[0] 1723252936.624083 mapwrite 0x35402b thru 0x35405f (0x35 bytes) 000321[0] 1723252936.676277 trunc from 0x998ffb to 0x3f7426 (0x5a1bd4 bytes) 000322[0] 1723252936.696975 trunc from 0x3f7427 to 0x0fa55c (0x2fceca bytes) 000323[1] 1723252936.705295 write 0x940a21 thru 0x941576 (0xb56 bytes) 000324[1] 1723252936.720258 mapwrite 0x4a6b1a thru 0x4a7621 (0xb08 bytes) 000325[0] 1723252936.763761 mapwrite 0x825f16 thru 0x827011 (0x10fc bytes) 000327[1] 1723252936.816772 mapwrite 0x162631 thru 0x16426c (0x1c3c bytes) 000328[0] 1723252936.849975 trunc from 0x941577 to 0x6a357c (0x29dffa bytes) 000332[0] 1723252936.886427 read 0x4584c2 thru 0x459016 (0xb55 bytes) 000333[0] 1723252936.932403 mapwrite 0x30b8ce thru 0x30d84a (0x1f7d bytes) 000334[1] 1723252936.958502 write 0x28e2aa thru 0x290154 (0x1eab bytes) 000335[1] 1723252936.977275 write 0x4eace5 thru 0x4ead47 (0x63 bytes) 000336[0] 1723252936.985558 trunc from 0x6a357d to 0x870e2c (0x1cd8b0 bytes) 000337[0] 1723252937.016658 mapread 0x70f6cf thru 0x70fcf3 (0x625 bytes) 000338[0] 1723252937.042505 trunc from 0x870e2d to 0x808e49 (0x67fe3 bytes) 000340[1] 1723252937.059861 write 0x9eb03d thru 0x9eb794 (0x758 bytes) 000341[0] 1723252937.070968 mapread 0x935134 thru 0x936b11 (0x19de bytes) 000346[0] 1723252937.125058 trunc from 0x9eb795 to 0x277099 (0x7746fb bytes) 000348[1] 1723252937.152175 read 0x109cb4 thru 0x10b308 (0x1655 bytes) 000349[0] 1723252937.193701 trunc from 0x27709a to 0x511be1 (0x29ab48 bytes) 000351[0] 1723252937.209301 mapwrite 0x05a176 thru 0x05ab66 (0x9f1 bytes) 000352[1] 1723252937.251397 trunc from 0x511be2 to 0x3ed59e (0x124643 bytes) 000353[1] 1723252937.273990 mapread 0x1f393d thru 0x1f55aa (0x1c6e bytes) 000355[1] 1723252937.308951 mapread 0x0241e7 thru 0x0250ef (0xf09 bytes) 000356[0] 1723252937.324892 mapread 0x1752e6 thru 0x175b60 (0x87b bytes) 000357[0] 1723252937.347113 write 0x703468 thru 0x70534d (0x1ee6 bytes) 000358[1] 1723252937.353278 write 0x929b80 thru 0x92a278 (0x6f9 bytes) 000363[1] 1723252937.396492 trunc from 0x92a279 to 0x7f9ee0 (0x130398 bytes) 000371[1] 1723252937.455765 read 0x2ba596 thru 0x2ba712 (0x17d bytes) 000372[0] 1723252937.457917 mapread 0x4435c2 thru 0x4454b8 (0x1ef7 bytes) 000374[1] 1723252937.484229 write 0x7eeb1e thru 0x7f0ac1 (0x1fa4 bytes) 000375[1] 1723252937.504129 write 0x9e6f1f thru 0x9e787c (0x95e bytes) 000376[0] 1723252937.517532 mapread 0x630458 thru 0x631349 (0xef2 bytes) 000377[1] 1723252937.537379 read 0x629ba4 thru 0x62ae46 (0x12a3 bytes) 000378[0] 1723252937.593161 mapread 0x3a7233 thru 0x3a78d7 (0x6a5 bytes) 000381[1] 1723252937.611251 read 0x235483 thru 0x2359d8 (0x556 bytes) 000382[1] 1723252937.644433 trunc from 0x9e787d to 0x11a5c8 (0x8cd2b4 bytes) 000388[0] 1723252937.678442 write 0x496f55 thru 0x498d23 (0x1dcf bytes) 000389[0] 1723252937.690105 mapread 0x362dda thru 0x3632da (0x501 bytes) 000390[1] 1723252937.701302 read 0x2b8f46 thru 0x2b9d95 (0xe50 bytes) 000392[0] 1723252937.732577 read 0x2d196c thru 0x2d28a7 (0xf3c bytes) 000396[1] 1723252937.768518 mapread 0x46d81e thru 0x46daab (0x28e bytes) 000400[1] 1723252937.783569 read 0x04e881 thru 0x0501a2 (0x1922 bytes) 000401[0] 1723252937.784074 mapread 0x10a403 thru 0x10b7ee (0x13ec bytes) 000403[0] 1723252937.784697 mapread 0x2585ea thru 0x25a5c8 (0x1fdf bytes) 000405[1] 1723252937.792284 trunc from 0x498d24 to 0x39c562 (0xfc7c1 bytes) 000406[1] 1723252937.809689 mapwrite 0x8e9505 thru 0x8eacd0 (0x17cc bytes) 000407[0] 1723252937.893324 mapread 0x29bbde thru 0x29c708 (0xb2b bytes) 000409[0] 1723252937.937521 read 0x5258c5 thru 0x5267d4 (0xf10 bytes) 000411[0] 1723252937.985134 mapwrite 0x726fd2 thru 0x728d88 (0x1db7 bytes) 000414[0] 1723252938.057205 read 0x0c57e3 thru 0x0c60ea (0x908 bytes) 000415[1] 1723252938.067220 mapwrite 0x7fd83e thru 0x7fdb26 (0x2e9 bytes) 000416[1] 1723252938.127234 mapread 0x6276b0 thru 0x6282ea (0xc3b bytes) 000418[0] 1723252938.145019 read 0x8de79d thru 0x8dee35 (0x699 bytes) 000419[0] 1723252938.152510 write 0x533660 thru 0x534a24 (0x13c5 bytes) 000420[1] 1723252938.196255 trunc from 0x8eacd1 to 0x7ae439 (0x13c897 bytes) 000421[0] 1723252938.229098 write 0x2bba79 thru 0x2bc576 (0xafe bytes) 000423[0] 1723252938.263730 mapread 0x143194 thru 0x1433af (0x21c bytes) 000424[0] 1723252938.277151 trunc from 0x7ae43a to 0x54d8ff (0x260b3a bytes) 000425[0] 1723252938.287980 write 0x7810e9 thru 0x781fd8 (0xef0 bytes) 000427[1] 1723252938.298764 mapread 0x4c89e8 thru 0x4c8ba1 (0x1ba bytes) 000429[0] 1723252938.328576 read 0x71c6a5 thru 0x71df54 (0x18b0 bytes) 000430[1] 1723252938.332299 trunc from 0x781fd9 to 0x8a5423 (0x12344b bytes) 000432[1] 1723252938.355284 write 0x420784 thru 0x42080e (0x8b bytes) 000433[1] 1723252938.371874 read 0x306e8c thru 0x307e00 (0xf75 bytes) 000435[0] 1723252938.427351 mapread 0x42d416 thru 0x42ee5e (0x1a49 bytes) 000438[0] 1723252938.467260 mapwrite 0x78d2ea thru 0x78da4b (0x762 bytes) 000439[0] 1723252938.535454 trunc from 0x8a5424 to 0x736900 (0x16eb23 bytes) 000440[0] 1723252938.560283 write 0x9255f5 thru 0x92682b (0x1237 bytes) 000444[1] 1723252938.574778 trunc from 0x92682c to 0x69cfb7 (0x289874 bytes) 000446[1] 1723252938.594086 write 0x161b0f thru 0x163722 (0x1c14 bytes) 000447[0] 1723252938.598978 write 0x24b652 thru 0x24d255 (0x1c04 bytes) 000449[0] 1723252938.626330 mapwrite 0x293e23 thru 0x294789 (0x967 bytes) 000452[1] 1723252938.682117 write 0x453ab1 thru 0x454d63 (0x12b3 bytes) 000458[0] 1723252938.731121 mapread 0x49de82 thru 0x49ef24 (0x10a3 bytes) 000459[1] 1723252938.749710 trunc from 0x69cfb8 to 0x373d9c (0x32921b bytes) 000460[1] 1723252938.778929 trunc from 0x373d9d to 0x3c3e44 (0x500a8 bytes) 000461[1] 1723252938.801512 read 0x34a228 thru 0x34ab04 (0x8dd bytes) 000463[0] 1723252938.842632 read 0x1a82e8 thru 0x1a8e4d (0xb66 bytes) 000465[1] 1723252938.897183 read 0x069504 thru 0x06adec (0x18e9 bytes) 000470[1] 1723252938.980098 mapwrite 0x105377 thru 0x105d54 (0x9de bytes) 000471[1] 1723252939.030939 mapwrite 0x11d015 thru 0x11e338 (0x1324 bytes) 000474[1] 1723252939.081217 mapread 0x1dd76b thru 0x1de3ea (0xc80 bytes) 000475[1] 1723252939.086306 write 0x2ff62d thru 0x300890 (0x1264 bytes) 000476[0] 1723252939.096840 trunc from 0x3c3e45 to 0x9659c0 (0x5a1b7c bytes) 000479[1] 1723252939.128919 mapwrite 0x4513ce thru 0x452c31 (0x1864 bytes) 000480[0] 1723252939.179534 trunc from 0x9659c1 to 0x1305c1 (0x8353ff bytes) 000481[1] 1723252939.202418 mapwrite 0x210f62 thru 0x21247c (0x151b bytes) 000484[0] 1723252939.291911 mapwrite 0x8cd7f4 thru 0x8ce27a (0xa87 bytes) 000485[1] 1723252939.357806 mapwrite 0x1f8413 thru 0x1f8b33 (0x721 bytes) 000488[0] 1723252939.410799 mapread 0x589cc8 thru 0x58a33f (0x678 bytes) 000489[0] 1723252939.419898 mapread 0x217fa4 thru 0x219b1d (0x1b7a bytes) 000495[1] 1723252939.466360 mapread 0x8597d0 thru 0x85a3ae (0xbdf bytes) 000496[0] 1723252939.479547 trunc from 0x8ce27b to 0x91936f (0x4b0f5 bytes) 000498[0] 1723252939.492091 mapread 0x7d5d4a thru 0x7d5d7e (0x35 bytes) 000499[0] 1723252939.492636 read 0x33ba0d thru 0x33d25d (0x1851 bytes) All operations completed A-OK! PASS 16b (10s) == sanityn test 16c: verify data consistency on ldiskfs with cache disabled (b=17397) ========================================================== 21:22:20 (1723252940) SKIP: sanityn test_16c dio on ldiskfs only SKIP 16c (2s) == sanityn test 16d: Verify DIO and buffer IO with two clients ========================================================== 21:22:22 (1723252942) 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.22739 s, 36.9 MB/s 2+0 records in 2+0 records out 8388608 bytes (8.4 MB) copied, 0.188351 s, 44.5 MB/s ldlm.namespaces.MGC192.168.202.143@tcp.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff8800ab0de800.lru_size=clear ldlm.namespaces.lustre-MDT0000-mdc-ffff88012aab2000.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff8800ab0de800.lru_size=clear ldlm.namespaces.lustre-OST0000-osc-ffff88012aab2000.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff8800ab0de800.lru_size=clear ldlm.namespaces.lustre-OST0001-osc-ffff88012aab2000.lru_size=clear 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 5.16341 s, 20.3 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.18817 s, 88.3 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.816767 s, 128 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 1.95751 s, 53.6 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 3.93118 s, 26.7 MB/s 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 0.98609 s, 106 MB/s PASS 16d (18s) == sanityn test 16e: Verify size consistency for O_DIRECT write ========================================================== 21:22:40 (1723252960) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0687652 s, 152 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.043629 s, 24.0 MB/s PASS 16e (2s) == sanityn test 16f: rw sequential consistency vs drop_caches ========================================================== 21:22:42 (1723252962) TIMEOUT PASS 16f (22s) == sanityn test 16g: mmap rw sequential consistency vs drop_caches ========================================================== 21:23:04 (1723252984) TIMEOUT PASS 16g (22s) == sanityn test 16h: mmap read after truncate file ======= 21:23:26 (1723253006) ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16h (2s) == sanityn test 16i: read after truncate file ============ 21:23:28 (1723253008) ------- before truncate -------- 0003220 3035 3a31 3035 3a31 2f3a 6f68 656d 732f 0003240 6e61 7469 7579 7273 3a31 622f 6e69 622f 0003260 7361 0a68 0003264 ------- after truncate -------- 0001460 7373 6468 783a 373a 3a34 3437 503a 6972 0001500 6976 656c 6567 732d 7065 7261 7461 6465 0001520 5320 4853 2f3a 6176 2f72 0001532 PASS 16i (1s) == sanityn test 16j: race dio with buffered i/o ========== 21:23:29 (1723253009) 1+0 records in 1+0 records out 26214400 bytes (26 MB) copied, 0.409109 s, 64.1 MB/s bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.341814 s, 76.7 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.759878 s, 34.5 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.212997 s, 123 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.854697 s, 30.7 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.18548 s, 141 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.841462 s, 31.2 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1044480, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.295004 s, 88.9 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.379111 s, 69.1 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.951807 s, 27.5 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 1.01968 s, 25.7 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1048576, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.263284 s, 99.6 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.342069 s, 76.6 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.933612 s, 28.1 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.984607 s, 26.6 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK bs: 1049600, file_size 26214400 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.246409 s, 106 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.333053 s, 78.7 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.927637 s, 28.3 MB/s 12+1 records in 12+1 records out 26214400 bytes (26 MB) copied, 0.999221 s, 26.2 MB/s /mnt/lustre/f16j.sanityn.2 has type file OK /mnt/lustre/f16j.sanityn.2 has size 26214400 OK /mnt/lustre2/f16j.sanityn.2 has type file OK /mnt/lustre2/f16j.sanityn.2 has size 26214400 OK PASS 16j (11s) == sanityn test 16k: Parallel FSX and drop caches should not panic ========================================================== 21:23:40 (1723253020) + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.1 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.2 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.3 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.4 -l 67108864 + /home/green/git/lustre-release/lustre/tests/fsx -N 1000 /mnt/lustre/fsxfile.5 -l 67108864 fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported truncating to largest ever: 0x1a7062c truncating to largest ever: 0x1a7062c skipping zero size read truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x1a7062c fsx: test_fallocate: filesystem does not support fallocate mode 0x0, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x3, disabling!: Operation not supported fsx: test_fallocate: filesystem does not support fallocate mode 0x10, disabling!: Operation not supported truncating to largest ever: 0x232e1d3 fsx: test_fallocate: filesystem does not support fallocate mode 0x1, disabling!: Operation not supported skipping zero size read truncating to largest ever: 0x1a7062c truncating to largest ever: 0x232e1d3 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x32cce75 truncating to largest ever: 0x3c569db truncating to largest ever: 0x32cce75 truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c569db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3c711db truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f0e56b truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab truncating to largest ever: 0x3f706ab All operations completed A-OK! All operations completed A-OK! All operations completed A-OK! All operations completed A-OK! All operations completed A-OK! + fsx 1 done: rc=0 Fri Aug 9 21:24:12 EDT 2024 + fsx 2 done: rc=0 Fri Aug 9 21:24:12 EDT 2024 + fsx 3 done: rc=0 Fri Aug 9 21:24:12 EDT 2024 + fsx 4 done: rc=0 Fri Aug 9 21:24:12 EDT 2024 + fsx 5 done: rc=0 Fri Aug 9 21:24:12 EDT 2024 PASS 16k (35s) == sanityn test 17: resource creation/LVB creation race ========================================================================= 21:24:15 (1723253055) fail_loc=0x8000030a PASS 17 (4s) == sanityn test 18: mmap sanity check =========================================================================================== 21:24:19 (1723253059) mmap test1: basic mmap operation (PASS, 0.031011s) mmap test2: MAP_PRIVATE not write back (PASS, 0.020061s) mmap test3: concurrent mmap ops on two nodes (PASS, 9.4657s) mmap test4: c1 write to f1 from mmapped f2, c2 write to f1 from mmapped f1 (PASS, 4.0795s) mmap test5: read/write file to/from the buffer which mmapped to just this file (PASS, 0.027712s) mmap test6: check mmap write/read content on two nodes (PASS, 0.039709s) mmap test7: file i/o with an unmapped buffer (SKIPPED, 0s) mmap test8: SIGBUS for beyond file size (SKIPPED, 0s) mmap test9: SIGBUS for negative file offset (SKIPPED, 0s) mmap test10: multi-thread mmap access (PASS, 0.31307s) mmap test11: multi-thread shared mmap (PASS, 0.30711s) mmap test10: mtime not change for readonly mmap access (PASS, 1.0137s) PASS 18 (18s) == sanityn test 19: test concurrent uncached read races ========================================================================= 21:24:37 (1723253077) oleg243-server: error: get_param: param_path 'osd-*/lustre-OST*/read_cache_enable': No such file or directory pdsh@oleg243-client: oleg243-server: ssh exited with exit code 2 SKIP: sanityn test_19 not cache-capable obdfilter SKIP 19 (1s) == sanityn test 20: test extra readahead page left in cache ============================================================== 21:24:38 (1723253078) PASS 20 (2s) == sanityn test 21: Try to remove mountpoint on another dir ============================================================== 21:24:40 (1723253080) rmdir: removing directory, '/mnt/lustre/d21.sanityn' rmdir: failed to remove '/mnt/lustre/d21.sanityn': Device or resource busy rmdir: removing directory, '/mnt/lustre2/d21.sanityn' Removed mounted directory from another mountpoint, needs to be fixed PASS 21 (2s) == sanityn test 23: others should see updated atime while another read============================================================== 21:24:42 (1723253082) now is 1723253082 starting reads multiop /mnt/lustre/f23.sanityn vor20_c TMPPIPE=/tmp/multiop_open_wait_pipe.6965 new atime is 1723253143 PASS 23 (63s) == sanityn test 24a: lfs df [-ih] [path] test =================================================================================== 21:25:45 (1723253145) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 32768 3736576 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 38912 7499776 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 6144 3763200 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 32768 3736576 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 38912 7499776 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.6K 387 490.2K 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 115.3K 402 114.9K 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 114.5K 399 114.1K 1% /mnt/lustre[OST:1] filesystem_summary: 229.4K 387 229.0K 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.6K 387 490.2K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.3K 402 114.9K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 114.5K 399 114.1K 1% /mnt/lustre2[OST:1] filesystem_summary: 229.4K 387 229.0K 1% /mnt/lustre2 UUID bytes Used Available Use% Mounted on lustre-MDT0000_UUID 2.1G 3.2M 2.1G 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3.6G 6.0M 3.6G 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3.6G 32.0M 3.6G 1% /mnt/lustre[OST:1] filesystem_summary: 7.2G 38.0M 7.2G 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502378 387 501991 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118066 402 117664 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 117231 399 116832 1% /mnt/lustre2[OST:1] filesystem_summary: 234883 387 234496 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 32768 3736576 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 38912 7499776 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 490.6K 387 490.2K 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 115.3K 402 114.9K 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 114.5K 399 114.1K 1% /mnt/lustre2[OST:1] filesystem_summary: 229.4K 387 229.0K 1% /mnt/lustre2 UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502378 387 501991 1% /mnt/lustre[MDT:0] filesystem_summary: 502378 387 501991 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 502378 387 501991 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 118066 402 117664 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 117231 399 116832 1% /mnt/lustre2[OST:1] filesystem_summary: 234883 387 234496 1% /mnt/lustre2 UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre[MDT:0] lustre-OST0000_UUID 3771392 6144 3763200 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 32768 3736576 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 38912 7499776 1% /mnt/lustre UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 3328 2205312 1% /mnt/lustre2[MDT:0] lustre-OST0000_UUID 3771392 6144 3763200 1% /mnt/lustre2[OST:0] lustre-OST0001_UUID 3771392 32768 3736576 1% /mnt/lustre2[OST:1] filesystem_summary: 7542784 38912 7499776 1% /mnt/lustre2 PASS 24a (2s) == sanityn test 24b: lfs df should show both filesystems ========================================================================= 21:25:47 (1723253147) PASS 24b (2s) == sanityn test 25a: change ACL on one mountpoint be seen on another ============================================================= 21:25:50 (1723253150) running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] Can't lstat /mnt/lustre2/d25a.sanityn/f1: Permission denied running as uid/gid/euid/egid 500/500/500/500, groups: [checkstat] [-v] [/mnt/lustre2/d25a.sanityn/f1] PASS 25a (3s) == sanityn test 25b: change ACL under remote dir on one mountpoint be seen on another ========================================================== 21:25:52 (1723253152) SKIP: sanityn test_25b needs >= 2 MDTs SKIP 25b (1s) == sanityn test 26a: allow mtime to get older ============ 21:25:53 (1723253153) utime: good mknod times 1723253152 <= 1723253153 <= 1723253153 for /mnt/lustre/f26a utime: good mknod times 1723253152 <= 1723253153 <= 1723253153 for /mnt/lustre2/f26a utime: good utime mtimes 100000, atime 200000 utime: updated times for /mnt/lustre2/f26a PASS 26a (3s) == sanityn test 26b: sync mtime between ost and mds ====== 21:25:56 (1723253156) PASS 26b (4s) == sanityn test 26c: set-in-past on open file is not lost on close ========================================================== 21:26:00 (1723253160) multiop /mnt/lustre/f26c.sanityn vO_c TMPPIPE=/tmp/multiop_open_wait_pipe.6965 File: '/mnt/lustre/f26c.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205272502398 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2024-08-09 21:26:01.000000000 -0400 Birth: - File: '/mnt/lustre2/f26c.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205272502398 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2000-12-31 06:12:59.000000000 -0500 Modify: 2000-12-31 06:12:59.000000000 -0500 Change: 2024-08-09 21:26:01.000000000 -0400 Birth: - PASS 26c (3s) SKIP: sanityn test_27 skipping excluded test 27 SKIP: sanityn test_28 skipping ALWAYS excluded test 28 == sanityn test 30: recreate file race =================== 21:26:04 (1723253164) 0 PASS 30 (4s) == sanityn test 31a: voluntary cancel / blocking ast race======================================================================== 21:26:08 (1723253168) fail_loc=0x314 PASS 31a (3s) == sanityn test 31b: voluntary OST cancel / blocking ast race======================================================================== 21:26:11 (1723253171) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg243-server mds-ost sync done. sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete fail_loc=0x314 fail_loc=0x316 fail_loc=0 fail_loc=0 Filesystem 1K-blocks Used Available Use% Mounted on 192.168.202.143@tcp:/lustre 7542784 38912 7497728 1% /mnt/lustre2 PASS 31b (22s) == sanityn test 31r: open-rename(replace) race =========== 21:26:33 (1723253193) -rw-r--r-- 1 root root 0 Aug 9 21:26 /mnt/lustre/f31r.sanityn.target fail_loc=0x1419 fail_val=3 PASS 31r (5s) == sanityn test 31s: open should not revalidate invalid dentry ========================================================== 21:26:38 (1723253198) /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 1211: 12754 Terminated tail -f $tfile PASS 31s (2s) == sanityn test 31t: getattr should not revalidate invalid dentry ========================================================== 21:26:40 (1723253200) PASS 31t (3s) SKIP: sanityn test_33a skipping SLOW test 33a == sanityn test 33b: COS: cross create/delete, 2 clients, benchmark under remote dir ========================================================== 21:26:43 (1723253203) SKIP: sanityn test_33b Need two or more clients, have 1 SKIP 33b (1s) == sanityn test 33c: Cancel cross-MDT lock should trigger Sync-on-Lock-Cancel ========================================================== 21:26:44 (1723253204) SKIP: sanityn test_33c needs >= 2 MDTs SKIP 33c (1s) == sanityn test 33d: dependent transactions should trigger COS ========================================================== 21:26:45 (1723253205) SKIP: sanityn test_33d needs >= 2 MDTs SKIP 33d (1s) == sanityn test 33e: independent transactions shouldn't trigger COS ========================================================== 21:26:46 (1723253206) SKIP: sanityn test_33e needs >= 2 MDTs SKIP 33e (1s) == sanityn test 34: no lock timeout under IO ============= 21:26:47 (1723253207) fail_loc=0x512 fail_loc=0x512 lock should not expire writing on client1 reading on client2 success fail_loc=0x511 fail_loc=0x511 lock should expire writing on client1 reading on client2 success oleg243-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800ab0de800.ost_server_uuid,osc.lustre-OST0000-osc-ffff88012aab2000.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800ab0de800.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0000-osc-ffff88012aab2000.ost_server_uuid in FULL state after 0 sec oleg243-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800ab0de800.ost_server_uuid,osc.lustre-OST0001-osc-ffff88012aab2000.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800ab0de800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0001-osc-ffff88012aab2000.ost_server_uuid in IDLE state after 0 sec oleg243-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800ab0de800.ost_server_uuid,osc.lustre-OST0000-osc-ffff88012aab2000.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800ab0de800.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0000-osc-ffff88012aab2000.ost_server_uuid in FULL state after 0 sec oleg243-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800ab0de800.ost_server_uuid,osc.lustre-OST0001-osc-ffff88012aab2000.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800ab0de800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0001-osc-ffff88012aab2000.ost_server_uuid in IDLE state after 0 sec oleg243-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0000-osc-ffff8800ab0de800.ost_server_uuid,osc.lustre-OST0000-osc-ffff88012aab2000.ost_server_uuid 50 osc.lustre-OST0000-osc-ffff8800ab0de800.ost_server_uuid in FULL state after 0 sec osc.lustre-OST0000-osc-ffff88012aab2000.ost_server_uuid in FULL state after 0 sec oleg243-client.virtnet: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff8800ab0de800.ost_server_uuid,osc.lustre-OST0001-osc-ffff88012aab2000.ost_server_uuid 50 osc.lustre-OST0001-osc-ffff8800ab0de800.ost_server_uuid in IDLE state after 0 sec osc.lustre-OST0001-osc-ffff88012aab2000.ost_server_uuid in IDLE state after 0 sec PASS 34 (90s) == sanityn test 35: -EINTR cp_ast vs. bl_ast race does not evict client ========================================================== 21:28:17 (1723253297) fail_loc=0x80000317 Race attempt 0 Wait for 20262 20407 for 60 sec... - open/close 3192 (time 1723253309.14 total 10.00 last 319.17) total: 4000 open/close in 12.48 seconds: 320.52 ops/second fail_loc=0x0 Filesystem Size Used Avail Use% Mounted on 192.168.202.143@tcp:/lustre 7.2G 39M 7.2G 1% /mnt/lustre 192.168.202.143@tcp:/lustre 7.2G 39M 7.2G 1% /mnt/lustre2 PASS 35 (64s) == sanityn test 36: handle ESTALE/open-unlink correctly == 21:29:21 (1723253361) Waiting for orphan cleanup... osp.lustre-OST0000-osc-MDT0000.old_sync_processed osp.lustre-OST0001-osc-MDT0000.old_sync_processed wait 40 secs maximumly for oleg243-server mds-ost sync done. Waiting for MDT destroys to complete 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.319736 s, 164 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6965 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(0) *** before(7498752) after_dd(7447552) after(7498752) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.317498 s, 165 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6965 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(1) *** before(7498752) after_dd(7447552) after(7498752) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.285177 s, 184 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6965 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(2) *** before(7498752) after_dd(7447552) after(7498752) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.274894 s, 191 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6965 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(3) *** before(7498752) after_dd(7445504) after(7496704) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.321086 s, 163 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6965 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(4) *** before(7496704) after_dd(7447552) after(7498752) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.286275 s, 183 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6965 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(5) *** before(7498752) after_dd(7445504) after(7496704) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.262264 s, 200 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6965 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(6) *** before(7496704) after_dd(7445504) after(7496704) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.289571 s, 181 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6965 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(7) *** before(7496704) after_dd(7447552) after(7498752) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.288939 s, 181 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6965 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(8) *** before(7498752) after_dd(7445504) after(7496704) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.302811 s, 173 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6965 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(9) *** before(7496704) after_dd(7447552) after(7498752) 50+0 records in 50+0 records out 52428800 bytes (52 MB) copied, 0.258066 s, 203 MB/s multiop /mnt/lustre2/d36.sanityn/f36.sanityn vO_r52428800c TMPPIPE=/tmp/multiop_open_wait_pipe.6965 sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete *** cycle(10) *** before(7498752) after_dd(7447552) after(7498752) PASS 36 (226s) == sanityn test 37: check i_size is not updated for directory on close (bug 18695) ======================================================================== 21:33:07 (1723253587) multiop /mnt/lustre/d37.sanityn vD_c TMPPIPE=/tmp/multiop_open_wait_pipe.6965 - create 9938 (time 1723253598.05 total 10.00 last 993.75) total: 10000 create in 10.06 seconds: 993.62 ops/second PASS 37 (12s) == sanityn test 39a: file mtime does not change after rename ========================================================== 21:33:19 (1723253599) repeat after cancel_lru_locks PASS 39a (2s) == sanityn test 39b: file mtime the same on clients with/out lock ========================================================== 21:33:21 (1723253601) repeat after cancel_lru_locks PASS 39b (2s) == sanityn test 39c: check truncate mtime update ================================================================================ 21:33:23 (1723253603) repeat after cancel_lru_locks PASS 39c (3s) == sanityn test 39d: sync write should update mtime ====== 21:33:26 (1723253606) fail_loc=0x411 fail_loc=0 PASS 39d (1s) == sanityn test 40a: pdirops: create vs others ======================================================================== 21:33:28 (1723253608) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40a (8s) == sanityn test 40b: pdirops: open|create and others ======================================================================== 21:33:35 (1723253615) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40b (7s) == sanityn test 40c: pdirops: link and others ======================================================================== 21:33:42 (1723253622) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40c (7s) == sanityn test 40d: pdirops: unlink and others ======================================================================== 21:33:49 (1723253629) No conflict No conflict No conflict No conflict No conflict No conflict No conflict PASS 40d (7s) == sanityn test 40e: pdirops: rename and others ======================================================================== 21:33:56 (1723253636) No conflict No conflict No conflict No conflict No conflict No conflict PASS 40e (6s) == sanityn test 41a: pdirops: create vs mkdir ======================================================================== 21:34:02 (1723253642) mkdir: cannot create directory '/mnt/lustre2/f41a.sanityn': File exists Conflict PASS 41a (4s) == sanityn test 41b: pdirops: create vs create ======================================================================== 21:34:06 (1723253646) open: File exists Conflict PASS 41b (4s) == sanityn test 41c: pdirops: create vs link ======================================================================== 21:34:10 (1723253650) link: cannot create link '/mnt/lustre2/f41c.sanityn' to '/mnt/lustre2/f41c.sanityn-2': File exists Conflict PASS 41c (5s) == sanityn test 41d: pdirops: create vs unlink ======================================================================== 21:34:15 (1723253655) Conflict PASS 41d (4s) == sanityn test 41e: pdirops: create and rename (tgt) ======================================================================== 21:34:19 (1723253659) Conflict PASS 41e (4s) == sanityn test 41f: pdirops: create and rename (src) ======================================================================== 21:34:23 (1723253663) Conflict PASS 41f (4s) == sanityn test 41g: pdirops: create vs getattr ======================================================================== 21:34:27 (1723253667) Conflict PASS 41g (4s) == sanityn test 41h: pdirops: create vs readdir ======================================================================== 21:34:31 (1723253671) Conflict PASS 41h (5s) == sanityn test 41i: reint_open: create vs create ======== 21:34:36 (1723253676) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 41i (643s) == sanityn test 42a: pdirops: mkdir vs mkdir ======================================================================== 21:45:19 (1723254319) mkdir: cannot create directory '/mnt/lustre2/f42a.sanityn': File exists Conflict PASS 42a (4s) == sanityn test 42b: pdirops: mkdir vs create ======================================================================== 21:45:23 (1723254323) open: File exists Conflict PASS 42b (5s) == sanityn test 42c: pdirops: mkdir vs link ======================================================================== 21:45:28 (1723254328) link: cannot create link '/mnt/lustre2/f42c.sanityn' to '/mnt/lustre2/f42c.sanityn-2': File exists Conflict PASS 42c (4s) == sanityn test 42d: pdirops: mkdir vs unlink ======================================================================== 21:45:32 (1723254332) Conflict PASS 42d (4s) == sanityn test 42e: pdirops: mkdir and rename (tgt) ======================================================================== 21:45:36 (1723254336) mv: cannot overwrite directory '/mnt/lustre2/f42e.sanityn' with non-directory Conflict PASS 42e (4s) == sanityn test 42f: pdirops: mkdir and rename (src) ======================================================================== 21:45:40 (1723254340) Conflict PASS 42f (4s) == sanityn test 42g: pdirops: mkdir vs getattr ======================================================================== 21:45:44 (1723254344) Conflict PASS 42g (5s) == sanityn test 42h: pdirops: mkdir vs readdir ======================================================================== 21:45:49 (1723254349) Conflict PASS 42h (4s) == sanityn test 43a: rmdir,mkdir doesn't return -EEXIST ======================================================================== 21:45:53 (1723254353) PASS 43a (12s) == sanityn test 43b: pdirops: unlink vs create ======================================================================== 21:46:05 (1723254365) Conflict PASS 43b (4s) == sanityn test 43c: pdirops: unlink vs link ======================================================================== 21:46:09 (1723254369) Conflict PASS 43c (5s) == sanityn test 43d: pdirops: unlink vs unlink ======================================================================== 21:46:14 (1723254374) rm: cannot remove '/mnt/lustre2/f43d.sanityn': No such file or directory Conflict PASS 43d (4s) == sanityn test 43e: pdirops: unlink and rename (tgt) ======================================================================== 21:46:18 (1723254378) Conflict PASS 43e (5s) == sanityn test 43f: pdirops: unlink and rename (src) ======================================================================== 21:46:23 (1723254383) mv: cannot stat '/mnt/lustre2/f43f.sanityn': No such file or directory Conflict PASS 43f (5s) == sanityn test 43g: pdirops: unlink vs getattr ======================================================================== 21:46:28 (1723254388) stat: cannot stat '/mnt/lustre2/f43g.sanityn': No such file or directory Conflict PASS 43g (4s) == sanityn test 43h: pdirops: unlink vs readdir ======================================================================== 21:46:32 (1723254392) Conflict PASS 43h (4s) == sanityn test 43i: pdirops: unlink vs remote mkdir ===== 21:46:36 (1723254396) SKIP: sanityn test_43i needs >= 2 MDTs SKIP 43i (1s) == sanityn test 43j: racy mkdir return EEXIST ======================================================================== 21:46:37 (1723254397) mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists mkdir: cannot create directory '/mnt/lustre2/d43j.sanityn/sub': File exists PASS 43j (62s) == sanityn test 43k: unlink vs create ==================== 21:47:39 (1723254459) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 43k (494s) == sanityn test 44a: pdirops: rename tgt vs mkdir ======================================================================== 21:55:53 (1723254953) mkdir: cannot create directory '/mnt/lustre2/f44a.sanityn': File exists Conflict Fri Aug 9 21:55:57 EDT 2024 PASS 44a (5s) == sanityn test 44b: pdirops: rename tgt vs create ======================================================================== 21:55:58 (1723254958) open: File exists Conflict PASS 44b (5s) == sanityn test 44c: pdirops: rename tgt vs link ======================================================================== 21:56:03 (1723254963) link: cannot create link '/mnt/lustre2/f44c.sanityn' to '/mnt/lustre2/f44c.sanityn-3': File exists Conflict PASS 44c (5s) == sanityn test 44d: pdirops: rename tgt vs unlink ======================================================================== 21:56:08 (1723254968) Conflict PASS 44d (6s) == sanityn test 44e: pdirops: rename tgt and rename (tgt) ======================================================================== 21:56:14 (1723254974) Conflict PASS 44e (5s) == sanityn test 44f: pdirops: rename tgt and rename (src) ======================================================================== 21:56:19 (1723254979) Conflict PASS 44f (6s) == sanityn test 44g: pdirops: rename tgt vs getattr ======================================================================== 21:56:25 (1723254985) Conflict PASS 44g (6s) == sanityn test 44h: pdirops: rename tgt vs readdir ======================================================================== 21:56:31 (1723254991) Conflict PASS 44h (5s) == sanityn test 44i: pdirops: rename tgt vs remote mkdir ========================================================== 21:56:36 (1723254996) SKIP: sanityn test_44i needs >= 2 MDTs SKIP 44i (2s) == sanityn test 45a: rename,mkdir doesn't return -EEXIST ======================================================================== 21:56:38 (1723254998) PASS 45a (45s) == sanityn test 45b: pdirops: rename src vs create ======================================================================== 21:57:23 (1723255043) Conflict PASS 45b (5s) == sanityn test 45c: pdirops: rename src vs link ======================================================================== 21:57:28 (1723255048) Conflict PASS 45c (6s) == sanityn test 45d: pdirops: rename src vs unlink ======================================================================== 21:57:34 (1723255054) rm: cannot remove '/mnt/lustre2/f45d.sanityn': No such file or directory Conflict PASS 45d (5s) == sanityn test 45e: pdirops: rename src and rename (tgt) ======================================================================== 21:57:40 (1723255060) Conflict PASS 45e (6s) == sanityn test 45f: pdirops: rename src and rename (src) ======================================================================== 21:57:46 (1723255066) mv: cannot stat '/mnt/lustre2/f45f.sanityn': No such file or directory Conflict PASS 45f (5s) == sanityn test 45g: pdirops: rename src vs getattr ======================================================================== 21:57:51 (1723255071) stat: cannot stat '/mnt/lustre2/f45g.sanityn': No such file or directory Conflict PASS 45g (5s) == sanityn test 45h: pdirops: unlink vs readdir ======================================================================== 21:57:56 (1723255076) Conflict PASS 45h (4s) == sanityn test 45i: pdirops: rename src vs remote mkdir ========================================================== 21:58:00 (1723255080) SKIP: sanityn test_45i needs >= 2 MDTs SKIP 45i (1s) == sanityn test 45j: read vs rename ====================== 21:58:01 (1723255081) Begin 100 tests with fail_loc=0x80000169 Progress: **************************************************************************************************** Begin 100 tests with fail_loc=0x8000016a Progress: **************************************************************************************************** PASS 45j (403s) == sanityn test 46a: pdirops: link vs mkdir ======================================================================== 22:04:44 (1723255484) mkdir: cannot create directory '/mnt/lustre2/f46a.sanityn': File exists Conflict PASS 46a (5s) == sanityn test 46b: pdirops: link vs create ======================================================================== 22:04:49 (1723255489) open: File exists Conflict PASS 46b (4s) == sanityn test 46c: pdirops: link vs link ======================================================================== 22:04:53 (1723255493) link: cannot create link '/mnt/lustre2/f46c.sanityn' to '/mnt/lustre2/f46c.sanityn': File exists Conflict PASS 46c (4s) == sanityn test 46d: pdirops: link vs unlink ======================================================================== 22:04:58 (1723255498) Conflict PASS 46d (5s) == sanityn test 46e: pdirops: link and rename (tgt) ======================================================================== 22:05:02 (1723255502) Conflict PASS 46e (4s) == sanityn test 46f: pdirops: link and rename (src) ======================================================================== 22:05:06 (1723255506) Conflict PASS 46f (4s) == sanityn test 46g: pdirops: link vs getattr ======================================================================== 22:05:11 (1723255511) Conflict PASS 46g (5s) == sanityn test 46h: pdirops: link vs readdir ======================================================================== 22:05:15 (1723255515) Conflict PASS 46h (4s) == sanityn test 46i: pdirops: link vs remote mkdir ======= 22:05:19 (1723255519) SKIP: sanityn test_46i needs >= 2 MDTs SKIP 46i (0s) == sanityn test 47a: pdirops: remote mkdir vs mkdir ====== 22:05:19 (1723255519) SKIP: sanityn test_47a needs >= 2 MDTs SKIP 47a (1s) == sanityn test 47b: pdirops: remote mkdir vs create ===== 22:05:20 (1723255520) SKIP: sanityn test_47b needs >= 2 MDTs SKIP 47b (1s) == sanityn test 47c: pdirops: remote mkdir vs link ======= 22:05:21 (1723255521) SKIP: sanityn test_47c needs >= 2 MDTs SKIP 47c (0s) == sanityn test 47d: pdirops: remote mkdir vs unlink ===== 22:05:22 (1723255522) SKIP: sanityn test_47d needs >= 2 MDTs SKIP 47d (1s) == sanityn test 47e: pdirops: remote mkdir and rename (tgt) ========================================================== 22:05:22 (1723255522) SKIP: sanityn test_47e needs >= 2 MDTs SKIP 47e (1s) == sanityn test 47f: pdirops: remote mkdir and rename (src) ========================================================== 22:05:23 (1723255523) SKIP: sanityn test_47f needs >= 2 MDTs SKIP 47f (1s) == sanityn test 47g: pdirops: remote mkdir vs getattr ==== 22:05:24 (1723255524) SKIP: sanityn test_47g needs >= 2 MDTs SKIP 47g (0s) == sanityn test 50: osc lvb attrs: enqueue vs. CP AST ======================================================================== 22:05:24 (1723255524) 10+0 records in 10+0 records out 10240 bytes (10 kB) copied, 0.0037974 s, 2.7 MB/s fail_loc=0x410 fail_loc=0x0 PASS 50 (7s) == sanityn test 51a: layout lock: refresh layout should work ========================================================== 22:05:31 (1723255531) 0+1 records in 0+1 records out 159 bytes (159 B) copied, 0.00350321 s, 45.4 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 3514: kill: (31789) - No such process PASS 51a (3s) == sanityn test 51b: layout lock: glimpse should be able to restart if layout changed ========================================================== 22:05:34 (1723255534) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.0023134 s, 443 kB/s fail_loc=0x1404 fail_val=4 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011521 s, 91.0 MB/s 3145728 PASS 51b (14s) == sanityn test 51c: layout lock: IT_LAYOUT blocked and correct layout can be returned ========================================================== 22:05:48 (1723255548) fail_loc=0x172 Setting layout to have 2 stripes ... 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00311619 s, 329 kB/s PASS 51c (6s) == sanityn test 51d: layout lock: losing layout lock should clean up memory map region ========================================================== 22:05:54 (1723255554) 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106323 s, 98.6 MB/s Before revoking layout lock: 1024 KB mapped PASS 51d (2s) == sanityn test 51e: lfs getstripe does not break leases, part 2 ========================================================== 22:05:57 (1723255557) /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2450 0x992 0x280000400 write lease(2) has applied. /mnt/lustre2/f51e.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 2450 0x992 0x280000400 read lease(1) has applied. PASS 51e (3s) == sanityn test 54: rename locking ======================= 22:06:00 (1723255560) llite.lustre-ffff8800ab0de800.xattr_cache=1 llite.lustre-ffff88012aab2000.xattr_cache=1 ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505012 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-08-09 22:06:00.000000000 -0400 Modify: 2024-08-09 22:06:00.000000000 -0400 Change: 2024-08-09 22:06:00.000000000 -0400 Birth: - ==> rename vs getattr vs setxattr should not deadlock fail_loc=0x80000154 File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505015 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-08-09 22:06:06.000000000 -0400 Modify: 2024-08-09 22:06:06.000000000 -0400 Change: 2024-08-09 22:06:06.000000000 -0400 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000153 File: '/mnt/lustre/d1/d2' Size: 512 Blocks: 1 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505018 Links: 3 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-08-09 22:06:11.000000000 -0400 Modify: 2024-08-09 22:06:11.000000000 -0400 Change: 2024-08-09 22:06:11.000000000 -0400 Birth: - open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505017 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-08-09 22:06:11.000000000 -0400 Modify: 2024-08-09 22:06:11.000000000 -0400 Change: 2024-08-09 22:06:11.000000000 -0400 Birth: - ==> rename vs getattr vs open vs getattr should not deadlock fail_loc=0x80000154 open(O_RDWR|O_CREAT): Is a directory File: '/mnt/lustre/d1' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505020 Links: 4 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-08-09 22:06:17.000000000 -0400 Modify: 2024-08-09 22:06:17.000000000 -0400 Change: 2024-08-09 22:06:17.000000000 -0400 Birth: - File: '/mnt/lustre/d1/d2' Size: 11776 Blocks: 23 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272505021 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-08-09 22:06:17.000000000 -0400 Modify: 2024-08-09 22:06:17.000000000 -0400 Change: 2024-08-09 22:06:17.000000000 -0400 Birth: - PASS 54 (23s) == sanityn test 55a: rename vs unlink target dir ========= 22:06:23 (1723255583) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55a.sanityn/d1/d2' to '/mnt/lustre/d55a.sanityn/d3/d2': No such file or directory PASS 55a (7s) == sanityn test 55b: rename vs unlink source dir ========= 22:06:30 (1723255590) fail_loc=0x80000156 mv: cannot move '/mnt/lustre/d55b.sanityn/d1/d2' to '/mnt/lustre/d55b.sanityn/d3/d2': No such file or directory PASS 55b (7s) == sanityn test 55c: rename vs unlink orphan target dir == 22:06:37 (1723255597) fail_loc=0x156 mv: cannot move '/mnt/lustre/d55c.sanityn/d1/d2' to '/mnt/lustre/d55c.sanityn/d3/d2': No such file or directory PASS 55c (12s) == sanityn test 55d: rename file vs link ================= 22:06:49 (1723255609) fail_loc=0x155 mv: cannot move '/mnt/lustre/d55d.sanityn/f1' to '/mnt/lustre/d55d.sanityn/d55d.sanityn': Is a directory PASS 55d (9s) == sanityn test 56a: test llverdev with single large stripe ========================================================== 22:06:58 (1723255618) run_llverdev /mnt/lustre/f56a.sanityn -p -s 16000000 -c 4k llverdev: /mnt/lustre/f56a.sanityn is 16777216000000 bytes (15625 GB) in size timestamp: 1723255618 chunksize: 4096 size: 16777216000000 write offset: 16384000000kB 3.05195 MB/s read offset: 16384000000kB inf MB/s llverdev: data verified successfully PASS 56a (21s) == sanityn test 56b: test llverdev and partial verify of wide stripe file ========================================================== 22:07:19 (1723255639) run_llverdev /mnt/lustre/f56b.sanityn -p -s 32000000 -c 4k llverdev: read /mnt/lustre/f56b.sanityn@33554431995904+4096 no data: Success llverdev: read /mnt/lustre/f56b.sanityn@33554431995904+4096 no data: Success llverdev: /mnt/lustre/f56b.sanityn is 33554432000000 bytes (31250 GB) in size timestamp: 1723255640 chunksize: 4096 size: 33554432000000 write offset: 32768000000kB 3.93788 MB/s read offset: 32768000000kB -nan MB/s llverdev: data verified successfully PASS 56b (35s) == sanityn test 60: Verify data_version behaviour ======== 22:07:54 (1723255674) PASS 60 (1s) == sanityn test 70a: cd directory && rm directory ======== 22:07:55 (1723255675) PASS 70a (2s) == sanityn test 70b: remove files after calling rm_entry ========================================================== 22:07:57 (1723255677) PASS 70b (2s) == sanityn test 71a: correct file map just after write operation is finished ========================================================== 22:07:59 (1723255679) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00270543 s, 24.2 MB/s SKIP: sanityn test_71a ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71a (1s) == sanityn test 71b: check fiemap support for stripecount > 1 ========================================================== 22:08:00 (1723255680) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00295048 s, 22.2 MB/s SKIP: sanityn test_71b ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71b (1s) == sanityn test 71c: check FIEMAP_EXTENT_LAST flag with different extents number ========================================================== 22:08:01 (1723255681) SKIP: sanityn test_71c support only ldiskfs ost SKIP 71c (0s) == sanityn test 71d: fiemap corruption test with fm_extent_count=0 ========================================================== 22:08:02 (1723255682) 1+0 records in 1+0 records out 65536 bytes (66 kB) copied, 0.00425153 s, 15.4 MB/s SKIP: sanityn test_71d ORI-366/LU-1941: FIEMAP unimplemented on ZFS SKIP 71d (1s) == sanityn test 72: getxattr/setxattr cache should be consistent between nodes ========================================================== 22:08:02 (1723255682) llite.lustre-ffff8800ab0de800.xattr_cache=1 llite.lustre-ffff88012aab2000.xattr_cache=1 getfattr: Removing leading '/' from absolute path names user.attr1="value1" getfattr: Removing leading '/' from absolute path names user.attr1="value2" getfattr: Removing leading '/' from absolute path names getfattr: Removing leading '/' from absolute path names b362740ad371eae580e7f85452e8830b - 870e072da1ebfc20ea8c0cd3d6bdf3b6 - PASS 72 (2s) == sanityn test 73: getxattr should not cause xattr lock cancellation ========================================================== 22:08:04 (1723255684) llite.lustre-ffff8800ab0de800.xattr_cache=1 llite.lustre-ffff88012aab2000.xattr_cache=1 getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre/f73.sanityn user.attr1="value1" getfattr: Removing leading '/' from absolute path names # file: mnt/lustre2/f73.sanityn user.attr1="value1" PASS 73 (2s) == sanityn test 74: flock deadlock: different mounts ======================================================================== 22:08:06 (1723255686) 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00349556 s, 293 kB/s 1+0 records in 1+0 records out 1024 bytes (1.0 kB) copied, 0.00272931 s, 375 kB/s 11747: get lock2 11748: get lock1 11747: done 11747: get lock1 11748: done 11748: get lock2 fcntl cmd 7 failed: Resource deadlock avoided 11747: cannot get lock1: Resource deadlock avoided fcntl cmd 7 failed: Resource deadlock avoided 11748: cannot get lock2: Resource deadlock avoided 11748: exit rc=0 11747: done 11747: exit rc=0 PASS 74 (6s) == sanityn test 75: osc: upcall after unuse lock============================================================================= 22:08:12 (1723255692) 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0138472 s, 151 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00775383 s, 135 MB/s fail_loc=0x31d /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 4103: 12385 Killed stat -c %s $DIR1/$tfile fail_loc=0 PASS 75 (6s) == sanityn test 76: Verify MDT open_files listing ======== 22:08:19 (1723255699) opening files: ........ closing files: ........ PASS 76 (14s) == sanityn test 77a: check FIFO NRS policy =============== 22:08:33 (1723255713) ost.OSS.ost.nrs_policies=fifo ost.OSS.ost_create.nrs_policies=fifo ost.OSS.ost_io.nrs_policies=fifo ost.OSS.ost_out.nrs_policies=fifo ost.OSS.ost_seq.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0918509 s, 183 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00806514 s, 130 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115708 s, 90.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128107 s, 81.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0082245 s, 127 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144763 s, 72.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0183383 s, 57.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00704294 s, 149 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00978642 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0195003 s, 53.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0231054 s, 45.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212198 s, 49.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0127059 s, 82.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0311863 s, 33.6 MB/s , 0.0413325 s, 25.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0209358 s, 50.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0240954 s, 43.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00589974 s, 178 MB/s 1048576 bytes (1.0 MB) copied, 0.00880237 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114834 s, 91.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126619 s, 82.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00822217 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00737987 s, 142 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00749986 s, 140 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105875 s, 99.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00918807 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00934952 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00982307 s, 107 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0117688 s, 89.1 MB/s , 0.0117704 s, 89.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121705 s, 86.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124238 s, 84.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0134434 s, 78.0 MB/s removed '/mnt/lustre/d77a.sanityn/nrs_r_oleg243-client.virtnet' removed '/mnt/lustre/d77a.sanityn/nrs_w_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77a.sanityn' PASS 77a (3s) == sanityn test 77b: check CRR-N NRS policy ============== 22:08:36 (1723255716) ost.OSS.ost.nrs_policies=crrn ost.OSS.ost_create.nrs_policies=crrn ost.OSS.ost_io.nrs_policies=crrn ost.OSS.ost_out.nrs_policies=crrn ost.OSS.ost_seq.nrs_policies=crrn ost.OSS.ost.nrs_crrn_quantum=1 ost.OSS.ost_create.nrs_crrn_quantum=1 ost.OSS.ost_io.nrs_crrn_quantum=1 ost.OSS.ost_out.nrs_crrn_quantum=1 ost.OSS.ost_seq.nrs_crrn_quantum=1 policy: crr-n, crrn_quantum 1 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0930162 s, 180 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119995 s, 87.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00797568 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144258 s, 72.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111329 s, 94.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0356881 s, 29.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.033121 s, 31.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.037358 s, 28.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0393676 s, 26.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0425039 s, 24.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0495726 s, 21.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0413991 s, 25.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0466385 s, 22.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0512606 s, 20.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.052105 s, 20.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0542756 s, 19.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0444887 s, 23.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00877079 s, 120 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00736876 s, 142 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0073224 s, 143 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00942119 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00953652 s, 110 MB/s 1048576 bytes (1.0 MB) copied, 0.00799857 s, 131 MB/s , 0.00720864 s, 145 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00136299 s, 769 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00935193 s, 112 MB/s 1048576 bytes (1.0 MB) copied, 0.00685311 s, 153 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00964605 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00946431 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107475 s, 97.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101439 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00984339 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107567 s, 97.5 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg243-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost.nrs_crrn_quantum=64 ost.OSS.ost_create.nrs_crrn_quantum=64 ost.OSS.ost_io.nrs_crrn_quantum=64 ost.OSS.ost_out.nrs_crrn_quantum=64 ost.OSS.ost_seq.nrs_crrn_quantum=64 policy: crr-n, crrn_quantum 64 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0799035 s, 210 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00903154 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00690913 s, 152 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108575 s, 96.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0371938 s, 28.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0416358 s, 25.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0397914 s, 26.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0391158 s, 26.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0327639 s, 32.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0450914 s, 23.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0407469 s, 25.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0470861 s, 22.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0485824 s, 21.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0391497 s, 26.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0493923 s, 21.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0460997 s, 22.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0562961 s, 18.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00370504 s, 283 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00379019 s, 277 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00472215 s, 222 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00939648 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104261 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00932321 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00863111 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00578875 s, 181 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00562186 s, 187 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0065275 s, 161 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00659117 s, 159 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.006785 s, 155 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00689435 s, 152 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00815299 s, 129 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0081606 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00870004 s, 121 MB/s removed '/mnt/lustre/d77b.sanityn/nrs_w_oleg243-client.virtnet' removed '/mnt/lustre/d77b.sanityn/nrs_r_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77b.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77b (2s) == sanityn test 77c: check ORR NRS policy ================ 22:08:39 (1723255719) ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_orr_quantum=1 ost.OSS.ost_io.nrs_orr_offset_type=physical ost.OSS.ost_io.nrs_orr_supported=reads policy: orr, orr_quantum 1, orr_offset_type physical, orr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0894768 s, 188 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110301 s, 95.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0107306 s, 97.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0295495 s, 35.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0357106 s, 29.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0382072 s, 27.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0387213 s, 27.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0273287 s, 38.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0266684 s, 39.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0370904 s, 28.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0354163 s, 29.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0428706 s, 24.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0446264 s, 23.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0449937 s, 23.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0377087 s, 27.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0462927 s, 22.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0469775 s, 22.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136495 s, 76.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0170487 s, 61.5 MB/s , 0.0139215 s, 75.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105536 s, 99.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0161901 s, 64.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108629 s, 96.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109917 s, 95.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0113333 s, 92.5 MB/s 1+0 records in 1+0 records out , 0.01147 s, 91.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0115378 s, 90.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126391 s, 83.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135209 s, 77.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0136465 s, 76.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0142114 s, 73.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148664 s, 70.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0151312 s, 69.3 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg243-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=writes ost.OSS.ost_io.nrs_orr_quantum=64 policy: orr, orr_quantum 64, orr_offset_type physical, orr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.10392 s, 161 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124082 s, 84.5 MB/s , 0.00924932 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125758 s, 83.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.015289 s, 68.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0293841 s, 35.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0375018 s, 28.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.04017 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0307695 s, 34.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.031778 s, 33.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0372412 s, 28.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0464092 s, 22.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0598604 s, 17.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0613743 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0598069 s, 17.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0725596 s, 14.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0780424 s, 13.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00862389 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00861435 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107607 s, 97.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00894219 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123248 s, 85.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120211 s, 87.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116582 s, 89.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00990772 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00905233 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119961 s, 87.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108834 s, 96.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113752 s, 92.2 MB/s , 0.0119672 s, 87.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116969 s, 89.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113054 s, 92.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129465 s, 81.0 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg243-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_orr_supported=reads_and_writes ost.OSS.ost_io.nrs_orr_offset_type=logical policy: orr, orr_quantum 64, orr_offset_type logical, orr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.103261 s, 162 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113502 s, 92.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107527 s, 97.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0201139 s, 52.1 MB/s , 0.0299365 s, 35.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0286422 s, 36.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0291792 s, 35.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0270268 s, 38.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0305043 s, 34.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0278669 s, 37.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.043341 s, 24.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0513727 s, 20.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.055196 s, 19.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0601036 s, 17.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0598278 s, 17.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0610665 s, 17.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0599921 s, 17.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00609422 s, 172 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00865758 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00679281 s, 154 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00686023 s, 153 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00732309 s, 143 MB/s , 0.00694464 s, 151 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00885685 s, 118 MB/s 1048576 bytes (1.0 MB) copied, 0.00956191 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00844364 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00817888 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00970028 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00815991 s, 129 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00855546 s, 123 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00958012 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00939031 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00933137 s, 112 MB/s removed '/mnt/lustre/d77c.sanityn/nrs_w_oleg243-client.virtnet' removed '/mnt/lustre/d77c.sanityn/nrs_r_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77c.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77c (4s) == sanityn test 77d: check TRR nrs policy ================ 22:08:42 (1723255722) ost.OSS.ost_io.nrs_policies=trr ost.OSS.ost_io.nrs_trr_quantum=1 ost.OSS.ost_io.nrs_trr_offset_type=physical ost.OSS.ost_io.nrs_trr_supported=reads policy: trr, trr_quantum 1, trr_offset_type physical, trr_supported reads 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0920905 s, 182 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00989944 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102704 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00780767 s, 134 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0161846 s, 64.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0139658 s, 75.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00787343 s, 133 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00919338 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00696059 s, 151 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135564 s, 77.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0387858 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0289205 s, 36.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0430116 s, 24.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0307015 s, 34.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0426498 s, 24.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0314238 s, 33.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0498288 s, 21.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00992248 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00877915 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00680599 s, 154 MB/s 1048576 bytes (1.0 MB) copied, 0.0071313 s, 147 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00874096 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105306 s, 99.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00960668 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00863239 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101134 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0102552 s, 102 MB/s 1048576 bytes (1.0 MB) copied, 0.0108113 s, 97.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103024 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100118 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00959063 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00961944 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115339 s, 90.9 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg243-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=writes ost.OSS.ost_io.nrs_trr_quantum=64 policy: trr, trr_quantum 64, trr_offset_type physical, trr_supported writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.092633 s, 181 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0115708 s, 90.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0100251 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0293915 s, 35.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0388181 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0509366 s, 20.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0479111 s, 21.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0414467 s, 25.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0523457 s, 20.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0483882 s, 21.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0529617 s, 19.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0537319 s, 19.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0580406 s, 18.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0584268 s, 17.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0575799 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0550614 s, 19.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0558791 s, 18.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00664979 s, 158 MB/s , 0.00525233 s, 200 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0085623 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00650135 s, 161 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00729593 s, 144 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117436 s, 89.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0075373 s, 139 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00870433 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0089341 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00897346 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0098079 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104669 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102294 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010697 s, 98.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011058 s, 94.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011992 s, 87.4 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg243-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_trr_supported=reads_and_writes ost.OSS.ost_io.nrs_trr_offset_type=logical policy: trr, trr_quantum 64, trr_offset_type logical, trr_supported reads_and_writes 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.10198 s, 165 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00978461 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00881133 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0188151 s, 55.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0311371 s, 33.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.032019 s, 32.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0370353 s, 28.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0361181 s, 29.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0385222 s, 27.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.039333 s, 26.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0326527 s, 32.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0406799 s, 25.8 MB/s 1048576 bytes (1.0 MB) copied, 0.041425 s, 25.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0383002 s, 27.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0442959 s, 23.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0398518 s, 26.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0501005 s, 20.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00941205 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106402 s, 98.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00709756 s, 148 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00553268 s, 190 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00711341 s, 147 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00898927 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00671031 s, 156 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00752677 s, 139 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00872433 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00864142 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00877829 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00912461 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100908 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104765 s, 100 MB/s , 0.0101376 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00988398 s, 106 MB/s removed '/mnt/lustre/d77d.sanityn/nrs_w_oleg243-client.virtnet' removed '/mnt/lustre/d77d.sanityn/nrs_r_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77d.sanityn' ost.OSS.ost_io.nrs_policies=fifo PASS 77d (4s) == sanityn test 77e: check TBF NID nrs policy ============ 22:08:46 (1723255726) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_tbf_rule=start localhost nid={0@lo} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start clients nid={192.168.202.43@tcp} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start others nid={*.*.*.*@tcp} rate=50 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0777441 s, 216 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00867491 s, 121 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110085 s, 95.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0168256 s, 62.3 MB/s , 0.0150517 s, 69.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0365468 s, 28.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0369883 s, 28.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0276791 s, 37.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0306942 s, 34.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.027897 s, 37.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0428723 s, 24.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0506314 s, 20.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0543935 s, 19.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0618857 s, 16.9 MB/s , 0.0531765 s, 19.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0596993 s, 17.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0529847 s, 19.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00963233 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00821228 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00856896 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00889402 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00918598 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103639 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0087919 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00975936 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102301 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105231 s, 99.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0093151 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00993123 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00988454 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101551 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102319 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124856 s, 84.0 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg243-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change localhost rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change clients rate=101 ost.OSS.ost_io.nrs_tbf_rule=change others rate=51 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0889544 s, 189 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101522 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00800484 s, 131 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0363551 s, 28.8 MB/s , 0.0342569 s, 30.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0390672 s, 26.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0357427 s, 29.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0408696 s, 25.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0401456 s, 26.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0409295 s, 25.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0393955 s, 26.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0328695 s, 31.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0370593 s, 28.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0388684 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0417282 s, 25.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0462951 s, 22.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0472224 s, 22.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0098037 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00760668 s, 138 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00945908 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00833 s, 126 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00958017 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123035 s, 85.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113795 s, 92.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00967443 s, 108 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111549 s, 94.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0112969 s, 92.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107692 s, 97.4 MB/s 1048576 bytes (1.0 MB) copied, 0.010991 s, 95.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0120337 s, 87.1 MB/s , 0.0111501 s, 94.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103544 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0144539 s, 72.5 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg243-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop localhost ost.OSS.ost_io.nrs_tbf_rule=stop clients ost.OSS.ost_io.nrs_tbf_rule=stop others 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.100903 s, 166 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00996178 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117853 s, 89.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0070203 s, 149 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0095886 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0247399 s, 42.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0293499 s, 35.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0305094 s, 34.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0287098 s, 36.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0329978 s, 31.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0342412 s, 30.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0349992 s, 30.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0557372 s, 18.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0611896 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0614902 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0626275 s, 16.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0692304 s, 15.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00888706 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00725089 s, 145 MB/s , 0.00704249 s, 149 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00774332 s, 135 MB/s 1048576 bytes (1.0 MB) copied, 0.00791403 s, 132 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114614 s, 91.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0091109 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00938778 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00933121 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00939574 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010118 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105951 s, 99.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107721 s, 97.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108844 s, 96.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116596 s, 89.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121442 s, 86.3 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg243-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' ost.OSS.ost_io.nrs_policies=fifo 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0959017 s, 175 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00922326 s, 114 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00870579 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125178 s, 83.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0219851 s, 47.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.03397 s, 30.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0343152 s, 30.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0320403 s, 32.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0329852 s, 31.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0405242 s, 25.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0418866 s, 25.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0425656 s, 24.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0461185 s, 22.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0407898 s, 25.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0454543 s, 23.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0393014 s, 26.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0450582 s, 23.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00480247 s, 218 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00795241 s, 132 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0083227 s, 126 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00714496 s, 147 MB/s , 0.00978286 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00845225 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00742735 s, 141 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00683693 s, 153 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00754415 s, 139 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00805655 s, 130 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0091307 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00960494 s, 109 MB/s , 0.00954014 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00995701 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105017 s, 99.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101406 s, 103 MB/s removed '/mnt/lustre/d77e.sanityn/nrs_w_oleg243-client.virtnet' removed '/mnt/lustre/d77e.sanityn/nrs_r_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77e.sanityn' PASS 77e (6s) == sanityn test 77f: check TBF JobID nrs policy ========== 22:08:52 (1723255732) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start runas jobid={iozone.500 dd.500 tiotest.500} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start iozone_runas jobid={iozone.500} rate=100 ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg243-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.107702 s, 156 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00891167 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155765 s, 67.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0162676 s, 64.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0140825 s, 74.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104101 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109066 s, 96.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0233274 s, 45.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0179252 s, 58.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00749232 s, 140 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00906546 s, 116 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.059295 s, 17.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0555777 s, 18.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0511885 s, 20.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0670767 s, 15.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.061366 s, 17.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0727593 s, 14.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0979073 s, 10.7 MB/s 1048576 bytes (1.0 MB) copied, 0.100602 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.10174 s, 10.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.104022 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.101898 s, 10.3 MB/s 1048576 bytes (1.0 MB) copied, 0.100766 s, 10.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0999375 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.100103 s, 10.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.101169 s, 10.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.103355 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.10362 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.103851 s, 10.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.104386 s, 10.0 MB/s 1048576 bytes (1.0 MB) copied, 0.10453 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.105303 s, 10.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.105411 s, 9.9 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg243-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=change runas rate=1001 ost.OSS.ost_io.nrs_tbf_rule=change iozone_runas rate=101 ost.OSS.ost_io.nrs_tbf_rule=change dd_runas rate=51 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg243-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0940596 s, 178 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104039 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135846 s, 77.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0287425 s, 36.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0271607 s, 38.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0316075 s, 33.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0340218 s, 30.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0375656 s, 27.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0387966 s, 27.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0424473 s, 24.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0490389 s, 21.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0449296 s, 23.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0470904 s, 22.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0534219 s, 19.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0481034 s, 21.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0508412 s, 20.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0599401 s, 17.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00761968 s, 138 MB/s , 0.00882649 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00683698 s, 153 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00694182 s, 151 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0082508 s, 127 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115112 s, 91.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00819246 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00860757 s, 122 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010753 s, 97.5 MB/s , 0.0104434 s, 100 MB/s , 0.00982782 s, 107 MB/s 1048576 bytes (1.0 MB) copied, 0.0112091 s, 93.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105005 s, 99.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0111854 s, 93.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0106952 s, 98.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116968 s, 89.6 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg243-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_tbf_rule=stop runas ost.OSS.ost_io.nrs_tbf_rule=stop iozone_runas ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg243-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0974428 s, 172 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010542 s, 99.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115002 s, 91.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.032734 s, 32.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0387097 s, 27.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0403717 s, 26.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.041399 s, 25.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0449133 s, 23.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0482909 s, 21.7 MB/s 1048576 bytes (1.0 MB) copied, 0.0444228 s, 23.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0396137 s, 26.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0466638 s, 22.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0467791 s, 22.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0478221 s, 21.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0506052 s, 20.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0522701 s, 20.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0528044 s, 19.9 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00715267 s, 147 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108605 s, 96.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108651 s, 96.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00804276 s, 130 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131751 s, 79.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00874335 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00904018 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011073 s, 94.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109468 s, 95.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00946556 s, 111 MB/s 1048576 bytes (1.0 MB) copied, 0.00979288 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00940683 s, 111 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0114198 s, 91.8 MB/s , 0.0115746 s, 90.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116011 s, 90.4 MB/s , 0.0116858 s, 89.7 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg243-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' ost.OSS.ost_io.nrs_policies=fifo running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77f.sanityn/nrs_r_oleg243-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.105148 s, 160 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121533 s, 86.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123954 s, 84.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00933059 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104585 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0314977 s, 33.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0309751 s, 33.9 MB/s , 0.0311808 s, 33.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0275423 s, 38.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0413145 s, 25.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0466459 s, 22.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0426297 s, 24.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.046866 s, 22.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0367085 s, 28.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0509904 s, 20.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0393466 s, 26.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0565328 s, 18.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00875476 s, 120 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00967868 s, 108 MB/s 1048576 bytes (1.0 MB) copied, 0.00965689 s, 109 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.016659 s, 62.9 MB/s 1048576 bytes (1.0 MB) copied, 0.0171777 s, 61.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0134142 s, 78.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0228937 s, 45.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0116045 s, 90.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0132114 s, 79.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133007 s, 78.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133633 s, 78.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0137396 s, 76.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.015404 s, 68.1 MB/s 1048576 bytes (1.0 MB) copied, 0.0153976 s, 68.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0154771 s, 67.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0164367 s, 63.8 MB/s removed '/mnt/lustre/d77f.sanityn/nrs_r_oleg243-client.virtnet' removed '/mnt/lustre/d77f.sanityn/nrs_w_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77f.sanityn' PASS 77f (6s) == sanityn test 77g: Change TBF type directly ============ 22:08:58 (1723255738) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.500} rate=50 ost.OSS.ost_io.nrs_policies=fifo PASS 77g (2s) == sanityn test 77h: Wrong policy name should report error, not LBUG ========================================================== 22:09:01 (1723255741) oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=abc: No such file or directory oleg243-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='abc': No such file or directory pdsh@oleg243-client: oleg243-server: ssh exited with exit code 2 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc: Unknown error 524 oleg243-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf abc': Unknown error 524 pdsh@oleg243-client: oleg243-server: ssh exited with exit code 12 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf reg abc: Unknown error 524 oleg243-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf reg abc': Unknown error 524 pdsh@oleg243-client: oleg243-server: ssh exited with exit code 12 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_policies=tbf abc efg: Unknown error 524 oleg243-server: error: set_param: setting 'ost/OSS/ost_io/nrs_policies'='tbf abc efg': Unknown error 524 pdsh@oleg243-client: oleg243-server: ssh exited with exit code 12 PASS 77h (3s) == sanityn test 77i: Change rank of TBF rule ============= 22:09:04 (1723255744) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=start before jobid={jobid} rate=1000 ost.OSS.ost_io.nrs_tbf_rule=start after jobid={jobid} rate=1000 rank=default ost.OSS.ost_io.nrs_tbf_rule=start target jobid={jobid} rate=1000 rank=after Move before itself ost.OSS.ost_io.nrs_tbf_rule=change target rank=target Move to higher rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=before Move to lower rank ost.OSS.ost_io.nrs_tbf_rule=change target rank=after Move before default ost.OSS.ost_io.nrs_tbf_rule=change target rank=default ost.OSS.ost_io.nrs_policies=fifo PASS 77i (5s) == sanityn test 77j: check TBF-OPCode NRS policy ========= 22:09:09 (1723255749) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf opcode ost.OSS.ost_io.nrs_tbf_rule=start ost_r opcode={ost_read} rate=5 ost.OSS.ost_io.nrs_tbf_rule=start ost_w opcode={ost_write} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0861558 s, 195 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00884284 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111288 s, 94.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0275228 s, 38.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0265596 s, 39.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.027409 s, 38.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0276219 s, 38.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0372784 s, 28.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.035954 s, 29.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0345985 s, 30.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0378991 s, 27.7 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0373166 s, 28.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0391425 s, 26.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0306154 s, 34.2 MB/s , 0.0324111 s, 32.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0307625 s, 34.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0357219 s, 29.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00969337 s, 108 MB/s , 0.0137273 s, 76.4 MB/s 1048576 bytes (1.0 MB) copied, 0.00915448 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0099864 s, 105 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.01054 s, 99.5 MB/s , 0.0121284 s, 86.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107051 s, 98.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128863 s, 81.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0119738 s, 87.6 MB/s , 0.012855 s, 81.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135116 s, 77.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0138466 s, 75.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.013091 s, 80.1 MB/s , 0.0111386 s, 94.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0159473 s, 65.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117927 s, 88.9 MB/s removed '/mnt/lustre/d77j.sanityn/nrs_w_oleg243-client.virtnet' removed '/mnt/lustre/d77j.sanityn/nrs_r_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77j.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 5 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.94249 s, 21.2 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.4276 s, 5.4 MB/s Read runtime is 20 s, speed is 5.000000 IOPS cleanup_tbf /mnt/lustre/d77j.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_r ost.OSS.ost_io.nrs_tbf_rule=stop ost_w ost.OSS.ost_io.nrs_policies=fifo PASS 77j (51s) == sanityn test 77ja: check TBF-UID/GID NRS policy ======= 22:10:00 (1723255800) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg243-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg243-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [chmod] [777] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg243-client.virtnet] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg243-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg243-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.2195 s, 13.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0175304 s, 59.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0209994 s, 49.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0174205 s, 60.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0150548 s, 69.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0325278 s, 32.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0298535 s, 35.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121601 s, 86.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0323632 s, 32.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.166565 s, 6.3 MB/s , 0.175111 s, 6.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.187353 s, 5.6 MB/s 1+0 records in 1+0 records out , 0.173861 s, 6.0 MB/s 1048576 bytes (1.0 MB) copied, 0.158162 s, 6.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.171538 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.182954 s, 5.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.205836 s, 5.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00894823 s, 117 MB/s , 0.00752978 s, 139 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00880926 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00872025 s, 120 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0112686 s, 93.1 MB/s , 0.0112058 s, 93.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113544 s, 92.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00959204 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00579154 s, 181 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104401 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010608 s, 98.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102769 s, 102 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109719 s, 95.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111585 s, 94.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110926 s, 94.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123364 s, 85.0 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg243-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d77ja.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 20.0279 s, 5.2 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9654 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg243-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg243-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [chmod] [777] [/mnt/lustre/d77ja.sanityn/nrs_r_oleg243-client.virtnet] [/mnt/lustre/d77ja.sanityn/nrs_w_oleg243-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/nrs_r_oleg243-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.22045 s, 13.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0168712 s, 62.2 MB/s 1048576 bytes (1.0 MB) copied, 0.0180581 s, 58.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0300332 s, 34.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0324681 s, 32.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.034653 s, 30.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0207705 s, 50.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0371075 s, 28.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0409444 s, 25.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.171578 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.171758 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.188767 s, 5.6 MB/s , 0.191263 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.190219 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.190104 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.2043 s, 5.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.206729 s, 5.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121774 s, 86.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123296 s, 85.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111199 s, 94.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0131532 s, 79.7 MB/s , 0.0138111 s, 75.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122473 s, 85.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0142666 s, 73.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0120315 s, 87.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0124087 s, 84.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0135477 s, 77.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0127301 s, 82.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0127932 s, 82.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0147075 s, 71.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0139695 s, 75.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0137953 s, 76.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0153913 s, 68.1 MB/s removed '/mnt/lustre/d77ja.sanityn/nrs_w_oleg243-client.virtnet' removed '/mnt/lustre/d77ja.sanityn/nrs_r_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77ja.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/500/500/500, groups: [touch] [/mnt/lustre/d77ja.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77ja.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 20.0273 s, 5.2 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77ja.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9655 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77ja.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77ja (132s) == sanityn test 77jb: check TBF-UID/GID NRS policy on files that don't belong to us ========================================================== 22:12:12 (1723255932) jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf uid ost.OSS.ost_io.nrs_tbf_rule=start ost_uid uid={500} rate=5 running as uid/gid/euid/egid 0/500/0/500, groups: [touch] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg243-client.virtnet] running as uid/gid/euid/egid 0/500/0/500, groups: [touch] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg243-client.virtnet] running as uid/gid/euid/egid 0/500/0/500, groups: [chmod] [777] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg243-client.virtnet] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg243-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/nrs_r_oleg243-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 1.22174 s, 13.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0134236 s, 78.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0168622 s, 62.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0344848 s, 30.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0363697 s, 28.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0329864 s, 31.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0440469 s, 23.8 MB/s 1048576 bytes (1.0 MB) copied, 0.043844 s, 23.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0463672 s, 22.6 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.170786 s, 6.1 MB/s , 0.170177 s, 6.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.188548 s, 5.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.188935 s, 5.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.175602 s, 6.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.176581 s, 5.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.199154 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.197358 s, 5.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00958639 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0118703 s, 88.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0124181 s, 84.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0128378 s, 81.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125055 s, 83.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146163 s, 71.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0140552 s, 74.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0155343 s, 67.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0134653 s, 77.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0146284 s, 71.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0139346 s, 75.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141831 s, 73.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148331 s, 70.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0152177 s, 68.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0160186 s, 65.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148164 s, 70.8 MB/s removed '/mnt/lustre/d77jb.sanityn/nrs_w_oleg243-client.virtnet' removed '/mnt/lustre/d77jb.sanityn/nrs_r_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77jb.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 0/500/0/500, groups: [touch] [/mnt/lustre/d77jb.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 20.027 s, 5.2 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77jb.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9608 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77jb.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_uid ost.OSS.ost_io.nrs_policies=fifo jobid_var=procname_uid ost.OSS.ost_io.nrs_policies=tbf gid ost.OSS.ost_io.nrs_tbf_rule=start ost_gid gid={500} rate=5 running as uid/gid/euid/egid 500/0/500/0, groups: [touch] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg243-client.virtnet] running as uid/gid/euid/egid 500/0/500/0, groups: [touch] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg243-client.virtnet] running as uid/gid/euid/egid 500/0/500/0, groups: [chmod] [777] [/mnt/lustre/d77jb.sanityn/nrs_r_oleg243-client.virtnet] [/mnt/lustre/d77jb.sanityn/nrs_w_oleg243-client.virtnet] running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/nrs_r_oleg243-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.436609 s, 38.4 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117919 s, 88.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.016827 s, 62.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0186066 s, 56.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0334592 s, 31.3 MB/s , 0.0323046 s, 32.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0308051 s, 34.0 MB/s 1048576 bytes (1.0 MB) copied, 0.0355758 s, 29.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0161029 s, 65.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.152859 s, 6.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.152309 s, 6.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.165096 s, 6.4 MB/s , 0.149208 s, 7.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.155187 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.155591 s, 6.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.171206 s, 6.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.185123 s, 5.7 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110867 s, 94.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0112035 s, 93.6 MB/s , 0.0111823 s, 93.8 MB/s , 0.0110754 s, 94.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112712 s, 93.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122596 s, 85.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107002 s, 98.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.011066 s, 94.8 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0127395 s, 82.3 MB/s , 0.0126922 s, 82.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0118699 s, 88.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0130537 s, 80.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0135925 s, 77.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0133064 s, 78.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0132828 s, 78.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0148447 s, 70.6 MB/s removed '/mnt/lustre/d77jb.sanityn/nrs_w_oleg243-client.virtnet' removed '/mnt/lustre/d77jb.sanityn/nrs_r_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77jb.sanityn' cpu_npartitions on ost1 is 1 running as uid/gid/euid/egid 500/0/500/0, groups: [touch] [/mnt/lustre/d77jb.sanityn/tbf] Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77jb.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 20.0288 s, 5.2 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77jb.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.9594 s, 5.3 MB/s Read runtime is 21 s, speed is 4.761904 IOPS cleanup_tbf /mnt/lustre/d77jb.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ost_gid ost.OSS.ost_io.nrs_policies=fifo PASS 77jb (130s) == sanityn test 77k: check TBF policy with UID/GID/JobID/OPCode expression ========================================================== 22:14:22 (1723256062) ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_tbf_rule=start ext_w jobid={dd.500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r jobid={dd.500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg243-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.250084 s, 67.1 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116235 s, 90.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0234044 s, 44.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0221471 s, 47.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187479 s, 55.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0281397 s, 37.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0307669 s, 34.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.041356 s, 25.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0491295 s, 21.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0550156 s, 19.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.047545 s, 22.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.042815 s, 24.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0581885 s, 18.0 MB/s , 0.0546815 s, 19.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0536133 s, 19.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0826167 s, 12.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0768454 s, 13.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0106407 s, 98.5 MB/s , 0.00964532 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0079684 s, 132 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00899644 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00976694 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107713 s, 97.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0102559 s, 102 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0123628 s, 84.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0119902 s, 87.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111498 s, 94.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105072 s, 99.8 MB/s 1048576 bytes (1.0 MB) copied, 0.0128199 s, 81.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0123989 s, 84.6 MB/s 1048576 bytes (1.0 MB) copied, 0.0121079 s, 86.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126638 s, 82.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0141257 s, 74.2 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg243-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.96818 s, 21.1 MB/s Write runtime is 5 s, speed is 20.000000 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.72879 s, 10.8 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext_w nid={0@lo 192.168.202.43@tcp}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_r nid={0@lo 192.168.202.43@tcp}&opcode={ost_read} rate=10 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.118662 s, 141 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00743779 s, 141 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00938844 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0174579 s, 60.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0182861 s, 57.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0271076 s, 38.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0324497 s, 32.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0416302 s, 25.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0350109 s, 29.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0441985 s, 23.7 MB/s , 0.0447541 s, 23.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.201684 s, 5.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.199136 s, 5.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.240529 s, 4.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.252036 s, 4.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.298065 s, 3.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.295992 s, 3.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00745276 s, 141 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00997206 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0084879 s, 124 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00966222 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00977368 s, 107 MB/s 1+0 records in 1+0 records out , 0.0127936 s, 82.0 MB/s 1048576 bytes (1.0 MB) copied, 0.00942922 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110443 s, 94.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108255 s, 96.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0121983 s, 86.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101581 s, 103 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0105717 s, 99.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0114684 s, 91.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.011614 s, 90.3 MB/s 1048576 bytes (1.0 MB) copied, 0.0123545 s, 84.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104884 s, 100 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg243-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.97382 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.72909 s, 10.8 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_w ost.OSS.ost_io.nrs_tbf_rule=stop ext_r ost.OSS.ost_io.nrs_tbf_rule=start ext nid={0@lo 192.168.202.43@tcp}&jobid={dd.500} rate=20 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg243-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.101455 s, 165 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00733625 s, 143 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0108 s, 97.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0245074 s, 42.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.022042 s, 47.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0246932 s, 42.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0275579 s, 38.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0359159 s, 29.2 MB/s , 0.0375742 s, 27.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0373916 s, 28.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.036907 s, 28.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0349891 s, 30.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0339694 s, 30.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0357058 s, 29.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.04322 s, 24.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0598446 s, 17.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.065406 s, 16.0 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00594068 s, 177 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00701641 s, 149 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0103765 s, 101 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00685252 s, 153 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00822015 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00872946 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00766574 s, 137 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111894 s, 93.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00981743 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00974749 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00929925 s, 113 MB/s 1048576 bytes (1.0 MB) copied, 0.0106324 s, 98.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0115097 s, 91.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00939177 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106334 s, 98.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0109185 s, 96.0 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg243-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.9731 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.87752 s, 21.5 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext ost.OSS.ost_io.nrs_tbf_rule=start ext_a jobid={dd.500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b jobid={dd.500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg243-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.107064 s, 157 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0122393 s, 85.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126065 s, 83.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0323772 s, 32.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0343729 s, 30.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.030833 s, 34.0 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0375407 s, 27.9 MB/s , 0.0423799 s, 24.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0409073 s, 25.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0421002 s, 24.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0379901 s, 27.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0355178 s, 29.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0350122 s, 29.9 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.123595 s, 8.5 MB/s , 0.120032 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.119875 s, 8.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.122117 s, 8.6 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0082659 s, 127 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00840093 s, 125 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00898859 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111235 s, 94.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00775759 s, 135 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111606 s, 94.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0107717 s, 97.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00939327 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110334 s, 95.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101429 s, 103 MB/s , 0.00902197 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111249 s, 94.3 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00962755 s, 109 MB/s , 0.0104902 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100418 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0126546 s, 82.9 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg243-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.78847 s, 10.7 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.72571 s, 10.8 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.92296 s, 21.3 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.73072 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_tbf_rule=start ext_ug uid={500}&gid={500} rate=5 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg243-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.102998 s, 163 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00870569 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0112808 s, 93.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.014751 s, 71.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111276 s, 94.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0156603 s, 67.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0318177 s, 33.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0162455 s, 64.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0211173 s, 49.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.119047 s, 8.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.138097 s, 7.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.126538 s, 8.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.129453 s, 8.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.146914 s, 7.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.143875 s, 7.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.154751 s, 6.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.161095 s, 6.5 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0101534 s, 103 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00916005 s, 114 MB/s , 0.00738335 s, 142 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00999929 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00926032 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00962963 s, 109 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100632 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.010995 s, 95.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104102 s, 101 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117196 s, 89.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0121516 s, 86.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0117664 s, 89.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0125005 s, 83.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.011992 s, 87.4 MB/s 1048576 bytes (1.0 MB) copied, 0.0125141 s, 83.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0143435 s, 73.1 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg243-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 5, read rate: 5 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.8372 s, 5.3 MB/s Write runtime is 21 s, speed is 4.761904 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 19.4363 s, 5.4 MB/s Read runtime is 20 s, speed is 5.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_ug ost.OSS.ost_io.nrs_tbf_rule=start ext_uw uid={500}&opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_ur uid={500}&opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg243-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.10471 s, 160 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00832598 s, 126 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0113872 s, 92.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0287761 s, 36.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0315208 s, 33.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0328644 s, 31.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0349537 s, 30.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0338409 s, 31.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0316368 s, 33.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0420318 s, 24.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0330903 s, 31.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0339801 s, 30.9 MB/s 1048576 bytes (1.0 MB) copied, 0.038822 s, 27.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0497865 s, 21.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0574977 s, 18.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0559645 s, 18.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0559095 s, 18.8 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00895655 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00579718 s, 181 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00603012 s, 174 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00660078 s, 159 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00756053 s, 139 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00387555 s, 271 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0082054 s, 128 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106138 s, 98.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00874254 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00938149 s, 112 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00914152 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00909614 s, 115 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00944209 s, 111 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100504 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00967482 s, 108 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00939708 s, 112 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg243-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.95798 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.7279 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_uw ost.OSS.ost_io.nrs_tbf_rule=stop ext_ur ost.OSS.ost_io.nrs_tbf_rule=start ext_a uid={500},opcode={ost_write} rate=20 ost.OSS.ost_io.nrs_tbf_rule=start ext_b uid={500},opcode={ost_read} rate=10 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/nrs_r_oleg243-client.virtnet] [bs=1M] [count=16] 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.11181 s, 150 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_w] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00949035 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00925009 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00957495 s, 110 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0243107 s, 43.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.025228 s, 41.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0293541 s, 35.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0315941 s, 33.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0207963 s, 50.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212977 s, 49.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0220995 s, 47.4 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.0659247 s, 15.9 MB/s , 0.0642686 s, 16.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.112319 s, 9.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.098845 s, 10.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.113943 s, 9.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.12669 s, 8.3 MB/s running as uid/gid/euid/egid 500/500/500/500, groups: [declare] [-a] [pids_r] execvp fails running declare (2): No such file or directory 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00713409 s, 147 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00897229 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00687819 s, 152 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00835111 s, 126 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.008957 s, 117 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00988049 s, 106 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129188 s, 81.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00494222 s, 212 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100683 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100824 s, 104 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100088 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0106207 s, 98.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0100227 s, 105 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0111982 s, 93.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0104463 s, 100 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120632 s, 86.9 MB/s removed '/mnt/lustre/d77k.sanityn/nrs_r_oleg243-client.virtnet' removed '/mnt/lustre/d77k.sanityn/nrs_w_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77k.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 10, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.77932 s, 10.7 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.72764 s, 10.8 MB/s Read runtime is 10 s, speed is 10.000000 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 10 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77k.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.77192 s, 10.7 MB/s Write runtime is 11 s, speed is 9.090909 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77k.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 9.72772 s, 10.8 MB/s Read runtime is 11 s, speed is 9.090909 IOPS cleanup_tbf /mnt/lustre/d77k.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop ext_a ost.OSS.ost_io.nrs_tbf_rule=stop ext_b ost.OSS.ost_io.nrs_policies=fifo PASS 77k (332s) == sanityn test 77l: check the output of NRS policies for generic TBF ========================================================== 22:19:54 (1723256394) ost.OSS.ost_io.nrs_policies=tbf nid ost.OSS.ost_io.nrs_policies=tbf ost.OSS.ost_io.nrs_policies=fifo PASS 77l (2s) == sanityn test 77m: check NRS Delay slows write RPC processing ========================================================== 22:19:56 (1723256396) ost.OSS.ost_io.nrs_policies=delay ost.OSS.ost_io.nrs_delay_min=4 ost.OSS.ost_io.nrs_delay_max=4 ost.OSS.ost_io.nrs_delay_pct=100 running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg243-client.virtnet] [bs=1M] [count=1] [oflag=direct] [conv=fdatasync] 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 3.49344 s, 300 kB/s running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77m.sanityn/nrs_delay_oleg243-client.virtnet] [bs=1M] [count=10] [oflag=direct] [conv=fdatasync] 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 40.009 s, 262 kB/s ost.OSS.ost_io.nrs_policies=fifo PASS 77m (50s) == sanityn test 77n: check wildcard support for TBF JobID NRS policy ========================================================== 22:20:46 (1723256446) ost.OSS.ost_io.nrs_policies=tbf jobid ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={*.500} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.0867995 s, 193 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00733086 s, 143 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0116407 s, 90.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0168763 s, 62.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0212737 s, 49.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0120882 s, 86.7 MB/s 1048576 bytes (1.0 MB) copied, 0.00822789 s, 127 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0129169 s, 81.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00759974 s, 138 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0187205 s, 56.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0221894 s, 47.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.027154 s, 38.6 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0320129 s, 32.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0440158 s, 23.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.030619 s, 34.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0424214 s, 24.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0354886 s, 29.5 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00826664 s, 127 MB/s , 0.00670423 s, 156 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00975858 s, 107 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00681121 s, 154 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00902035 s, 116 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00393551 s, 266 MB/s 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.00869887 s, 121 MB/s 1048576 bytes (1.0 MB) copied, 0.00884168 s, 119 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0103909 s, 101 MB/s 1048576 bytes (1.0 MB) copied, 0.00888785 s, 118 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00796001 s, 132 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00869839 s, 121 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.00926031 s, 113 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.00944825 s, 111 MB/s , 0.00871991 s, 120 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0097795 s, 107 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg243-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/dev/zero] [of=/mnt/lustre/d77n.sanityn/tbf] [bs=1M] [count=100] [oflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.93184 s, 21.3 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control running as uid/gid/euid/egid 500/500/500/500, groups: [dd] [if=/mnt/lustre/d77n.sanityn/tbf] [of=/dev/null] [bs=1M] [count=100] [iflag=direct] 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.96664 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_tbf_rule=start dd_runas jobid={dd.*} rate=20 16+0 records in 16+0 records out 16777216 bytes (17 MB) copied, 0.228762 s, 73.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0110732 s, 94.7 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0266835 s, 39.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0168509 s, 62.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0304167 s, 34.5 MB/s 1048576 bytes (1.0 MB) copied, 0.0240787 s, 43.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0313038 s, 33.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0293158 s, 35.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0337491 s, 31.1 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0252468 s, 41.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0447133 s, 23.5 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.039682 s, 26.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0453781 s, 23.1 MB/s 1+0 records in 1+0 records out 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1048576 bytes (1.0 MB) copied, 0.264227 s, 4.0 MB/s , 0.275762 s, 3.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.311319 s, 3.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.320025 s, 3.3 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.02497 s, 42.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out , 0.0258026 s, 40.6 MB/s 1048576 bytes (1.0 MB) copied, 0.025948 s, 40.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0247289 s, 42.4 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.027068 s, 38.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0262252 s, 40.0 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0289599 s, 36.2 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0263417 s, 39.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0266665 s, 39.3 MB/s , 0.0276839 s, 37.9 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0264445 s, 39.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0270579 s, 38.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0270372 s, 38.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0271258 s, 38.7 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.027745 s, 37.8 MB/s 1+0 records in 1+0 records out 1048576 bytes (1.0 MB) copied, 0.0295554 s, 35.5 MB/s removed '/mnt/lustre/d77n.sanityn/nrs_w_oleg243-client.virtnet' removed '/mnt/lustre/d77n.sanityn/nrs_r_oleg243-client.virtnet' removed directory: '/mnt/lustre/d77n.sanityn' cpu_npartitions on ost1 is 1 Limited write rate: 20, read rate: 20 Verify the write rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.96071 s, 21.1 MB/s Write runtime is 6 s, speed is 16.666666 IOPS Verify the read rate is under TBF control 100+0 records in 100+0 records out 104857600 bytes (105 MB) copied, 4.96692 s, 21.1 MB/s Read runtime is 6 s, speed is 16.666666 IOPS cleanup_tbf /mnt/lustre/d77n.sanityn sleep 5 for ZFS zfs sleep 5 for ZFS zfs Waiting for MDT destroys to complete ost.OSS.ost_io.nrs_tbf_rule=stop dd_runas ost.OSS.ost_io.nrs_policies=fifo PASS 77n (62s) == sanityn test 77o: Changing rank should not panic ====== 22:21:48 (1723256508) mds.MDS.mdt.nrs_policies=tbf nid mds.MDS.mdt.nrs_tbf_rule=start name nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=start name1 nid={192.168.*.*@tcp} rate=10000 mds.MDS.mdt.nrs_tbf_rule=change name1 rank=name mds.MDS.mdt.nrs_tbf_rule=stop name mds.MDS.mdt.nrs_policies=fifo PASS 77o (3s) == sanityn test 77q: Parallel TBF rule definitions should not panic ========================================================== 22:21:51 (1723256511) mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=start rule77q_1 uid={ 500 11 3}&gid={500 10 33 100 } rate=100 mds.MDS.mdt.nrs_tbf_rule=start rule77q_2 uid={1000}&gid={1000} rate=100 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_1 mds.MDS.mdt.nrs_tbf_rule=stop rule77q_2 mds.MDS.mdt.nrs_policies=fifo PASS 77q (26s) == sanityn test 77p: Check validity of rule names for TBF policies ========================================================== 22:22:17 (1723256537) mds.MDS.mdt.nrs_policies=tbf oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_overflo uid={500} rate=500: File name too long oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test_77p_overflo uid={500} rate=500': File name too long pdsh@oleg243-client: oleg243-server: ssh exited with exit code 36 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test_77p_empty: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test_77p_empty': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p@spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p@spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p.spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p.spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p~spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p~spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p#spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p#spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p/spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p/spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p^spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p^spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p%spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p%spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p*spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p*spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p;spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p;spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p,spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p,spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p?spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p?spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77pspec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p>spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p:spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p:spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p+spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p+spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p=spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p=spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p)spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p)spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p(spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p(spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p{spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p{spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p}spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p}spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p|spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p|spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p[spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p[spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p]spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p]spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p!spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p!spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p&spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p&spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p$spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p$spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p`spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p`spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/mds/MDS/mdt/nrs_tbf_rule=start test77p\spec uid={500} rate=500: Invalid argument oleg243-server: error: set_param: setting 'mds/MDS/mdt/nrs_tbf_rule'='start test77p\spec uid={500} rate=500': Invalid argument pdsh@oleg243-client: oleg243-server: ssh exited with exit code 22 mds.MDS.mdt.nrs_policies=fifo PASS 77p (9s) == sanityn test 77r: Change type of tbf policy at run time ========================================================== 22:22:27 (1723256547) mds.MDS.mdt.nrs_policies=tbf uid mds.MDS.mdt.nrs_tbf_rule=start md_rule uid={500} rate=1 mds.MDS.mdt.nrs_policies=tbf gid mds.MDS.mdt.nrs_tbf_rule=start md_rule gid={500} rate=1 mds.MDS.mdt.nrs_policies=tbf jobid mds.MDS.mdt.nrs_tbf_rule=start md_rule jobid={*.500} rate=1 mds.MDS.mdt.nrs_policies=tbf mds.MDS.mdt.nrs_tbf_rule=start md_rule uid={500} rate=1 mds.MDS.mdt.nrs_policies=fifo check the number of requests in queue: fifo: 0 crrn: 0 tbf: 0 delay: 0 fifo: 0 crrn: 0 tbf: 0 delay: 0 cleanup 77r 8921 kill md_thread xargs PASS 77r (36s) == sanityn test 78: Enable policy and specify tunings right away ========================================================== 22:23:03 (1723256583) oleg243-server: error: set_param: setting /sys/kernel/debug/lustre/ost/OSS/ost_io/nrs_orr_quantum=1: No such device oleg243-server: error: set_param: setting 'ost/OSS/*/nrs_orr_quantum'='1': No such device pdsh@oleg243-client: oleg243-server: ssh exited with exit code 19 ost.OSS.ost_io.nrs_policies=orr ost.OSS.ost_io.nrs_policies=fifo PASS 78 (2s) == sanityn test 79: xattr: intent error ================== 22:23:06 (1723256586) File: '/mnt/lustre/d79.sanityn' Size: 512 Blocks: 1 IO Block: 1048576 directory Device: 2c54f966h/743766374d Inode: 144115205272506870 Links: 2 Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-08-09 22:23:06.000000000 -0400 Modify: 2024-08-09 22:23:06.000000000 -0400 Change: 2024-08-09 22:23:06.000000000 -0400 Birth: - fail_val=0 fail_loc=0x80000160 fail_val=0 fail_loc=0x80000131 # file: mnt/lustre/d79.sanityn trusted.name1="value1" PASS 79 (12s) == sanityn test 80a: migrate directory when some children is being opened ========================================================== 22:23:17 (1723256597) SKIP: sanityn test_80a needs >= 2 MDTs SKIP 80a (1s) == sanityn test 80b: Accessing directory during migration ========================================================== 22:23:18 (1723256598) SKIP: sanityn test_80b needs >= 2 MDTs SKIP 80b (1s) == sanityn test 81a: rename and stat under striped directory ========================================================== 22:23:19 (1723256599) SKIP: sanityn test_81a needs >= 2 MDTs SKIP 81a (1s) == sanityn test 81b: rename under striped directory doesn't deadlock ========================================================== 22:23:20 (1723256600) SKIP: sanityn test_81b We need at least 2 MDTs for this test SKIP 81b (1s) == sanityn test 81c: rename revoke LOOKUP lock for remote object ========================================================== 22:23:21 (1723256601) SKIP: sanityn test_81c needs >= 4 MDTs SKIP 81c (0s) == sanityn test 81d: parallel rename file cross-dir on same MDT ========================================================== 22:23:21 (1723256601) total: 2500 open/close in 5.04 seconds: 495.79 ops/second snapshot_time 1723256620.434227097 secs.nsecs start_time 1723256602.783435199 secs.nsecs elapsed_time 17.650791898 secs.nsecs open 2505 samples [usecs] 72 1262 702828 208629692 close 2504 samples [usecs] 58 230 210001 18409179 mknod 2501 samples [usecs] 172 1197 626383 166877869 unlink 2500 samples [usecs] 308 16320 1490203 3956338461 mkdir 2 samples [usecs] 612 689 1301 849265 rmdir 2 samples [usecs] 2137 4428 6565 24173953 rename 2500 samples [usecs] 234 15249 2266984 3144371908 getattr 3760 samples [usecs] 8 91 57155 1006629 parallel_rename_file 2500 samples [usecs] 234 15249 2266984 3144371908 crossdir_rename 2500 samples [usecs] 234 15249 2266984 3144371908 PASS 81d (20s) == sanityn test 82: fsetxattr and fgetxattr on orphan files ========================================================== 22:23:41 (1723256621) multiop /mnt/lustre/f82.sanityn vO_ac TMPPIPE=/tmp/multiop_open_wait_pipe.6965 multiop /mnt/lustre2/f82.sanityn vo_Ac TMPPIPE=/tmp/multiop_open_wait_pipe.6965 PASS 82 (2s) == sanityn test 83: access striped directory while it is being created/unlinked ========================================================== 22:23:43 (1723256623) SKIP: sanityn test_83 needs >= 2 MDTs SKIP 83 (1s) == sanityn test 84: 0-nlink race in lu_object_find() ===== 22:23:44 (1723256624) fail_loc=0x8000060b PASS 84 (6s) == sanityn test 85: Lustre API root cache race =========== 22:23:50 (1723256630) Starting: llapi_root_test /mnt/lustre/f85.sanityn /mnt/lustre2/f85.sanityn Starting test test1 at 1723256631 Finishing test test1 at 1723256631 PASS 85 (3s) == sanityn test 90: open/create and unlink striped directory ========================================================== 22:23:53 (1723256633) SKIP: sanityn test_90 needs >= 2 MDTs SKIP 90 (0s) == sanityn test 91: chmod and unlink striped directory === 22:23:53 (1723256633) SKIP: sanityn test_91 needs >= 2 MDTs SKIP 91 (1s) == sanityn test 92: create remote directory under orphan directory ========================================================== 22:23:54 (1723256634) SKIP: sanityn test_92 needs >= 2 MDTs SKIP 92 (1s) == sanityn test 93: alloc_rr should not allocate on same ost ========================================================== 22:23:55 (1723256635) fail_loc=0x00000163 fail_loc=0x0 /mnt/lustre/f93.sanityn-1/file1 lmm_stripe_count: 2 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 6247 0x1867 0x240000400 1 6232 0x1858 0x280000400 /mnt/lustre2/f93.sanityn-2/file2 lmm_stripe_count: 2 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 6233 0x1859 0x280000400 0 6248 0x1868 0x240000400 rc1=0 and rc2=0 PASS 93 (8s) == sanityn test 94: signal vs CP callback race =========== 22:24:03 (1723256643) osc.lustre-OST0000-osc-ffff8800ab0de800.idle_timeout=0 osc.lustre-OST0000-osc-ffff88012aab2000.idle_timeout=0 osc.lustre-OST0001-osc-ffff8800ab0de800.idle_timeout=0 osc.lustre-OST0001-osc-ffff88012aab2000.idle_timeout=0 2+0 records in 2+0 records out 8192 bytes (8.2 kB) copied, 0.0265089 s, 309 kB/s fail_val=5 fail_loc=0x80000312 fail_val=6 fail_loc=0x80000329 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 3.00374 s, 1.4 kB/s /home/green/git/lustre-release/lustre/tests/sanityn.sh: line 5739: 30448 Alarm clock dd if=/dev/zero of=$DIR/$tfile conv=notrunc oflag=append bs=4k count=1 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.0133105 s, 308 kB/s osc.lustre-OST0000-osc-ffff8800ab0de800.idle_timeout=debug osc.lustre-OST0000-osc-ffff88012aab2000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8800ab0de800.idle_timeout=debug osc.lustre-OST0001-osc-ffff88012aab2000.idle_timeout=debug PASS 94 (9s) == sanityn test 95a: Check readpage() on a page that was removed from page cache ========================================================== 22:24:12 (1723256652) llite.lustre-ffff8800ab0de800.fast_read=0 llite.lustre-ffff88012aab2000.fast_read=0 2+0 records in 2+0 records out 2097152 bytes (2.1 MB) copied, 0.0170831 s, 123 MB/s fail_loc=0x80001421 fail_val=7 fail_loc=0x80001422 fail_val=10 llite.lustre-ffff8800ab0de800.fast_read=1 llite.lustre-ffff88012aab2000.fast_read=1 PASS 95a (19s) == sanityn test 95b: Check readpage() on a page that is no longer uptodate ========================================================== 22:24:31 (1723256671) llite.lustre-ffff8800ab0de800.fast_read=0 llite.lustre-ffff88012aab2000.fast_read=0 1+0 records in 1+0 records out 12288 bytes (12 kB) copied, 0.00125751 s, 9.8 MB/s fail_loc=0x80001424 fail_val=5 fail_loc=0 llite.lustre-ffff8800ab0de800.fast_read=1 llite.lustre-ffff88012aab2000.fast_read=1 PASS 95b (7s) == sanityn test 100a: DoM: glimpse RPCs for stat without IO lock (DoM only file) ========================================================== 22:24:39 (1723256679) SKIP: sanityn test_100a Reserved for glimpse-ahead SKIP 100a (0s) == sanityn test 100b: DoM: no glimpse RPC for stat with IO lock (DoM only file) ========================================================== 22:24:39 (1723256679) 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00135062 s, 3.0 MB/s /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK /mnt/lustre/d100b.sanityn/dom has type file OK /mnt/lustre/d100b.sanityn/dom has size 4096 OK PASS 100b (2s) == sanityn test 100c: DoM: write vs stat without IO lock (combined file) ========================================================== 22:24:41 (1723256681) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.0210367 s, 99.7 MB/s /mnt/lustre/d100c.sanityn/dom has type file OK /mnt/lustre/d100c.sanityn/dom has size 2097152 OK PASS 100c (1s) == sanityn test 100d: DoM: write+truncate vs stat without IO lock (combined file) ========================================================== 22:24:42 (1723256682) 1+0 records in 1+0 records out 2097152 bytes (2.1 MB) copied, 0.024986 s, 83.9 MB/s /mnt/lustre/d100d.sanityn/dom has type file OK /mnt/lustre/d100d.sanityn/dom has size 4096 OK PASS 100d (2s) == sanityn test 100e: DoM: read on open and file size ==== 22:24:44 (1723256684) 1+0 records in 1+0 records out 12000 bytes (12 kB) copied, 0.0017543 s, 6.8 MB/s PASS 100e (2s) == sanityn test 101a: Discard DoM data on unlink ========= 22:24:46 (1723256686) /mnt/lustre/f101a.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.000525005 s, 7.8 MB/s PASS 101a (1s) == sanityn test 101b: Discard DoM data on rename ========= 22:24:47 (1723256687) /mnt/lustre/f101b.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.00051667 s, 7.9 MB/s PASS 101b (2s) == sanityn test 101c: Discard DoM data on close-unlink === 22:24:49 (1723256689) /mnt/lustre/f101c.sanityn has type file OK 1+0 records in 1+0 records out 4096 bytes (4.1 kB) copied, 0.000498918 s, 8.2 MB/s PASS 101c (2s) SKIP: sanityn test_102 skipping ALWAYS excluded test 102 == sanityn test 103: Test size correctness with lockahead ========================================================== 22:24:52 (1723256692) fail_loc=0x415 fail_loc=0x415 fail_val=2 Incorrect size expected (no glimpse fix): Starting test test23 at 1723256692 lockahead_test: lockahead_test.c:1191: test23: assertion 'sb.st_size == sb2.st_size' failed: size on /mnt/lustre/d103.sanityn/f103.sanityn and /mnt/lustre2/d103.sanityn/f103.sanityn differs: 0 vs 1048576 fail_loc=0 fail_loc=0x214 fail_val=2 Starting test test23 at 1723256695 Finishing test test23 at 1723256695 PASS 103 (6s) == sanityn test 104: Verify that MDS stores atime/mtime/ctime during close ========================================================== 22:24:58 (1723256698) SKIP: sanityn test_104 ldiskfs only test SKIP 104 (1s) == sanityn test 105: Glimpse and lock cancel race ======== 22:24:59 (1723256699) fail_loc=0x416 PASS 105 (27s) == sanityn test 106a: Verify the btime via statx() ======= 22:25:26 (1723256726) SKIP: sanityn test_106a Test only for ldiskfs and statx() supported SKIP 106a (1s) == sanityn test 106b: Glimpse RPCs test for statx ======== 22:25:27 (1723256727) SKIP: sanityn test_106b statx() only test SKIP 106b (1s) == sanityn test 106c: Verify statx attributes mask ======= 22:25:28 (1723256728) SKIP: sanityn test_106c statx() only test SKIP 106c (1s) == sanityn test 107a: Basic grouplock conflict =========== 22:25:29 (1723256729) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0912676 s, 115 MB/s /mnt/lustre/f107a.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 obdidx objid objid group 0 6255 0x186f 0x240000400 multiop /mnt/lustre/f107a.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.6965 multiop /mnt/lustre2/f107a.sanityn vO_G16022000r10g16022000c TMPPIPE=/tmp/multiop_open_wait_pipe.6965 First grouplock blocks second one PASS 107a (5s) == sanityn test 107b: Grouplock is added to the head of waiting list ========================================================== 22:25:34 (1723256734) 10+0 records in 10+0 records out 10485760 bytes (10 MB) copied, 0.0869332 s, 121 MB/s /mnt/lustre/f107b.sanityn lmm_stripe_count: 1 lmm_stripe_size: 4194304 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 1 obdidx objid objid group 1 6239 0x185f 0x280000400 multiop /mnt/lustre/f107b.sanityn vOG14091995_g14091995c TMPPIPE=/tmp/multiop_open_wait_pipe.6965 Grouplock blocks IO First grouplock blocks second one Second grouplock blocks IO PASS 107b (8s) == sanityn test 108a: lseek: parallel updates ============ 22:25:42 (1723256742) 1+0 records in 1+0 records out 10000 bytes (10 kB) copied, 0.00226493 s, 4.4 MB/s fail_val=4 fail_loc=0x80000414 1+0 records in 1+0 records out 8388608 bytes (8.4 MB) copied, 4.21026 s, 2.0 MB/s PASS 108a (6s) == sanityn test 109: Race with several mount instances on 1 node ========================================================== 22:25:48 (1723256748) 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Starting race between client mount instances (50 iterations): Iteration 1 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 2 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 3 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions oleg243-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg243-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 4 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions oleg243-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 5 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 6 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 7 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 8 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 9 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 10 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 11 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions oleg243-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 12 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 13 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_size: failed to read coresize from /sys/module/acpi_cpufreq libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions oleg243-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 14 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 15 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions oleg243-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg243-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 16 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 17 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 18 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions oleg243-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 19 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions oleg243-server: libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory Iteration 20 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 21 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions libkmod: kmod_module_get_refcnt: could not read integer from '/sys/module/acpi_cpufreq/refcnt': 'No such device' ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 22 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 23 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 24 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 25 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 26 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 27 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 28 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 29 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 30 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions oleg243-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 31 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 32 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions oleg243-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 33 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions oleg243-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 34 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions oleg243-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 35 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 36 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions oleg243-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 37 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 38 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions oleg243-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory oleg243-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 39 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 40 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 41 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 42 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 43 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions oleg243-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 44 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' libkmod: kmod_module_get_holders: could not open '/sys/module/intel_rapl/holders': No such file or directory ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions oleg243-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 45 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions oleg243-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory Iteration 46 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions oleg243-server: libkmod: kmod_module_get_holders: could not open '/sys/module/pcc_cpufreq/holders': No such file or directory oleg243-server: libkmod: kmod_module_get_holders: could not open '/sys/module/acpi_cpufreq/holders': No such file or directory Iteration 47 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 48 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 49 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Iteration 50 Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 192.168.202.143@tcp:/lustre /mnt/lustre lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 192.168.202.143@tcp:/lustre /mnt/lustre2 lustre rw,checksum,flock,user_xattr,lruresize,lazystatfs,nouser_fid2path,verbose,noencrypt,statfs_project 0 0 Stopping client oleg243-client.virtnet /mnt/lustre (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 (opts:) Loading modules from /home/green/git/lustre-release/lustre detected 4 online CPUs by sysfs Force libcfs to create 2 CPU partitions ../libcfs/libcfs/libcfs options: 'cpu_npartitions=2' ptlrpc/ptlrpc options: 'lbug_on_grant_miscount=1' quota/lquota options: 'hash_lqs_cur_bits=3' loading modules on: 'oleg243-server' oleg243-server: oleg243-server.virtnet: executing load_modules_local oleg243-server: Loading modules from /home/green/git/lustre-release/lustre oleg243-server: detected 4 online CPUs by sysfs oleg243-server: Force libcfs to create 2 CPU partitions Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre Starting client: oleg243-client.virtnet: -o user_xattr,flock 192.168.202.143@tcp:/lustre /mnt/lustre2 PASS 109 (386s) == sanityn test 110: do not grant another lock on resend ========================================================== 22:32:14 (1723257134) fail_loc=0x525 fail_val=3 fail_loc=0x534 File: '/mnt/lustre/f110.sanityn' Size: 0 Blocks: 1 IO Block: 4194304 regular empty file Device: 2c54f966h/743766374d Inode: 144115205306056707 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2024-08-09 22:32:14.000000000 -0400 Modify: 2024-08-09 22:32:14.000000000 -0400 Change: 2024-08-09 22:32:14.000000000 -0400 Birth: - fail_loc=0 fail_val=0 Connected clients: oleg243-client.virtnet oleg243-client.virtnet PASS 110 (64s) == sanityn test 111: A racy rename/link an open file should not cause fs corruption ========================================================== 22:33:18 (1723257198) SKIP: sanityn test_111 needs >= 2 MDTs SKIP 111 (1s) == sanityn test 112: update max-inherit in default LMV === 22:33:19 (1723257199) SKIP: sanityn test_112 We need at least 2 MDTs for this test SKIP 112 (1s) == sanityn test 113: check servers of specified fs ======= 22:33:20 (1723257200) lustre-OST0000-osc-ffff8800ab13d800 active. lustre-OST0001-osc-ffff8800ab13d800 active. lustre-OST0000-osc-ffff8800ab13d800 active. lustre-OST0001-osc-ffff8800ab13d800 active. MGC192.168.202.143@tcp active. PASS 113 (1s) == sanityn test 114: implicit default LMV inherit ======== 22:33:21 (1723257201) SKIP: sanityn test_114 We need at least 2 MDTs for this test SKIP 114 (1s) == sanityn test 115: ldiskfs doesn't check direntry for uniqueness ========================================================== 22:33:22 (1723257202) SKIP: sanityn test_115 ldiskfs only test SKIP 115 (1s) == sanityn test 116: DNE: Set default LMV layout from a remote client ========================================================== 22:33:23 (1723257203) SKIP: sanityn test_116 needs >= 2 MDTs SKIP 116 (1s) cleanup: ====================================================== == sanityn test complete, duration 4558 sec ============== 22:33:24 (1723257204) === sanityn: start cleanup 22:33:25 (1723257205) === Stopping clients: oleg243-client.virtnet /mnt/lustre2 (opts:) Stopping client oleg243-client.virtnet /mnt/lustre2 opts: === sanityn: finish cleanup 22:34:00 (1723257240) ===